Support automatic-mixed-precision (AMP)

[csukuangfj]

No description provided.

[yuekaizhang]

Hi, I was wondering if this PR is ready to test or not. I'd like checkout to csukuangfj:mixed-precision-2022-12-07 do a test.

[csukuangfj]

Hi, I was wondering if this PR is ready to test or not.

I have tested it locally but it does not seem to improve the speed, so it is still left to open.

[yuekaizhang]

Hi, I was wondering if this PR is ready to test or not.

I have tested it locally but it does not seem to improve the speed, so it is still left to open.

I see. Did you try to use model.half() then export using libtorch? I think it should be pure fp16 mode.

[csukuangfj]

Hi, I was wondering if this PR is ready to test or not.

I have tested it locally but it does not seem to improve the speed, so it is still left to open.

I see. Did you try to use model.half() then export using libtorch? I think it should be pure fp16 mode.

No, not yet. I have not tried this approach.