I want to use TensorRT FP16 mode to accelerate my pytorch model, but there is a loss of precision.
My question is how can I use the mixed precision training of pytorch, to avoid the loss of accuracy when converting to a TensorRT FP16 model.
I have tried the torch.cuda.amp.autocast
to training the model, but it still lost some precision.
Asked
Active
Viewed 364 times
2

Yao
- 43
- 3