• Hardware Platform NVIDIA RTX A5000
• TensorRT Version 8.5.1-1+cuda11.8
• NVIDIA GPU Driver Version (valid for GPU only) 535.183.01**
I have a model trained on tao toolkit (3.22.05) which is built to two engine files with batch size 1 and 30. When I test them using the trtexec tool I am getting lower FPS for the engine with the higher batch size, help me understand this weird behaviour.
Following are the commands and logs respectively
trtexec --loadEngine=/opt/paralaxiom/vast/vast-platform/nvast/ds_vast_pipeline/d26_apr1924_yolov4_resnet18_epoch_045.etlt_b1_gpu0_int8.engine --batch=1
b1.log (13.4 KB)
trtexec --loadEngine=/opt/paralaxiom/vast/vast-platform/nvast/ds_vast_pipeline/d26_apr1924_yolov4_resnet18_epoch_045.etlt_b30_gpu0_int8.engine --batch=30
b30.log (13.2 KB)
6 posts - 2 participants