According to the TAO Deploy documentation for Mask2Former, INT8 data type is supported for TensorRT.
However, in the actual TAO Deploy implementation, this support does not seem to be present.
TAO Deploy GitHub Repository
Is this a mistake in the documentation, or is the deploy code missing an update to enable INT8 support?
1 post - 1 participant