TensorRT overview

NVIDIA's SDK for high-performance deep-learning inference on GPU. Optimises trained models through layer fusion, precision calibration (FP16/INT8), and kernel auto-tuning to minimise latency and maximise throughput. Integrates with PyTorch via torch-tensorrt, ONNX import, and the Triton Inference Server backend ecosystem.