Topics tagged tensorrt

Topic	Replies	Views	Activity
2:4 sparsity doesnot improve inference performance on RTX 3090 TensorRT tensorrt	15	3706	June 4, 2026
Jetson AGX Orin (JetPack 6.2.1): silent GPU hang - host1x interrupt servicing stalls under sustained compute, reproduces on two distinct Orin systems Jetson AGX Orin tensorrt , kernel , deepstream	10	166	June 3, 2026
Production Inference Path for Fine-Tuned Canary-v2 (TensorRT or RIVA Support) NVIDIA NeMo tensorrt , riva , speech	4	137	June 2, 2026
Questions about the CUDA Runtime Jetson Orin NX tensorrt , cuda , cutensor	23	202	June 2, 2026
Qwen3.6-27B-FP8 export failed in fuse_gdn_input_projections: Float8_e4m3fn and Half torch.cat promotion unsupported Jetson Thor tensorrt	1	47	May 30, 2026
Strange changes in file size when deployed with tensorrt TensorRT tensorrt	9	959	May 30, 2026
Fail to Build the TRT Engine of a multi-GatherND ONNX Model for large input volume TensorRT tensorrt , cudnn , onnx	1	47	May 30, 2026
I need Tensorrt 10.3 C++ API Documentation Jetson Orin Nano tensorrt	2	52	May 21, 2026
Question Regarding INT8 Accuracy Degradation on Turing GPUs with TensorRT 10.11 TensorRT tensorrt , yolo , cudnn	3	77	June 3, 2026
Adaptive Governance Runtime Engineering Base Command Manager tensorrt , cuda , kernel , python , artificialintelligence , nim	0	40	May 19, 2026
Runtime Optimization vs Governance Runtime Engineering — Parallel Acceleration Above the Model Layer Base Command Manager tensorrt , cuda , inference-server-triton , artificialintelligence , system-management-and-architecture , nim	0	33	May 16, 2026
Runtime Optimization vs Governance Orchestration — A New AI Acceleration Layer Emerging Above the Model Base Command Manager tensorrt , cuda , inference-server-triton , artificialintelligence , nim , humanoid-robotics	0	55	May 11, 2026
Issues with long term execution of computer vision project using Jetson Orin Jetson AGX Orin tensorrt , camera , jetson-inference , cudnn	6	82	May 7, 2026
TensorRT engine produces distorted outputs on Jetson Orin NX (JetPack 6.2 / Ampere) but matches ONNX on DGX Spark (JetPack 7.0 / Grace Blackwell) Jetson Orin NX tensorrt , nvbugs , cudnn	11	179	June 2, 2026
The versions of deep learning tools such as CUDA and TensorRT for Jetson Jetson Orin NX tensorrt , cuda , cudnn	6	89	May 4, 2026
[Issue] Qwen3-Next-80B NVFP4 and FP8 Cannot Be Served via trtllm-serve on DGX Spark GB10 (TRT-LLM 1.3.0rc7) DGX Spark / GB10 tensorrt , kernel	2	256	May 1, 2026
Error Code: 9: Skipping tactic 0x001526e231ae2e51 due to exception Cask convolution execution TensorRT tensorrt	4	371	April 30, 2026
Issues with Using TensorRT on Jetson Orin Nano TensorRT tensorrt , jetson	4	169	April 30, 2026
Jetson Orin Nano run TensorRT's sample failed Jetson Orin Nano tensorrt	9	85	April 27, 2026
Model outputting NaNs TensorRT tensorrt , cudnn , onnx	3	216	April 20, 2026
How to run SAM3 on Jetson ORIN NX 8G Jetson Orin NX tensorrt , segmentation	2	259	April 13, 2026
JetPack 6.2 / TensorRT 10.3 on Orin NX/Nano: engine runs but outputs are numerically wrong (flat planes) vs correct output on DGX (TRT 10.14 Jetson Orin Nano tensorrt	4	102	April 9, 2026
Jetson Thor AGX - Poor INT8 performance Jetson Thor tensorrt , jetson-inference	7	449	April 1, 2026
Cannot upgrade AGX Xavier : Stuck on Jetpack 4.6 - Options for upgrading libraries without OEM BSP support? Jetson AGX Xavier jetpack , tensorrt , cudnn , dla , pva , vpi , jetson	4	55	March 31, 2026
[Bug?] Builder Internal Error Code 2 on RTX 6000 Ada (sm89) but succeeds on Blackwell (sm120) with IPluginV2DynamicExt + OBEY_PRECISION_CONSTRAINTS TensorRT tensorrt , cudnn	2	64	March 31, 2026
TensorRT 10.7.0 on Orin Nano: Target GPU SM 87 is not supported by this TensorRT release TensorRT tensorrt , cudnn , onnx , jetson , jetson-nano , jetson-orin	2	103	March 31, 2026
How to install TensorRT 8.6.2 in jetpack 6.2 Jetson Orin Nano tensorrt	6	105	March 25, 2026
Why tensorrt can use concatenation in-place TensorRT tensorrt	0	37	March 24, 2026
Public repositories for TensorRT 11.0 TensorRT tensorrt	6	147	March 26, 2026
Same ONNX model produces incorrect output on Thor; works correctly on Orin Jetson Thor tensorrt , jetson-inference	2	66	March 10, 2026