Skip to content

Issues: NVIDIA/TensorRT

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

419 Open 3,424 Closed
419 Open 3,424 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

GroupNormalizationPlugin not found
#4312 opened Jan 4, 2025 by hrishi121
How should I export the onnx network structure within ForeignNode ?
#4311 opened Jan 3, 2025 by peanutPod
Publish updated polygraphy Tools: Polygraphy Issues with Polygraphy triaged Issue has been triaged by maintainers
#4309 opened Jan 2, 2025 by idantene
@asfiyab-nvidia
[Bug]After converting sensevoice's onnx to trt via trtexec, an error is reported triaged Issue has been triaged by maintainers
#4307 opened Dec 31, 2024 by wjj19950828
@asfiyab-nvidia
4
Logger sends messages to stdout rather than stderr Documentation Lack of clarity in documentation triaged Issue has been triaged by maintainers
#4306 opened Dec 30, 2024 by HolyWu
@pranavm-nvidia
1
Different output on python and C++ Accuracy Output mismatch between TensorRT and other frameworks triaged Issue has been triaged by maintainers
#4305 opened Dec 30, 2024 by app-houqiangli
2
I used pytorch-quantization to perform PTQ int8 quantization on ResNet50 and exported it to onnx, followed by exporting it to engine. trt. When reasoning, I found that the speed did not increase, but instead slowed down. What went wrong.
#4304 opened Dec 30, 2024 by jishenghuang
1
Core dump when call getDeviceMemorySizeForProfileV2
#4302 opened Dec 26, 2024 by tp-nan
1
Does the plug-in code implemented in cubin such as FlashAttention support the orin platform?
#4301 opened Dec 26, 2024 by lzymmm123
2
Compatible Tensorrt version for Jetpack 5.1.2 and CUDA 12.2
#4300 opened Dec 24, 2024 by mfatih7
3
Refittable failure of TensorRT 8.6.1.6 when running model.onnx on GPU A100
#4299 opened Dec 24, 2024 by lizexu123
7
Onnx does not support block-wise quantization when quantizing a pt model by modelopt. How do I transform pt model to tensorrt?
#4298 opened Dec 23, 2024 by lqq-feel
1
Inserting QDQ has severely impacted the performance of the unquantized Myelin part.
#4297 opened Dec 23, 2024 by zsh4614
2
Building engine failed of TensorRT 8.6.13 when running on GPU H20 Engine Build Issues with engine build triaged Issue has been triaged by maintainers
#4295 opened Dec 23, 2024 by XuDeshengCat
4
AttributeError: 'tensorrt_bindings.tensorrt.ICudaEngine' object has no attribute 'max_batch_size'
#4293 opened Dec 20, 2024 by kratos231245
1
[Question] What is the recommended API for deprecated SetDynamicRange?
#4292 opened Dec 19, 2024 by Benjamin-Tan
1
Internal Error (Could not find any implementation for node {...Tensordot/Reshape}) failure of TensorRT 8.6 when running generate INT8 engine on GPU RTX3080 Engine Build Issues with engine build quantization Issues related to Quantization triaged Issue has been triaged by maintainers
#4291 opened Dec 19, 2024 by yjiangling
@yuanyao-nv
7
Engine cache and model security ONNX Issues relating to ONNX usage and import triaged Issue has been triaged by maintainers
#4290 opened Dec 19, 2024 by MickaMickaMicka
@yuanyao-nv
2
Long Inference Time on First Run After Changing Input Shape in Dynamic Shape TensorRT Engine Demo: Diffusion Issues regarding demoDiffusion triaged Issue has been triaged by maintainers
#4289 opened Dec 19, 2024 by renne444
@asfiyab-nvidia
4
Error Code 2: Internal Error (Assertion !mValueMapUndo failed. )（Trt10.5/10.7 trtexec convert onnx model failed) Engine Build Issues with engine build internal-bug-tracked Tracked internally, will be fixed in a future release. triaged Issue has been triaged by maintainers
#4288 opened Dec 18, 2024 by TigerSong
@asfiyab-nvidia
4
Using trtexec with builderOptimizationLevel==5 ,i got a segmenttation(core dump)，but builderOptimizationLevel==3 is right Engine Build Issues with engine build triaged Issue has been triaged by maintainers
#4286 opened Dec 17, 2024 by peanutPod
@asfiyab-nvidia
2
About device size and streaming budget size in TensorRT 10.7
#4285 opened Dec 16, 2024 by Jsy0220
2
不同个数的输出导致运行结果不一致
#4284 opened Dec 15, 2024 by Rudin6
4
Can I implement block quantization through tensorflow-quantization?
#4283 opened Dec 15, 2024 by lqq-feel
4
[Feature request] allow uint8 output without an ICastLayer before Enhancement New feature or request quantization Issues related to Quantization triaged Issue has been triaged by maintainers
#4282 opened Dec 12, 2024 by QMassoz
3
ProTip! What’s not been updated in a month: updated:<2024-12-04.