Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Different output on python and C++ #4305

Open
app-houqiangli opened this issue Dec 30, 2024 · 2 comments
Open

Different output on python and C++ #4305

app-houqiangli opened this issue Dec 30, 2024 · 2 comments
Labels
Accuracy Output mismatch between TensorRT and other frameworks triaged Issue has been triaged by maintainers

Comments

@app-houqiangli
Copy link

Hello, I have a model where both the input and output are float32. After providing the same input, I performed TensorRT inference on the same GPU (4090) using both the C++ and Python versions, and I obtained different floating-point outputs. The discrepancy starts from the third decimal place. Could you please help explain the reason for this? I look forward to your reply.
TensorRT version: 8.5.1.7
GPU:4090

@lix19937
Copy link

lix19937 commented Jan 1, 2025

You should make sure the c++ and py version of trt are the same. c++ map to libnvinfer.so, py map to tensorrt.so.

@asfiyab-nvidia
Copy link
Collaborator

@app-houqiangli Yes, as @lix19937 mentioned make sure the C++ and Python TRT versions installed in your env are the same. If you're still noticing a discrepancy, please provide additional information and scripts to reproduce this issue

@asfiyab-nvidia asfiyab-nvidia added triaged Issue has been triaged by maintainers Accuracy Output mismatch between TensorRT and other frameworks labels Jan 2, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Accuracy Output mismatch between TensorRT and other frameworks triaged Issue has been triaged by maintainers
Projects
None yet
Development

No branches or pull requests

3 participants