Skip to content

[feature] TensorRT Export for NITEC Model#4

Open
Muhammadjabbar123 wants to merge 1 commit intothohemp:mainfrom
Muhammadjabbar123:feature/tensorrt-export
Open

[feature] TensorRT Export for NITEC Model#4
Muhammadjabbar123 wants to merge 1 commit intothohemp:mainfrom
Muhammadjabbar123:feature/tensorrt-export

Conversation

@Muhammadjabbar123
Copy link
Copy Markdown

@Muhammadjabbar123 Muhammadjabbar123 commented Feb 26, 2026

TensorRT Export for NITEC Model

This PR adds TensorRT support for the pretrained NITEC model.

Implemented Features

  • ONNX export (opset 17, dynamic batch size)
  • TensorRT engine build script (FP32 + optional FP16)
  • TensorRT inference demo (webcam + image-based for Colab)
  • PyTorch vs TensorRT validation (np.allclose comparison)
  • README documentation for full TensorRT workflow

TensorRT Version

Tested with: TensorRT 10.15.1.29

Validation

np.allclose: True
Max abs err: ~2.98e-07

Known Limitations

  • TensorRT requires NVIDIA GPU + CUDA.
  • Webcam demo does not run in Google Colab.
  • ONNX export required legacy exporter (dynamo=False) for TensorRT parser compatibility.
    @thohemp please review this PR.

Copy link
Copy Markdown
Owner

@thohemp thohemp left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the pull request.

Unfortunately, this PR cannot be merged because of the following reasons:

  1. It contains personal image data, see images/5.jpeg.
  2. It contains unwanted bytecode data, see __pycache__
  3. It contains weight files. We don't want any larges file in this github repository. Please upload the weights to some file sharing service, or even better, our cloud: https://cloud.ovgu.de
  4. move the comparison script to /tools please.

Since the models and the perosnal data is already in the git log of this PR, please open a fresh new PR on a fresh new branch.

Then, assign me as reviewer, do not tag me in the text.

Thanks and BG

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants