Commit Graph

111 Commits

Author SHA1 Message Date
Kevin Chen b8db91e15b TensorRT 10.13 OSS Release (#4531)
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2025-07-24 14:58:47 -07:00
akhilg-nv 6d178ce8c7 TensorRT 10.12 OSS Release (#4491)
Signed-off-by: Akhil Goel <akhilg@nvidia.com>
2025-06-18 14:35:18 -07:00
asfiyab-nvidia 9255eb39e6 TensorRT 10.11 release updates (#4455)
* TensorRT 10.11 release updates

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* Update changelog date

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* Update ONNX parser

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* add shouldCompileKernel

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* changelog updates

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

* Update changelog plugin

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>

---------

Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
2025-05-21 15:58:04 -07:00
Po-Wei (Vincent) 665cfbe862 TensorRT 10.10 OSS Release (#4437)
Signed-off-by: Po-Wei Wang (Vincent) <poweiw@nvidia.com>
2025-05-09 15:21:00 -07:00
Leo Dong 8c6d69ddec TensorRT 10.9 OSS Release. (#4381)
Signed-off-by: Leo Dong <leod@nvidia.com>
2025-03-11 14:54:52 -07:00
Yuan Yao a180e08111 10.8 release changes
Signed-off-by: Yuan Yao <yuanyao@nvidia.com>
2025-01-31 10:17:00 -08:00
Kevin Chen 17003e43da TensorRT 10.7-GA OSS Release (#4269)
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2024-12-05 13:12:22 -08:00
Kevin Chen c468d67760 TensorRT 10.6-GA OSS Release (#4238)
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2024-11-05 13:52:52 -08:00
Michal Guzek c8a50438f6 Update for 10.5-GA (#4185)
* Updated submodule onnx to 10.5

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

* Updated files to 10.5

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

* Restore the previous .gitmodules

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

* .gitmodules new line

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

* Update public docker files

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

* Update 10.5 oss deleted files

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

* Update deprecated APIs

Signed-off-by: Michal Guzek <mguzek@nvidia.com>

---------

Signed-off-by: Michal Guzek <mguzek@nvidia.com>
2024-10-10 12:43:27 -07:00
poweiw c664ce22b0 Update for 10.4-GA
Signed-off-by: poweiw <poweiw@nvidia.com>
2024-09-11 17:26:50 -07:00
Balarama Raju Buddharaju 84dd6ed18c Updates for Release 10.3-GA.
Signed-off-by: Balarama Raju Buddharaju <bbuddharaju@nvidia.com>
2024-08-08 12:32:01 -07:00
Yuan Yao 2332a7191d 10.2 GA release update (#3998)
* 10.2 GA updates

Signed-off-by: Yuan Yao (yuanyao) <yuanyao@nvidia.com>

* update changelog

Signed-off-by: Yuan Yao (yuanyao) <yuanyao@nvidia.com>

* revert plugin README format changes

Signed-off-by: Yuan Yao (yuanyao) <yuanyao@nvidia.com>

---------

Signed-off-by: Yuan Yao (yuanyao) <yuanyao@nvidia.com>
2024-07-11 10:18:43 -07:00
Akhil Goel 21f31ba77e TensorRT OSS 10.1 GA Release
Signed-off-by: Akhil Goel <akhilg@nvidia.com>
2024-06-17 16:58:17 -07:00
Vincent Huang ccf119972b force install trt10
Signed-off-by: Vincent Huang <vincenth@nvidia.com>
2024-05-28 10:28:05 -07:00
Vincent Huang a282d919e2 None: update the notebook to make it stand-alone
Signed-off-by: Vincent Huang <vincenth@nvidia.com>
2024-05-24 16:19:34 -07:00
Xiaodong (Vincent) Huang 0598d5dd82 None: cherry-pick weight stripping notebook (#3885)
Signed-off-by: Vincent Huang <vincenth@nvidia.com>
2024-05-21 09:01:42 -07:00
Francesco 9d2613d353 Doc/3839/update sample int8 readme (#3845)
* Replaced non existing call setINit8Mode

INT8 ANN quantization is started by setting the builder flag kINT8 over the setFlags of the builder option

Signed-off-by: Francesco Spadafora <sf-fs@windowslive.com>

* Fix wring naming in example

Replaced name with tensor_name in example

Signed-off-by: Francesco Spadafora <sf-fs@windowslive.com>

* setStrictTypeConstraints updated to BuilderFlag::kINT8

The documentation regarding debugging of the INT8 mode is updated to match the builder flags

Signed-off-by: Francesco Spadafora <sf-fs@windowslive.com>

* typo fix

Signed-off-by: Francesco Spadafora <sf-fs@windowslive.com>

---------

Signed-off-by: Francesco Spadafora <sf-fs@windowslive.com>
Co-authored-by: Francesco Spadafora <francesco.spadafora@advertima.com>
2024-05-15 11:15:17 -07:00
Asfiya Baig d3107c885a TensorRT 10.0 GA Release
Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
2024-04-30 10:00:50 -07:00
Asfiya Baig 147005ffe1 TensorRT 10.0 Release
Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
2024-04-02 17:06:37 -07:00
Jan Bernlöhr 6e5bebd95a trtexec: Use getNbOutputs when computing outputs
Signed-off-by: Jan Bernlöhr <jan@bernloehrs.de>
2023-06-08 09:21:30 +08:00
Ilya Sherstyuk 0d2bf98287 Update demoBERT perf numbers for 8.6.1
Also apply a minor fix to sampleINT8API.cpp

Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
2023-05-15 16:18:07 -07:00
Ilya Sherstyuk e314528281 Update TensorRT to 8.6.1
Signed-off-by: Ilya Sherstyuk <isherstyuk@nvidia.com>
2023-05-04 17:18:12 -07:00
Samurdhi Karunaratne 3efb69b291 Support class-independent NMS with new parameter in efficientNMSPlugin
Also adds goldenIO testcases: one for class agnostic NMS and another for class aware NMS.
With this, golden_io_snippet.py is also modified to support checking for multiple
plugin outputs.

	Adds `class_agnostic` parameter to `EfficientNMS_TRT` plugin:

	 - Some object detection networks/architectures like YOLO series need to
	 use class-independent NMS operations.
	 - If `class_agnostic` is enabled, class-independent NMS is performed;
	 otherwise, different classes would do NMS separately.

	Signed-off-by: Samurdhi Karunaratne <skarunaratne@nvidia.com>

Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2023-03-16 20:53:29 -07:00
Tal Cherckez 3722b38afd Various minor updates for plugins - part 1
Update datatype switch statements for kQUANT_E4M3
Fix win CUDA12.0 build

Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2023-03-15 17:38:49 -07:00
Shuyue Lan 3ec7b425cf Cherry-pick sample changes and update headers & python bindings from TRT rel-8.6
Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2023-03-15 17:38:49 -07:00
asfiyab-nvidia 59898c103f sampleINT8API- update resnet50.onnx download link (#2697)
Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
2023-02-22 13:27:32 -08:00
asfiyab-nvidia b0c259a749 TensorRT OSS - 8.5.3.1 Release (#2630)
Signed-off-by: Asfiya Baig <asfiyab@nvidia.com>
2023-02-03 12:26:51 -08:00
Shuyue Lan 8dc4e70e70 remove UFF/Caffe samples (#2631)
Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
2023-02-02 11:47:02 -08:00
Simeng Liu 1d6bf36034 TensorRT 8.5.1 OSS Release
Update tools including onnx-graphsurgeon(v0.3.25), Polygraphy(v0.43.1), tensorflow-quantization(v0.2.0)
Update onnx-tensorrt(8.5GA)
Mass merge sample, plugin, demo, python changes for TRT-8.5 GA release
Update demoBERT benchmark data for TensorRT 8.5.1

Signed-off-by: Simeng Liu <simengl@nvidia.com>

Signed-off-by: Simeng Liu <simengl@nvidia.com>
2022-11-02 16:43:34 -07:00
Kevin Chen 87f3394404 TensorRT 8.4.3.1 updates
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2022-08-19 14:23:52 -07:00
Amey Patel 85b573d81b Migrate code to parse onnx models instead of caffe models for sampleIOFormats and sampleAlgorithmSelector
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2022-08-16 17:12:26 -07:00
Samurdhi Karunaratne 2dbbf37137 Serialize mInputVolume in customClipPlugin
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2022-08-16 17:12:26 -07:00
Shuyue Lan fe785a6c7f remove unused import
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2022-08-16 17:12:26 -07:00
azhurkevich eeaa085ae4 Fix detectron2 requirements and README
Signed-off-by: Kevin Chen <kevinch@nvidia.com>
2022-07-21 22:44:02 -04:00
Rajeev Rao 8fd0b8a750 Remove Pillow version pin in requirements.txt
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Rajeev Rao 450325089a Specify torch version requirement for sampleOnnxMnistCoordConvAC
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Kevin Chen dc01d36bbe Add UFF legacy mode for PyramidROIPlugin
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Rajeev Rao 9cb7aa70de Miscellaneous samples fixes from 8.4.1.4
- trtexec should not call reportToProfiler if getEnqueueEmitsProfile is true
- Fix protobuf version to 3.15.7

Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Jonas Li 65b9900b46 Always run reportToProfiler() explicitly after enqueue
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Po-Han Huang 556c3d1526 Hide inaccurate trtexec e2e perf report
- Report can be confusing when --dumpProfile is added but not --separateProfileRun

Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Kevin Chen cabb42f024 Support Windows paths through expliclity quoting input names
Add logic for supporting `'inputName':PATH` input format for trtexec's commandline options.

In trtexec documentation we state that input names can be wrapped in single quotes '', but we don't actually support that.
On Windows, --loadInputs flag will generally take a path that starts with `c:\..`, so splitting on last seen colon does not work in this case.

Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Rajeev Rao 6498887518 TensorRT sample updates for rel-8.4
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Shuyue Lan 84583e1664 Use enqueueV2() instead of enqueue() in trtexec when engine has explicit batch dim
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-06-14 14:23:17 -07:00
Rajeev Rao 99a11a5fcd Revert tensor names to torch 1.10.2 in CorrdConvAC sample
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00
Rajeev Rao f2fe120d3a Update CoordConvAC export for torch v1.11 and plugin fix
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00
Shuyue Lan 02ba14480f Update modify_onnx_ac.py using onnx_gs
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00
Shuyue Lan 7023729776 Remove references to legacy reportParsingInfo() API
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00
Shuyue Lan 1dfa2bdb36 Remove use of legacy buildEngineWithConfig() API
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00
Shuyue Lan f25148db9f Bugfix in int8_caffe_mnist sample
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00
Alexander Zhurkevich 5bd9f0ab5c Fix Detectron2 sample README
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2022-05-13 14:51:01 -07:00