* Updated submodule onnx to 10.5
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
* Updated files to 10.5
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
* Restore the previous .gitmodules
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
* .gitmodules new line
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
* Update public docker files
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
* Update 10.5 oss deleted files
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
* Update deprecated APIs
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
---------
Signed-off-by: Michal Guzek <mguzek@nvidia.com>
Clean up CustomFCPlugin
Clean up CropAndResizePlugin
Clean up BatchTilePlugin
Improve code quality of proposalPlugin
Clean up DetectionLayerPlugin
Run clang-format on all .cpp and .h plugin code
upper case literal suffixes in plugin module
Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
Limit output_dims == W[1] for plugin test
update embLayernorm plugin doc
Remove else after return as they are not required.
Fix FlattenConcat plugin readme
Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
For version forward compatibility, we want to generate a shared library which contains vfc plugins. Currently we only have ROIAlign plugin in the list.
Signed-off-by: Shuyue Lan <shuyuel@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
Update tools including onnx-graphsurgeon(v0.3.25), Polygraphy(v0.43.1), tensorflow-quantization(v0.2.0)
Update onnx-tensorrt(8.5GA)
Mass merge sample, plugin, demo, python changes for TRT-8.5 GA release
Update demoBERT benchmark data for TensorRT 8.5.1
Signed-off-by: Simeng Liu <simengl@nvidia.com>
Signed-off-by: Simeng Liu <simengl@nvidia.com>
This graceful failure is needed to enable tests under `trt_mod_test`.
`PLUGIN_ASSERT` is used in many places inside plugin methods, most of
which are `noexcept` and do not contain try-catch blocks. So changing
`PLUGIN_ASSERT` would require a major refactor which is beyond
rel-8.4. Instead, this MR introduces `PLUGIN_VALIDATE` as a temporary
replacement for `PLUGIN_ASSERT` in places where it is required to enable
valid/invalid attribute tests (mostly `createPlugin` and plugin constructors).
i.e. `PLUGIN_VALIDATE` implements the expected behavior of `PLUGIN_ASSERT`
(throws) while `PLUGIN_ASSERT` still aborts.
Signed-off-by: samurdhi karunaratne <skarunaratne@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
Moves `BasePlugin` and `BaseCreator` in `plugin/common/plugin.h` out of
`nvinfer1::plugin` into `nvinfer1::pluginInternal`, as currently,
everything inside `nvinfer1::plugin` is being exported and those two
are meant to be internal helper classes.
Signed-off-by: samurdhi karunaratne <skarunaratne@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
The README.md mentioned that "The proposalPlugin generates the following
two outputs:" even though it only generates one output named `rois`. Also
fixed two mismatches in parameter names in README and the code.
Signed-off-by: skarunaratne <skarunaratne@nvidia.com>
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
Kevin Chen