8 Commits

Author SHA1 Message Date
Rajeev Rao 2d517d270e TensorRT OSS v8.2 Early Access Release
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-10-05 11:30:06 -07:00
Rajeev Rao aff45dd565 TensorRT OSS 8.0 release
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-07-02 16:35:44 -07:00
Rajeev Rao 80e2473bdb serialize CPU data of PriorBox to engine only
PriorBox plugin serialize CPU metadata (array size) A and GPU data
(array elements) B' in engine. B' is modified from CPU array B
when constructing the object. A deserialized object then holds data
A and B' which is different from the original (A and B).

If a new object is created from a deserialized one via `PriorBox::clone()`,
which rebuilds array elements at GPU side from CPU holding array A and
B', the generated GPU data is incorrect (A and B''), resulting in
wrong inference result.

As PriorBox is designed to track data in specific format, we now
serialize only the CPU data A and B, i.e. the parameters that used to
construct a PriorBox object, to engine.

bad image processing with deserialized engine

1. Fixed the memory deallocation error in plugin PriorBox::clone() method
even without serialization by initializing empty pointer to nullptr.

2. Initialized weights to empty structs

3. Added mParam.aspectRatios to serialization and deserialization since
mParam.aspectRatios are different from aspectRatios device weights in count and values.

Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-04-12 14:56:06 -07:00
Rajeev Rao 183f891191 Update onnx-tensorrt and copyright headers (2021)
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-01-14 01:16:45 -08:00
Rajeev Rao 492878b2df TensorRT OSS release v7.2.1
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2020-10-20 16:48:23 -07:00
Rajeev Rao 805810b112 TensorRT 7.1 Open Source Release
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2020-07-01 16:31:50 -07:00
Kevin Chen 98ab844a6c Adding support for building BERT plugins with GPU_ARCHS specified (#255) 2019-12-05 15:48:18 -08:00
Rajeev Rao 0d36bbb297 TensorRT Open Source Release/5.1 2019-06-17 10:47:48 -07:00