12 Commits

Author SHA1 Message Date
Rajeev Rao 2d517d270e TensorRT OSS v8.2 Early Access Release
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-10-05 11:30:06 -07:00
Rajeev Rao aff45dd565 TensorRT OSS 8.0 release
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-07-02 16:35:44 -07:00
Rajeev Rao 64fa61b415 Add varlen MHA fp16 slen=384 kernels for sm_86
1. add varlen mha fp16 slen=384 kernel for sm_86
2. referesh all sm_86 kernels now use NVCC -gencode=arch=compute_86,code=\"sm_86\"
3. use unfused kernel for fixed len s=384 fp16

Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-04-12 14:56:06 -07:00
Vincent Huang 2e875dbb28 fix doc for bert plugins
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-04-12 14:56:06 -07:00
Rajeev Rao cc5dede848 clang-format plugins and samples
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-04-12 14:56:06 -07:00
Rajeev Rao 183f891191 Update onnx-tensorrt and copyright headers (2021)
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2021-01-14 01:16:45 -08:00
Rajeev Rao 492878b2df TensorRT OSS release v7.2.1
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2020-10-20 16:48:23 -07:00
Rajeev Rao 805810b112 TensorRT 7.1 Open Source Release
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2020-07-01 16:31:50 -07:00
Rajeev Rao 3afdc3cbd7 Fix review nits
Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2020-06-17 13:48:22 -07:00
Rajeev Rao eff9163466 BERT kernel improvements
- Softmax and batched GEMM tuning
- Increase tuning runs qkv
- Softmax and batched GEMM tuning

Signed-off-by: Rajeev Rao <rajeevrao@nvidia.com>
2020-06-17 13:48:22 -07:00
Kevin Chen 98ab844a6c Adding support for building BERT plugins with GPU_ARCHS specified (#255) 2019-12-05 15:48:18 -08:00
Pranav Marathe 77af534c21 Moves BERT plugins into main plugin library, removes demo (will be relocated to DeepLearningExamples shortly)
Signed-off-by: pranavm <pranavm@nvidia.com>
2019-11-13 13:48:15 -08:00