github-featured/nvidia--tensorrt
2
0
Fork 0
Code Issues Pull Requests Deployments Models Agent Notes Packages Projects Releases Wiki Activity

TensorRT 10.10 OSS Release (#4437)

Browse Source 
Signed-off-by: Po-Wei Wang (Vincent) <poweiw@nvidia.com>
This commit is contained in:
Po-Wei (Vincent)
2025-05-09 15:21:00 -07:00
committed by GitHub
parent 9e0835ac8a
commit 665cfbe862
182 changed files with 1821 additions and 2854 deletions
Download Patch File Download Diff File Expand all files Collapse all files
python/docstrings/infer/pyCoreDoc.h
+5 -4
View File
@@ -1155,6 +1155,9 @@ constexpr char const* PROFILE_SHARING_0806 = R"trtdoc(
constexpr char const* ALIASED_PLUGIN_IO_10_03 = R"trtdoc(
Allows plugin I/O to be aliased when using IPluginV3OneBuildV2.
)trtdoc";
constexpr char const* RUNTIME_ACTIVATION_RESIZE_10_10 = R"trtdoc(
Allow update_device_memory_size_for_shapes to resize runner internal activation memory by changing the allocation algorithm. Using this feature can reduce runtime memory requirement when the actual input tensor shapes are smaller than the maximum input tensor dimensions.
)trtdoc";
} // namespace PreviewFeatureDoc
namespace HardwareCompatibilityLevelDoc
@@ -1223,7 +1226,7 @@ constexpr char const* FULL = R"trtdoc(
namespace NetworkDefinitionCreationFlagDoc
{
constexpr char const* descr
= R"trtdoc(List of immutable network properties expressed at network creation time. For example, to enable explicit batch mode, pass a value of ``1 << int(NetworkDefinitionCreationFlag.STRONGLY_TYPED)`` to :func:`create_network` )trtdoc";
= R"trtdoc(List of immutable network properties expressed at network creation time. For example, to enable strongly typed mode, pass a value of ``1 << int(NetworkDefinitionCreationFlag.STRONGLY_TYPED)`` to :func:`create_network` )trtdoc";
constexpr char const* EXPLICIT_BATCH
= R"trtdoc([DEPRECATED] Ignored because networks are always "explicit batch" in TensorRT 10.0.)trtdoc";
constexpr char const* STRONGLY_TYPED
@@ -1889,15 +1892,13 @@ namespace RuntimeInspectorDoc
{
constexpr char const* descr = R"trtdoc(
An engine inspector which prints out the layer information of an engine or an execution context.
The engine or the context must be set before get_layer_information() or get_engine_information() can be called.
The amount of printed information depends on the profiling verbosity setting of the builder config when the engine is built.
By default, the profiling verbosity is set to ProfilingVerbosity.LAYER_NAMES_ONLY, and only layer names will be printed.
If the profiling verbosity is set to ProfilingVerbosity.DETAILED, layer names and layer parameters will be printed.
If the profiling verbosity is set to ProfilingVerbosity.NONE, no layer information will be printed.
:ivar engine: :class:`ICudaEngine` Set or get the engine currently being inspected.
:ivar context: :class:`IExecutionContext` Set or get context currently being inspected.
:ivar execution_context: :class:`IExecutionContext` Set or get context currently being inspected.
:ivar error_recorder: :class:`IErrorRecorder` Application-implemented error reporting interface for TensorRT objects.
)trtdoc";
python/docstrings/infer/pyInt8Doc.h
+2
View File
@@ -24,6 +24,8 @@ namespace tensorrt
namespace CalibrationAlgoTypeDoc
{
constexpr const char* descr = R"trtdoc(
[DEPRECATED] Deprecated in TensorRT 10.1. Superseded by explicit quantization.
Version of calibration algorithm to use.
)trtdoc";
} // namespace CalibrationAlgoTypeDoc
python/docstrings/infer/pyPluginDoc.h
+10 -4
View File
@@ -1,5 +1,5 @@
/*
* SPDX-FileCopyrightText: Copyright (c) 1993-2024 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
* SPDX-FileCopyrightText: Copyright (c) 1993-2025 NVIDIA CORPORATION & AFFILIATES. All rights reserved.
* SPDX-License-Identifier: Apache-2.0
*
* Licensed under the Apache License, Version 2.0 (the "License");
@@ -383,7 +383,7 @@ constexpr const char* ipluginv3_descr = R"trtdoc(
:ivar num_outputs: :class:`int` The number of outputs from the plugin. This is used by the implementations of :class:`INetworkDefinition` and :class:`Builder`. In particular, it is called prior to any call to :func:`initialize`.
:ivar tensorrt_version: :class:`int` [READ ONLY] The API version with which this plugin was built.
:ivar plugin_type: :class:`str` The plugin type. Should match the plugin name returned by the corresponding plugin creator.
:ivar plugin_name: :class:`str` The plugin name. Should match the plugin name returned by the corresponding plugin creator.
:ivar plugin_version: :class:`str` The plugin version. Should match the plugin version returned by the corresponding plugin creator.
:ivar plugin_namespace: :class:`str` The namespace that this plugin object belongs to. Ideally, all plugin objects from the same plugin library should have the same namespace.
:ivar serialization_size: :class:`int` [READ ONLY] The size of the serialization buffer required.
@@ -403,7 +403,7 @@ constexpr const char* ipluginv3onecore_descr = R"trtdoc(
Every attribute must be explicitly initialized on Python-based plugins.
These attributes will be read-only when accessed through a C++-based plugin.
:ivar plugin_type: :class:`str` The plugin type. Should match the plugin name returned by the corresponding plugin creator.
:ivar plugin_name: :class:`str` The plugin name. Should match the plugin name returned by the corresponding plugin creator.
:ivar plugin_version: :class:`str` The plugin version. Should match the plugin version returned by the corresponding plugin creator.
:ivar plugin_namespace: :class:`str` The namespace that this plugin object belongs to. Ideally, all plugin objects from the same plugin library should have the same namespace.
)trtdoc";
@@ -418,6 +418,10 @@ constexpr const char* ipluginv3onebuild_descr = R"trtdoc(
These attributes will be read-only when accessed through a C++-based plugin.
:ivar num_outputs: :class:`int` The number of outputs from the plugin. This is used by the implementations of :class:`INetworkDefinition` and :class:`Builder`.
:ivar format_combination_limit: :class:`int` The maximum number of format combinations that the plugin supports.
:ivar metadata_string: :class:`str` The metadata string for the plugin.
:ivar timing_cache_id: :class:`str` The timing cache ID for the plugin.
)trtdoc";
constexpr const char* ipluginv3onebuildv2_descr = R"trtdoc(
@@ -929,7 +933,9 @@ namespace IPluginRegistryDoc
constexpr const char* descr = R"trtdoc(
Registers plugin creators.
:ivar plugin_creator_list: All the registered plugin creators.
:ivar plugin_creator_list: [DEPRECATED] Deprecated in TensorRT 10.0. List of IPluginV2-descendent plugin creators in current registry.
:ivar all_creators: List of all registered plugin creators of current registry.
:ivar all_creators_recursive: List of all registered plugin creators of current registry and its parents (if :attr:`parent_search_enabled` is True).
:ivar error_recorder: :class:`IErrorRecorder` Application-implemented error reporting interface for TensorRT objects.
:ivar parent_search_enabled: bool variable indicating whether parent search is enabled. Default is True.
)trtdoc";