Skip to content

cherry-pick: Key converters and documentation to release/2.1 #2387

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 5 commits into from
Oct 11, 2023
Merged

cherry-pick: Key converters and documentation to release/2.1 #2387

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
5 commits
Select commit Hold shift + click to select a range
738771a
feat: support group_norm, batch_norm, and layer_norm (#2330)
zewenli98 Oct 10, 2023
e6e5170
support argmax converter (#2291)
bowang007 Oct 10, 2023
ac37217
feat: Decomposition for `_unsafe_index` (#2386)
gs-olive Oct 10, 2023
69fbf6e
docs: Add documentation of `torch.compile` backend usage (#2363)
gs-olive Oct 10, 2023
b5e6487
docs: [Automated] Regenerating documenation for 4a920a1
Oct 10, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 3 additions & 2 deletions docs/_cpp_api/classtorch__tensorrt_1_1DataType.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Class DataType &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Class DataType &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/classtorch__tensorrt_1_1Device_1_1DeviceType.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Class Device::DeviceType &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Class Device::DeviceType &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/classtorch__tensorrt_1_1TensorFormat.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Class TensorFormat &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Class TensorFormat &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/classtorch__tensorrt_1_1ptq_1_1Int8CacheCalibrator.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Template Class Int8CacheCalibrator &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Template Class Int8CacheCalibrator &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/classtorch__tensorrt_1_1ptq_1_1Int8Calibrator.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Template Class Int8Calibrator &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Template Class Int8Calibrator &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1a18d295a837ac71add5578860b55e5502.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define STR &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define STR &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1a282fd3c0b1c3a215148ae372070e1268.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define TORCH_TENSORRT_PATCH_VERSION &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define TORCH_TENSORRT_PATCH_VERSION &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1a31398a6d4d27e28817afb0f0139e909e.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define TORCH_TENSORRT_MAJOR_VERSION &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define TORCH_TENSORRT_MAJOR_VERSION &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1a35703561b26b1a9d2738ad7d58b27827.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define TORCH_TENSORRT_MINOR_VERSION &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define TORCH_TENSORRT_MINOR_VERSION &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1abd1465eb38256d3f22cc1426b23d516b.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define TORCHTRT_API &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define TORCHTRT_API &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1abe87b341f562fd1cf40b7672e4d759da.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define XSTR &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define XSTR &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
5 changes: 3 additions & 2 deletions docs/_cpp_api/define_macros_8h_1ad19939408f7be171a74a89928b36eb59.html
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@

<meta name="viewport" content="width=device-width, initial-scale=1.0">

<title>Define TORCHTRT_HIDDEN &mdash; Torch-TensorRT v2.2.0.dev0+50ab2c1 documentation</title>
<title>Define TORCHTRT_HIDDEN &mdash; Torch-TensorRT v2.2.0.dev0+4a920a1 documentation</title>



Expand Down Expand Up @@ -225,7 +225,7 @@


<div class="version">
v2.2.0.dev0+50ab2c1
v2.2.0.dev0+4a920a1
</div>


Expand Down Expand Up @@ -267,6 +267,7 @@
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#working-with-torchscript-in-python">Working with TorchScript in Python</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/creating_torchscript_module_in_python.html#saving-torchscript-module-to-disk">Saving TorchScript Module to Disk</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/getting_started_with_fx_path.html">Torch-TensorRT (FX Frontend) User Guide</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/torch_compile.html">Torch-TensorRT <cite>torch.compile</cite> Backend</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/ptq.html">Post Training Quantization (PTQ)</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/runtime.html">Deploying Torch-TensorRT Programs</a></li>
<li class="toctree-l1"><a class="reference internal" href="../user_guide/saving_models.html">Saving models compiled with Torch-TensorRT</a></li>
Expand Down
Loading