We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent caeaf6a commit aa4ba85Copy full SHA for aa4ba85
docsrc/user_guide/dynamic_shapes.rst
@@ -74,9 +74,9 @@ Here's a simple example that exports a matmul layer with some restrictions on dy
74
dynamic_shapes=({2: seq_len}, {2: seq_len})
75
# Export the model first with custom dynamic shape constraints
76
exp_program = torch.export.export(model, tuple(inputs), dynamic_shapes=dynamic_shapes)
77
- trt_gm = torch_tensorrt.dynamo.compile(exp_program, [inputs])
+ trt_gm = torch_tensorrt.dynamo.compile(exp_program, inputs)
78
# Run inference
79
- trt_gm(inputs)
+ trt_gm(*inputs)
80
81
82
Dynamic shapes using torch.compile (JIT)
0 commit comments