File tree Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Expand file tree Collapse file tree 1 file changed +3
-3
lines changed Original file line number Diff line number Diff line change @@ -41,7 +41,7 @@ python3 torchchat.py eval stories15M --compile --tasks wikitext hellaswag
41
41
```
42
42
43
43
** exported PTE**
44
- Running an exported model as PTE
44
+ Running an exported model with ExecuTorch ( as PTE)
45
45
```
46
46
python3 torchchat.py export stories15M --output-pte-path stories15M.pte
47
47
python3 torchchat.py eval stories15M --pte-path stories15M.pte
@@ -53,10 +53,10 @@ python3 torchchat.py eval stories15M --pte-path stories15M.pte --tasks wikitext
53
53
```
54
54
55
55
** exported AOTI**
56
- Running an exported model as PTE
56
+ Running an exported model with AOT Inductor (DSO model)
57
57
```
58
58
python3 torchchat.py export stories15M --dtype fast16 --output-dso-path stories15M.so
59
- python3 torchchat.py eval stories15M --dtype fast16 --pte -path stories15M.so
59
+ python3 torchchat.py eval stories15M --dtype fast16 --dso -path stories15M.so
60
60
```
61
61
62
62
Running multiple tasks and calling eval.py directly (with AOTI):
You can’t perform that action at this time.
0 commit comments