File tree Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Expand file tree Collapse file tree 1 file changed +5
-3
lines changed Original file line number Diff line number Diff line change @@ -23,7 +23,7 @@ The evaluation mode of `torchchat.py` script can be used to evaluate your langua
23
23
24
24
## Examples
25
25
26
- ** Python**
26
+ ### Python
27
27
28
28
Running wikitext for 10 iterations
29
29
```
@@ -40,7 +40,8 @@ Running multiple tasks and calling eval.py directly (with torch.compile):
40
40
python3 torchchat.py eval stories15M --compile --tasks wikitext hellaswag
41
41
```
42
42
43
- ** exported PTE**
43
+ ### exported PTE
44
+
44
45
Running an exported model with ExecuTorch (as PTE)
45
46
```
46
47
python3 torchchat.py export stories15M --output-pte-path stories15M.pte
@@ -52,7 +53,8 @@ Running multiple tasks and calling eval.py directly (with PTE):
52
53
python3 torchchat.py eval stories15M --pte-path stories15M.pte --tasks wikitext hellaswag
53
54
```
54
55
55
- ** exported AOTI**
56
+ ### exported AOTI
57
+
56
58
Running an exported model with AOT Inductor (DSO model)
57
59
```
58
60
python3 torchchat.py export stories15M --dtype fast16 --output-dso-path stories15M.so
You can’t perform that action at this time.
0 commit comments