We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
There was an error while loading. Please reload this page.
1 parent 7c2d949 commit 6c39a4aCopy full SHA for 6c39a4a
README.md
@@ -199,6 +199,22 @@ export TORCHCHAT_ROOT=${PWD}
199
./scripts/install_et.sh
200
```
201
202
+### Test it out using our Executorch runner
203
+Build the runner
204
+```bash
205
+scripts/build_native.sh et
206
+```
207
+
208
+**Get a PTE file if you don't have one already**
209
210
+python3 torchchat.py export llama3 --quantize config/data/mobile.json --output-pte-path llama3.pte
211
212
213
+Execute using the runner
214
215
+cmake-out/et_run llama3.pte -z ~/.torchchat/model-cache/meta-llama/Meta-Llama-3-8B-Instruct/tokenizer.model -i "Once upon a time"
216
217
218
### Export for mobile
219
The following example uses the Llama3 8B Instruct model.
220
0 commit comments