File tree Expand file tree Collapse file tree 2 files changed +27
-0
lines changed Expand file tree Collapse file tree 2 files changed +27
-0
lines changed Original file line number Diff line number Diff line change
1
+ # Executing LLM models on Android
2
+
3
+ Check out the [ tutorial on how to build an Android app running your
4
+ PyTorch models with
5
+ Executorch] ( https://pytorch.org/executorch/main/llm/llama-demo-android.html ) ,
6
+ and give your torchat models a spin.
7
+
8
+ ![ Screenshot] ( https://pytorch.org/executorch/main/_static/img/android_llama_app.png " Android app running Llama model ")
9
+
10
+ Detailed step by step in conjunction with ET Android build, to run on
11
+ simulator for Android. ` scripts/android_example.sh ` for running a
12
+ model on an Android simulator (on Mac)
Original file line number Diff line number Diff line change
1
+ # iOS
2
+
3
+ Open the iOS Llama Xcode project at
4
+ https://github.com/pytorch/executorch/tree/main/examples/demo-apps/apple_ios/LLaMA/LLaMA.xcodeproj
5
+ in Xcode and click Run. You will need to provide a provisioning
6
+ profile (similar to what's expected for any iOS dev).
7
+
8
+ Once you can run the app on you device,
9
+ 1 - connect the device to you Mac,
10
+ 2 - copy the model and tokenizer.bin to the iOS Llama app
11
+ 3 - select the tokenizer and model with the ` (...) ` control (bottom left of screen, to the left of the text entrybox)
12
+
13
+
14
+ Detailed step by step in conjunction with ET iOS build, to run on
15
+ simulator for iOS.
You can’t perform that action at this time.
0 commit comments