Skip to content

Commit cacc5dc

Browse files
Xingying Chengfacebook-github-bot
authored andcommitted
Create placeholder pages for LLM TOC. (#2419)
Summary: Pull Request resolved: #2419 Differential Revision: D54878408
1 parent 3e414fb commit cacc5dc

File tree

6 files changed

+72
-1
lines changed

6 files changed

+72
-1
lines changed

docs/source/index.rst

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,17 @@ Topics in this section will help you get started with ExecuTorch.
7979
getting-started-setup
8080
runtime-build-and-cross-compilation
8181

82+
.. toctree::
83+
:glob:
84+
:maxdepth: 1
85+
:caption: LLM
86+
:hidden:
87+
88+
llm-introduction
89+
llm-on-mobile
90+
llm-on-desktop
91+
llm-on-advanced-flow
92+
8293
.. toctree::
8394
:glob:
8495
:maxdepth: 1

docs/source/llm-advanced-flow.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# Advanced Flows
2+
3+
## Custom quantization
4+
5+
## Bring GGUF to PyTorch ecosystem
6+
7+
## TorchTune interoperability

docs/source/llm-introduction.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
# LLM Introduction
2+
3+
[Current landscape of local LLMs]
4+
[What is our offering?]
5+
[Why and when should you use it?]

docs/source/llm-on-desktop.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# Enabling LLMs on Desktop
2+
3+
## Local Llama on Desktop Benchmarks
4+
5+
**Results**
6+
7+
**Instructions**

docs/source/llm-on-mobile.md

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
# Enabling LLMs on Mobile
2+
3+
4+
## Local Llama on Mobile Benchmarks
5+
6+
**Results**
7+
8+
**Instructions**
9+
10+
11+
12+
## Getting Started with LLMs via ExecuTorch
13+
14+
**Simple “Hello World” example**
15+
16+
**Use Mobile Acceleration**
17+
18+
**Quantization via XNNPACKQuantizer**
19+
20+
**Debugging and Profiling**
21+
22+
**Build Mobile LLM chat App Examples**
23+
24+
25+
26+
## Customization examples:
27+
28+
**Custom tokenization**
29+
30+
**Custom sampler**
31+
32+
**Speculative decoding**
33+
34+
**Modify a mobile app to use a different LLM model**
35+
36+
37+
38+
## Validating other models
39+
40+
**Exportability results**

install_requirements.sh

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -49,4 +49,5 @@ pip install --pre torchsr==${TORCHSR_VERSION}
4949
pip install . --no-build-isolation
5050

5151
# Install flatc dependency
52-
bash build/install_flatc.sh
52+
# bash build/install_flatc.sh
53+
bash install_flatc.sh

0 commit comments

Comments
 (0)