Skip to content

Commit b6056df

Browse files
Xingying Chengfacebook-github-bot
authored andcommitted
Create placeholder pages for LLM TOC. (#2419)
Summary: Pull Request resolved: #2419 Differential Revision: D54878408
1 parent 3e414fb commit b6056df

File tree

6 files changed

+71
-1
lines changed

6 files changed

+71
-1
lines changed

docs/source/executorch_custom_versions.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -29,7 +29,7 @@
2929

3030
def read_version_files():
3131
cwd = os.getcwd()
32-
version_file_path = os.path.join(cwd, "..", ".ci", "docker", "ci_commit_pins")
32+
version_file_path = os.path.join(cwd, "..", "oss", ".ci", "docker", "ci_commit_pins")
3333

3434
for file_name in version_file_names:
3535
file_path = os.path.join(version_file_path, file_name)

docs/source/index.rst

Lines changed: 11 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -79,6 +79,17 @@ Topics in this section will help you get started with ExecuTorch.
7979
getting-started-setup
8080
runtime-build-and-cross-compilation
8181

82+
.. toctree::
83+
:glob:
84+
:maxdepth: 1
85+
:caption: LLM
86+
:hidden:
87+
88+
llm-introduction
89+
llm-on-mobile
90+
llm-on-desktop
91+
llm-on-advanced-flow
92+
8293
.. toctree::
8394
:glob:
8495
:maxdepth: 1

docs/source/llm-advanced-flow.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# Advanced Flows
2+
3+
## Custom quantization
4+
5+
## Bring GGUF to PyTorch ecosystem
6+
7+
## TorchTune interoperability

docs/source/llm-introduction.md

Lines changed: 5 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,5 @@
1+
# LLM Introduction
2+
3+
[Current landscape of local LLMs]
4+
[What is our offering?]
5+
[Why and when should you use it?]

docs/source/llm-on-desktop.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,7 @@
1+
# Enabling LLMs on Desktop
2+
3+
## Local Llama on Desktop Benchmarks
4+
5+
**Results**
6+
7+
**Instructions**

docs/source/llm-on-mobile.md

Lines changed: 40 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,40 @@
1+
# Enabling LLMs on Mobile
2+
3+
4+
## Local Llama on Mobile Benchmarks
5+
6+
**Results**
7+
8+
**Instructions**
9+
10+
11+
12+
## Getting Started with LLMs via ExecuTorch
13+
14+
**Simple “Hello World” example**
15+
16+
**Use Mobile Acceleration**
17+
18+
**Quantization via XNNPACKQuantizer**
19+
20+
**Debugging and Profiling**
21+
22+
**Build Mobile LLM chat App Examples**
23+
24+
25+
26+
## Customization examples:
27+
28+
**Custom tokenization**
29+
30+
**Custom sampler**
31+
32+
**Speculative decoding**
33+
34+
**Modify a mobile app to use a different LLM model**
35+
36+
37+
38+
## Validating other models
39+
40+
**Exportability results**

0 commit comments

Comments
 (0)