Skip to content

Commit d6a5fb3

Browse files
mergennachinfacebook-github-bot
authored andcommitted
Prepare a simple TOC for 4/2 launch. (#2728)
Summary: Pull Request resolved: #2728 I think the current TOC contains more information that would be later populated after 4/2. I simplified the current TOC to be one page and reflecting current blockers for 4/2 launch. We can always venture out to more pages, but let's start with a simple single page. Reviewed By: dbort Differential Revision: D55451176 fbshipit-source-id: dc49460fdfbaa0f9b242671b3c9a69e412b1b899
1 parent 34b1cfc commit d6a5fb3

File tree

12 files changed

+35
-89
lines changed

12 files changed

+35
-89
lines changed

docs/source/index.rst

Lines changed: 1 addition & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -85,10 +85,7 @@ Topics in this section will help you get started with ExecuTorch.
8585
:caption: Working with LLMs
8686
:hidden:
8787

88-
llm/introduction
89-
llm/mobile/index
90-
llm/desktop/index
91-
llm/advanced-flow/index
88+
llm/getting-started
9289

9390
.. toctree::
9491
:glob:

docs/source/llm/advanced-flow/advanced-flow.md

Lines changed: 0 additions & 7 deletions
This file was deleted.

docs/source/llm/advanced-flow/index.rst

Lines changed: 0 additions & 9 deletions
This file was deleted.

docs/source/llm/desktop/benchmarks.md

Lines changed: 0 additions & 7 deletions
This file was deleted.

docs/source/llm/desktop/index.rst

Lines changed: 0 additions & 9 deletions
This file was deleted.

docs/source/llm/getting-started.md

Lines changed: 34 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,34 @@
1+
# Getting Started with LLMs via ExecuTorch
2+
3+
This section provides guidance on enabling Large Language Models (LLMs), starting with a simple example and gradually introducing new concepts to improve performance and productivity.
4+
5+
## Prerequisites
6+
7+
- To run this tutorial, you’ll first need to first [Set up your ExecuTorch environment](../getting-started-setup.md).
8+
9+
- We highly suggest you to check out [LLama2 README](../../../examples/models/llama2/README.md) in our examples for end-to-end Llama2 mobile demo.
10+
11+
12+
## Simple “Hello World” LLM example
13+
14+
Let's create a simple LLM app from scratch. TODO
15+
16+
## Quantization
17+
18+
Most LLMs are too large to fit into a mobile phone, making quantization necessary. In this example, we will demonstrate how to use the XNNPACKQuantizer to quantize the model and run it on a CPU. TODO
19+
20+
## Use Mobile Acceleration
21+
22+
One of the benefits of ExecuTorch is the ability to delegate to mobile accelerators. Now, we will show a few examples of how to easily take advantage of mobile accelerators. TODO
23+
24+
## Debugging and Profiling
25+
26+
It is sometimes necessary to profile and inspect the execution process. In this example, we will demonstrate how the ExecuTorch SDK can be used to identify which operations are being executed on which hardware. TODO
27+
28+
## How to use custom kernels
29+
30+
In some cases, it is necessary to write custom kernels or import them from another source in order to achieve the desired performance. In this example, we will demonstrate how to use the `kvcache_with_sdpa` kernel.
31+
32+
## How to build Mobile Apps
33+
34+
Here's how to finally build a mobile app on Android and iOS. TODO

docs/source/llm/introduction.md

Lines changed: 0 additions & 7 deletions
This file was deleted.

docs/source/llm/mobile/benchmarks.md

Lines changed: 0 additions & 6 deletions
This file was deleted.

docs/source/llm/mobile/customization-examples.md

Lines changed: 0 additions & 9 deletions
This file was deleted.

docs/source/llm/mobile/getting-started.md

Lines changed: 0 additions & 16 deletions
This file was deleted.

docs/source/llm/mobile/index.rst

Lines changed: 0 additions & 12 deletions
This file was deleted.

docs/source/llm/mobile/validating-other-models.md

Lines changed: 0 additions & 3 deletions
This file was deleted.

0 commit comments

Comments
 (0)