Skip to content

Create placeholder pages for LLM TOC. #2419

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion docs/source/_templates/layout.html
Original file line number Diff line number Diff line change
Expand Up @@ -62,7 +62,7 @@
{% block footer %}
{{ super() }}
<script script type="text/javascript">
var collapsedSections = ['Introduction', 'Getting Started', 'Exporting to ExecuTorch', 'API Reference', 'IR Specification', 'Compiler Entry Points', 'Runtime', 'Quantization', 'Kernel Library', 'Native Delegates', 'SDK', 'Tutorials']
var collapsedSections = ['Introduction', 'Getting Started', 'Working with LLMs', 'Exporting to ExecuTorch', 'API Reference', 'IR Specification', 'Compiler Entry Points', 'Runtime', 'Quantization', 'Kernel Library', 'Native Delegates', 'SDK', 'Tutorials']
</script>

{{ super() }}
Expand Down
11 changes: 11 additions & 0 deletions docs/source/index.rst
Original file line number Diff line number Diff line change
Expand Up @@ -79,6 +79,17 @@ Topics in this section will help you get started with ExecuTorch.
getting-started-setup
runtime-build-and-cross-compilation

.. toctree::
:glob:
:maxdepth: 2
:caption: Working with LLMs
:hidden:

llm/introduction
llm/mobile/index
llm/desktop/index
llm/advanced-flow/index

.. toctree::
:glob:
:maxdepth: 1
Expand Down
7 changes: 7 additions & 0 deletions docs/source/llm/advanced-flow/advanced-flow.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# Advanced Flows

## Custom quantization

## Bring GGUF to PyTorch ecosystem

## TorchTune interoperability
9 changes: 9 additions & 0 deletions docs/source/llm/advanced-flow/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
Enabling LLMs on Advanced Flow
=======================

This section will walk you through

.. toctree::
:maxdepth: 1

advanced-flow
7 changes: 7 additions & 0 deletions docs/source/llm/desktop/benchmarks.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# Enabling LLMs on Desktop

## Local Llama on Desktop Benchmarks

**Results**

**Instructions**
9 changes: 9 additions & 0 deletions docs/source/llm/desktop/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
Enabling LLMs on Desktop
=======================

This section will walk you through

.. toctree::
:maxdepth: 1

benchmarks
7 changes: 7 additions & 0 deletions docs/source/llm/introduction.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,7 @@
# Introduction

## Current landscape of local LLMs

## What is our offering?

## Why and when should you use it?
6 changes: 6 additions & 0 deletions docs/source/llm/mobile/benchmarks.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
# Mobile Benchmarks for Local Llama

## Results


## Instructions
9 changes: 9 additions & 0 deletions docs/source/llm/mobile/customization-examples.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# Customization examples

## Custom tokenization

## Custom sampler

## Speculative decoding

## Modify a mobile app to use a different LLM model
16 changes: 16 additions & 0 deletions docs/source/llm/mobile/getting-started.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,16 @@
# Getting Started with LLMs via ExecuTorch


## Simple “Hello World” example


## Use Mobile Acceleration


## Quantization via XNNPACKQuantizer


## Debugging and Profiling


## Build Mobile LLM chat App Examples
12 changes: 12 additions & 0 deletions docs/source/llm/mobile/index.rst
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
Enabling LLMs on Mobile
=======================

This section will walk you through

.. toctree::
:maxdepth: 1

benchmarks
getting-started
customization-examples
validating-other-models
3 changes: 3 additions & 0 deletions docs/source/llm/mobile/validating-other-models.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
# Validating other models

## Exportability results