Skip to content

Commit 285505e

Browse files
jspisakmergennachin
authored andcommitted
Update README.md (#851)
Summary: Added a model description.. Pull Request resolved: #851 Reviewed By: iseeyuan Differential Revision: D50230628 Pulled By: larryliu0820 fbshipit-source-id: 80bc765b5432687cd34444b637977f4144a2c2f4
1 parent cdaa987 commit 285505e

File tree

1 file changed

+10
-1
lines changed

1 file changed

+10
-1
lines changed

examples/models/llama2/README.md

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1,8 +1,17 @@
11
# Summary
2-
This example demonstrates how to Export a Llama 2 model in ExecuTorch.
2+
This example demonstrates how to Export a [Llama 2](https://ai.meta.com/llama/) model in ExecuTorch such that it can be used in a mobile environment.
33
For Llama2, please refer to [the llama's github page](https://github.com/facebookresearch/llama) for details.
44
Pretrained parameters are not included in this repo. Users are suggested to download them through [the llama's download page](https://ai.meta.com/resources/models-and-libraries/llama-downloads/).
55

6+
# What is Llama 2?
7+
Llama is a family of large language models that uses publicly available data for training. These models are based on the transformer architecture, which allows it to process input sequences of arbitrary length and generate output sequences of variable length. One of the key features of Llama models is its ability to generate coherent and contextually relevant text. This is achieved through the use of attention mechanisms, which allow the model to focus on different parts of the input sequence as it generates output. Additionally, Llama models use a technique called “masked language modeling” to pre-train the model on a large corpus of text, which helps it learn to predict missing words in a sentence.
8+
9+
Llama models have shown to perform well on a variety of natural language processing tasks, including language translation, question answering, and text summarization and are also capable of generating human-like text, making Llama models a useful tool for creative writing and other applications where natural language generation is important.
10+
11+
Overall, Llama models are powerful and versatile language models that can be used for a wide range of natural language processing tasks. The model’s ability to generate coherent and contextually relevant text makes it particularly useful for applications such as chatbots, virtual assistants, and language translation.
12+
13+
Please note that the models are subject to the [acceptable use policy](https://github.com/facebookresearch/llama/blob/main/USE_POLICY.md) and the provided [responsible use guide](https://ai.meta.com/static-resource/responsible-use-guide/).
14+
615
# Notes
716
1. This example is to show the feasibility of exporting a Llama2 model in ExecuTorch. There is no guarantee for performance.
817
2. It's targeted to a reasonable size for edge devices. Depending on the model size, the memory usage of exporting the model can be high. TODO: improve memory usage in EXIR emitter.

0 commit comments

Comments
 (0)