Skip to content

Commit c28a839

Browse files
authored
examples : remove --instruct remnants (ggml-org#7846)
1 parent d9da0e4 commit c28a839

File tree

5 files changed

+0
-99
lines changed

5 files changed

+0
-99
lines changed

README.md

Lines changed: 0 additions & 29 deletions
Original file line numberDiff line numberDiff line change
@@ -53,7 +53,6 @@ Inference of Meta's [LLaMA](https://arxiv.org/abs/2302.13971) model (and others)
5353
<li><a href="#quantization">Quantization</a></li>
5454
<li><a href="#interactive-mode">Interactive mode</a></li>
5555
<li><a href="#constrained-output-with-grammars">Constrained output with grammars</a></li>
56-
<li><a href="#instruct-mode">Instruct mode</a></li>
5756
<li><a href="#obtaining-and-using-the-facebook-llama-2-model">Obtaining and using the Facebook LLaMA 2 model</a></li>
5857
<li><a href="#seminal-papers-and-background-on-the-models">Seminal papers and background on the models</a></li>
5958
<li><a href="#perplexity-measuring-model-quality">Perplexity (measuring model quality)</a></li>
@@ -769,34 +768,6 @@ The `grammars/` folder contains a handful of sample grammars. To write your own,
769768

770769
For authoring more complex JSON grammars, you can also check out https://grammar.intrinsiclabs.ai/, a browser app that lets you write TypeScript interfaces which it compiles to GBNF grammars that you can save for local use. Note that the app is built and maintained by members of the community, please file any issues or FRs on [its repo](http://github.com/intrinsiclabsai/gbnfgen) and not this one.
771770

772-
### Instruct mode
773-
774-
1. First, download and place the `ggml` model into the `./models` folder
775-
2. Run the `main` tool like this:
776-
777-
```
778-
./examples/alpaca.sh
779-
```
780-
781-
Sample run:
782-
783-
```
784-
== Running in interactive mode. ==
785-
- Press Ctrl+C to interject at any time.
786-
- Press Return to return control to LLaMA.
787-
- If you want to submit another line, end your input in '\'.
788-
789-
Below is an instruction that describes a task. Write a response that appropriately completes the request.
790-
791-
> How many letters are there in the English alphabet?
792-
There 26 letters in the English Alphabet
793-
> What is the most common way of transportation in Amsterdam?
794-
The majority (54%) are using public transit. This includes buses, trams and metros with over 100 lines throughout the city which make it very accessible for tourists to navigate around town as well as locals who commute by tram or metro on a daily basis
795-
> List 5 words that start with "ca".
796-
cadaver, cauliflower, cabbage (vegetable), catalpa (tree) and Cailleach.
797-
>
798-
```
799-
800771
### Obtaining and using the Facebook LLaMA 2 model
801772

802773
- Refer to [Facebook's LLaMA download page](https://ai.meta.com/resources/models-and-libraries/llama-downloads/) if you want to access the model data.

examples/alpaca.sh

Lines changed: 0 additions & 19 deletions
This file was deleted.

examples/gpt4all.sh

Lines changed: 0 additions & 15 deletions
This file was deleted.

examples/llama2-13b.sh

Lines changed: 0 additions & 18 deletions
This file was deleted.

examples/llama2.sh

Lines changed: 0 additions & 18 deletions
This file was deleted.

0 commit comments

Comments
 (0)