Skip to content

Commit 55ad42a

Browse files
committed
Move chat scripts into "./examples"
1 parent 459e93c commit 55ad42a

File tree

4 files changed

+13
-2
lines changed

4 files changed

+13
-2
lines changed

README.md

Lines changed: 5 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -179,7 +179,10 @@ Here is an example few-shot interaction, invoked with the command
179179

180180
```bash
181181
# default arguments using 7B model
182-
./chat.sh
182+
./examples/chat.sh
183+
184+
# advanced chat with 13B model
185+
./examples/chat-13B.sh
183186

184187
# custom arguments using 13B model
185188
./main -m ./models/13B/ggml-model-q4_0.bin -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt
@@ -195,7 +198,7 @@ Note the use of `--color` to distinguish between user input and generated text.
195198
2. Run the `main` tool like this:
196199

197200
```
198-
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins
201+
./examples/alpaca.sh
199202
```
200203

201204
Sample run:
Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,10 @@
11
#!/bin/bash
2+
23
#
34
# Temporary script - will be removed in the future
45
#
56

7+
cd `dirname $0`
8+
cd ..
9+
610
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7
File renamed without changes.
Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,10 @@
11
#!/bin/bash
2+
23
#
34
# Temporary script - will be removed in the future
45
#
56

7+
cd `dirname $0`
8+
cd ..
9+
610
./main -m ./models/7B/ggml-model-q4_0.bin -b 128 -n 256 --repeat_penalty 1.0 --color -i -r "User:" -f prompts/chat-with-bob.txt

0 commit comments

Comments
 (0)