Skip to content

Commit e9a9cb0

Browse files
authored
examples : Improve Alpaca Default Repeat Penalty: Better Match Alpaca.cpp Experience (#1107)
* Moving parameters to separate lines for readability. * Increasing repeate_penalty to 1.1 to make alpaca more usable by default. * Adding trailing newline.
1 parent b6e7f9b commit e9a9cb0

File tree

1 file changed

+10
-1
lines changed

1 file changed

+10
-1
lines changed

examples/alpaca.sh

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -7,4 +7,13 @@
77
cd `dirname $0`
88
cd ..
99

10-
./main -m ./models/ggml-alpaca-7b-q4.bin --color -f ./prompts/alpaca.txt --ctx_size 2048 -n -1 -ins -b 256 --top_k 10000 --temp 0.2 --repeat_penalty 1 -t 7
10+
./main -m ./models/ggml-alpaca-7b-q4.bin \
11+
--color \
12+
-f ./prompts/alpaca.txt \
13+
--ctx_size 2048 \
14+
-n -1 \
15+
-ins -b 256 \
16+
--top_k 10000 \
17+
--temp 0.2 \
18+
--repeat_penalty 1.1 \
19+
-t 7

0 commit comments

Comments
 (0)