Skip to content

Commit 98595e2

Browse files
authored
add shell vars for tokenizer path (#413)
add shell vars for tokenizer path to fix run-tinystories CI failures
1 parent 8b35acd commit 98595e2

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

.github/workflows/et-gguf.yml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -86,6 +86,10 @@ jobs:
8686
- name: Run inference
8787
run: |
8888
export MODEL_DIR=/tmp
89+
export GGUF_PATH=${PWD}/gguf_files/llama-2-7b.Q4_0.gguf
90+
export TOKENIZER_PATH=${PWD}/gguf_files/tokenizer.model
91+
export MODEL_NAME=llama-2-7b_Q4_0_gguf
92+
8993
python export.py --tokenizer-path ${TOKENIZER_PATH} --gguf-path ${GGUF_PATH} --output-pte-path ${MODEL_DIR}/${MODEL_NAME}.pte
9094
python generate.py --tokenizer-path ${TOKENIZER_PATH} --gguf-path ${GGUF_PATH} --temperature 0 --pte-path ${MODEL_DIR}/${MODEL_NAME}.pte > ./output_et
9195
cat ./output_et

0 commit comments

Comments
 (0)