Skip to content

Commit 164e34e

Browse files
committed
update tokenizer_model name
1 parent 4ce6630 commit 164e34e

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

convert_hf_to_gguf.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5054,7 +5054,7 @@ def set_vocab(self):
50545054
toktypes.append(gguf.TokenType.NORMAL)
50555055
tokens.append(token)
50565056

5057-
self.gguf_writer.add_tokenizer_model("gpt2")
5057+
self.gguf_writer.add_tokenizer_model("llama")
50585058
self.gguf_writer.add_tokenizer_pre(tokpre)
50595059
self.gguf_writer.add_token_list(tokens)
50605060
self.gguf_writer.add_token_types(toktypes)

0 commit comments

Comments
 (0)