Skip to content

Commit 43dfd74

Browse files
authored
llguidance : set tokenizer slices to default (#13424)
1 parent b064a51 commit 43dfd74

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

common/llguidance.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -189,6 +189,7 @@ static LlgTokenizer * llama_sampler_llg_new_tokenizer(const llama_vocab * vocab)
189189
/* .tokenize_fn = */ llama_sampler_llg_tokenize_fn,
190190
/* .use_approximate_greedy_tokenize_fn = */ false,
191191
/* .tokenize_user_data = */ vocab,
192+
/* .slices = */ nullptr,
192193
};
193194

194195
char error_buffer[1024];

0 commit comments

Comments
 (0)