Skip to content

Commit 0e97cdf

Browse files
ochafikggerganov
authored andcommitted
sampler: fixes trigger tokens + lazy grammars (fix typo cast from token to string) (ggml-org#12291)
* Fix typo in lazy grammar handling (fixes trigger tokens) Co-authored-by: Georgi Gerganov <[email protected]> --------- Co-authored-by: Georgi Gerganov <[email protected]>
1 parent 4d6c24d commit 0e97cdf

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/server/server.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -386,7 +386,7 @@ struct server_task {
386386
trigger.type = COMMON_GRAMMAR_TRIGGER_TYPE_TOKEN;
387387
trigger.value = word;
388388
trigger.token = token;
389-
params.sampling.grammar_triggers.push_back(trigger);
389+
params.sampling.grammar_triggers.push_back(std::move(trigger));
390390
} else {
391391
SRV_DBG("Grammar trigger word: `%s`\n", word.c_str());
392392
params.sampling.grammar_triggers.push_back({COMMON_GRAMMAR_TRIGGER_TYPE_WORD, word});

0 commit comments

Comments
 (0)