Skip to content

Commit 06fd058

Browse files
committed
Adding logprobs to /v1/completions
Signed-off-by: Jiri Podivin <[email protected]>
1 parent 667d728 commit 06fd058

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

examples/server/server.cpp

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -253,6 +253,7 @@ struct server_task {
253253
params.sampling.mirostat_eta = json_value(data, "mirostat_eta", defaults.sampling.mirostat_eta);
254254
params.sampling.seed = json_value(data, "seed", defaults.sampling.seed);
255255
params.sampling.n_probs = json_value(data, "n_probs", defaults.sampling.n_probs);
256+
params.sampling.n_probs = json_value(data, "logprobs", defaults.sampling.n_probs);
256257
params.sampling.min_keep = json_value(data, "min_keep", defaults.sampling.min_keep);
257258
params.post_sampling_probs = json_value(data, "post_sampling_probs", defaults.post_sampling_probs);
258259

0 commit comments

Comments
 (0)