Skip to content

Commit 8dad318

Browse files
msy-katoarthw
authored andcommitted
batched: fix n_predict parameter (ggml-org#8527)
1 parent 050ba94 commit 8dad318

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

examples/batched/batched.cpp

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -31,7 +31,7 @@ int main(int argc, char ** argv) {
3131
int n_parallel = params.n_parallel;
3232

3333
// total length of the sequences including the prompt
34-
int n_predict = 32;
34+
int n_predict = params.n_predict;
3535

3636
// init LLM
3737

0 commit comments

Comments
 (0)