Skip to content

Commit 19ef7e2

Browse files
author
“Vivek
committed
[LMI-V7] minor fixes
1 parent a09ee0b commit 19ef7e2

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

inference/generativeai/llm-workshop/deploy-V7-lmi/llama2_70b_lmi_v7.ipynb

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -242,9 +242,9 @@
242242
"%%writefile ./code_llama2/serving.properties\n",
243243
"engine = MPI\n",
244244
"option.model_id = {{s3url}}\n",
245-
"option.task = text - generation\n",
245+
"option.task = text-generation\n",
246246
"option.tensor_parallel_degree = 8\n",
247-
"option.rolling_batch = lmi - dist\n",
247+
"option.rolling_batch = lmi-dist\n",
248248
"option.output_formatter = json\n",
249249
"option.max_rolling_batch_size = 64\n",
250250
"option.model_loading_timeout = 3600"

0 commit comments

Comments
 (0)