Skip to content

Commit 1cc0155

Browse files
authored
server : tuning tests (#7388)
* server : don't pass temperature as string * server : increase timeout * tests : fix the fix 0.8f -> 0.8 ggml-ci * tests : set explicit temperature
1 parent e932094 commit 1cc0155

File tree

2 files changed

+4
-2
lines changed

2 files changed

+4
-2
lines changed

examples/server/tests/features/results.feature

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@ Feature: Results
1313

1414
Scenario Outline: consistent results with same seed
1515
Given <n_slots> slots
16+
And 0.0 temperature
1617
Then the server is starting
1718
Then the server is healthy
1819

@@ -30,6 +31,7 @@ Feature: Results
3031

3132
Scenario Outline: different results with different seed
3233
Given <n_slots> slots
34+
And 1.0 temperature
3335
Then the server is starting
3436
Then the server is healthy
3537

examples/server/tests/features/steps/steps.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -199,7 +199,7 @@ async def step_wait_for_the_server_to_be_started(context, expecting_status):
199199

200200
case 'ready' | 'idle':
201201
await wait_for_health_status(context, context.base_url, 200, 'ok',
202-
timeout=10,
202+
timeout=30,
203203
params={'fail_on_no_slot': 0, 'include_slots': 0},
204204
slots_idle=context.n_slots,
205205
slots_processing=0,
@@ -883,7 +883,7 @@ async def request_completion(prompt,
883883
"cache_prompt": cache_prompt,
884884
"id_slot": id_slot,
885885
"seed": seed if seed is not None else 42,
886-
"temperature": temperature if temperature is not None else "0.8f",
886+
"temperature": temperature if temperature is not None else 0.8,
887887
"n_probs": 2,
888888
},
889889
headers=headers,

0 commit comments

Comments
 (0)