File tree Expand file tree Collapse file tree 1 file changed +6
-5
lines changed Expand file tree Collapse file tree 1 file changed +6
-5
lines changed Original file line number Diff line number Diff line change @@ -102,7 +102,7 @@ jobs:
102
102
--branch ${{ github.head_ref || github.ref_name }} \
103
103
--commit ${{ github.sha }} \
104
104
--scenario script.js \
105
- --duration 1m \
105
+ --duration 10m \
106
106
--hf-repo ggml-org/models \
107
107
--hf-file phi-2/ggml-model-q4_0.gguf \
108
108
--model-path-prefix /models \
@@ -186,14 +186,15 @@ jobs:
186
186
message : |
187
187
📈 **llama.cpp server** benchmark for _${{ github.job }}_ on _${{ env.RUNNER_LABEL }}_: **${{ env.BENCH_ITERATIONS}} iterations** 🚀
188
188
189
- - ${{ env.BENCH_GRAPH_TITLE }}
190
189
- ${{ env.BENCH_GRAPH_XLABEL }}
191
-
190
+ - req_avg=${{ env.HTTP_REQ_DURATION_AVG }} pp_avg=${{ env.LLAMACPP_PROMPT_TOKENS_AVG }} tks_avg=${{ env.LLAMACPP_TOKENS_SECOND_AVG }}
191
+
192
+
192
193
<p align="center">
193
194
<img width="100%" height="100%" src="${{ fromJSON(steps.imgur_step.outputs.imgur_urls)[0] }}" alt="prompt_tokens_seconds" />
194
195
195
196
<details>
196
- <summary>Mermaid </summary>
197
+ <summary>More </summary>
197
198
198
199
```mermaid
199
200
${{ env.PROMPT_TOKENS_SECONDS }}
@@ -214,7 +215,7 @@ jobs:
214
215
215
216
</p>
216
217
<details>
217
- <summary>More </summary>
218
+ <summary>Details </summary>
218
219
<p align="center">
219
220
<img width="100%" height="100%" src="${{ fromJSON(steps.imgur_step.outputs.imgur_urls)[2] }}" alt="kv_cache_usage_ratio" />
220
221
You can’t perform that action at this time.
0 commit comments