File tree Expand file tree Collapse file tree 1 file changed +6
-6
lines changed
examples/server/tests/features Expand file tree Collapse file tree 1 file changed +6
-6
lines changed Original file line number Diff line number Diff line change @@ -35,9 +35,9 @@ Feature: llama.cpp server
35
35
And metric llamacpp:tokens_predicted is <n_predicted>
36
36
37
37
Examples : Prompts
38
- | prompt | n_predict | re_content | n_prompt | n_predicted | truncated |
39
- | I believe the meaning of life is | 8 | (read \|going )+ | 18 | 8 | not |
40
- | Write a joke about AI from a very long prompt which will not be truncated | 256 | (princesses \|everyone \|kids \|Anna )+ | 46 | 64 | not |
38
+ | prompt | n_predict | re_content | n_prompt | n_predicted | truncated |
39
+ | I believe the meaning of life is | 8 | (read \|going )+ | 18 | 8 | not |
40
+ | Write a joke about AI from a very long prompt which will not be truncated | 256 | (princesses \|everyone \|kids \|Anna \| forest )+ | 46 | 64 | not |
41
41
42
42
Scenario : Completion prompt truncated
43
43
Given a prompt:
@@ -65,9 +65,9 @@ Feature: llama.cpp server
65
65
And the completion is <truncated> truncated
66
66
67
67
Examples : Prompts
68
- | model | system_prompt | user_prompt | max_tokens | re_content | n_prompt | n_predicted | enable_streaming | truncated |
69
- | llama -2 | Book | What is the best book | 8 | (Here \|what )+ | 77 | 8 | disabled | not |
70
- | codellama70b | You are a coding assistant . | Write the fibonacci function in c ++. | 128 | (thanks \|happy \|bird )+ | -1 | 64 | enabled | |
68
+ | model | system_prompt | user_prompt | max_tokens | re_content | n_prompt | n_predicted | enable_streaming | truncated |
69
+ | llama -2 | Book | What is the best book | 8 | (Here \|what )+ | 77 | 8 | disabled | not |
70
+ | codellama70b | You are a coding assistant . | Write the fibonacci function in c ++. | 128 | (thanks \|happy \|bird \| Annabyear )+ | -1 | 64 | enabled | |
71
71
72
72
73
73
Scenario : Tokenize / Detokenize
You can’t perform that action at this time.
0 commit comments