Skip to content

Commit 6e7d133

Browse files
ngxsonggerganov
andauthored
server : refactor multitask handling (#9274)
* server : remove multitask from server_task * refactor completions handler * fix embeddings * use res_ok everywhere * small change for handle_slots_action * use unordered_set everywhere * (try) fix test * no more "mutable" lambda * Apply suggestions from code review Co-authored-by: Georgi Gerganov <[email protected]> * use deque --------- Co-authored-by: Georgi Gerganov <[email protected]>
1 parent b60074f commit 6e7d133

File tree

5 files changed

+352
-449
lines changed

5 files changed

+352
-449
lines changed

0 commit comments

Comments
 (0)