Skip to content

Commit cbcd235

Browse files
ggerganovhodlen
authored andcommitted
readme : update API changes and hot topics
1 parent 786910d commit cbcd235

File tree

1 file changed

+2
-0
lines changed

1 file changed

+2
-0
lines changed

README.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -10,12 +10,14 @@ Inference of Meta's [LLaMA](https://arxiv.org/abs/2302.13971) model (and others)
1010

1111
### Recent API changes
1212

13+
- [2024 Mar 13] Add `llama_synchronize()` + `llama_context_params.n_ubatch` https://github.com/ggerganov/llama.cpp/pull/6017
1314
- [2024 Mar 8] `llama_kv_cache_seq_rm()` returns a `bool` instead of `void`, and new `llama_n_seq_max()` returns the upper limit of acceptable `seq_id` in batches (relevant when dealing with multiple sequences) https://github.com/ggerganov/llama.cpp/pull/5328
1415
- [2024 Mar 4] Embeddings API updated https://github.com/ggerganov/llama.cpp/pull/5796
1516
- [2024 Mar 3] `struct llama_context_params` https://github.com/ggerganov/llama.cpp/pull/5849
1617

1718
### Hot topics
1819

20+
- Multi-GPU pipeline parallelizm support https://github.com/ggerganov/llama.cpp/pull/6017
1921
- Looking for contributions to add Deepseek support: https://github.com/ggerganov/llama.cpp/issues/5981
2022
- Quantization blind testing: https://github.com/ggerganov/llama.cpp/discussions/5962
2123
- Initial Mamba support has been added: https://github.com/ggerganov/llama.cpp/pull/5328

0 commit comments

Comments
 (0)