Skip to content

Commit 3f40aec

Browse files
author
ochafik
committed
Update function-calling.md
1 parent c74226e commit 3f40aec

File tree

1 file changed

+10
-4
lines changed

1 file changed

+10
-4
lines changed

docs/function-calling.md

Lines changed: 10 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -12,11 +12,12 @@ Function calling is supported for all models (see https://github.com/ggml-org/ll
1212
- Llama 3.1 / 3.3 (including builtin tools support - tool names for `wolfram_alpha`, `web_search` / `brave_search`, `code_interpreter`), Llama 3.2
1313
- Functionary v3.1 / v3.2
1414
- Hermes 2/3, Qwen 2.5
15-
- Qwen 2.5 Coder (WIP: https://github.com/ggml-org/llama.cpp/pull/12034)
15+
- Qwen 2.5 Coder (#12034)
1616
- Mistral Nemo
1717
- Firefunction v2
18-
- Command R7B
19-
- DeepSeek R1 (WIP / seems reluctant to call any tools?)
18+
- Command R7B (#11585)
19+
- DeepSeek R1 (#11607)
20+
- Phi 4 (#12288)
2021

2122
- Generic tool call is supported when the template isn't recognized by native format handlers (you'll see `Chat format: Generic` in the logs).
2223
- Use `--chat-template-file` to override the template when appropriate (see examples below)
@@ -297,9 +298,14 @@ llama-server --jinja -fa -hf bartowski/DeepSeek-R1-Distill-Qwen-7B-GGUF:Q6_K_L \
297298
llama-server --jinja -fa -hf bartowski/DeepSeek-R1-Distill-Qwen-32B-GGUF:Q4_K_M \
298299
--chat-template-file models/templates/llama-cpp-deepseek-r1.jinja
299300

301+
# Native support for Phi 4 also needs a template override (official template is buggy)
302+
303+
llama-server --jinja -fa -hf bartowski/microsoft_Phi-4-mini-instruct-GGUF \
304+
--chat-template-file models/templates/llama-cpp-microsoft-Phi-4-mini-instruct.jinja
305+
300306
# Native support requires the right template for these GGUFs:
301307

302-
llama-server --jinja -fa -hf bartowski/functionary-small-v3.2-GGUF:Q4_K_M
308+
llama-server --jinja -fa -hf bartowski/functionary-small-v3.2-GGUF:Q4_K_M \
303309
--chat-template-file models/templates/meetkai-functionary-medium-v3.2.jinja
304310

305311
llama-server --jinja -fa -hf bartowski/Hermes-2-Pro-Llama-3-8B-GGUF:Q4_K_M \

0 commit comments

Comments
 (0)