-
|
How to connect the LLM using Azure endpoints? |
Beta Was this translation helpful? Give feedback.
Replies: 1 comment
-
|
@rwang1987 responded in #73, but also writing here for others' benefit! It's very similar to the Ollama example: Simply specify the base_url to be your Azure model deployment URL. Should be something like Everything else stays exactly the same. Please let me know if you run into any issues! Also, if you get it working, please contribute an example to the repo for others to benefit! |
Beta Was this translation helpful? Give feedback.
@rwang1987 responded in #73, but also writing here for others' benefit!
It's very similar to the Ollama example:
https://github.com/lastmile-ai/mcp-agent/blob/main/examples/mcp_basic_ollama_agent/mcp_agent.config.yaml#L24-L25
Simply specify the base_url to be your Azure model deployment URL. Should be something like
https://${azure_resource}.openai.azure.com/openai/deployments/{model_name},and specify api_key to be the corresponding API key.
Everything else stays exactly the same.
Please let me know if you run into any issues! Also, if you get it working, please contribute an example to the repo for others to benefit!