Skip to content

[Bug] ChainOfThoughtWithHint is broken (at least for Azure) #8205

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
chrico-bu-uab opened this issue May 11, 2025 · 3 comments
Open

[Bug] ChainOfThoughtWithHint is broken (at least for Azure) #8205

chrico-bu-uab opened this issue May 11, 2025 · 3 comments
Labels
bug Something isn't working

Comments

@chrico-bu-uab
Copy link

What happened?

WARNING dspy.adapters.json_adapter: Failed to use structured output format. Falling back to JSON mode. Error: litellm.BadRequestError: AzureException BadRequestError - Unknown parameter: 'rationale_type'.

Steps to reproduce

any signature should reproduce the error

DSPy version

2.6.23

@chrico-bu-uab chrico-bu-uab added the bug Something isn't working label May 11, 2025
@Ankit3794
Copy link

failing for direct OpenAI call also

Original error: litellm.BadRequestError: OpenAIException - Unrecognized request argument supplied: rationale_type.

@ManuelRios18
Copy link

Same problem!

Have you guys any updates on this?

@rafsid
Copy link

rafsid commented May 23, 2025

use dspy==2.6.19. I was using the latest and i kept on downgrading one version at a time.

it looks like downgrading dspy to 2.6.19 (which also brought in older versions of litellm and openai) resolved the compatibility issues you were facing with the Gemini API and structured output.
It's not uncommon for rapid developments in libraries like DSPy and LiteLLM, and changes in how they interact with various model provider APIs, to sometimes lead to temporary incompatibilities or require specific version combinations to work smoothly, especially with newer or preview models.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

4 participants