Skip to content

arg : add --no-mmproj-offload #13093

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Apr 24, 2025
Merged

Conversation

ngxson
Copy link
Collaborator

@ngxson ngxson commented Apr 24, 2025

Add --no-mmproj-offload to allow running mmproj on CPU, while text model can run on GPU. Useful for debugging

@ngxson ngxson requested a review from ggerganov April 24, 2025 08:30
@ngxson ngxson merged commit 7c727fb into ggml-org:master Apr 24, 2025
48 checks passed
@ngxson ngxson mentioned this pull request Apr 25, 2025
8 tasks
pockers21 pushed a commit to pockers21/llama.cpp that referenced this pull request Apr 28, 2025
* arg : add --no-mmproj-offload

* Update common/arg.cpp
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants