Skip to content

make/cmake: add missing force MMQ/cuBLAS for HIP #8515

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jul 16, 2024

Conversation

JohannesGaessler
Copy link
Collaborator

On master GGML_CUDA_FORCE_MMQ and GGML_CUDA_FORCE_CUBLAS are not applied correctly when using HIP. This PR adds the missing compile definitions.

@JohannesGaessler
Copy link
Collaborator Author

Fixes #8513 .

@JohannesGaessler JohannesGaessler added the Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix label Jul 16, 2024
@JohannesGaessler JohannesGaessler merged commit 5e116e8 into ggml-org:master Jul 16, 2024
53 checks passed
arthw pushed a commit to arthw/llama.cpp that referenced this pull request Jul 27, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Review Complexity : Low Trivial changes to code that most beginner devs (or those who want a break) can tackle. e.g. UI fix
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants