Skip to content

Add gqa parameter support to the server #2351

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jul 23, 2023
Merged

Conversation

IgnacioFDM
Copy link
Contributor

@IgnacioFDM IgnacioFDM commented Jul 23, 2023

Add gqa parameter support to the server
Also change help to stdout to follow #2338

@SlyEcho SlyEcho merged commit 4f06592 into ggml-org:master Jul 23, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants