Skip to content

The beam search and llama_token_get_type related functions have #1514

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

AdolfVonKleist
Copy link

recently been removed from llama.cpp and are no longer present in the latest commit (f83351f9a62a6262f1fc3d08f320033089cddfb5) This causes llama-cpp-python import to fail due to missing symbols. This commit removes the stale references from llama-cpp-python.

without these changes, llama_cpp generates the following symbol lookup errors on import:

libllama.so: undefined symbol: llama_beam_search
libllama.so: undefined symbol: llama_token_get_type. Did you mean: 'llama_token_get_text'?

these deletions eliminate the symbol lookup errors.

recently been removed from llama.cpp and are no longer present
in the latest commit (f83351f9a62a6262f1fc3d08f320033089cddfb5)
This causes llama-cpp-python import to fail due to missing symbols.
This commit removes the stale references from llama-cpp-python.
@AdolfVonKleist
Copy link
Author

AdolfVonKleist commented Jun 7, 2024

The specific pull request where llama_beam_search was removed from llama.cpp, for reference:

@abetlen
Copy link
Owner

abetlen commented Jun 13, 2024

Thank you for the PR, the functions have been removed on main.

@abetlen abetlen closed this Jun 13, 2024
@AdolfVonKleist AdolfVonKleist deleted the no_beam_no_ttype branch June 13, 2024 11:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants