-
Notifications
You must be signed in to change notification settings - Fork 608
[llava] Expose prefill image and prompt APIs #5119
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/5119
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 New FailureAs of commit f582259 with merge base 89829b5 ( NEW FAILURE - The following job has failed:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
Summary: We want to expose prefill_images() and prefill_prompt() for Llava runner. These APIs will be called by JNI/Demo app so that we can prefill asynchronously. Test Plan: Reviewers: Subscribers: Tasks: Tags:
8929100
to
296e99f
Compare
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
Summary: Test Plan: Reviewers: Subscribers: Tasks: Tags:
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
Summary: Test Plan: Reviewers: Subscribers: Tasks: Tags:
@larryliu0820 has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator. |
Summary: We want to expose prefill_images() and prefill_prompt() for Llava runner. These APIs will be called by JNI/Demo app so that we can prefill asynchronously.
Test Plan:
Reviewers:
Subscribers:
Tasks:
Tags: