Skip to content

Add buck build for static llama runner #6950

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Nov 21, 2024

Conversation

cccclai
Copy link
Contributor

@cccclai cccclai commented Nov 19, 2024

Summary:
Command to build qnn_llama3_2_runner via buck:

buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 

Differential Revision: D66107963

Copy link

pytorch-bot bot commented Nov 19, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6950

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

✅ No Failures

As of commit 8bc90cc with merge base a39ea29 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Nov 19, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

: tokenizer_path_(tokenizer_path),
temperature_(temperature),
n_bos_(1),
: n_bos_(1),
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@shewu-quic can you take a look and see if the change in the runner makes sense?

Copy link
Collaborator

@shewu-quic shewu-quic left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks!

cccclai added a commit to cccclai/executorch-1 that referenced this pull request Nov 20, 2024
Summary:

Command to build qnn_llama3_2_runner via buck: 
```
buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 
```

Differential Revision: D66107963
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

cccclai added a commit to cccclai/executorch-1 that referenced this pull request Nov 20, 2024
Summary:

Command to build qnn_llama3_2_runner via buck: 
```
buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 
```

Reviewed By: dvorjackz

Differential Revision: D66107963
cccclai added a commit to cccclai/executorch-1 that referenced this pull request Nov 20, 2024
Summary:

Command to build qnn_llama3_2_runner via buck: 
```
buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 
```

Reviewed By: dvorjackz

Differential Revision: D66107963
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

cccclai added a commit to cccclai/executorch-1 that referenced this pull request Nov 21, 2024
Summary:

Command to build qnn_llama3_2_runner via buck: 
```
buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 
```

Reviewed By: dvorjackz

Differential Revision: D66107963
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

Summary:

Command to build qnn_llama3_2_runner via buck: 
```
buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 
```

Reviewed By: dvorjackz

Differential Revision: D66107963
cccclai added a commit to cccclai/executorch-1 that referenced this pull request Nov 21, 2024
Summary:

Command to build qnn_llama3_2_runner via buck: 
```
buck build arvr/mode/android/linux/opt  //xplat/executorch/examples/qualcomm/oss_scripts/llama3_2:qnn_llama3_2_runner --out /tmp/qnn_llama3_2_runner 
```

Reviewed By: dvorjackz

Differential Revision: D66107963
@cccclai cccclai force-pushed the export-D66107963 branch 2 times, most recently from ce9a19b to 8bc90cc Compare November 21, 2024 05:24
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D66107963

@facebook-github-bot facebook-github-bot merged commit 50b4ac3 into pytorch:main Nov 21, 2024
43 of 71 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported release notes: misc Miscellaneous
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants