[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py #6996

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Merged

facebook-github-bot merged 22 commits into gh/kimishpatel/144/base from gh/kimishpatel/144/head

Dec 5, 2024

Contributor

kimishpatel commented Nov 20, 2024 •

edited

Loading

Stack from ghstack (oldest at bottom):

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: D66269486


          [Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py

0cd2c82

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

pytorch-bot bot commented Nov 20, 2024 •

edited

Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/6996

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit bad68c7 with merge base cd306d3 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

facebook-github-bot added the CLA Signed label

Contributor

facebook-github-bot commented Nov 20, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486

facebook-github-bot added the fb-exported label

This was referenced Nov 20, 2024

[Executorch][quant] Optimize per channel dequantize #5670

Merged

Dont quantize the current token for attention #5715

Merged

[Executorch][llama] Rename update_quantized_cache to update_cache #6914

Merged

[Executorch] Add quantized kv cache to oss ci #6997

Merged

lucylq approved these changes

View reviewed changes


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

1527cdc

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 21, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

c8b2820

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 21, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

5493ae0

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 21, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

02e0608

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486

kimishpatel added the topic: not user facing label


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

91929a3

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

01dfaf1

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

863b55c

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

a2e5433

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

27dde5e

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486

kimishpatel mentioned this pull request

[Executorch][custom ops] Change lib loading logic to account for package dir #7038

Merged


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

7c6a16b

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 22, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

aed92cb

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 23, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

1248a85

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 23, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486

kimishpatel mentioned this pull request

[Executorch][CI] Fix qnn runner ci job scripts #7049

Closed


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

58518d7

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 23, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

78639d4

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 23, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

df394fd

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 27, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

a2b9b82

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 28, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

5460a5d

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Nov 29, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

1f91bde

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Dec 4, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

478978c

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Dec 4, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486


          Update on "[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_op…

bad68c7

…s.py"

Because now we have more than sdpa_with_kv_cache in it

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

[ghstack-poisoned]

Contributor

facebook-github-bot commented Dec 5, 2024

This pull request was exported from Phabricator. Differential Revision: D66269486

facebook-github-bot merged commit 5f82265 into gh/kimishpatel/144/base

40 of 43 checks passed

facebook-github-bot deleted the gh/kimishpatel/144/head branch

December 5, 2024 21:20

facebook-github-bot temporarily deployed to cherry-pick-bot

December 5, 2024 21:20

— with

GitHub Actions Inactive

pytorchbot mentioned this pull request

[Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py #7210

Merged

kimishpatel added a commit that referenced this pull request


          [Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py (#7210)

c15fab1

Pull Request resolved: #6996

Because now we have more than sdpa_with_kv_cache in it
ghstack-source-id: 256711931
@exported-using-ghexport

//oss complaining of internal lint failure, unit-test-arm broken in trunk
@bypass-github-export-checks
@exported-using-ghexport

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

Co-authored-by: Kimish Patel <[email protected]>

Jack-Khuu mentioned this pull request

Update import of sdpa_with_kv_cache to custom_ops pytorch/torchchat#1470

Merged

kedarnath03 pushed a commit to kedarnath03/executorch that referenced this pull request


          [Executorch][BE] Rename sdpa_with_kv_cache.py to custom_ops.py

68ca03c

Pull Request resolved: pytorch/executorch#6996

Because now we have more than sdpa_with_kv_cache in it
ghstack-source-id: 255055772
@exported-using-ghexport

Differential Revision: [D66269486](https://our.internmc.facebook.com/intern/diff/D66269486/)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed fb-exported topic: not user facing