Skip to content

[ET-VK] Changing all conv 2d pw ints from uint16 to int since it slightly improves perf. #7566

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 4 commits into from
Jan 9, 2025

Conversation

pytorchbot
Copy link
Collaborator

This PR was created by the merge bot to help merge the original PR into the main branch.
ghstack PR number: #7545
^ Please use this as the source of truth for the PR details, comments, and reviews
ghstack PR base: https://github.com/pytorch/executorch/tree/gh/trivedivivek/39/base
ghstack PR head: https://github.com/pytorch/executorch/tree/gh/trivedivivek/39/head
Merge bot PR base: https://github.com/pytorch/executorch/tree/gh/trivedivivek/38/orig
Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/trivedivivek/39/orig
@diff-train-skip-merge

…ion based on unique index.

Pull Request resolved: #7522

This diff adds an indexing utils header file used in Vulkan backend of Executorch. The header file includes functions for converting a global index to u16 indices based on input sizes.
ghstack-source-id: 260707858
@exported-using-ghexport

Differential Revision: [D67821941](https://our.internmc.facebook.com/intern/diff/D67821941/)
Copy link

pytorch-bot bot commented Jan 9, 2025

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/7566

Note: Links to docs will display an error until the docs builds have been completed.

❗ 1 Active SEVs

There are 1 currently active SEVs. If your PR is affected, please view them below:

❌ 1 New Failure

As of commit dacd711 with merge base c7098ca (image):

NEW FAILURE - The following job has failed:

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jan 9, 2025
…ing input texel for reuse.

Pull Request resolved: #7526

This diff adds batch processing in the x axis to the conv2d dw shader by reusing input texel overlapping between consecutive tiles. The changes include modifying the glsl code for the conv2d dw output tile, adding a new parameter to the yaml file, and modifying the Convolution.cpp file to use the new parameter.
ghstack-source-id: 260707856

Differential Revision: [D67868671](https://our.internmc.facebook.com/intern/diff/D67868671/)
…htly improves perf.

Pull Request resolved: #7545

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.
ghstack-source-id: 260707857

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)
@trivedivivek trivedivivek force-pushed the gh/trivedivivek/39/orig branch from 789021d to fc2653b Compare January 9, 2025 16:27
@trivedivivek trivedivivek force-pushed the gh/trivedivivek/38/orig branch from e1ce954 to 4a4dab5 Compare January 9, 2025 16:27
Base automatically changed from gh/trivedivivek/38/orig to main January 9, 2025 19:29
@trivedivivek trivedivivek merged commit b63d9fa into main Jan 9, 2025
43 of 44 checks passed
@trivedivivek trivedivivek deleted the gh/trivedivivek/39/orig branch January 9, 2025 20:59
@lucylq lucylq mentioned this pull request Jan 15, 2025
YIWENX14 pushed a commit that referenced this pull request Jan 28, 2025
…htly improves perf. (#7566)

* [ET-VK] Adding a common utility function to calculate 3d output position based on unique index.

Pull Request resolved: #7522

This diff adds an indexing utils header file used in Vulkan backend of Executorch. The header file includes functions for converting a global index to u16 indices based on input sizes.
ghstack-source-id: 260707858
@exported-using-ghexport

Differential Revision: [D67821941](https://our.internmc.facebook.com/intern/diff/D67821941/)

* [ET-VK] Adding batch processing in x axis to conv2d dw shader by caching input texel for reuse.

Pull Request resolved: #7526

This diff adds batch processing in the x axis to the conv2d dw shader by reusing input texel overlapping between consecutive tiles. The changes include modifying the glsl code for the conv2d dw output tile, adding a new parameter to the yaml file, and modifying the Convolution.cpp file to use the new parameter.
ghstack-source-id: 260707856

Differential Revision: [D67868671](https://our.internmc.facebook.com/intern/diff/D67868671/)

* [ET-VK] Changing all conv 2d pw ints from uint16 to int since it slightly improves perf.

Pull Request resolved: #7545

This diff changes all integers in conv 2d pw op shader from uint16 to int in the Vulkan backend of Executorch. The change is made to improve performance since the shader does not appear to be register bound.
ghstack-source-id: 260707857

Differential Revision: [D67906023](https://our.internmc.facebook.com/intern/diff/D67906023/)

---------

Co-authored-by: Vivek Trivedi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. topic: not user facing
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants