Skip to content

Add fuse_dq_q_pass in exir/passes and also add it to HTP backend #2295

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

tarun292
Copy link
Contributor

@tarun292 tarun292 commented Mar 7, 2024

Summary:
There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Differential Revision: D54543323

Copy link

pytorch-bot bot commented Mar 7, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/2295

Note: Links to docs will display an error until the docs builds have been completed.

✅ You can merge normally! (2 Unrelated Failures)

As of commit 1a5f23d with merge base 091e524 (image):

FLAKY - The following job failed but was likely due to flakiness present on trunk:

BROKEN TRUNK - The following job failed but was present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 7, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

tarun292 added a commit that referenced this pull request Mar 7, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

facebook-github-bot pushed a commit that referenced this pull request Mar 13, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Differential Revision: D54543323
tarun292 added a commit that referenced this pull request Mar 13, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

tarun292 added a commit that referenced this pull request Mar 18, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

facebook-github-bot pushed a commit that referenced this pull request Mar 18, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
facebook-github-bot pushed a commit that referenced this pull request Mar 29, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

1 similar comment
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

tarun292 added a commit that referenced this pull request Mar 29, 2024
Summary:
Pull Request resolved: #2295

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
facebook-github-bot pushed a commit that referenced this pull request Apr 1, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

tarun292 added a commit that referenced this pull request Apr 1, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

facebook-github-bot pushed a commit that referenced this pull request Apr 1, 2024
Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

Summary:

There are passes such as these https://fburl.com/code/vs6n4vcv that remove noops from the graph. The problem is that after this pass runs it still leaves in the dq->q nodes in the graph which then potentially get delegated to the backend causing perf regressions.

This pass will remove the dq->q ops if their qparams are of the same value. If not it won't touch them.

Reviewed By: kimishpatel

Differential Revision: D54543323
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D54543323

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in 24477df.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants