Skip to content

Lower phi3 mini with LoRA to edge for training #4722

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Aug 19, 2024

Conversation

jackzhxng
Copy link
Contributor

Exports phi3-mini with LoRA for training. The process involves AOT Autograd tracing a backward graphs which is combined with the forward into a joint graph, which is then finally lowered to Executorch.

Copy link

pytorch-bot bot commented Aug 15, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/4722

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 2876c00 with merge base c6347f3 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Aug 15, 2024
@facebook-github-bot
Copy link
Contributor

@dvorjackz has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

1 similar comment
@facebook-github-bot
Copy link
Contributor

@dvorjackz has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot pushed a commit that referenced this pull request Aug 16, 2024
Summary:
Exports phi3-mini with LoRA for training. The process involves AOT Autograd tracing a backward graphs which is combined with the forward into a joint graph, which is then finally lowered to Executorch.


Differential Revision: D61309917

Pulled By: dvorjackz
@facebook-github-bot facebook-github-bot force-pushed the jackz/export-phi3-lora-training branch from 01974e0 to 4bab1f2 Compare August 16, 2024 19:28
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61309917

jackzhxng added a commit that referenced this pull request Aug 16, 2024
Summary:
Exports phi3-mini with LoRA for training. The process involves AOT Autograd tracing a backward graphs which is combined with the forward into a joint graph, which is then finally lowered to Executorch.

Differential Revision: D61309917

Pulled By: dvorjackz
@jackzhxng jackzhxng force-pushed the jackz/export-phi3-lora-training branch from 4bab1f2 to 94ed14a Compare August 16, 2024 20:27
@facebook-github-bot
Copy link
Contributor

@dvorjackz has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

@jackzhxng jackzhxng force-pushed the jackz/export-phi3-lora-training branch from 94ed14a to 9914eef Compare August 16, 2024 21:15
jackzhxng added a commit that referenced this pull request Aug 16, 2024
Summary:
Exports phi3-mini with LoRA for training. The process involves AOT Autograd tracing a backward graphs which is combined with the forward into a joint graph, which is then finally lowered to Executorch.

Differential Revision: D61309917

Pulled By: dvorjackz
@facebook-github-bot
Copy link
Contributor

@dvorjackz has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

facebook-github-bot pushed a commit that referenced this pull request Aug 19, 2024
Summary:
Exports phi3-mini with LoRA for training. The process involves AOT Autograd tracing a backward graphs which is combined with the forward into a joint graph, which is then finally lowered to Executorch.


Reviewed By: helunwencser

Differential Revision: D61309917

Pulled By: dvorjackz
@facebook-github-bot facebook-github-bot force-pushed the jackz/export-phi3-lora-training branch from 9914eef to be32a62 Compare August 19, 2024 17:57
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61309917

Summary:
Exports phi3-mini with LoRA for training. The process involves AOT Autograd tracing a backward graphs which is combined with the forward into a joint graph, which is then finally lowered to Executorch.


Reviewed By: helunwencser

Differential Revision: D61309917

Pulled By: dvorjackz
@facebook-github-bot facebook-github-bot force-pushed the jackz/export-phi3-lora-training branch from be32a62 to 2876c00 Compare August 19, 2024 21:15
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D61309917

@facebook-github-bot facebook-github-bot merged commit d3da92d into main Aug 19, 2024
35 of 37 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants