Introduce extension/llm/export_llm #11746

jackzhxng · 2025-06-17T02:00:45Z

Summary: Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step.

Differential Revision: D76781745

pytorch-bot · 2025-06-17T02:00:48Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11746

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 6 New Failures

As of commit 38e1edc with merge base 7bd15b9 ():

NEW FAILURES - The following jobs have failed:

Build Linux Wheels / pytorch/executorch / build-manywheel-py3_10-cpu (gh)
ModuleNotFoundError: No module named 'torchvision'
Build Linux Wheels / pytorch/executorch / upload / upload-manywheel-py3_10-cpu (gh)
Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_x86_64
Build macOS Wheels / pytorch/executorch / build-wheel-py3_10-cpu (gh)
ModuleNotFoundError: No module named 'torchvision'
Build macOS Wheels / pytorch/executorch / upload / upload-wheel-py3_10-cpu (gh)
Unable to download artifact(s): Artifact not found for name: pytorch_executorch__3.10_cpu_
pull / android / run-emulator (gh)
The process '/usr/bin/sh' failed with exit code 255
pull / unittest-editable / macos / macos-job (gh)
RuntimeError: Command bash /Users/ec2-user/runner/_work/_temp/exec_script failed with exit code 1

This comment was automatically generated by Dr. CI and updates every 15 minutes.

facebook-github-bot · 2025-06-17T02:01:09Z

This pull request was exported from Phabricator. Differential Revision: D76781745

github-actions · 2025-06-17T02:01:41Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

facebook-github-bot · 2025-06-17T02:09:22Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T02:09:26Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:00:26Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:00:33Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:08:30Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:08:38Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:14:12Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:14:20Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:22:12Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:22:19Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:29:44Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:29:51Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:40:09Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:40:18Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:44:16Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:44:29Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:49:49Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-17T20:50:01Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-18T01:12:07Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-18T01:12:15Z

This pull request was exported from Phabricator. Differential Revision: D76781745

facebook-github-bot · 2025-06-18T01:26:56Z

This pull request was exported from Phabricator. Differential Revision: D76781745

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

facebook-github-bot · 2025-06-18T01:27:07Z

This pull request was exported from Phabricator. Differential Revision: D76781745

mergennachin

Please see inline.

Attach the PRs into the issue #11527
Please add me as reviewers for future extensions/llm directory (https://github.com/pytorch/executorch/pull/11785/files)

mergennachin · 2025-06-18T14:18:18Z

extension/llm/export/export_llm.py

+
+"""
+Export an LLM with ExecuTorch. Currently follows the following steps:
+1. Instantiate our custom PyTorch transformer definition from examples/llama/models/llama_transformer.py.


Don't mention implementation details in the docblock.

If it's a public API, the docblock should contain description of the contract.

I will move this information to a README

extension/llm/export/export_llm.py

jackzhxng requested review from larryliu0820, swolchok and lucylq as code owners June 17, 2025 02:00

facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Jun 17, 2025

facebook-github-bot added the fb-exported label Jun 17, 2025

jackzhxng force-pushed the export-D76781745 branch from 26bf643 to 68c467e Compare June 17, 2025 02:09

jackzhxng force-pushed the export-D76781745 branch from 68c467e to 8833214 Compare June 17, 2025 20:00

jackzhxng force-pushed the export-D76781745 branch from 8833214 to 5122e42 Compare June 17, 2025 20:08

larryliu0820 approved these changes Jun 17, 2025

View reviewed changes

jackzhxng force-pushed the export-D76781745 branch from 5122e42 to 661bba9 Compare June 17, 2025 20:14

jackzhxng force-pushed the export-D76781745 branch from 661bba9 to e091538 Compare June 17, 2025 20:22

jackzhxng force-pushed the export-D76781745 branch from e091538 to 6e74c8c Compare June 17, 2025 20:29

jackzhxng force-pushed the export-D76781745 branch from 6e74c8c to 7d1b94c Compare June 17, 2025 20:40

jackzhxng force-pushed the export-D76781745 branch from 7d1b94c to aac60e2 Compare June 17, 2025 20:44

jackzhxng force-pushed the export-D76781745 branch from aac60e2 to 4de4916 Compare June 17, 2025 20:50

jackzhxng force-pushed the export-D76781745 branch from 4de4916 to 327d41a Compare June 18, 2025 01:12

Introduce extension/llm/export_llm (pytorch#11746)

38e1edc

Summary: Pull Request resolved: pytorch#11746 Introduces frontend of export_llm in extension/llm, while keeping most of the code still in examples/models/llama as a first step. Reviewed By: larryliu0820 Differential Revision: D76781745

jackzhxng force-pushed the export-D76781745 branch from 327d41a to 38e1edc Compare June 18, 2025 01:27

facebook-github-bot merged commit 44d2643 into pytorch:main Jun 18, 2025
96 of 104 checks passed

mergennachin self-requested a review June 18, 2025 14:16

mergennachin reviewed Jun 18, 2025

View reviewed changes

jackzhxng linked an issue Jun 18, 2025 that may be closed by this pull request

Introduce export_llama to extension/llm as export_llm #11527

Open

Introduce extension/llm/export_llm #11746

Introduce extension/llm/export_llm #11746

Uh oh!

Conversation

jackzhxng commented Jun 17, 2025

Uh oh!

pytorch-bot bot commented Jun 17, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11746

❌ 6 New Failures

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

github-actions bot commented Jun 17, 2025

This PR needs a release notes: label

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 17, 2025

Uh oh!

facebook-github-bot commented Jun 18, 2025

Uh oh!

facebook-github-bot commented Jun 18, 2025

Uh oh!

facebook-github-bot commented Jun 18, 2025

Uh oh!

facebook-github-bot commented Jun 18, 2025

Uh oh!

Uh oh!

mergennachin left a comment

Choose a reason for hiding this comment

Uh oh!

mergennachin Jun 18, 2025

Choose a reason for hiding this comment

Uh oh!

jackzhxng Jun 18, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

pytorch-bot bot commented Jun 17, 2025 •

edited

Loading

This PR needs a `release notes:` label

jackzhxng Jun 18, 2025 •

edited

Loading