Skip to content

Skip one op for coreml partitioner #2826

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 1 commit into from

Conversation

cccclai
Copy link
Contributor

@cccclai cccclai commented Apr 3, 2024

Summary:
There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now

"aten.index_put.default"

test with

python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache

also test the stories-llama model

python3 -m examples.models.llama2.export_llama -kv --coreml --checkpoint /Users/chenlai/Documents/stories110M/stories110M.pt  --params /Users/chenlai/Documents/stories110M/params.json

Differential Revision: D55680297

Copy link

pytorch-bot bot commented Apr 3, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/2826

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit a7047b2 with merge base 88b6cd2 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Apr 3, 2024
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

@cccclai cccclai changed the title skip two ops for coreml partitioenr Skip two ops for coreml partitioner Apr 3, 2024
cccclai added a commit to cccclai/executorch-1 that referenced this pull request Apr 3, 2024
Summary:

There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now 
```
"aten.index.tensor", "aten.index_put.default"
```
test with
```
python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache
```

Differential Revision: D55680297
@cccclai cccclai force-pushed the export-D55680297 branch from 6cbe1f5 to f1ef94b Compare April 3, 2024 05:54
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

@cccclai cccclai force-pushed the export-D55680297 branch from f1ef94b to 9329a75 Compare April 3, 2024 18:17
cccclai added a commit to cccclai/executorch-1 that referenced this pull request Apr 3, 2024
Summary:

There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now 
```
"aten.index.tensor", "aten.index_put.default"
```
test with
```
python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache
```

Differential Revision: D55680297
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

cccclai added a commit to cccclai/executorch-1 that referenced this pull request Apr 4, 2024
Summary:

There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now 
```
"aten.index.tensor", "aten.index_put.default"
```
test with
```
python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache
```

Differential Revision: D55680297
@cccclai cccclai force-pushed the export-D55680297 branch from 9329a75 to 88df6cd Compare April 4, 2024 00:31
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

cccclai added a commit to cccclai/executorch-1 that referenced this pull request Apr 4, 2024
Summary:

There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now 
```
"aten.index.tensor", "aten.index_put.default"
```
test with
```
python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache
```

Differential Revision: D55680297
@cccclai cccclai force-pushed the export-D55680297 branch from 88df6cd to f18cb99 Compare April 4, 2024 00:32
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

@mergennachin mergennachin self-requested a review April 4, 2024 17:08
@cccclai cccclai changed the title Skip two ops for coreml partitioner Skip one op for coreml partitioner Apr 4, 2024
@cccclai
Copy link
Contributor Author

cccclai commented Apr 4, 2024

Thanks Yifan for adding the index with bool, so we can skip one less op!

@cccclai cccclai force-pushed the export-D55680297 branch from f18cb99 to 549001c Compare April 4, 2024 20:44
cccclai added a commit to cccclai/executorch-1 that referenced this pull request Apr 4, 2024
Summary:

There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now 
```
"aten.index.tensor", "aten.index_put.default"
```
test with
```
python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache
```

Reviewed By: mergennachin

Differential Revision: D55680297
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

Summary:

There are some issues with the current two ops in coreml side. While waiting for the fix, skip them for now 
```
"aten.index.tensor", "aten.index_put.default"
```
test with
```
python3 -m examples.models.llama2.export_llama --coreml --use_kv_cache
```

Reviewed By: mergennachin

Differential Revision: D55680297
@cccclai cccclai force-pushed the export-D55680297 branch from 549001c to a7047b2 Compare April 4, 2024 20:45
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D55680297

@facebook-github-bot
Copy link
Contributor

This pull request has been merged in dd06b7a.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported Merged
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants