-
Notifications
You must be signed in to change notification settings - Fork 607
Add CMake preset for LLM #11052
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add CMake preset for LLM #11052
Conversation
Summary: By default turn on custom ops, optimized kernels, xnnpack. For macOS/iOS turn on coreml and MPS. Test Plan: Rely on CI jobs. [ghstack-poisoned]
🔗 Helpful Links🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/11052
Note: Links to docs will display an error until the docs builds have been completed. ❌ 1 Cancelled JobAs of commit e2e330d with merge base d892b66 ( CANCELLED JOB - The following job was cancelled. Please retry:
This comment was automatically generated by Dr. CI and updates every 15 minutes. |
-DEXECUTORCH_BUILD_XNNPACK="$XNNPACK" \ | ||
-DEXECUTORCH_BUILD_MPS="$MPS" \ | ||
-DEXECUTORCH_BUILD_COREML="$COREML" \ | ||
retry cmake --preset llm \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
it's beautiful 🥹
Summary: By default turn on custom ops, optimized kernels, xnnpack. For macOS/iOS turn on coreml and MPS. Test Plan: Rely on CI jobs. [ghstack-poisoned]
Summary: By default turn on custom ops, optimized kernels, xnnpack. For macOS/iOS turn on coreml and MPS. Test Plan: Rely on CI jobs. [ghstack-poisoned]
Summary: By default turn on custom ops, optimized kernels, xnnpack. For macOS/iOS turn on coreml and MPS. Test Plan: Rely on CI jobs. [ghstack-poisoned]
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
thank you!!!
@@ -152,21 +152,11 @@ which "${PYTHON_EXECUTABLE}" | |||
cmake_install_executorch_libraries() { | |||
echo "Installing libexecutorch.a, libextension_module.so, libportable_ops_lib.a" | |||
rm -rf cmake-out | |||
retry cmake \ | |||
retry cmake --preset llm \ | |||
-DCMAKE_INSTALL_PREFIX=cmake-out \ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This can be deleted too, since it's the default
Summary: By default turn on custom ops, optimized kernels, xnnpack. For macOS/iOS turn on coreml and MPS. Test Plan: Rely on CI jobs. [ghstack-poisoned]
a36e122
into
gh/larryliu0820/64/base
This PR was created by the merge bot to help merge the original PR into the main branch. ghstack PR number: #11052 by @larryliu0820 ^ Please use this as the source of truth for the PR details, comments, and reviews ghstack PR base: https://github.com/pytorch/executorch/tree/gh/larryliu0820/64/base ghstack PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/64/head Merge bot PR base: https://github.com/pytorch/executorch/tree/main Merge bot PR head: https://github.com/pytorch/executorch/tree/gh/larryliu0820/64/orig @diff-train-skip-merge Co-authored-by: Mengwei Liu <[email protected]>
Stack from ghstack (oldest at bottom):
Summary: By default turn on custom ops, optimized kernels, xnnpack. For
macOS/iOS turn on coreml and MPS.
Test Plan: Rely on CI jobs.