Skip to content

Buckify tokenizers #17

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Feb 14, 2025
Merged

Buckify tokenizers #17

merged 1 commit into from
Feb 14, 2025

Conversation

larryliu0820
Copy link
Contributor

Summary: So that it can be used by ET internally

Differential Revision: D69509028

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Meta Open Source bot. label Feb 12, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

Copy link

@iseeyuan iseeyuan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. Thanks!

@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 12, 2025
Summary:
Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 12, 2025
Summary:
Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 13, 2025
Summary:
Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 13, 2025
Summary:
Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
larryliu0820 added a commit to pytorch/executorch that referenced this pull request Feb 13, 2025
Summary:
X-link: pytorch-labs/tokenizers#17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 13, 2025
Summary:
X-link: pytorch/executorch#8408

Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 13, 2025
Summary:
X-link: pytorch/executorch#8408

Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
larryliu0820 added a commit to pytorch/executorch that referenced this pull request Feb 13, 2025
Summary:
Pull Request resolved: #8408

X-link: pytorch-labs/tokenizers#17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 13, 2025
Summary:
X-link: pytorch/executorch#8408

Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
larryliu0820 added a commit to pytorch/executorch that referenced this pull request Feb 13, 2025
Summary:
Pull Request resolved: #8408

X-link: pytorch-labs/tokenizers#17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit that referenced this pull request Feb 13, 2025
Summary:
X-link: pytorch/executorch#8408

Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
Summary:
X-link: pytorch/executorch#8408

Pull Request resolved: #17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69509028

larryliu0820 added a commit to pytorch/executorch that referenced this pull request Feb 14, 2025
Summary:
Pull Request resolved: #8408

X-link: pytorch-labs/tokenizers#17

So that it can be used by ET internally

Reviewed By: jackzhxng

Differential Revision: D69509028
@facebook-github-bot facebook-github-bot merged commit 03744ce into main Feb 14, 2025
4 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ciflow/trunk/all Run trunk.yml ciflow/trunk CLA Signed This label is managed by the Meta Open Source bot. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants