Skip to content

alltoallv communication operator support #1134

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 18 commits into
base: main
Choose a base branch
from

Conversation

cyx-6
Copy link
Collaborator

@cyx-6 cyx-6 commented Jun 10, 2025

📌 Description

Introduce alltoallv communication operators.

🔍 Related Issues

🚀 Pull Request Checklist

Thank you for contributing to FlashInfer! Before we review your pull request, please make sure the following items are complete.

✅ Pre-commit Checks

  • I have installed pre-commit by running pip install pre-commit (or used your preferred method).
  • I have installed the hooks with pre-commit install.
  • I have run the hooks manually with pre-commit run --all-files and fixed any reported issues.

If you are unsure about how to set up pre-commit, see the pre-commit documentation.

🧪 Tests

  • Tests have been added or updated as needed.
  • All tests are passing (unittest, etc.).

Reviewer Notes

@cyx-6
Copy link
Collaborator Author

cyx-6 commented Jun 11, 2025

above issues are all fixed

@cyx-6
Copy link
Collaborator Author

cyx-6 commented Jun 11, 2025

removed and decoupled

@yongwww yongwww marked this pull request as ready for review June 11, 2025 15:47
@yongwww
Copy link
Collaborator

yongwww commented Jun 11, 2025

The multi-gpu tests are skipped in CI due to the ci resource limit. They pass on my multi-B200 node.

@yongwww yongwww changed the title All-to-all communication operator support alltoallv communication operator support Jun 11, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants