Skip to content

Pull requests: pytorch/torchtune

New pull request New
94 Open 1,656 Closed
94 Open 1,656 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

skip compiling opt step instead of erroring if opt_in_bwd=True CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2827 opened Jun 13, 2025 by felipemello1 Loading…
1 of 4 tasks
1
raise error if fsdp_cpu_offload + opt_in_bwd CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2826 opened Jun 13, 2025 by felipemello1 Loading…
1 of 4 tasks
1
fix loss compile for dtensor CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2824 opened Jun 13, 2025 by felipemello1 Loading…
1 of 4 tasks
1
2
fix LinearCrossEntropy CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2823 opened Jun 12, 2025 by songhappy Loading…
2 tasks done
2
Fix #2809, modify attention CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2822 opened Jun 12, 2025 by krammnic Loading…
2 of 13 tasks
1
2
Changes to DCP HF integration CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2821 opened Jun 12, 2025 by ankitageorge Loading…
1 of 9 tasks
1
[WIP] Qwen3 MoE support CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2820 opened Jun 12, 2025 by intervitens • Draft
6 tasks
6
[RFC] on-the-fly packing CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2819 opened Jun 12, 2025 by felipemello1 Loading…
11
[WIP] Integrate OptimizerInBackward into SFT distributed recipe CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2818 opened Jun 11, 2025 by joecummings • Draft
1
add truncation_type for llama4 tokenizer CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2812 opened Jun 10, 2025 by adheep04 Loading…
4 tasks done
1
3
Test alignment of shared methods in recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2807 opened Jun 9, 2025 by Andrei-Aksionov • Draft
1
Integrate Muon optimizer (2725) CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2803 opened Jun 8, 2025 by Saurabh750 Loading…
1 of 13 tasks
11
Fix command in config CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2796 opened Jun 6, 2025 by krammnic Loading…
1 of 13 tasks
7
[WIP] Proper tool calling support in the torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2794 opened Jun 6, 2025 by krammnic Loading…
2 of 13 tasks
1
[RFC] Reward modeling CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2788 opened Jun 5, 2025 by krammnic Loading…
1
[RFC] Iterable Dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2785 opened Jun 4, 2025 by felipemello1 Loading…
46
custom device CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2783 opened Jun 3, 2025 by songhappy Loading…
1 task done
6
Enable loss parallel, Ungate FP8 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2782 opened Jun 3, 2025 by nathan-az Loading…
1 of 13 tasks
18
Ungate FP8 + TP CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2781 opened Jun 3, 2025 by nathan-az • Draft
3 of 13 tasks
1
[NOT FOR REVIEW] Full knowledge distillation recipe TP + FP8 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2767 opened May 28, 2025 by krammnic • Draft
13 tasks
2
[WIP] DSV3 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2764 opened May 27, 2025 by SalmanMohammadi • Draft
2 of 7 tasks
2
Add LRScheduler.state_dict() to checkpoints CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2762 opened May 23, 2025 by omkar-334 Loading…
2 of 13 tasks
1
4
[WIP][DEBUG] llama4 debugging CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2756 opened May 21, 2025 by IvanKobzarev Loading…
2
Fixing counting number of batches for accumulation through epoch CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2745 opened May 17, 2025 by wesbz Loading…
7 of 13 tasks
4
Add feature ligerceloss CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2741 opened May 16, 2025 by mananchawla2005 Loading…
7 of 9 tasks
1
47
ProTip! Filter pull requests by the default branch with base:main.