Skip to content

Commit 50ed60d

Browse files
committed
white space
1 parent 7e8ec2d commit 50ed60d

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

doc/api/training/smp_versions/latest/smd_model_parallel_pytorch.rst

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -502,7 +502,7 @@ smdistributed.modelparallel.torch.nn.FlashAttentionLayer
502502
This class supports
503503
`FlashAttention <https://github.com/HazyResearch/flash-attention>`_
504504
for PyTorch 2.0.
505-
It takes the ``qkv`` matrix as an argument through its ``forward`` class method,
505+
It takes the ``qkv`` matrix as an argument through its ``forward`` class method,
506506
computes attention scores and probabilities,
507507
and then operates the matrix multiplication with value layers.
508508

0 commit comments

Comments
 (0)