Skip to content

Commit cb47e84

Browse files
yl-tonavinsoni
authored andcommitted
update pytorch documentation for torchrun gpu support
1 parent 9e5dca6 commit cb47e84

File tree

1 file changed

+2
-3
lines changed

1 file changed

+2
-3
lines changed

doc/frameworks/pytorch/using_pytorch.rst

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -262,8 +262,7 @@ during the PyTorch DDP initialization.
262262

263263
.. note::
264264

265-
The SageMaker PyTorch estimator operates ``mpirun`` in the backend.
266-
It doesn’t use ``torchrun`` for distributed training.
265+
The SageMaker PyTorch estimator can operates both ``mpirun`` and ``torchrun`` in the backend for distributed training.
267266

268267
For more information about setting up PyTorch DDP in your training script,
269268
see `Getting Started with Distributed Data Parallel
@@ -317,7 +316,7 @@ with the ``torch_distributed`` option as the distribution strategy.
317316
.. note::
318317

319318
This ``torch_distributed`` support is available
320-
in the AWS Deep Learning Containers for PyTorch Neuron starting v1.11.0.
319+
in the AWS Deep Learning Containers for PyTorch Neuron starting v1.11.0 and other gpu instances starting v1.31.1.
321320
To find a complete list of supported versions of PyTorch Neuron, see
322321
`Neuron Containers <https://github.com/aws/deep-learning-containers/blob/master/available_images.md#neuron-containers>`_
323322
in the *AWS Deep Learning Containers GitHub repository*.

0 commit comments

Comments
 (0)