fix doc structure

Author: mchoi8739

doc/api/training/distributed.rst

@@ -26,3 +26,6 @@ The SageMaker Distributed Model Parallel Library
    :maxdepth: 3
 
    smd_model_parallel
+   smp_versions/latest
+   smd_model_parallel_general
+   smd_model_parallel_release_notes/smd_model_parallel_change_log

doc/api/training/smd_model_parallel.rst

@@ -9,15 +9,6 @@ allowing you to increase prediction accuracy by creating larger models with more
 You can use the library to automatically partition your existing TensorFlow and PyTorch workloads
 across multiple GPUs with minimal code changes. The library's API can be accessed through the Amazon SageMaker SDK.
 
-See the following sections to learn more about the SageMaker model parallel library APIs.
-
-.. toctree::
-   :maxdepth: 3
-
-   smp_versions/latest
-   smd_model_parallel_general
-
-
 .. tip::
 
   We recommended using this API documentation with the conceptual guide at
@@ -48,14 +39,3 @@ See the following sections to learn more about the SageMaker model parallel libr
    `Extend or Adapt A Docker Container that Contains the Model Parallel Library
    <https://integ-docs-aws.amazon.com/sagemaker/latest/dg/model-parallel-use-api.html#model-parallel-customize-container>`__
    for more information.
-
-Release Notes
-=============
-
-New features, bug fixes, and improvements are regularly made to the SageMaker
-distributed model parallel library.
-
-.. toctree::
-   :maxdepth: 1
-
-   smd_model_parallel_release_notes/smd_model_parallel_change_log

doc/api/training/smd_model_parallel_release_notes/smd_model_parallel_change_log.rst

@@ -1,6 +1,56 @@
-Sagemaker Distributed Model Parallel 1.6.0 Release Notes
+#############
+Release Notes
+#############
+
+New features, bug fixes, and improvements are regularly made to the SageMaker
+distributed model parallel library.
+
+Sagemaker Distributed Model Parallel 1.7.0 Release Notes
 ========================================================
 
+*Date: March. 07. 2022*
+
+**New Features**
+
+**Currency Updates**
+
+* Support for PyTorch 1.10.2
+* Support for Hugging Face Transformers 4.16.2
+
+**New Features**
+
+* Support for query key layer scaling to avoid overflow for large model
+* Support for FP32 residual addition to avoid overflow (NaN loss values) for large models when using FP16.
+
+**Improvements**
+
+* Added support for a custom CUDA kernel for softmax to improve throughput
+* Added support for the following `NVIDIA Megatron’s fused kernels
+  <https://github.com/NVIDIA/Megatron-LM/tree/main/megatron/fused_kernels>`_:
+
+  * Fusion of attention masking and softmax
+  * Fusion of bias addition and Gelu activation
+
+**Migration to AWS Deep Learning Containers**
+
+This version passed benchmark testing and is migrated to the following AWS Deep Learning Containers:
+
+
+* PyTorch 1.10.2
+
+  .. code::
+
+    763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.10.2-gpu-py38-cu113-ubuntu20.04-sagemaker
+
+
+----
+
+Release History
+===============
+
+Sagemaker Distributed Model Parallel 1.6.0 Release Notes
+--------------------------------------------------------
+
 *Date: December. 20. 2021*
 
 **New Features**
@@ -30,10 +80,7 @@ AWS Deep Learning Container(s):
 
     763104351884.dkr.ecr.<region>.amazonaws.com/pytorch-training:1.8.1-gpu-py36-cu111-ubuntu18.04
 
-----
 
-Release History
-===============
 
 Sagemaker Distributed Model Parallel 1.5.0 Release Notes
 --------------------------------------------------------