documentation: add docs for Sagemaker Model Parallel 1.3, released with PT 1.8 #2219

rahul003 · 2021-03-16T23:21:05Z

Issue #, if available:

Description of changes:
PT 1.8 container coming soon has SMP 1.3. Adding docs for that.
Testing done:

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

rahul003 · 2021-03-16T23:48:10Z

doc/api/training/smd_model_parallel_general.rst

@@ -304,6 +303,45 @@ table are optional.
   |                   |                         |                 | provided by                       |
   |                   |                         |                 | SageMaker.                        |
   +-------------------+-------------------------+-----------------+-----------------------------------+
+   | ``active_microbatches`` | int          |  ``partitions`` + 2          | The number of                      |


Fixing formatting

into smp13

rahul003 · 2021-03-17T17:48:07Z

doc/api/training/smd_model_parallel_general.rst

 process 6 is 1.

 Analogously, the library defines ``dp_group``\ s as the sets of processes that
 all hold the same model partition, and perform data parallelism among
 each other. In the example above, there are two ``dp_group``\ s,
-``[0, 1, 2, 3]`` and ``[4, 5, 6, 7]``,
+``[0, 1, 2, 3]`` and ``[4, 5, 6, 7]``,


Not sure why this happened, Talia ran this through an rst formatter

rahul003 · 2021-03-17T17:48:41Z

@ChoiByungWook Would it be possible to get this in before the next release? As this should ideally accompany #2220

sagemaker-bot · 2021-03-17T21:51:16Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 1bc5502
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T19:04:47Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a984d04
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T19:34:35Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a984d04
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T19:35:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a984d04
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T19:41:33Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: a984d04
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T19:45:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: a984d04
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T21:32:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a47d3b3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T22:05:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a47d3b3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T22:07:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: a47d3b3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T22:13:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: a47d3b3
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-18T22:25:45Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a47d3b3
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-19T00:25:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ff1002b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…e TOC

sagemaker-bot · 2021-03-19T00:27:44Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: ff1002b
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-23T23:15:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: ee46bf5
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-23T23:16:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: ee46bf5
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-23T23:26:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ee46bf5
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-23T23:31:37Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: ee46bf5
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-24T04:25:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: a1befd4
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-24T04:57:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: a1befd4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-24T05:00:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: a1befd4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-24T05:07:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: a1befd4
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-24T05:09:56Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: a1befd4
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T00:05:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 8484537
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T00:34:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 8484537
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T00:42:22Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 8484537
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T00:50:07Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 8484537
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T01:18:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 8484537
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T17:03:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 30d01ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T17:28:50Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 30d01ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T17:38:26Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 30d01ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T17:38:41Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 30d01ff
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-25T17:40:23Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 30d01ff
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-27T01:24:29Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: c594a44
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-27T01:50:14Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: c594a44
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-27T01:52:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: c594a44
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-27T01:57:11Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: c594a44
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-03-27T02:01:57Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: c594a44
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

documentation: add SMP 1.3 docs

3b52234

rahul003 force-pushed the smp13 branch from f381ffe to 3b52234 Compare March 16, 2021 23:22

rahul003 changed the title ~~Add docs for Sagemaker Model Parallel 1.3, released with PT 1.8~~ documentation: add docs for Sagemaker Model Parallel 1.3, released with PT 1.8 Mar 16, 2021

Merge branch 'master' into smp13

70125f8

rahul003 commented Mar 16, 2021

View reviewed changes

Dan and others added 3 commits March 16, 2021 20:05

Merge branch 'master' into smp13

df708ef

Fix rst formatting

29d7497

Merge branch 'smp13' of https://github.com/rahul003/sagemaker-python-sdk

6e17191

into smp13

rahul003 commented Mar 17, 2021

View reviewed changes

Merge branch 'master' into smp13

1bc5502

Merge branch 'master' into smp13

a984d04

Format

a47d3b3

rahul003 added 2 commits March 18, 2021 17:23

Add line about state dict

ff1002b

Add 1.7.1 as a supported version

791008c

Talia Chopra added 2 commits March 18, 2021 17:26

Documentation: adding :noindex: to older versioned files. Updating th…

5e383c4

…e TOC

Merge remote-tracking branch 'rahul/smp13' into HEAD

6151b4e

Merge branch 'master' into smp13

a1befd4

Merge branch 'master' into smp13

8484537

Merge branch 'master' into smp13

30d01ff

Merge branch 'master' into smp13

c594a44

TEChopra1000 approved these changes Mar 27, 2021

View reviewed changes

TEChopra1000 merged commit b7b4549 into aws:master Mar 27, 2021

documentation: add docs for Sagemaker Model Parallel 1.3, released with PT 1.8 #2219

documentation: add docs for Sagemaker Model Parallel 1.3, released with PT 1.8 #2219

Uh oh!

Conversation

rahul003 commented Mar 16, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Merge Checklist

General

Tests

Uh oh!

rahul003 Mar 16, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

rahul003 Mar 17, 2021

Choose a reason for hiding this comment

Uh oh!

rahul003 commented Mar 17, 2021 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

sagemaker-bot commented Mar 17, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 18, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 19, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 19, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 23, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 23, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 23, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 23, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 24, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 24, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Mar 24, 2021

AWS CodeBuild CI Report

Uh oh!

rahul003 commented Mar 16, 2021 •

edited

Loading

rahul003 Mar 16, 2021 •

edited

Loading

rahul003 commented Mar 17, 2021 •

edited

Loading