feature: Add support for Callback steps in model building pipelines #2423

staubhp · 2021-06-01T16:29:22Z

Issue #, if available:
N/A

Description of changes:
Add support for Callback step to model building pipelines.

Testing done:
Unit tests, manual tests.

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

I have read the CONTRIBUTING doc
I used the commit message format described in CONTRIBUTING
I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

I have added tests that prove my fix is effective or that my feature works (if appropriate)
I have checked that my tests are not configured for a specific region or account (if appropriate)
I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

…python-sdk into callback-step

sagemaker-bot · 2021-06-01T16:32:12Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 03bbd28
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-01T17:03:12Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 03bbd28
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-01T17:06:57Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 03bbd28
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-01T17:13:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 03bbd28
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-01T17:14:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 03bbd28
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-02T22:15:39Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 8c50d92
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-02T22:47:35Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 8c50d92
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-02T22:50:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 8c50d92
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-02T22:51:31Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 8c50d92
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-02T22:52:32Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 8c50d92
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…l unit tests

sagemaker-bot · 2021-06-03T16:35:49Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 14b743a
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:10:31Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 14b743a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:12:24Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 14b743a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:17:48Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 14b743a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T17:28:36Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 14b743a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T20:49:10Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 319b5f0
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T20:56:15Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: d5fea7a
Result: FAILED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T21:22:30Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 319b5f0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T21:28:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: d5fea7a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T21:29:00Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: d5fea7a
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T21:30:12Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 319b5f0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-03T21:32:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 319b5f0
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T00:33:34Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 6212c8b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T00:35:04Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 6212c8b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T00:56:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 6212c8b
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T17:31:51Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: ad1a95f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T17:57:02Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: ad1a95f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T18:00:46Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: ad1a95f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T18:05:14Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: ad1a95f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T18:05:52Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: ad1a95f
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

…l unit tests

…python-sdk into callback-step

sagemaker-bot · 2021-06-04T18:49:18Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-unit-tests
Commit ID: 2596927
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T19:11:47Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-pr
Commit ID: 2596927
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T19:19:05Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-notebook-tests
Commit ID: 2596927
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T19:20:25Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-slow-tests
Commit ID: 2596927
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

sagemaker-bot · 2021-06-04T19:21:44Z

AWS CodeBuild CI Report

CodeBuild project: sagemaker-python-sdk-local-mode-tests
Commit ID: 2596927
Result: SUCCEEDED
Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

Payton Staub added 4 commits May 20, 2021 09:37

Add callback step

2cae789

Add callback step

84d1411

Merge branch 'callback-step' of https://github.com/staubhp/sagemaker-…

aff9bac

…python-sdk into callback-step

Fix license text

03bbd28

Fix referencing of CallbackOutputs in other steps

8c50d92

Fix multiple output parameters in callback step properties. Additiona…

14b743a

…l unit tests

Fix flake8

319b5f0

Fix pylint

d5fea7a

jerrypeng7773 previously approved these changes Jun 4, 2021

View reviewed changes

leoroy previously approved these changes Jun 4, 2021

View reviewed changes

Merge branch 'master' into callback-step

ad1a95f

Payton Staub added 9 commits June 4, 2021 11:37

Add callback step

c81a5e8

Fix license text

f8d0e27

Fix referencing of CallbackOutputs in other steps

86d34e1

Fix multiple output parameters in callback step properties. Additiona…

b2e52a6

…l unit tests

Fix flake8

6c7a8df

Fix pylint

63b6871

Fix docstyle/black-check

4f7be83

Add integ test

9a09443

Merge branch 'callback-step' of https://github.com/staubhp/sagemaker-…

2596927

…python-sdk into callback-step

staubhp dismissed stale reviews from leoroy and jerrypeng7773 via 2596927 June 4, 2021 18:38

ajaykarpur approved these changes Jun 4, 2021

View reviewed changes

jerrypeng7773 approved these changes Jun 4, 2021

View reviewed changes

ajaykarpur merged commit 0a63eec into aws:master Jun 7, 2021

feature: Add support for Callback steps in model building pipelines #2423

feature: Add support for Callback steps in model building pipelines #2423

Uh oh!

Conversation

staubhp commented Jun 1, 2021

Merge Checklist

General

Tests

Uh oh!

sagemaker-bot commented Jun 1, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 1, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 1, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 1, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 1, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 2, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 2, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 2, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 2, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 2, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 3, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 4, 2021

AWS CodeBuild CI Report

Uh oh!

sagemaker-bot commented Jun 4, 2021

AWS CodeBuild CI Report