Skip to content

fix: use the provided kms key to upload user code #2005

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
wants to merge 3 commits into from

Conversation

Christian-kam
Copy link

@Christian-kam Christian-kam commented Dec 1, 2020

Added entry for kms_key under Args for all the updated methods. Fix the missing space as per the build log file and also took care of the unused parameter.

Issue #, if available:

Description of changes:
In the fix #1897 that was recently merged, the kms key is not propagated throughout all the methods that require it to upload customer code.

For example:

  • _normalize_args() #L208
  • _include_code_in_inputs() #L496
  • _handle_user_code_url() #L554
  • _upload_code() #L581

This PR is to addresses the issue.

Testing done:
unit test

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

General

  • I have read the CONTRIBUTING doc
  • I used the commit message format described in CONTRIBUTING
  • I have passed the region in to all S3 and STS clients that I've initialized as part of this change.
  • I have updated any necessary documentation, including READMEs and API docs (if appropriate)

Tests

  • I have added tests that prove my fix is effective or that my feature works (if appropriate)
  • I have checked that my tests are not configured for a specific region or account (if appropriate)
  • I have used unique_name_from_base to create resource names in integ tests (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

Somehow the kms key fix aws#1897 that was recently merged is not propagate throughout all the methods that require itt when uploading customer code for example, in _upload_code() #L581 which is called in _handle_user_code_url() #L554, which in turn is referenced in _include_code_in_inputs() #L496.  _include_code_in_inputs() is then called  by _normalize_args() #L208 . This pull request address this issue.
Added entry for kms_key under Args for all the updated methods. Fix the missing space as per the build log file and also took care of the unused parameter.
I removed the trailing whitespaces on line 590 and 591 as per build logs.
@sagemaker-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-unit-tests
  • Commit ID: fa41066
  • Result: FAILED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-notebook-tests
  • Commit ID: fa41066
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-local-mode-tests
  • Commit ID: fa41066
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@sagemaker-bot
Copy link
Collaborator

AWS CodeBuild CI Report

  • CodeBuild project: sagemaker-python-sdk-pr
  • Commit ID: fa41066
  • Result: SUCCEEDED
  • Build Logs (available for 30 days)

Powered by github-codebuild-logs, available on the AWS Serverless Application Repository

@ajaykarpur
Copy link
Contributor

Thank you for contributing @Christian-kam! Is this a duplicate of #1992?

@Christian-kam
Copy link
Author

Thank you for contributing @Christian-kam! Is this a duplicate of #1992?

@ajaykarpur yes, after I made the changes to remove the white space in the code as per the build logs, I thought it would update the original pull request. I did not realize that it create a new one. The code in this one is the latest one.

Copy link
Contributor

@ajaykarpur ajaykarpur left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thank you! Could you please add unit and integration tests?

@Christian-kam
Copy link
Author

Thank you! Could you please add unit and integration tests?

I am not really sure, how to add those tests. Can you please assist here?

@icywang86rui
Copy link
Contributor

For unit test, you can add the kms_key arg to this test - https://github.com/aws/sagemaker-python-sdk/blob/master/tests/unit/test_processing.py#L257

For integ test you can create another key for testing like this - https://github.com/aws/sagemaker-python-sdk/blob/master/tests/integ/test_processing.py#L84
I would suggest just add the kms_key arg to one of the existing test's run method.

@icywang86rui
Copy link
Contributor

There have been any actions for a few weeks. Closing for now. Feel free to reopen when you have the chance to add the tests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants