Skip to content

Add support for file:// URI as the input for LocalMode training data #168

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 7 commits into from
May 9, 2018

Conversation

Valorum
Copy link
Contributor

@Valorum Valorum commented May 4, 2018

…passing uploading to/downloading from S3.

Issue #, if available:

Description of changes:

SDK now supports using training data stored on the local filesystem rather than expecting the data to be on s3.

Merge Checklist

Put an x in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.

  • I have read the CONTRIBUTING doc
  • I have added tests that prove my fix is effective or that my feature works (if appropriate)
  • I have updated the changelog with a description of my changes (if appropriate)
  • I have updated any necessary documentation (if appropriate)

By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.

@codecov-io
Copy link

codecov-io commented May 8, 2018

Codecov Report

Merging #168 into master will decrease coverage by 0.06%.
The diff coverage is 83.78%.

Impacted file tree graph

@@            Coverage Diff             @@
##           master     #168      +/-   ##
==========================================
- Coverage   90.63%   90.57%   -0.07%     
==========================================
  Files          37       37              
  Lines        2478     2504      +26     
==========================================
+ Hits         2246     2268      +22     
- Misses        232      236       +4
Impacted Files Coverage Δ
src/sagemaker/local/local_session.py 82.65% <100%> (+5.12%) ⬆️
src/sagemaker/local/image.py 87% <77.77%> (-0.41%) ⬇️
src/sagemaker/estimator.py 84.55% <77.77%> (-1.47%) ⬇️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update d2f018e...42abc1b. Read the comment docs.

@iquintero iquintero force-pushed the local_mode_phase1 branch from b6d5abf to e656965 Compare May 8, 2018 00:09
Also fix some TODOs here and there.
@iquintero iquintero force-pushed the local_mode_phase1 branch from e656965 to 6f1cf40 Compare May 8, 2018 00:29
@iquintero iquintero changed the title Local mode support for file:// URI as the input for training data, by… Add support for file:// URI as the input for LocalMode training data May 8, 2018
@iquintero iquintero requested a review from owen-t May 8, 2018 00:33
owen-t
owen-t previously approved these changes May 8, 2018
Copy link
Contributor

@owen-t owen-t left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks really good.

The Local Mode Readme documentation needs to be updated with these changes.

@iquintero iquintero force-pushed the local_mode_phase1 branch from ecd4452 to 23be9d1 Compare May 8, 2018 17:29
README.rst Outdated
@@ -184,7 +187,7 @@ For detailed examples of running docker in local mode, see:
A few important notes:

- Only one local mode endpoint can be running at a time
- Since the data are pulled from S3 to your local environment, please ensure you have sufficient space.
- Since the data is pulled from S3 to your local environment, please ensure you have sufficient space.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is no longer true, if you're using file://

@iquintero iquintero merged commit c1f1ab9 into aws:master May 9, 2018
apacker pushed a commit to apacker/sagemaker-python-sdk that referenced this pull request Nov 15, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants