-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Add support for file:// URI as the input for LocalMode training data #168
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
…passing uploading to/downloading from S3.
Codecov Report
@@ Coverage Diff @@
## master #168 +/- ##
==========================================
- Coverage 90.63% 90.57% -0.07%
==========================================
Files 37 37
Lines 2478 2504 +26
==========================================
+ Hits 2246 2268 +22
- Misses 232 236 +4
Continue to review full report at Codecov.
|
b6d5abf
to
e656965
Compare
Also fix some TODOs here and there.
e656965
to
6f1cf40
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks really good.
The Local Mode Readme documentation needs to be updated with these changes.
ecd4452
to
23be9d1
Compare
README.rst
Outdated
@@ -184,7 +187,7 @@ For detailed examples of running docker in local mode, see: | |||
A few important notes: | |||
|
|||
- Only one local mode endpoint can be running at a time | |||
- Since the data are pulled from S3 to your local environment, please ensure you have sufficient space. | |||
- Since the data is pulled from S3 to your local environment, please ensure you have sufficient space. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is no longer true, if you're using file://
Pyspark kmeans clustering on MNIST
…passing uploading to/downloading from S3.
Issue #, if available:
Description of changes:
SDK now supports using training data stored on the local filesystem rather than expecting the data to be on s3.
Merge Checklist
Put an
x
in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.