-
Notifications
You must be signed in to change notification settings - Fork 1.2k
Add airflow tuning config export API #486
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
Codecov Report
@@ Coverage Diff @@
## master #486 +/- ##
==========================================
+ Coverage 93.82% 93.84% +0.02%
==========================================
Files 58 58
Lines 4323 4355 +32
==========================================
+ Hits 4056 4087 +31
- Misses 267 268 +1
Continue to review full report at Codecov.
|
tests/unit/test_airflow.py
Outdated
@@ -16,7 +16,7 @@ | |||
import pytest | |||
import mock | |||
|
|||
from sagemaker import estimator, tensorflow | |||
from sagemaker import estimator, tensorflow, mxnet, tuner |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
alphabetize the imported modules
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated
tests/unit/test_airflow.py
Outdated
mxnet_estimator = mxnet.MXNet( | ||
entry_point="{{ entry_point }}", | ||
source_dir="{{ source_dir }}", | ||
py_version='py2', |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I know it's just a unit test, but it does seem a bit strange to me we're still adding new code that "uses" Python 2
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated.
src/sagemaker/workflow/airflow.py
Outdated
"""Export Airflow training config from an estimator | ||
|
||
Args: | ||
estimator (sagemaker.estimator.EstimatroBase): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
s/Estimatro/Estimator
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated
src/sagemaker/workflow/airflow.py
Outdated
Amazon algorithm. For other estimators, batch size should be specified in the estimator. | ||
|
||
Returns: | ||
A dict of training config that can be directly used by SageMakerTrainingOperator |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
change this to "dict: training config..."
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Updated
Issue #, if available:
Description of changes:
Merge Checklist
Put an
x
in the boxes that apply. You can also fill these out after creating the PR. If you're unsure about any of them, don't hesitate to ask. We're here to help! This is simply a reminder of what we are going to look for before merging your pull request.By submitting this pull request, I confirm that my contribution is made under the terms of the Apache 2.0 license.