Skip to content

ADL PowerShell Updates #2511

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 20 commits into from
Jul 1, 2016
Merged

ADL PowerShell Updates #2511

merged 20 commits into from
Jul 1, 2016

Conversation

begoldsm
Copy link
Contributor

  1. Update to latest SDK
  2. Enable File and Folder performant download support
  3. Add a full path property to ADLS items returned with GET and LIST
  4. Update the help for new properties/property documentation changes
  5. Add default values for Upload and download for threading and number of files to download/upload at once during a folder upload/download
  6. Set the max connections for the ADLS client during client creation to 1000. This ensures the connection limit is high enough before any other ADLS calls are made, enabling upload/download to open sufficient connections.
  7. Remove tracing from file/folder copy until issue: ServiceClientTracingInterceptor consumes lots of memory for cmdlets with large response bodies #2499 is resolved.

@markcowl
Copy link
Member

begoldsm added 10 commits June 28, 2016 11:30
This enables ADL tests to run during CI and gets them totally updated.
Following the pattern from compute tests.
This is a requirement for the tests to be discovered when run in
playback mode.
This updates the change log to reflect the changes made
Fixes to datetime offset for listing jobs
fix to import/export logic due to inverted parameters.
# Conflicts:
#	AzurePowershell.Test.targets
#	ChangeLog.md
Inside of ACLs we allow ":", which breaks the playback of tests, since
it encodes ":", which results in a missed match in the recorded json
(which contains the colon). This fixes that so playback does not encode
colons for paths that start with: /webhdfs/v1/?aclspec
@markcowl
Copy link
Member

markcowl commented Jul 1, 2016

LGTM once the on-demand run passes

@markcowl
Copy link
Member

markcowl commented Jul 1, 2016

@begoldsm
Copy link
Contributor Author

begoldsm commented Jul 1, 2016

@markcowl great, thanks Mark! I will keep an eye on it and post here once on demand passes.

@begoldsm
Copy link
Contributor Author

begoldsm commented Jul 1, 2016

@markcowl on demand has passed!

@markcowl markcowl merged commit 3e0d8f7 into Azure:dev Jul 1, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants