Merge pull request Azure#3401 from Azure/release-3.4.0

[Release 3.4.0] Merge release --> master

Author: cormacpayne

.github/PULL_REQUEST_TEMPLATE.md

@@ -26,9 +26,9 @@ This checklist is used to make sure that common guidelines for a pull request ar
 
 ### [Cmdlet Signature Guidelines](https://github.com/Azure/azure-powershell/blob/dev/CONTRIBUTING.md#cmdlet-signature-guidelines)
 - [ ] New cmdlets that make changes or have side effects should implement `ShouldProcess` and have `SupportShouldProcess=true` specified in the cmdlet attribute. You can find more information on `ShouldProcess` [here](https://gist.github.com/markcowl/338e16fe5c8bbf195aff9f8af0db585d#what-is-the-change).
-- [ ] Cmdlet specifies `OutputType` attribute if any output is produced - if the cmdlet produces no output, it should implement a `PassThrough` parameter.
+- [ ] Cmdlet specifies `OutputType` attribute if any output is produced - if the cmdlet produces no output, it should implement a `PassThru` parameter.
 
 ### [Cmdlet Parameter Guidelines](https://github.com/Azure/azure-powershell/blob/dev/CONTRIBUTING.md#cmdlet-parameter-guidelines)
 - [ ] Parameter types should not expose types from the management library - complex parameter types should be defined in the module.
 - [ ] Complex parameter types are discouraged - a parameter type should be simple types as often as possible. If complex types are used, they should be shallow and easily creatable from a constructor or another cmdlet.
-- [ ] Cmdlet parameter sets should be mutually exclusive - each parameter set must have at least one mandatory parameter not in other parameter sets.
+- [ ] Cmdlet parameter sets should be mutually exclusive - each parameter set must have at least one mandatory parameter not in other parameter sets.

ChangeLog.md

@@ -1,4 +1,88 @@
-## 2016.12.14 - Version 3.3.0
+## 2017.01.18 - Version 3.4.0
+* AnalysisServices
+    * Added two new dataplane APIs in a separate module Azure.AnalysisServices.psd1
+        - This introduces two new APIs that enable customers to login to Azure Analysis Services servers and issue a restart command.
+* Compute
+    * Fix Get-AzureRmVM with -Status issue: Get-AzureRmVM throws an exception when Get-AzureRmVM lists multiple VMs and some of the VMs are deleted during Get-AzureRmVM is performed.
+    * New parameters in New-AzureRmVMSqlServerAutoBackupConfig cmdlet to support Auto Backup for SQL Server 2016 VMs.
+    	- BackupSystemDbs : Specifies if system databases should be added to Sql Server Managed Backup.
+    	- BackupScheduleType : Specifies the type of managed backup schedule, manual or automated. If it's manual, schedule settings need to be specified.
+    	- FullBackupFrequency : Specifies the frequency of Full Backup, daily or weekly.
+    	- FullBackupStartHour : Specifies the hour of the day when the Sql Server Full Backup should start.
+    	- FullBackupWindowInHours : Specifies the window (in hours) when Sql Server Full Backup should occur.
+    	- LogBackupFrequencyInMinutes : Specifies the frequency of Sql Server Log Backup.
+    * New-AzureVMSqlServer* cmdlets are renamed to New-AzureRmVMSqlServer* now. Old ones will continue to work however.
+* DataLakeAnalytics
+    * Update Get-AdlJob to support Top parameter
+    * Update Get-AdlJob to return the list of jobs in order by most recently submitted
+    * Updated help for all cmdlets to include output as well as more descriptions of parameters and the inclusion of aliases.
+    * Update New-AdlAnalyticsAccount and Set-AdlAnalyticsAccount to support commitment tier options for the service.
+    * Added OutputType mismatch warnings to all cmdlets with incorrect OutputType attributes. These will be fixed in a future breaking change release.
+* DataLakeStore
+    * Updated help for all cmdlets to include output as well as more descriptions of parameters and the inclusion of aliases.
+    * Update New-AdlStore and Set-AdlStore to support commitment tier options for the service.
+    * Added OutputType mismatch warnings to all cmdlets with incorrect OutputType attributes. These will be fixed in a future breaking change release.
+    * Add Diagnostic logging support to Import-AdlStoreItem and Export-AdlStoreItem. This can be enabled through the following parameters:
+        * -Debug, enables full diagnostic logging as well as debug logging to the PowerShell console. Most verbose options
+        * -DiagnosticLogLevel, allows finer control of the output than debug. If used with debug, this is ignored and debug logging is used.
+        * -DiagnosticLogPath, optionally specify the file to write diagnostic logs to. By default it is written to a file under %LOCALAPPDATA%\AdlDataTransfer
+    * Added support to New-AdlStore to explicitly opt-out of account encryption. To do so, create the account with the -DisableEncryption flag.
+* OperationalInsights
+    * Get-AzureRmOperationalInsightsSearchResults no longer requires the Top parameter to retrieve results
+* Resources
+    * Support Tag as parameters for Find-AzureRmResource
+        - Users can now use Tag parameter with Find-AzureRmResource
+        - Fixed the issue where illegal combinations of TagName, TagValue with other search parameters was allowed in Find-AzureRmResource and would result in users getting exception from the service by disallowing such combinations. 
+* ServiceBus
+    * Add SkuCapacity parameter to Set-AzureRmServiceBusNamespace
+        - User will be able to update the SkuCapacity(Messaging units in case of a premium namespace) of the SeriveBus NameSpace
+    
+    * Future Breaking Change Notification: We've added a warning about removing property 'ResourceGroupName' from the returned NamespceAttributes from cmdlets New-AzureRmServiceBusNamespace, Get-AzureRmServiceBusNamespace and Set-AzureRmServiceBusNamespace
+        -The call remains the same, but the returned values NameSpace object will not have the ResourceGroupName property  
+* Sql
+    * Added new return parameter "AuditType" to Get-AzureRmSqlDatabaseAuditingPolicy and Get-AzureRmSqlServerAuditingPolicy returned object
+        - This parameter value indicates the returned auditing policy type - Table or Blob.
+* ServiceManagement
+    * New parameters in New-AzureVMSqlServerAutoBackupConfig cmdlet to support Auto Backup for SQL Server 2016 VMs.
+    	- BackupSystemDbs : Specifies if system databases should be added to Sql Server Managed Backup.
+    	- BackupScheduleType : Specifies the type of managed backup schedule, manual or automated. If it's manual, schedule settings need to be specified.
+    	- FullBackupFrequency : Specifies the frequency of Full Backup, daily or weekly.
+    	- FullBackupStartHour : Specifies the hour of the day when the Sql Server Full Backup should start.
+    	- FullBackupWindowInHours : Specifies the window (in hours) when Sql Server Full Backup should occur.
+    	- LogBackupFrequencyInMinutes : Specifies the frequency of Sql Server Log Backup.
+* Storage
+    * Fix Start-AzureStorageBlobCopy output might has wrong BlobType issue
+        - Start-AzureStorageBlobCopy
+    * Fix hang issue when running cmdlets from WPF/Winform context  
+        - Get-AzureStorageBlob
+        - Get-AzureStorageBlobContent
+        - Get-AzureStorageBlobCopyState
+        - Get-AzureStorageContainer
+        - Get-AzureStorageContainerStoredAccessPolicy
+        - New-AzureStorageContainer
+        - Remove-AzureStorageBlob
+        - Remove-AzureStorageContainer
+        - Set-AzureStorageBlobContent
+        - Set-AzureStorageContainerAcl
+        - Start-AzureStorageBlobCopy
+        - Stop-AzureStorageBlobCopy
+        - Get-AzureStorageFile
+        - Get-AzureStorageFileContent
+        - Get-AzureStorageFileCopyState
+        - Get-AzureStorageShare
+        - Get-AzureStorageShareStoredAccessPolicy
+        - New-AzureStorageDirectory
+        - New-AzureStorageShare
+        - Remove-AzureStorageDirectory
+        - Remove-AzureStorageFile
+        - Remove-AzureStorageShare
+        - Set-AzureStorageFileContent
+        - Start-AzureStorageFileCopy
+        - Stop-AzureStorageFileCopy
+        - Get-AzureStorageQueueStoredAccessPolicy
+        - Get-AzureStorageTableStoredAccessPolicy 
+
+## 2016.12.14 - Version 3.3.0
 * ApiManagement
     * Added new cmdlets to manage external Identity Provider Configurations
         - New-AzureRmApiManagementIdentityProvider

README.md

@@ -36,7 +36,7 @@ This repository contains a set of PowerShell cmdlets for developers and administ
   * Scheduler
   * StorSimple
   * Redis Cache
- 
+
 * Windows Azure Pack
   * Web Site: CRUD web site, deployment, configure and get log, start/stop/restart/show web site
   * Service Bus: CRD namespace
@@ -46,7 +46,7 @@ This repository contains a set of PowerShell cmdlets for developers and administ
 * Windows Azure Stack
   * Azure Stack Administration
   * Storage Service Management
-  
+
 
 For detail descriptions and examples of the cmdlets, type
 * ```help azure``` to get all the cmdlets.
@@ -92,7 +92,7 @@ You can also find the standalone installers for all the versions at [Downloads](
 
 In general, follow these steps to start using Microsoft Azure PowerShell
 
-* Get yourself authenticated with Microsoft Azure. For details, please check out [this article](https://azure.microsoft.com/en-us/documentation/articles/install-configure-powershell/).
+* Get yourself authenticated with Microsoft Azure. For details, please check out [this article](https://docs.microsoft.com/powershell/azureps-cmdlets-docs/).
   * Option 1: Login with your Microsoft account or Organizational account directly from PowerShell. Microsoft Azure Active Directory authentication is used in this case. No management certificate is needed.
       * Starting from 1.0.0, you can use ```Add-AzureRmAccount -Credential``` to avoid the browser pop up for Organizational account.
       * To use RDFE cmdlets, use ```Add-AzureAccount```

build.proj

@@ -45,7 +45,7 @@
     <Scope Condition=" $(Scope) == '' " >all</Scope>
   </PropertyGroup>
   <ItemGroup>
-    <CmdletSolutionsToBuild Include=".\src\Storage\Storage.sln;.\src\ResourceManager\**\*.sln;.\src\ServiceManagement\ServiceManagement.sln"
+    <CmdletSolutionsToBuild Include=".\src\Storage\Storage.sln;.\src\ResourceManager\**\*.sln;.\src\ServiceManagement\ServiceManagement.sln;"
                             Exclude=".\src\ResourceManager\Intune\*.sln"
                             Condition=" '$(Scope)' == 'all' "/>
     <CmdletSolutionsToBuild Include=".\src\ResourceManager\$(Scope)\*.sln" 

setup/azurecmd.wxs

@@ -1,11 +1,11 @@
 <?xml version="1.0" encoding="UTF-8"?>
 <Wix xmlns="http://schemas.microsoft.com/wix/2006/wi" xmlns:util="http://schemas.microsoft.com/wix/UtilExtension">
 
-  <?define productName="Microsoft Azure PowerShell - December 2016" ?>
+  <?define productName="Microsoft Azure PowerShell - January 2017" ?>
   <?define sourceDir="$(var.SolutionDir)..\src\Package\$(var.Configuration)" ?>
   <?define caSourceDir="$(var.SolutionDir)setup\bin\$(var.Configuration)" ?>
 
-  <?define version="3.3.0" ?>
+  <?define version="3.4.0" ?>
 
   <Product Id="*"
            Name="$(var.productName)"

src/Common/Commands.Common.Authentication.Test/Properties/AssemblyInfo.cs

@@ -28,6 +28,6 @@
 
 [assembly: ComVisible(false)]
 [assembly: CLSCompliant(false)]
-[assembly: AssemblyVersion("3.3.0")]
-[assembly: AssemblyFileVersion("3.3.0")]
+[assembly: AssemblyVersion("3.4.0")]
+[assembly: AssemblyFileVersion("3.4.0")]
 [assembly: CollectionBehavior(DisableTestParallelization = true)]

src/Common/Commands.Common.Authentication/Properties/AssemblyInfo.cs

@@ -46,5 +46,5 @@
 // You can specify all the values or you can default the Build and Revision Numbers 
 // by using the '*' as shown below:
 // [assembly: AssemblyVersion("1.0.*")]
-[assembly: AssemblyVersion("3.3.0")]
-[assembly: AssemblyFileVersion("3.3.0")]
+[assembly: AssemblyVersion("3.4.0")]
+[assembly: AssemblyFileVersion("3.4.0")]

src/Common/Commands.Common.Storage/Properties/AssemblyInfo.cs

@@ -24,5 +24,5 @@
 [assembly: ComVisible(false)]
 [assembly: CLSCompliant(false)]
 [assembly: Guid("c565107e-98a9-4703-85cd-a7efc3d8da7b")]
-[assembly: AssemblyVersion("3.3.0")]
-[assembly: AssemblyFileVersion("3.3.0")]
+[assembly: AssemblyVersion("3.4.0")]
+[assembly: AssemblyFileVersion("3.4.0")]

src/Common/Commands.Common/AzurePowerShell.cs

@@ -26,9 +26,9 @@ public class AzurePowerShell
 
         public const string AssemblyCopyright = "Copyright © Microsoft";
 
-        public const string AssemblyVersion = "3.3.0";
+        public const string AssemblyVersion = "3.4.0";
 
-        public const string AssemblyFileVersion = "3.3.0";
+        public const string AssemblyFileVersion = "3.4.0";
 
         public const string ProfileFile = "AzureProfile.json";
 

src/Common/Commands.Common/GeneralUtilities.cs

@@ -38,6 +38,9 @@ public static class GeneralUtilities
 
         private static List<string> AuthorizationHeaderNames = new List<string>() { "Authorization" };
 
+        // this is only used to determine cutoff for streams (not xml or json).
+        private const int StreamCutOffSize = 10 * 1024; //10KB
+
         private static bool TryFindCertificatesInStore(string thumbprint,
             System.Security.Cryptography.X509Certificates.StoreLocation location, out X509Certificate2Collection certificates)
         {
@@ -318,7 +321,9 @@ public static string FormatString(string content)
             }
             else
             {
-                return content;
+                return content.Length <= GeneralUtilities.StreamCutOffSize ? 
+                    content : 
+                    content.Substring(0, StreamCutOffSize) + "\r\nDATA TRUNCATED DUE TO SIZE\r\n";
             }
         }
 

src/Common/Commands.Common/Properties/AssemblyInfo.cs

@@ -25,8 +25,8 @@
 [assembly: ComVisible(false)]
 [assembly: CLSCompliant(false)]
 [assembly: Guid("4f3ab2e4-cc7a-43ac-bb15-f481fcf94d58")]
-[assembly: AssemblyVersion("3.3.0")]
-[assembly: AssemblyFileVersion("3.3.0")]
+[assembly: AssemblyVersion("3.4.0")]
+[assembly: AssemblyFileVersion("3.4.0")]
 #if SIGN
 [assembly: InternalsVisibleTo("Microsoft.WindowsAzure.Commands, PublicKey=0024000004800000940000000602000000240000525341310004000001000100b5fc90e7027f67871e773a8fde8938c81dd402ba65b9201d60593e96c492651e889cc13f1415ebb53fac1131ae0bd333c5ee6021672d9718ea31a8aebd0da0072f25d87dba6fc90ffd598ed4da35e44c398c454307e8e33b8426143daec9f596836f97c8f74750e5975c64e2189f45def46b2a2b1247adc3652bf5c308055da9")]
 [assembly: InternalsVisibleTo("Microsoft.WindowsAzure.Commands.CloudService, PublicKey=0024000004800000940000000602000000240000525341310004000001000100b5fc90e7027f67871e773a8fde8938c81dd402ba65b9201d60593e96c492651e889cc13f1415ebb53fac1131ae0bd333c5ee6021672d9718ea31a8aebd0da0072f25d87dba6fc90ffd598ed4da35e44c398c454307e8e33b8426143daec9f596836f97c8f74750e5975c64e2189f45def46b2a2b1247adc3652bf5c308055da9")]

src/Common/Commands.ScenarioTests.Common/Properties/AssemblyInfo.cs

@@ -32,6 +32,6 @@
 // You can specify all the values or you can default the Build and Revision Numbers 
 // by using the '*' as shown below:
 // [assembly: AssemblyVersion("1.0.*")]
-[assembly: AssemblyVersion("3.3.0")]
-[assembly: AssemblyFileVersion("3.3.0")]
+[assembly: AssemblyVersion("3.4.0")]
+[assembly: AssemblyFileVersion("3.4.0")]
 [assembly: CollectionBehavior(DisableTestParallelization = true)]

src/ResourceManager/AnalysisServices/AnalysisServices.sln

@@ -18,6 +18,8 @@ Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Commands.AnalysisServices.T
 EndProject
 Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Commands.AnalysisServices", "Commands.AnalysisServices\Commands.AnalysisServices.csproj", "{8AAB43E6-E8F6-4F91-AF8A-6A63CD78EF1E}"
 EndProject
+Project("{FAE04EC0-301F-11D3-BF4B-00C04F79EFBC}") = "Commands.AnalysisServices.Dataplane", "Commands.AnalysisServices.Dataplane\Commands.AnalysisServices.Dataplane.csproj", "{4944B213-4F12-4815-B416-3FF1853ADCC1}"
+EndProject
 Global
 	GlobalSection(SolutionConfigurationPlatforms) = preSolution
 		Debug|Any CPU = Debug|Any CPU
@@ -52,6 +54,10 @@ Global
 		{8AAB43E6-E8F6-4F91-AF8A-6A63CD78EF1E}.Debug|Any CPU.Build.0 = Debug|Any CPU
 		{8AAB43E6-E8F6-4F91-AF8A-6A63CD78EF1E}.Release|Any CPU.ActiveCfg = Release|Any CPU
 		{8AAB43E6-E8F6-4F91-AF8A-6A63CD78EF1E}.Release|Any CPU.Build.0 = Release|Any CPU
+		{4944B213-4F12-4815-B416-3FF1853ADCC1}.Debug|Any CPU.ActiveCfg = Debug|Any CPU
+		{4944B213-4F12-4815-B416-3FF1853ADCC1}.Debug|Any CPU.Build.0 = Debug|Any CPU
+		{4944B213-4F12-4815-B416-3FF1853ADCC1}.Release|Any CPU.ActiveCfg = Release|Any CPU
+		{4944B213-4F12-4815-B416-3FF1853ADCC1}.Release|Any CPU.Build.0 = Release|Any CPU
 	EndGlobalSection
 	GlobalSection(SolutionProperties) = preSolution
 		HideSolutionNode = FALSE