Skip to content

Implemented live test and integrated into Azure pipeline #20505

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Jan 6, 2023

Conversation

vidai-msft
Copy link
Contributor

Description

Added live test and integrated it in the pipeline.
This PR added the followings for live test.

  • Common module of live test - LiveTestUtility
  • Common module of test coverage - TestCoverageUtility
  • Ingest live test data and test coverage data to Kusto - KustoUtility
  • Live test pipeline related functions
  1. Script to invoke .ps1 for different PowerShell hosts - InvokeLiveTestCITask.ps1
  2. Script to install Az modules based on different sources - InstallLiveTestAzModules.ps1
  3. Script to connect Azure environment with service principal - ConnectLiveTestServicePrincipal.ps1
  4. Script to invoke each module which has live test file - InvokeLiveTestScenarios.ps1
  5. Script to save live test data and test coverage data to Kusto - SaveLiveTestResult.ps1

In addition, for Release build, test coverage is only enabled when TESTCOVERAGE compilation symbol is inserted.
So added one parameter for daily build with the flag TurnOnTestCoverage=true.

Checklist

  • SHOULD select appropriate branch. Cmdlets from Autorest.PowerShell should go to generation branch.
  • SHOULD make the title of PR clear and informative, and in the present imperative tense.
  • SHOULD update ChangeLog.md file(s) appropriately
    • For any service, the ChangeLog.md file can be found at src/{{SERVICE}}/{{SERVICE}}/ChangeLog.md
    • A snippet outlining the change(s) made in the PR should be written under the ## Upcoming Release header in the past tense. Add changelog in description section if PR goes into generation branch.
    • Should not change ChangeLog.md if no new release is required, such as fixing test case only.
  • SHOULD have approved design review for the changes in this repository (Microsoft internal only) with following situations
    • Create new module from scratch
    • Create new resource types which are not easy to conform to Azure PowerShell Design Guidelines
    • Create new resource type which name doesn't use module name as prefix
    • Have design question before implementation
  • SHOULD regenerate markdown help files if there is cmdlet API change. Instruction
  • SHOULD have proper test coverage for changes in pull request.
  • SHOULD NOT introduce breaking changes in Az minor release except preview version.
  • SHOULD NOT adjust version of module manually in pull request

@vidai-msft vidai-msft force-pushed the livetest branch 2 times, most recently from d0e12c7 to 152275d Compare December 22, 2022 13:32
}

$ModuleDetails = @{ TotalCommands = $totalCommands; TotalParameterSets = $totalParameterSets; TotalParameters = $totalParameters }
$ModuleDetails
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Do you want to return it or print it?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I want to return the hashtable. Added OutputType()

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I would like to return it explicitly。

@wyunchi-ms wyunchi-ms merged commit 790025c into Azure:main Jan 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants