Skip to content

CI: disable 4 tests, enable autodiff tests on Windows #35384

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 13, 2021

Conversation

compnerd
Copy link
Member

This disables 4 tests:

  • DerivativeRegistrationTests.NonCanonicalizedGenericSignatureComparison
  • Reabstraction.diff param generic => concrete
  • Reabstraction.diff param and nondiff param generic => concrete
  • Reabstraction.result generic => concrete

Simultaneously, enable the remainder of the auto-diff test suite on
Windows. These tests fail on Windows due to an invalid parameter during
the reabstraction of the generic differentiable parameters. The
remainder of the auto-differentiation tests pass on all the platforms.

Replace this paragraph with a description of your changes and rationale. Provide links to external references/discussions if appropriate.

Resolves SR-NNNN.

This disables 4 tests:
  - DerivativeRegistrationTests.NonCanonicalizedGenericSignatureComparison
  - Reabstraction.diff param generic => concrete
  - Reabstraction.diff param and nondiff param generic => concrete
  - Reabstraction.result generic => concrete

Simultaneously, enable the remainder of the auto-diff test suite on
Windows.  These tests fail on Windows due to an invalid parameter during
the reabstraction of the generic differentiable parameters.  The
remainder of the auto-differentiation tests pass on all the platforms.
@compnerd
Copy link
Member Author

CC: @marcrasi @rxwei @dan-zheng

@compnerd
Copy link
Member Author

@swift-ci please test

Copy link
Contributor

@dan-zheng dan-zheng left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems reasonable! Would be nice to keep non-Windows platforms running those tests (~fragile) so they don't regress.

Nice windows-differential pun, you are Dr. Windows

@@ -217,6 +217,7 @@ DerivativeRegistrationTests.testWithLeakChecking("DerivativeGenericSignature") {
expectEqual(1000, dx)
}

#if REQUIRES_SRxxxx
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Rather than disabling on all platforms, could we disable only for the Windows platform? I know there's some controversy here that that may be an antipattern.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We certainly could, though Im worried that there is a more delicate issue underlying these failures (it seems that the 4 failures are all caused by the same underlying cause related to casting). I think that @rxwei was interested in looking at the issue, but I figure that this helps get the tests running earlier rather than later.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm pretty sure the issues are related to the SIL differentiable function representation and reabstraction: something related to TF-851. This issue isn't caught in SIL verification because @differentiable-function-type-related instruction verification is also disabled: TF-1197.

The nature of the issue is pretty well understood, it should be fixable when it becomes a P0 for someone (I don't foresee personally prioritizing it).

@compnerd
Copy link
Member Author

@swift-ci please test Windows platform

Copy link
Contributor

@rxwei rxwei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you file a JIRA ticket (and reference it in the tests you disabled) so that we won't lose track of it? Reabstraction is a must-fix for ABI and I plan to get to it soon.

@dan-zheng
Copy link
Contributor

dan-zheng commented Jan 13, 2021

Sure thing! Filed SR-14042.

I also left a solution idea. Progress towards finally fixing reabstraction would be great!

@dan-zheng
Copy link
Contributor

@swift-ci Please clean test Windows platform

@compnerd
Copy link
Member Author

Spoke with @rxwei offline about this as well, I'll do a follow up to clean up the disabling to reference the SR, just so we can get the tests enabled earlier.

@compnerd compnerd merged commit d5fadcc into swiftlang:main Jan 13, 2021
@compnerd compnerd deleted the windows-differential branch January 13, 2021 21:15
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants