Skip to content

OCPBUGS-7102: make plugin e2e tests skippable #444

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 3 commits into from
Feb 15, 2023

Conversation

perdasilva
Copy link
Contributor

@perdasilva perdasilva commented Feb 7, 2023

This PR:

  • updates the plug-in framework to help make the e2e tests skippable when the plug-in is not enabled
  • removes the unit test timebomb
  • adds a new make target make update-plugin-deps
  • make the new target a dependency of the make vendor target

The CSV Labeler Plug-in test suite included a timebomb to force us to remember to switch the branch of its dependency on
github.com/openshift/cluster-policy-controller, i.e.

olm@release-master -> cluster-policy-controller@master
[email protected] -> [email protected]
[email protected] -> [email protected]
...

Instead of this, I've added a new script that go gets the latest dependency at the particular branch and attached it to the make vendor target. If there are changes here, the verify job will fail and we'll have to update the vendor folder and update the PR.

NOTE verify job will fail due to the removal of the timebomb test: changes to staging - this can be safely overridden

Signed-off-by: perdasilva [email protected]

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 7, 2023

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: perdasilva

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@dinhxuanvu
Copy link
Member

How can I disapprove this? 😉

@openshift-ci openshift-ci bot added the approved Indicates a PR has been approved by an approver from all required OWNERS files. label Feb 7, 2023
@perdasilva
Copy link
Contributor Author

perdasilva commented Feb 7, 2023

How can I disapprove this? wink

Just say the word, @dinhxuanvu XD

@grokspawn
Copy link
Contributor

/override ci/prow/verify

This is deliberately downstream-only.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 7, 2023

@grokspawn: Overrode contexts on behalf of grokspawn: ci/prow/verify

In response to this:

/override ci/prow/verify

This is deliberately downstream-only.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@perdasilva
Copy link
Contributor Author

/retest

@grokspawn
Copy link
Contributor

/hold for linking with OCPBUGS-7102

@openshift-ci openshift-ci bot added the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 7, 2023
@perdasilva perdasilva changed the title make plugin e2e tests skippable OCPBUGS-7102: make plugin e2e tests skippable Feb 7, 2023
@openshift-ci-robot openshift-ci-robot added jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. labels Feb 7, 2023
@openshift-ci-robot
Copy link

@perdasilva: This pull request references Jira Issue OCPBUGS-7102, which is valid. The bug has been moved to the POST state.

3 validation(s) were run on this bug
  • bug is open, matching expected state (open)
  • bug target version (4.13.0) matches configured target version for branch (4.13.0)
  • bug is in the state ASSIGNED, which is one of the valid states (NEW, ASSIGNED, POST)

Requesting review from QA contact:
/cc @jianzhangbjz

The bug has been updated to refer to the pull request using the external bug tracker.

In response to this:

This PR:

  • updates the plug-in framework to help make the e2e tests skippable when the plug-in is not enabled
  • removes the unit test timebomb
  • adds a new make target make update-plugin-deps
  • make the new target a dependency of the make vendor target

The CSV Labeler Plug-in test suite included a timebomb to force us to remember to switch the branch of its dependency on
github.com/openshift/cluster-policy-controller, i.e.

olm@release-master -> cluster-policy-controller@master
[email protected] -> [email protected]
[email protected] -> [email protected]
...

Instead of this, I've added a new script that go gets the latest dependency at the particular branch and attached it to the make vendor target. If there are changes here, the verify job will fail and we'll have to update the vendor folder and update the PR.

NOTE verify job will fail due to the removal of the timebomb test: changes to staging - this can be safely overridden

Signed-off-by: perdasilva [email protected]

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci openshift-ci bot requested a review from jianzhangbjz February 7, 2023 17:04
@grokspawn
Copy link
Contributor

/unhold

@openshift-ci openshift-ci bot removed the do-not-merge/hold Indicates that a PR should not merge because someone has issued a /hold command. label Feb 7, 2023
@grokspawn
Copy link
Contributor

/test e2e-upgrade

@awgreene
Copy link
Contributor

awgreene commented Feb 8, 2023

/retest

4 similar comments
@grokspawn
Copy link
Contributor

/retest

@grokspawn
Copy link
Contributor

/retest

@grokspawn
Copy link
Contributor

/retest

@grokspawn
Copy link
Contributor

/retest

@grokspawn
Copy link
Contributor

/lgtm

@openshift-ci openshift-ci bot added the lgtm Indicates that a PR is ready to be merged. label Feb 14, 2023
@openshift-ci-robot
Copy link

/retest-required

Remaining retests: 0 against base HEAD 8aa0b41 and 2 for PR HEAD 4a28010 in total

@grokspawn
Copy link
Contributor

/retest-required

@grokspawn
Copy link
Contributor

/retest

@grokspawn
Copy link
Contributor

/test verify

@grokspawn
Copy link
Contributor

/override ci/prow/verify

Urg. Evidently I have to override for normal CI, and then for pre-merge-check CI as well?

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 15, 2023

@grokspawn: Overrode contexts on behalf of grokspawn: ci/prow/verify

In response to this:

/override ci/prow/verify

Urg. Evidently I have to override for normal CI, and then for pre-merge-check CI as well?

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-ci
Copy link
Contributor

openshift-ci bot commented Feb 15, 2023

@perdasilva: all tests passed!

Full PR test history. Your PR dashboard.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here.

@openshift-merge-robot openshift-merge-robot merged commit bae42cd into openshift:master Feb 15, 2023
@openshift-ci-robot
Copy link

@perdasilva: All pull requests linked via external trackers have merged:

Jira Issue OCPBUGS-7102 has been moved to the MODIFIED state.

In response to this:

This PR:

  • updates the plug-in framework to help make the e2e tests skippable when the plug-in is not enabled
  • removes the unit test timebomb
  • adds a new make target make update-plugin-deps
  • make the new target a dependency of the make vendor target

The CSV Labeler Plug-in test suite included a timebomb to force us to remember to switch the branch of its dependency on
github.com/openshift/cluster-policy-controller, i.e.

olm@release-master -> cluster-policy-controller@master
[email protected] -> [email protected]
[email protected] -> [email protected]
...

Instead of this, I've added a new script that go gets the latest dependency at the particular branch and attached it to the make vendor target. If there are changes here, the verify job will fail and we'll have to update the vendor folder and update the PR.

NOTE verify job will fail due to the removal of the timebomb test: changes to staging - this can be safely overridden

Signed-off-by: perdasilva [email protected]

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@openshift-cherrypick-robot

@grokspawn: new pull request created: #447

In response to this:

/cherry-pick release-4.12

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved Indicates a PR has been approved by an approver from all required OWNERS files. bugzilla/valid-bug Indicates that a referenced Bugzilla bug is valid for the branch this PR is targeting. jira/valid-bug Indicates that a referenced Jira bug is valid for the branch this PR is targeting. jira/valid-reference Indicates that this PR references a valid Jira ticket of any type. lgtm Indicates that a PR is ready to be merged.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants