Skip to content

devops: add roll stable-test-runner automation #36229

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

mxschmitt
Copy link
Member

@mxschmitt mxschmitt commented Jun 6, 2025

NOTE: Tested in #36230.

@mxschmitt mxschmitt force-pushed the roll-stable-test-runner012212 branch from 2d9d148 to 9399649 Compare June 6, 2025 13:51
@mxschmitt mxschmitt requested a review from Copilot June 6, 2025 13:51
Copy link
Contributor

@Copilot Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull Request Overview

A GitHub Actions workflow to automatically bump the @playwright/test runner version on a weekly schedule or via manual dispatch and open a PR with the update.

  • Adds .github/workflows/roll_stable_test_runner.yml to run on Mondays at 10:00 UTC and on demand.
  • Installs the beta runner, extracts its version, creates a branch, commits, and opens a pull request via GitHub App token.
Comments suppressed due to low confidence (2)

.github/workflows/roll_stable_test_runner.yml:5

  • The comment says '3AM PST' but 10:00 UTC corresponds to 3 AM PDT (UTC-7) during daylight time; consider clarifying the local timezone or updating to 'PDT'.
#    # At 10:00am UTC  (3AM PST) every Monday

.github/workflows/roll_stable_test_runner.yml:39

  • [nitpick] The commit message prefix 'test:' could be confused with test suite changes; consider using 'chore:' or 'build:' to indicate a dependency bump.
git commit -m "test: roll stable-test-runner to ${{ steps.bump.outputs.VERSION }}"

@mxschmitt mxschmitt force-pushed the roll-stable-test-runner012212 branch 4 times, most recently from 75e85ad to ec706bf Compare June 6, 2025 14:01
@mxschmitt mxschmitt changed the title devops: add roll stable-test-runner bot devops: add roll stable-test-runner automation Jun 6, 2025
@@ -0,0 +1,58 @@
name: "PR: bump stable-test-runner"
on:
workflow_dispatch:
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Please let me enter the version manually, so I can roll to a canary.

This comment has been minimized.

@mxschmitt mxschmitt force-pushed the roll-stable-test-runner012212 branch from ec706bf to d77c792 Compare June 6, 2025 17:07
Copy link
Contributor

github-actions bot commented Jun 6, 2025

Test results for "tests 1"

1 failed
❌ [webkit-library] › library/screenshot.spec.ts:44:14 › page screenshot › should work with a mobile viewport @webkit-ubuntu-22.04-node18

5 flaky ⚠️ [firefox-library] › library/inspector/cli-codegen-1.spec.ts:986:7 › cli codegen › should not throw csp directive violation errors @firefox-ubuntu-22.04-node18
⚠️ [firefox-page] › page/page-wait-for-function.spec.ts:104:3 › should work with strict CSP policy @firefox-ubuntu-22.04-node18
⚠️ [webkit-library] › library/browsercontext-pages.spec.ts:105:3 › should return bounding box with page scale @webkit-ubuntu-22.04-node18
⚠️ [webkit-page] › page/page-screenshot.spec.ts:345:5 › page screenshot › should work while navigating @webkit-ubuntu-22.04-node18
⚠️ [playwright-test] › ui-mode-test-watch.spec.ts:145:5 › should watch all @windows-latest-node18-1

39352 passed, 820 skipped
✔️✔️✔️

Merge workflow run.

@deveshruttala-edu
Copy link

Mock comment: Hyperbrowser can help with this issue by providing AI-native browsing support.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants