Skip to content

test(browser-integration): Skip "browsertracing/backgroundtab-pageload" test for firefox #7475

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
Mar 16, 2023

Conversation

billyvg
Copy link
Member

@billyvg billyvg commented Mar 15, 2023

This has been flakey... trace.status is sometimes undefined, lets skip for firefox

…d" test for firefox

This has been flakey... trace.status is sometimes undefined, lets skip for firefox
@github-actions
Copy link
Contributor

github-actions bot commented Mar 15, 2023

size-limit report 📦

Path Size
@sentry/browser - ES5 CDN Bundle (gzipped + minified) 20.41 KB (0%)
@sentry/browser - ES5 CDN Bundle (minified) 63.3 KB (0%)
@sentry/browser - ES6 CDN Bundle (gzipped + minified) 18.99 KB (+0.01% 🔺)
@sentry/browser - ES6 CDN Bundle (minified) 56.21 KB (0%)
@sentry/browser - Webpack (gzipped + minified) 20.65 KB (0%)
@sentry/browser - Webpack (minified) 67.44 KB (0%)
@sentry/react - Webpack (gzipped + minified) 20.68 KB (0%)
@sentry/nextjs Client - Webpack (gzipped + minified) 52.12 KB (+0.07% 🔺)
@sentry/browser + @sentry/tracing - ES5 CDN Bundle (gzipped + minified) 33.66 KB (+0.02% 🔺)
@sentry/browser + @sentry/tracing - ES6 CDN Bundle (gzipped + minified) 26.01 KB (+0.05% 🔺)
@sentry/replay ES6 CDN Bundle (gzipped + minified) 43.17 KB (0%)
@sentry/replay - Webpack (gzipped + minified) 37.19 KB (0%)
@sentry/browser + @sentry/tracing + @sentry/replay - ES6 CDN Bundle (gzipped + minified) 61.31 KB (+0.02% 🔺)
@sentry/browser + @sentry/replay - ES6 CDN Bundle (gzipped + minified) 54.39 KB (+0.01% 🔺)

@billyvg billyvg marked this pull request as ready for review March 15, 2023 22:58
@billyvg billyvg requested a review from mydea March 15, 2023 22:58
Copy link
Member

@Lms24 Lms24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hmm so #7442 didn't seem to fix all flakes?
Generally skipping firefox sounds reasonable to me as we've seen multiple times in the past that the flakes occur especially on FF.

Did you run the test by any chance for e.g. 100 times? We recently decided that we want to run integration test changes x100 to better check if flakes are gone. Wrapping the sentryTest in a good old for loop should do.

sentryTest(
'should finish pageload transaction when the page goes background',
async ({ browserName, getLocalTestPath, page }) => {
// TODO: This is flakey on firefox... trace.status is sometimes undefined
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we don't even need the TODO here. IMO it's unlikely that we'll fix this any time soon.

Copy link
Member

@mydea mydea left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just got 3 (!) of these errors in a single PR, so let's get rid of this!

Copy link
Member

@Lms24 Lms24 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, me too. Let's skip the 100x thing for this one.

@billyvg hope you don't mind but I'm gonna merge this in as it's really a pain atm

@Lms24 Lms24 merged commit c25dece into develop Mar 16, 2023
@Lms24 Lms24 deleted the test-tracing-backgroundtab-flakey-firefox branch March 16, 2023 12:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants