Skip to content

ci: Fix overhead measurements runs on default branch #7313

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Mar 1, 2023
Merged

Conversation

mydea
Copy link
Member

@mydea mydea commented Mar 1, 2023

Currently, it doesn't handle the fact that it runs the measurements on develop very well, and picks random PRs to add comments to 😬

@github-actions
Copy link
Contributor

github-actions bot commented Mar 1, 2023

Replay SDK metrics 🚀

    Plain +Sentry +Replay
Revision Value Value Diff Ratio Value Diff Ratio
LCP This PR 69fbbbc 63.57 ms 62.67 ms -0.90 ms -1.42 % 71.86 ms +8.29 ms +13.04 %
Baseline 8a5e0c3 87.70 ms 76.81 ms -10.89 ms -12.42 % 82.41 ms -5.29 ms -6.03 %
CLS This PR 69fbbbc 0.00 ms 0.00 ms 0.00 ms 0.00 % 0.25 ms +0.25 ms +5421.33 %
Baseline 8a5e0c3 0.00 ms 0.00 ms 0.00 ms 0.00 % 0.25 ms +0.25 ms +5395.74 %
CPU This PR 69fbbbc 18.65 % 18.69 % +0.04 pp +0.23 % 34.89 % +16.24 pp +87.12 %
Baseline 8a5e0c3 25.97 % 26.29 % +0.33 pp +1.27 % 44.57 % +18.61 pp +71.67 %
JS heap avg This PR 69fbbbc 3.54 MB 6.93 MB +3.39 MB +95.67 % 11.29 MB +7.75 MB +218.84 %
Baseline 8a5e0c3 3.47 MB 5.81 MB +2.34 MB +67.51 % 10.01 MB +6.55 MB +188.91 %
JS heap max This PR 69fbbbc 3.9 MB 8.34 MB +4.44 MB +113.77 % 14.19 MB +10.29 MB +263.69 %
Baseline 8a5e0c3 3.89 MB 7.65 MB +3.75 MB +96.49 % 13.87 MB +9.98 MB +256.58 %
netTx This PR 69fbbbc 0 B 360.44 kB +360.44 kB n/a 105.65 kB +105.65 kB n/a
Baseline 8a5e0c3 0 B 228.09 kB +228.09 kB n/a 106.82 kB +106.82 kB n/a
netRx This PR 69fbbbc 18.1 kB 17.45 kB -645 B -3.56 % 18.16 kB +65 B +0.36 %
Baseline 8a5e0c3 17.17 kB 18.18 kB +1.02 kB +5.91 % 17.08 kB -84 B -0.49 %
netCount This PR 69fbbbc 1 2 +1 +100.00 % 4 +3 +300.00 %
Baseline 8a5e0c3 1 2 +1 +100.00 % 5 +4 +400.00 %
netTime This PR 69fbbbc 538.43 ms 802.53 ms +264.10 ms +49.05 % 742.37 ms +203.94 ms +37.88 %
Baseline 8a5e0c3 681.36 ms 804.14 ms +122.78 ms +18.02 % 793.97 ms +112.60 ms +16.53 %

Baseline results on branch: develop

RevisionLCPCLSCPUJS heap avgJS heap maxnetTxnetRxnetCountnetTime
3ba8e0b+11.39 ms+0.26 ms+18.59 pp+7.64 MB+10.42 MB+105.73 kB+332 B+3+67.85 ms
dbd7a81+98.37 ms-0.00 ms+6.68 pp+1.64 MB+1.82 MB+2.23 kB+41 B+1+124.71 ms
dbd7a81+86.19 ms-0.00 ms+6.77 pp+1.58 MB+1.67 MB+2.23 kB+41 B+1+87.99 ms
67b0684+84.74 ms-0.00 ms+7.38 pp+1.7 MB+1.81 MB+2.23 kB+41 B+1+85.52 ms
4b95c04+57.56 ms-0.00 ms+7.94 pp+920.88 kB+1.05 MB+2.21 kB+41 B+1+90.32 ms
e60cd02+56.25 ms-0.00 ms+6.32 pp+927.44 kB+1.06 MB+2.21 kB+41 B+1+117.55 ms
e25c067+48.34 ms+0.00 ms+5.59 pp+926.37 kB+1.05 MB+2.22 kB+41 B+1+65.23 ms
b1b249b+43.88 ms+0.00 ms+4.80 pp+937.99 kB+1.05 MB+2.22 kB+41 B+1+111.56 ms
12e34d4+28.57 ms+0.00 ms+5.77 pp+930.12 kB+1.04 MB+2.26 kB+41 B+1+109.67 ms

Previous results on branch: fn/fix-metrics

RevisionLCPCLSCPUJS heap avgJS heap maxnetTxnetRxnetCountnetTime
8a5e0c3-5.29 ms+0.25 ms+18.61 pp+6.55 MB+9.98 MB+106.82 kB-84 B+4+112.60 ms
3ba8e0b+11.39 ms+0.26 ms+18.59 pp+7.64 MB+10.42 MB+105.73 kB+332 B+3+67.85 ms
dbd7a81+98.37 ms-0.00 ms+6.68 pp+1.64 MB+1.82 MB+2.23 kB+41 B+1+124.71 ms
dbd7a81+86.19 ms-0.00 ms+6.77 pp+1.58 MB+1.67 MB+2.23 kB+41 B+1+87.99 ms
67b0684+84.74 ms-0.00 ms+7.38 pp+1.7 MB+1.81 MB+2.23 kB+41 B+1+85.52 ms
4b95c04+57.56 ms-0.00 ms+7.94 pp+920.88 kB+1.05 MB+2.21 kB+41 B+1+90.32 ms
e60cd02+56.25 ms-0.00 ms+6.32 pp+927.44 kB+1.06 MB+2.21 kB+41 B+1+117.55 ms
e25c067+48.34 ms+0.00 ms+5.59 pp+926.37 kB+1.05 MB+2.22 kB+41 B+1+65.23 ms
b1b249b+43.88 ms+0.00 ms+4.80 pp+937.99 kB+1.05 MB+2.22 kB+41 B+1+111.56 ms
12e34d4+28.57 ms+0.00 ms+5.77 pp+930.12 kB+1.04 MB+2.26 kB+41 B+1+109.67 ms

*) pp - percentage points - an absolute difference between two percentages.
Last updated: Wed, 01 Mar 2023 15:14:44 GMT

@mydea mydea merged commit b887fb7 into develop Mar 1, 2023
@mydea mydea deleted the fn/fix-metrics branch March 1, 2023 15:29
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants