Skip to content

Run EVM tests with --rts-statistics and collect the results #2533

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 26 commits into from
May 6, 2021

Conversation

andreiburdusa
Copy link
Contributor

@andreiburdusa andreiburdusa commented Apr 7, 2021

Fixes #2455


Review checklist

The author performs the actions on the checklist. The reviewer evaluates the work and checks the boxes as they are completed.

  • Summary. Write a summary of the changes. Explain what you did to fix the issue, and why you did it. Present the changes in a logical order. Instead of writing a summary in the pull request, you may push a clean Git history.
  • Documentation. Write documentation for new functions. Update documentation for functions that changed, or complete documentation where it is missing.
  • Tests. Write unit tests for every change. Write the unit tests that were missing before the changes. Include any examples from the reported issue as integration tests.
  • Clean up. The changes are already clean. Clean up anything near the changes that you noticed while working. This does not mean only spatially near the changes, but logically near: any code that interacts with the changes!

@ttuegel ttuegel marked this pull request as ready for review April 7, 2021 14:30
@ttuegel ttuegel self-requested a review April 7, 2021 14:30
@github-actions
Copy link

name diff_allocated_bytes diff_max_live_bytes
./test-pop1.sh -0.000000�~3�� 0
./test-straight-line.sh 0 0
./test-sumTo10.sh -0.000000�~3�� -0.000986:�[&�
./test-straight-line-no-invalid.sh -0.000000�~3�� 0
./test-branching-no-invalid.sh 0.000000 0
./test-add0.sh -0.000000�~3�� 0.000000
./test-sum-to-n.sh -0.000008�~3�� 0.002274
./test-branching-invalid.sh 0.000021 0

@ttuegel
Copy link
Contributor

ttuegel commented Apr 29, 2021

It makes comments! Even if they are garbled...

@github-actions
Copy link

github-actions bot commented May 3, 2021

name diff_allocated_bytes diff_max_live_bytes
./test-pop1.sh 0.000749 -0.000200
./test-straight-line.sh 0.000727 -0.000260
./test-sumTo10.sh 0.000034 -0.019946
./test-straight-line-no-invalid.sh 0.000783 -0.000182
./test-branching-no-invalid.sh 0.000602 -0.000285
./test-add0.sh 0.000546 -0.000200
./test-sum-to-n.sh 0.000114 0.005901
./test-branching-invalid.sh 0.000555 -0.000229

@github-actions
Copy link

github-actions bot commented May 4, 2021

name diff_allocated_bytes diff_max_live_bytes
./test-pop1.sh -0.000000 -0.000035
./test-straight-line.sh -0.000000 0
./test-sumTo10.sh -0.000000 0.000009
./test-straight-line-no-invalid.sh 0.000001 -0.000036
./test-branching-no-invalid.sh 0.000003 -0.000036
./test-add0.sh 0 0
./test-sum-to-n.sh -0.000001 -0.000072
./test-branching-invalid.sh 0.000000 -0.000036

@github-actions
Copy link

github-actions bot commented May 4, 2021

name diff_allocated_bytes diff_max_live_bytes
./test-pop1.sh 0.000030 0.117628
./test-straight-line.sh -0.000000 0
./test-sumTo10.sh 0.000001 -0.000612
./test-straight-line-no-invalid.sh 0.000000 0
./test-branching-no-invalid.sh -0.000000 0
./test-add0.sh 0.000000 0
./test-sum-to-n.sh -0.000002 0.001516
./test-branching-invalid.sh -0.000000 0

Copy link
Contributor Author

@andreiburdusa andreiburdusa left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is miller the package that contains mlr?

@github-actions
Copy link

github-actions bot commented May 5, 2021

name diff_allocated_bytes diff_max_live_bytes
test/regression-evm/test-pop1.sh -0.000000 -0.000034
test/regression-evm/test-straight-line.sh -0.000024 -0.000036
test/regression-evm/test-sumTo10.sh -0.000000 -0.001884
test/regression-evm/test-straight-line-no-invalid.sh 0.000001 -0.000035
test/regression-evm/test-branching-no-invalid.sh 0.000003 -0.000035
test/regression-evm/test-add0.sh 0.000000 -0.000000
test/regression-evm/test-sum-to-n.sh -0.000003 0.003407
test/regression-evm/test-branching-invalid.sh 0.000000 -0.000036
test/regression-wasm/test-simple-arithmetic.sh -0.000004 0
test/regression-wasm/test-locals.sh -0.000000 0
test/regression-wasm/test-loops.sh -0.000010 0
test/regression-wasm/test-wrc20.sh 0.000011 -0.002941
test/regression-wasm/test-memory.sh -0.000025 0

@github-actions
Copy link

github-actions bot commented May 5, 2021

name diff_allocated_bytes diff_max_live_bytes
test/regression-evm/test-pop1.sh 0.000000 -0.000037
test/regression-evm/test-straight-line.sh -0.000000 0
test/regression-evm/test-sumTo10.sh -0.000000 0.000162
test/regression-evm/test-straight-line-no-invalid.sh -0.000000 0.000000
test/regression-evm/test-branching-no-invalid.sh 0.000000 0
test/regression-evm/test-add0.sh 0.000000 0
test/regression-evm/test-sum-to-n.sh -0.000001 -0.000042
test/regression-evm/test-branching-invalid.sh -0.000001 -0.000038
test/regression-wasm/test-simple-arithmetic.sh 0.000008 0
test/regression-wasm/test-locals.sh 0.000000 0
test/regression-wasm/test-loops.sh -0.000015 0.000001
test/regression-wasm/test-wrc20.sh 0.000015 0.005105
test/regression-wasm/test-memory.sh -0.000007 0

@github-actions
Copy link

github-actions bot commented May 5, 2021

name diff_allocated_bytes diff_max_live_bytes
test/regression-evm/test-pop1.sh 0 0
test/regression-evm/test-straight-line.sh 0.000000 0
test/regression-evm/test-sumTo10.sh -0.000000 0.000093
test/regression-evm/test-straight-line-no-invalid.sh 0.000011 0
test/regression-evm/test-branching-no-invalid.sh 0.000000 -0.000037
test/regression-evm/test-add0.sh 0 0
test/regression-evm/test-sum-to-n.sh 0.000001 0.000090
test/regression-evm/test-branching-invalid.sh 0 0
test/regression-wasm/test-simple-arithmetic.sh 0.000006 0
test/regression-wasm/test-locals.sh 0.000003 -0.000002
test/regression-wasm/test-loops.sh -0.000010 0.000000
test/regression-wasm/test-wrc20.sh -0.000013 -0.012377
test/regression-wasm/test-memory.sh 0.000001 0.000001

@github-actions
Copy link

github-actions bot commented May 6, 2021

name diff_allocated_bytes diff_max_live_bytes
test/regression-evm/test-sumTo10.sh -0.000000 -0.027729
test/regression-evm/test-add0.sh 0.000000 0
test/regression-evm/test-straight-line-no-invalid.sh 0 0.000000
test/regression-evm/test-pop1.sh 0 0
test/regression-evm/test-straight-line.sh 0.000000 0
test/regression-evm/test-branching-invalid.sh -0.000000 0
test/regression-evm/test-branching-no-invalid.sh 0.000000 -0.000037
test/regression-evm/test-sum-to-n.sh -0.000003 -0.000681
test/regression-wasm/test-loops.sh -0.000026 0.000289
test/regression-wasm/test-wrc20.sh 0.000004 0.016099
test/regression-wasm/test-simple-arithmetic.sh 0.000002 0
test/regression-wasm/test-memory.sh 0.000002 0.000000
test/regression-wasm/test-locals.sh -0.000018 0.000000

@rv-jenkins rv-jenkins merged commit 909a9cb into master May 6, 2021
@rv-jenkins rv-jenkins deleted the issue-2455 branch May 6, 2021 17:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Automatic performance testing
3 participants