[DO NOT SUBMIT] Overlay performance tests #3161
Conversation
|
Note: there is also an increase about 30% on mutation write time, because the SDK now writes more data with local mutations. Things might improve when we remove base mutations, we should re-run this test when they are removed. |
|
RAW log attached: |
|
The public api surface has changed for the subproject firebase-firestore: Please update the api.txt files for the subprojects being affected by this change by running ./gradlew ${subproject}:generateApiTxtFile. Also perform a major/minor bump accordingly. |
Coverage ReportAffected SDKsNo changes between base commit (a8f8dd9) and head commit (8ec0b227). Test Logs
NotesHTML coverage reports can be produced locally with Head commit (8ec0b227) is created by Prow via merging commits: a8f8dd9 071ecbf. |
Binary Size ReportAffected SDKs
Test Logs
NotesHead commit (8ec0b227) is created by Prow via merging commits: a8f8dd9 071ecbf. |
|
@wu-hui: The following tests failed, say
Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository. I understand the commands that are listed here. |
All data are from the average of three runs.
As expected, with overlay the query performance stays constant as the number of local mutations grows; while without overlay, the query performance grows linearly as the number of local mutations grows.
Without Overlay
Write 10,000 mutations, each document has 1 mutation: 11614ms
Run 100 queries: 3932ms
Write 40,000 mutations, each document has 4 mutations: 57618ms
Run 100 queries: 7987ms
Write 70,000 mutations, each document has 7 mutations: 108599ms
Run 100 queries: 11798ms
Write 100,000 mutations, each document has 10 mutations: 168217ms
Run 100 queries: 15406ms
With Overlay
Write 10,000 mutations, each document has 1 mutation: 15327ms
Run 100 queries: 4493ms
Write 40,000 mutations, each document has 4 mutations: 67575ms
Run 100 queries: 4278ms
Write 70,000 mutations, each document has 7 mutations: 123661ms
Run 100 queries: 4767ms
Write 100,000 mutations, each document has 10 mutations: 185487ms
Run 100 queries: 4699ms