Skip to content

Firestore: add TODO comments about removing special 'missing index' test logic for multidb #5600

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Dec 14, 2023

Conversation

dconeybe
Copy link
Contributor

Add a comment to Firestore's integration tests about removing special logic when testing for the "missing index" error message. Formerly, the "missing index" error message was different for the default database and a non-default database; however, their logic has been unified, and will be rolled out to production soon. Once rolled out, these tests should be updated to remove the special logic for non-default dbs.

Also, remove the "else" branch that verified a different error message when a non-default db was used because when that change rolls out that "else" block will start to fail, seemingly without reason. This also brings the test into parity with the js sdk.

A similar change was made to the js sdk in firebase/firebase-js-sdk#7874.

Googlers see b/316359394 for details.

Copy link
Contributor

github-actions bot commented Dec 14, 2023

📝 PRs merging into main branch

Our main branch should always be in a releasable state. If you are working on a larger change, or if you don't want this change to see the light of the day just yet, consider using a feature branch first, and only merge into the main branch when the code complete and ready to be released.

@google-oss-bot
Copy link
Contributor

Copy link
Contributor

Unit Test Results

   180 files  +   144     180 suites  +144   4m 5s ⏱️ + 3m 12s
1 226 tests +1 069  1 210 ✔️ +1 053  16 💤 +16  0 ±0 
2 476 runs  +2 152  2 444 ✔️ +2 120  32 💤 +32  0 ±0 

Results for commit f92d45f. ± Comparison against base commit ff6cc57.

This pull request removes 157 and adds 1226 tests. Note that renamed tests count towards both.
com.google.firebase.ml.modeldownloader.CustomModelDownloadConditionsTest ‑ testConfigConditions
com.google.firebase.ml.modeldownloader.CustomModelDownloadConditionsTest ‑ testDefaultBuilder
com.google.firebase.ml.modeldownloader.CustomModelDownloadConditionsTest ‑ testTwoConfiguredConditionsDifferent
com.google.firebase.ml.modeldownloader.CustomModelDownloadConditionsTest ‑ testTwoConfiguredConditionsSame
com.google.firebase.ml.modeldownloader.CustomModelDownloadConditionsTest ‑ testTwoDefaultConditionsSame
com.google.firebase.ml.modeldownloader.CustomModelTest ‑ customModel_equals
com.google.firebase.ml.modeldownloader.CustomModelTest ‑ customModel_getDownloadId
com.google.firebase.ml.modeldownloader.CustomModelTest ‑ customModel_getDownloadUrl
com.google.firebase.ml.modeldownloader.CustomModelTest ‑ customModel_getDownloadUrlExpiry
com.google.firebase.ml.modeldownloader.CustomModelTest ‑ customModel_getFileSize
…
com.google.firebase.TimestampTest ‑ testCompare
com.google.firebase.TimestampTest ‑ testFromDate
com.google.firebase.TimestampTest ‑ testRejectBadDates
com.google.firebase.TimestampTest ‑ testTimestampParcelable
com.google.firebase.firestore.AggregateQuerySnapshotTest ‑ createWithCountShouldReturnInstanceWithTheGivenQueryAndCount
com.google.firebase.firestore.AggregateQueryTest ‑ testSourceMustNotBeNull
com.google.firebase.firestore.BlobTest ‑ testComparison
com.google.firebase.firestore.BlobTest ‑ testEquals
com.google.firebase.firestore.BlobTest ‑ testMutableBytes
com.google.firebase.firestore.CollectionReferenceTest ‑ testEquals
…

@google-oss-bot
Copy link
Contributor

@google-oss-bot
Copy link
Contributor

Startup Time Report 1

Note: Layout is sometimes suboptimal due to limited formatting support on GitHub. Please check this report on GCS.

Notes

Startup Times

  • fire-fst

    DeviceStatisticsDistributions
    oriole-32
    Percentileff6cc572f1fde2DiffSignificant (?)
    p10376 ±166 μs515 ±259 μs+139 μs (+37.1%)NO
    p25391 ±166 μs529 ±263 μs+137 μs (+35.1%)NO
    p50430 ±168 μs549 ±264 μs+119 μs (+27.7%)NO
    p75480 ±170 μs611 ±243 μs+131 μs (+27.2%)NO
    p90606 ±241 μs669 ±239 μs+63.0 μs (+10.4%)NO

    20 test runs in comparison
    CommitTest Runs
    ff6cc57
    • 2023-12-13_15:07:04.918943_QIZB
    • 2023-12-13_15:07:04.918972_Ymcs
    • 2023-12-13_15:07:04.918979_GzLR
    • 2023-12-13_15:07:04.918995_ZGAp
    • 2023-12-13_15:07:04.919004_Tfhh
    • 2023-12-13_15:07:04.919011_fNZL
    • 2023-12-13_15:07:04.919018_lSxs
    • 2023-12-13_15:07:04.919025_RVRr
    • 2023-12-13_15:07:04.919032_QCkn
    • 2023-12-13_15:07:04.919040_toNi
    2f1fde2
    • 2023-12-14_17:33:50.600850_JJcM
    • 2023-12-14_17:33:50.600891_JJLN
    • 2023-12-14_17:33:50.600903_tAOH
    • 2023-12-14_17:33:50.600912_NAym
    • 2023-12-14_17:33:50.600919_aOVU
    • 2023-12-14_17:33:50.600927_LfKc
    • 2023-12-14_17:33:50.600946_zKHB
    • 2023-12-14_17:33:50.600954_fRwU
    • 2023-12-14_17:33:50.600961_Jvcd
    • 2023-12-14_17:33:50.600967_XBRs
    redfin-30
    Percentileff6cc572f1fde2DiffSignificant (?)
    p10711 ±226 μs869 ±295 μs+158 μs (+22.1%)NO
    p25731 ±226 μs886 ±292 μs+155 μs (+21.2%)NO
    p50765 ±222 μs914 ±289 μs+148 μs (+19.4%)NO
    p75848 ±257 μs951 ±285 μs+103 μs (+12.1%)NO
    p90924 ±262 μs1.00e+03 ±284 μs+76.4 μs (+8.3%)NO

    20 test runs in comparison
    CommitTest Runs
    ff6cc57
    • 2023-12-13_15:07:04.918943_QIZB
    • 2023-12-13_15:07:04.918972_Ymcs
    • 2023-12-13_15:07:04.918979_GzLR
    • 2023-12-13_15:07:04.918995_ZGAp
    • 2023-12-13_15:07:04.919004_Tfhh
    • 2023-12-13_15:07:04.919011_fNZL
    • 2023-12-13_15:07:04.919018_lSxs
    • 2023-12-13_15:07:04.919025_RVRr
    • 2023-12-13_15:07:04.919032_QCkn
    • 2023-12-13_15:07:04.919040_toNi
    2f1fde2
    • 2023-12-14_17:33:50.600850_JJcM
    • 2023-12-14_17:33:50.600891_JJLN
    • 2023-12-14_17:33:50.600903_tAOH
    • 2023-12-14_17:33:50.600912_NAym
    • 2023-12-14_17:33:50.600919_aOVU
    • 2023-12-14_17:33:50.600927_LfKc
    • 2023-12-14_17:33:50.600946_zKHB
    • 2023-12-14_17:33:50.600954_fRwU
    • 2023-12-14_17:33:50.600961_Jvcd
    • 2023-12-14_17:33:50.600967_XBRs
  • timeToInitialDisplay

    DeviceStatisticsDistributions
    oriole-32
    Percentileff6cc572f1fde2DiffSignificant (?)
    p10203 ±3 ms205 ±4 ms+2.19 ms (+1.1%)NO
    p25211 ±3 ms211 ±3 ms+267 μs (+0.1%)NO
    p50218 ±4 ms219 ±3 ms+675 μs (+0.3%)NO
    p75226 ±4 ms227 ±3 ms+897 μs (+0.4%)NO
    p90234 ±4 ms240 ±5 ms+6.11 ms (+2.6%)NO

    20 test runs in comparison
    CommitTest Runs
    ff6cc57
    • 2023-12-13_15:07:04.918943_QIZB
    • 2023-12-13_15:07:04.918972_Ymcs
    • 2023-12-13_15:07:04.918979_GzLR
    • 2023-12-13_15:07:04.918995_ZGAp
    • 2023-12-13_15:07:04.919004_Tfhh
    • 2023-12-13_15:07:04.919011_fNZL
    • 2023-12-13_15:07:04.919018_lSxs
    • 2023-12-13_15:07:04.919025_RVRr
    • 2023-12-13_15:07:04.919032_QCkn
    • 2023-12-13_15:07:04.919040_toNi
    2f1fde2
    • 2023-12-14_17:33:50.600850_JJcM
    • 2023-12-14_17:33:50.600891_JJLN
    • 2023-12-14_17:33:50.600903_tAOH
    • 2023-12-14_17:33:50.600912_NAym
    • 2023-12-14_17:33:50.600919_aOVU
    • 2023-12-14_17:33:50.600927_LfKc
    • 2023-12-14_17:33:50.600946_zKHB
    • 2023-12-14_17:33:50.600954_fRwU
    • 2023-12-14_17:33:50.600961_Jvcd
    • 2023-12-14_17:33:50.600967_XBRs
    redfin-30
    Percentileff6cc572f1fde2DiffSignificant (?)
    p10248 ±2 ms271 ±3 ms+22.9 ms (+9.2%)YES
    p25255 ±3 ms277 ±3 ms+22.2 ms (+8.7%)YES
    p50262 ±3 ms285 ±4 ms+22.9 ms (+8.7%)YES
    p75270 ±4 ms294 ±4 ms+24.4 ms (+9.0%)YES
    p90281 ±6 ms307 ±7 ms+25.9 ms (+9.2%)MAYBE

    20 test runs in comparison
    CommitTest Runs
    ff6cc57
    • 2023-12-13_15:07:04.918943_QIZB
    • 2023-12-13_15:07:04.918972_Ymcs
    • 2023-12-13_15:07:04.918979_GzLR
    • 2023-12-13_15:07:04.918995_ZGAp
    • 2023-12-13_15:07:04.919004_Tfhh
    • 2023-12-13_15:07:04.919011_fNZL
    • 2023-12-13_15:07:04.919018_lSxs
    • 2023-12-13_15:07:04.919025_RVRr
    • 2023-12-13_15:07:04.919032_QCkn
    • 2023-12-13_15:07:04.919040_toNi
    2f1fde2
    • 2023-12-14_17:33:50.600850_JJcM
    • 2023-12-14_17:33:50.600891_JJLN
    • 2023-12-14_17:33:50.600903_tAOH
    • 2023-12-14_17:33:50.600912_NAym
    • 2023-12-14_17:33:50.600919_aOVU
    • 2023-12-14_17:33:50.600927_LfKc
    • 2023-12-14_17:33:50.600946_zKHB
    • 2023-12-14_17:33:50.600954_fRwU
    • 2023-12-14_17:33:50.600961_Jvcd
    • 2023-12-14_17:33:50.600967_XBRs

  1. https://storage.googleapis.com/firebase-sdk-metric-reports/rO1Jnv3Oav/index.html

@dconeybe dconeybe marked this pull request as ready for review December 14, 2023 20:52
@dconeybe dconeybe requested a review from milaGGL December 14, 2023 20:52
Copy link
Contributor

@milaGGL milaGGL left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@dconeybe dconeybe merged commit 2f546b2 into master Dec 14, 2023
@dconeybe dconeybe deleted the dconeybe/AddCommentAboutBug316359394 branch December 14, 2023 21:24
@firebase firebase locked and limited conversation to collaborators Jan 14, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants