Skip to content

test(storage): deflake integration tests#6792

Merged
coryan merged 3 commits intogoogleapis:mainfrom
coryan:test-storage-deflake-emulator-integration-tests
Jun 16, 2021
Merged

test(storage): deflake integration tests#6792
coryan merged 3 commits intogoogleapis:mainfrom
coryan:test-storage-deflake-emulator-integration-tests

Conversation

@coryan
Copy link
Copy Markdown
Contributor

@coryan coryan commented Jun 16, 2021

Use a different instance of the emulator to run the emulator tests
vs. the tests that use the emulator. The emulator tests
intentionally crash some of the emulator workers, which then causes
problems for the regular tests. Note that the emulator tests themselves
are still flaky, but they are very fast so using --flake-test_attempts
mostly avoids the problem.

Part of the work for #6641


This change is Reviewable

Use a different instance of the emulator to run the **emulator** tests
vs. the tests that **use** the emulator. The emulator tests
intentionally crash some of the emulator workers, which then causes
problems for the regular tests. Note that the emulator tests themselves
are still flaky, but they are very fast so using `--flake-test_attempts`
mostly workarounds the problem.
@coryan coryan requested a review from a team June 16, 2021 15:38
@product-auto-label product-auto-label Bot added the api: storage Issues related to the Cloud Storage API. label Jun 16, 2021
@google-cla google-cla Bot added the cla: yes This human has signed the Contributor License Agreement. label Jun 16, 2021
@google-cloud-cpp-bot
Copy link
Copy Markdown
Contributor

Google Cloud Build Logs
For commit: 642815ea90de358b6700fbb6bfa80752ab86e1fa

ℹ️ NOTE: Kokoro logs are linked from "Details" below.

@google-cloud-cpp-bot
Copy link
Copy Markdown
Contributor

Google Cloud Build Logs
For commit: 2cbdc2d2307ef80cfa22b841677cf7093b819962

ℹ️ NOTE: Kokoro logs are linked from "Details" below.

@codecov
Copy link
Copy Markdown

codecov Bot commented Jun 16, 2021

Codecov Report

Merging #6792 (ddf1400) into main (079c926) will increase coverage by 0.00%.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##             main    #6792   +/-   ##
=======================================
  Coverage   95.50%   95.51%           
=======================================
  Files        1257     1257           
  Lines      112769   112769           
=======================================
+ Hits       107705   107706    +1     
+ Misses       5064     5063    -1     
Impacted Files Coverage Δ
...le/cloud/internal/default_completion_queue_impl.cc 97.00% <0.00%> (-0.60%) ⬇️
.../cloud/storage/benchmarks/throughput_experiment.cc 74.76% <0.00%> (-0.47%) ⬇️
google/cloud/spanner/samples/samples.cc 82.55% <0.00%> (-0.24%) ⬇️
...cloud/pubsub/internal/subscription_session_test.cc 98.02% <0.00%> (ø)
google/cloud/pubsub/samples/samples.cc 91.75% <0.00%> (+0.07%) ⬆️
.../spanner/benchmarks/multiple_rows_cpu_benchmark.cc 83.76% <0.00%> (+0.23%) ⬆️
google/cloud/bigtable/async_read_stream_test.cc 97.99% <0.00%> (+0.66%) ⬆️
...bigtable/examples/bigtable_hello_instance_admin.cc 83.51% <0.00%> (+2.19%) ⬆️

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 079c926...ddf1400. Read the comment docs.

Comment thread google/cloud/storage/emulator/ci/run_integration_tests_bazel.sh Outdated
@google-cloud-cpp-bot
Copy link
Copy Markdown
Contributor

Google Cloud Build Logs
For commit: ddf14003a335d3bd4fe569a0776fcac56e95c573

ℹ️ NOTE: Kokoro logs are linked from "Details" below.

@coryan coryan merged commit 9cd83cc into googleapis:main Jun 16, 2021
@coryan coryan deleted the test-storage-deflake-emulator-integration-tests branch June 16, 2021 16:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

api: storage Issues related to the Cloud Storage API. cla: yes This human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants