Skip to content
This repository was archived by the owner on Mar 5, 2026. It is now read-only.

chore: address system test flakiness#275

Merged
DominicKramer merged 12 commits intogoogleapis:masterfrom
DominicKramer:chore/increase-sys-test-timeout
Dec 6, 2018
Merged

chore: address system test flakiness#275
DominicKramer merged 12 commits intogoogleapis:masterfrom
DominicKramer:chore/increase-sys-test-timeout

Conversation

@DominicKramer
Copy link
Copy Markdown
Contributor

@DominicKramer DominicKramer commented Dec 5, 2018

  • The timeout used for waiting for the API to report an error event has been increased.
  • The system tests only poll for error events for a specific service and version.
  • The page size has been increased when requesting reported errors.
  • Increase polling timeout to avoid using the API too much to hit quota exceeded errors.
  • Error items are not deleted after the test. This is needed to avoid conflicting with concurrent runs of the system test because it is not possible to delete error items only associated with a particular test.

It looks like the underlying issue with the system tests is that
it may take longer than the test timeout before the API reports
an error.  I have increased the timeout to 10 minutes since the
code will now poll the server so that it can quit early if a
response comes back earlier than the timeout.
@googlebot googlebot added the cla: yes This human has signed the Contributor License Agreement. label Dec 5, 2018
@DominicKramer DominicKramer requested review from a team December 5, 2018 23:43
@DominicKramer DominicKramer changed the title chore[WIP]: address system test flakiness chore: address system test flakiness Dec 5, 2018
@DominicKramer DominicKramer merged commit 2fa6403 into googleapis:master Dec 6, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

cla: yes This human has signed the Contributor License Agreement.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants