Skip to content
This repository was archived by the owner on Feb 25, 2025. It is now read-only.

Conversation

@jason-simmons
Copy link
Member

This test had been temporarily moved to an API 33 device as a workaround for an FTL infrastructure issue (see #50721)

This PR resumes use of a Pixel 8/API 34 device for the FTL tests. It also retries the test if FTL returns an error code that is known to represent an FTL infrastructure error. If the retries fail, then the test script will not block the engine tree if all failures were caused by infrastructure.

This is similar to what the CI recipes are doing in https://flutter.googlesource.com/recipes/+/a181878fde742dacd94afca04c5a4db1b3c30b91

@flutter-dashboard
Copy link

It looks like this pull request may not have tests. Please make sure to add tests before merging. If you need an exemption to this rule, contact "@test-exemption-reviewer" in the #hackers channel in Chat (don't just cc them here, they won't see it! Use Discord!).

If you are not sure if you need tests, consider this rule of thumb: the purpose of a test is to make sure someone doesn't accidentally revert the fix. Ask yourself, is there anything in your PR that you feel it is important we not accidentally revert back to how it was before your fix?

Reviewers: Read the Tree Hygiene page and make sure this patch meets those guidelines before LGTMing.

…handle FTL infrastructure errors in the script

This test had been temporarily moved to an API 33 device as a workaround for an FTL infrastructure issue (see flutter#50721)

This PR resumes use of a Pixel 8/API 34 device for the FTL tests.  It also retries the test if FTL returns an error code that is known to represent an FTL infrastructure error.  If the retries fail, then the test script will not block the engine tree if all failures were caused by infrastructure.

This is similar to what the CI recipes are doing in https://flutter.googlesource.com/recipes/+/a181878fde742dacd94afca04c5a4db1b3c30b91
@jason-simmons jason-simmons force-pushed the ftl_handle_infra_errors branch from 1065ff8 to a451910 Compare February 16, 2024 22:48
@jason-simmons jason-simmons changed the title Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastucture errors in the script Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script Feb 16, 2024
@reidbaker
Copy link
Contributor

Thank you lgtm


return_code = process.wait()
if return_code in FTL_INFRA_FAILURE_CODES:
print('Firebase test %s failed with infrastructure error code: %s' % (apk, return_code))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Good addition

@jason-simmons jason-simmons added the autosubmit Merge PR when tree becomes green via auto submit App label Feb 17, 2024
@auto-submit auto-submit bot merged commit 4278210 into flutter:main Feb 17, 2024
engine-flutter-autoroll added a commit to engine-flutter-autoroll/flutter that referenced this pull request Feb 17, 2024
…cript and handle FTL infrastructure errors in the script (flutter/engine#50735)
auto-submit bot pushed a commit to flutter/flutter that referenced this pull request Feb 17, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.

Labels

autosubmit Merge PR when tree becomes green via auto submit App

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants