-
Notifications
You must be signed in to change notification settings - Fork 6k
Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script #50735
Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script #50735
Conversation
|
It looks like this pull request may not have tests. Please make sure to add tests before merging. If you need an exemption to this rule, contact "@test-exemption-reviewer" in the #hackers channel in Chat (don't just cc them here, they won't see it! Use Discord!). If you are not sure if you need tests, consider this rule of thumb: the purpose of a test is to make sure someone doesn't accidentally revert the fix. Ask yourself, is there anything in your PR that you feel it is important we not accidentally revert back to how it was before your fix? Reviewers: Read the Tree Hygiene page and make sure this patch meets those guidelines before LGTMing. |
…handle FTL infrastructure errors in the script This test had been temporarily moved to an API 33 device as a workaround for an FTL infrastructure issue (see flutter#50721) This PR resumes use of a Pixel 8/API 34 device for the FTL tests. It also retries the test if FTL returns an error code that is known to represent an FTL infrastructure error. If the retries fail, then the test script will not block the engine tree if all failures were caused by infrastructure. This is similar to what the CI recipes are doing in https://flutter.googlesource.com/recipes/+/a181878fde742dacd94afca04c5a4db1b3c30b91
1065ff8 to
a451910
Compare
|
Thank you lgtm |
|
|
||
| return_code = process.wait() | ||
| if return_code in FTL_INFRA_FAILURE_CODES: | ||
| print('Firebase test %s failed with infrastructure error code: %s' % (apk, return_code)) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good addition
…cript and handle FTL infrastructure errors in the script (flutter/engine#50735)
…143624) flutter/engine@2ed159a...e51d4f1 2024-02-17 [email protected] Connect signals in swapped form. (flutter/engine#50705) 2024-02-17 [email protected] Restore use of the API 34 device in the Firebase Test Lab script and handle FTL infrastructure errors in the script (flutter/engine#50735) If this roll has caused a breakage, revert this CL and stop the roller using the controls here: https://autoroll.skia.org/r/flutter-engine-flutter-autoroll Please CC [email protected],[email protected],[email protected] on the revert to ensure that a human is aware of the problem. To file a bug in Flutter: https://github.com/flutter/flutter/issues/new/choose To report a problem with the AutoRoller itself, please file a bug: https://issues.skia.org/issues/new?component=1389291&template=1850622 Documentation for the AutoRoller is here: https://skia.googlesource.com/buildbot/+doc/main/autoroll/README.md
This test had been temporarily moved to an API 33 device as a workaround for an FTL infrastructure issue (see #50721)
This PR resumes use of a Pixel 8/API 34 device for the FTL tests. It also retries the test if FTL returns an error code that is known to represent an FTL infrastructure error. If the retries fail, then the test script will not block the engine tree if all failures were caused by infrastructure.
This is similar to what the CI recipes are doing in https://flutter.googlesource.com/recipes/+/a181878fde742dacd94afca04c5a4db1b3c30b91