Prerequisites

• Xcode 16 is available in CIPD
• Upgrade 50% of devicelab bots in each pool to macOS 14.5 #148881 (assuming Xcode 16 requires macOS 14.5)
  • If Xcode 16 requires a higher macOS version, bots will need to be upgraded to new required version before doing
• Upgrade 50% of chromium bots to macOS 14.5 #148891 (assuming Xcode 16 requires macOS 14.5)
  • If Xcode 16 requires a higher macOS version, bots will need to be upgraded to new required version before doing

Instructions to run via led

Update to latest depot_tools by running gclient:

To run manual led test on a Mac-14 staging bot:

1. led get-builder "luci.flutter.staging:Mac channels_integration_test" > properties.json
2. Replace "sdk_version": "15a240d" with new Xcode build version (case sensitive with CIPD version)
3. cat properties.json | led edit -d os=Mac-14 | led edit-recipes-bundle | led launch

❗ File issues for tests that fail and add links to the issues in #148898. This is important so we can track any fixes that need to be cherrypicked to beta/stable and so steps that are steps are not completed before issues are resolved.

Instructions to run via PR

If you run via PR, you can make a PR that changes the .ci.yaml to use the new Xcode build version and run exclusively on macOS 14. Note that not all tests run in presubmit, so you'll likely need to do some of them via led or edit the .ci.yaml to run the tests in presubmit.

https://github.com/flutter/flutter/blob/master/.ci.yaml

$flutter/osx_sdk : >-
        {
-          "sdk_version": "15a240d"
+          "sdk_version": "[insert new CIPD case-sensitive Xcode build version]"
        }
        
- os: Mac-13|Mac-14
+ os: Mac-14

- ["device_os=iOS-17","os=Mac-13|Mac-14", "cpu=x86"]
+ ["device_os=iOS-17","os=Mac-14", "cpu=x86"]

❗ File issues for tests that fail and add links to the issues in #148898. This is important so we can track any fixes that need to be cherrypicked to beta/stable and so steps that are steps are not completed before issues are resolved.