Skip to content

Running macOS tests with flutter drive (or integration_test) fails in a CI environment, on Intel based Mac machines #118469

@desistefanova

Description

@desistefanova

Hi team!
We have a problem running flutter drive on the latest MacOS image of GitHub CI. It works on a local Mac machine. And the CI is running on all the other environments successfully. We don't have this issue using Flutter stable version.
Is flutter drive being deprecated in favor of flutter test?

Steps to Reproduce

  1. Run a GitHub CI action on macos-latest image.
  2. Install Flutter from beta channel - Flutter 3.7.0-1.3.pre / Dart 2.19.0-444.3.beta
  3. Run flutter drive -d macos --target=test_driver/app.dart --suppress-analytics --dart-entrypoint-args="" It is also tried with --debug. It doesn't matter whether we set --no-dds or not.
  4. This command hangs and never starts the test application after "Building macOS application". The CI times outs and the operation is automatically canceled.

Logs

A detailed verbose log could be found here: https://github.com/realm/realm-dart/actions/runs/3901917475/jobs/6664375172
When running flutter drive without verbose the log is: https://github.com/realm/realm-dart/actions/runs/3902047674/jobs/6664647585.

Logs
flutter drive -d macos --target=test_driver/app.dart --suppress-analytics --dart-entrypoint-args="" --debug --no-dds
Running "flutter pub get" in tests...
Resolving dependencies...
+ _fe_analyzer_shared 52.0.0
+ analyzer 5.4.0
+ archive 3.3.2 (3.3.5 available)
+ args 2.3.1
+ async 2.10.0
+ boolean_selector 2.1.1
+ build 2.3.1
+ build_cli_annotations 2.1.0
+ build_config 1.1.1
+ build_daemon 3.1.0
+ build_resolvers 2.1.0
+ build_runner 2.3.3
+ build_runner_core 7.2.7
+ built_collection 5.1.1
+ built_value 8.4.3
+ cancellation_token 1.5.0
+ characters 1.2.1
+ checked_yaml 2.0.2
+ clock 1.1.1
+ code_builder 4.4.0
+ collection 1.[17](https://github.com/realm/realm-dart/actions/runs/3902047674/jobs/6664647585#step:11:18).0
+ convert 3.1.1
+ coverage 1.6.1
+ crypto 3.0.2
+ dart_style 2.2.4
+ fake_async 1.3.1
+ ffi 2.0.1
+ file 6.1.4
+ fixnum 1.0.1
+ flutter 0.0.0 from sdk flutter
+ flutter_driver 0.0.0 from sdk flutter
+ flutter_lints 2.0.1
+ flutter_test 0.0.0 from sdk flutter
+ frontend_server_client 3.2.0
+ fuchsia_remote_debug_protocol 0.0.0 from sdk flutter
+ glob 2.1.1
+ graphs 2.2.0
+ http 0.13.5
+ http_multi_server 3.2.1
+ http_parser 4.0.2
+ io 1.0.3
+ js 0.6.5 (0.6.6 available)
+ json_annotation 4.7.0
+ lints 2.0.1
+ logging 1.1.0
+ matcher 0.12.13 (0.12.14 available)
+ material_color_utilities 0.2.0
+ meta 1.8.0
+ mime 1.0.4
+ node_preamble 2.0.1
+ objectid 2.1.0
+ package_config 2.1.0
+ path 1.8.2 (1.8.3 available)
+ platform 3.1.0
+ pool 1.5.1
+ process 4.2.4
+ pub_semver 2.1.3
+ pubspec_parse 1.2.1
+ realm 0.8.0+rc from path ..
+ realm_common 0.8.0+rc from path ../../../common
+ realm_generator 0.8.0+rc from path ../../../generator
+ sane_uuid 1.0.0-alpha.4
+ shelf 1.4.0
+ shelf_packages_handler 3.0.1
+ shelf_static 1.1.1
+ shelf_web_socket 1.0.3
+ sky_engine 0.0.99 from sdk flutter
+ source_gen 1.2.6
+ source_map_stack_trace 2.1.1
+ source_maps 0.10.11
+ source_span 1.9.1
+ stack_trace 1.11.0
+ stream_channel 2.1.1
+ stream_transform 2.1.0
+ string_scanner 1.2.0
+ sync_http 0.3.1
+ tar 0.5.6
+ term_glyph 1.2.1
+ test 1.22.2
! test_api 0.4.17 (overridden) (0.4.[18](https://github.com/realm/realm-dart/actions/runs/3902047674/jobs/6664647585#step:11:19) available)
+ test_core 0.4.[22](https://github.com/realm/realm-dart/actions/runs/3902047674/jobs/6664647585#step:11:23)
+ timezone 0.9.1
+ timing 1.0.0
+ typed_data 1.3.1
+ vector_math 2.1.4
+ vm_service 9.4.0 (10.0.0 available)
+ watcher 1.0.2
+ web_socket_channel 2.3.0
+ webdriver 3.0.1
+ webkit_inspection_protocol 1.2.0
+ yaml 3.1.1
Warning: You are using these overridden dependencies:
! test_api 0.4.17 (0.4.18 available)
Changed [91](https://github.com/realm/realm-dart/actions/runs/3902047674/jobs/6664647585#step:11:92) dependencies!
Updating minimum macOS deployment target to 10.14.
Upgrading project.pbxproj
Upgrading Podfile
Updating project for Xcode compatibility.
Upgrading project.pbxproj
Upgrading Runner.xcscheme
Removing script build phase dependency analysis.
Running pod install...                                              3.0s
Building macOS application...                                   
warning: Run script build phase '[CP-User] Download Realm Flutter iOS Binaries' will be run during every build because it does not specify any outputs. To address this warning, either add output dependencies to the script phase, or configure it to run in every build by unchecking "Based on dependency analysis" in the script phase. (in target 'realm' from project 'Pods')
warning: Run script build phase '[CP-User] Report Metrics' will be run during every build because it does not specify any outputs. To address this warning, either add output dependencies to the script phase, or configure it to run in every build by unchecking "Based on dependency analysis" in the script phase. (in target 'realm' from project 'Pods')
warning: Run script build phase 'Run Script' will be run during every build because it does not specify any outputs. To address this warning, either add output dependencies to the script phase, or configure it to run in every build by unchecking "Based on dependency analysis" in the script phase. (in target 'Flutter Assemble' from project 'Runner')
Error: The operation was canceled.

Update 2023-04-25: Workaround for GitHub Actions

The macos-13 image for GitHub actions appears to now include Metal support. See details in comment #118469 (comment).

Metadata

Metadata

Assignees

No one assigned

    Labels

    P2Important issues not at the top of the work lista: desktopRunning on desktopa: tests"flutter test", flutter_test, or one of our testsc: regressionIt was better in the past than it is nowcustomer: crowdAffects or could affect many people, though not necessarily a specific customer.found in release: 3.7Found to occur in 3.7has reproducible stepsThe issue has been confirmed reproducible and is ready to work onplatform-macBuilding on or for macOS specificallyteam-macosOwned by the macOS platform teamtoolAffects the "flutter" command-line tool. See also t: labels.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions