Skip to content

Move macOS/Android device-specific perf benchmarks to Linux/Android builders #74522

@jmagman

Description

@jmagman

There are currently many devicelab Android and benchmark behavior tests that run on a macOS host with a tethered Android device. However, the infra team says Linux hosts are easier to maintain and more stable in terms of infra issues. Consider moving tests that are only measuring on-device Android performance and features since the host OS shouldn't matter for these tests.

Benchmark tests

  • complex_layout_scroll_perf__timeline_summary
  • tiles_scroll_perf__timeline_summary
  • home_scroll_perf__timeline_summary
  • cull_opacity_perf__timeline_summary
  • picture_cache_perf__timeline_summary
  • cubic_bezier_perf__timeline_summary
  • cubic_bezier_perf_sksl_warmup__timeline_summary
  • backdrop_filter_perf__timeline_summary
  • textfield_perf__timeline_summary
  • fullscreen_textfield_perf__timeline_summary
  • color_filter_and_fade_perf__timeline_summary
  • fading_child_animation_perf__timeline_summary
  • imagefiltered_transform_animation_perf__timeline_summary
  • platform_view__start_up
  • complex_layout__start_up
  • complex_layout_scroll_perf__memory
  • hello_world__memory
  • microbenchmarks
  • flutter_view__start_up
  • new_gallery__transition_perf
  • fast_scroll_large_images__memory

Android functionality tests

  • channels_integration_test
  • external_ui_integration_test
  • embedded_android_views_integration_test
  • hybrid_android_views_integration_test
  • android_semantics_integration_test
  • platform_interaction_test
  • platform_channel_sample_test
  • integration_ui_driver
  • integration_ui_keyboard_resize
  • integration_ui_screenshot
  • integration_ui_textfield
  • flavors_test
  • service_extensions_test (?)

flutter_drive test

  • drive_perf_debug_warning

Host-dependent tests (should not be moved)

  • run_release_test
  • hello_world_android__compile
  • hot_mode_dev_cycle__benchmark
  • android_plugin_example_app_build_test (moved to tools integration)

Validate these tests pass on a Linux host and adjust the configs from mac_android_tasks to linux_tasks
https://github.com/flutter/infra/blob/1943e229def07d8826f690dc4e6e22e7fe69f2a4/config/devicelab_staging_config.star#L169

Metadata

Metadata

Assignees

Labels

c: contributor-productivityTeam-specific productivity, code health, technical debt.team-infraOwned by Infrastructure teamteam: benchmarkPerformance issues found by inspecting benchmarks

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions