Skip to content

Two benchmarks that specify the same device in .ci.yaml are running on different devices. #105314

@zanderso

Description

@zanderso

In the.ci.yaml file Linux_samsung_s10 new_gallery__transition_perf and Linux_samsung_s10 new_gallery_impeller__transition_perf both specify tags ["devicelab", "android", "linux", "samsung", "s10"], which I would have guessed would mean that both would be running on Samsung S10 devices.

However, looking at both SkiaPerf and at the pages for the builders, they are running on different device types.

For example here, the impeller version ran on flutter-devicelab-linux-18, which has device type SM-A025V.

But here, the non-Impeller version ran flutter-devicelab-linux-20, which has device type SM-G973U1.

We are going to be able to need to compare Impeller to non-Impeller across a range of benchmarks and devices, so I'd really like to be 100% sure about the devices that we're running on. How can I do that?

@keyonghan

Metadata

Metadata

Assignees

Labels

P1High-priority issues at the top of the work listteam-infraOwned by Infrastructure team

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions