Skip to content

Chromium Mac Bots become unresponsive and Xcode commands hang #157636

@zanderso

Description

@zanderso

From https://chromium-swarm.appspot.com/bot?id=build806-m9

Screenshot 2024-10-25 at 13 25 01

XCode installs are failing due to data corruption as in:

https://logs.chromium.org/logs/flutter/buildbucket/cr-buildbucket/8733087603218910657/+/u/install_xcode/install_xcode_from_cipd/stdout

There are other failure modes as well. I suspect a bad disk or bad memory. The automatic reboots on task failure don't seem to be helping.

I put up this CL to remove it from the prod pool, but I'm wondering if this is the right thing to do? https://chrome-internal-review.googlesource.com/c/infradata/config/+/7775927

cc @christopherfujino I'm wondering if bad machines like this are the underlying cause of #156614 ?

Sub-issues

Metadata

Metadata

Assignees

Labels

P0Critical issues such as a build break or regressionteam-infraOwned by Infrastructure teamtriaged-infraTriaged by Infrastructure team

Type

No type

Projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions