baseline_coverage.dat missing with BES + BwtB #17001
Description
Description of the bug:
We're seeing a log like:
(13:23:40) WARNING: Uploading BEP referenced local files: /private/var/tmp/_bazel_iosci/6462d53b34f6666019a2973c03de6978/execroot/lyftios/bazel-out/darwin_arm64-fastbuild/testlogs/Modules/.../baseline_coverage.dat (No such file or directory)
java.io.FileNotFoundException: /private/var/tmp/_bazel_iosci/6462d53b34f6666019a2973c03de6978/execroot/lyftios/bazel-out/darwin_arm64-fastbuild/testlogs/Modules/.../baseline_coverage.dat (No such file or directory)
at com.google.devtools.build.lib.unix.NativePosixFiles.stat(Native Method)
at com.google.devtools.build.lib.unix.UnixFileSystem.statInternal(UnixFileSystem.java:209)
at com.google.devtools.build.lib.unix.UnixFileSystem.stat(UnixFileSystem.java:199)
at com.google.devtools.build.lib.vfs.PathTransformingDelegateFileSystem.stat(PathTransformingDelegateFileSystem.java:252)
at com.google.devtools.build.lib.remote.RemoteActionFileSystem.stat(RemoteActionFileSystem.java:460)
at com.google.devtools.build.lib.remote.RemoteActionFileSystem.getFileSize(RemoteActionFileSystem.java:392)
at com.google.devtools.build.lib.vfs.Path.getFileSize(Path.java:559)
at com.google.devtools.build.lib.remote.util.DigestUtil.compute(DigestUtil.java:61)
at com.google.devtools.build.lib.remote.ByteStreamBuildEventArtifactUploader.readPathMetadata(ByteStreamBuildEventArtifactUploader.java:186)
For every single test target when we run them on CI with BES uploads and --remote_download_toplevel --experimental_remote_build_event_upload=minimal
What's the simplest, easiest way to reproduce this bug? Please provide a minimal example if possible.
I'm not sure, it's hard to debug with cache hits vs not
Which operating system are you running Bazel on?
macOS
What is the output of bazel info release?
release 6.0.0rc4
If bazel info release returns development version or (@non-git), tell us how you built Bazel.
No response
What's the output of git remote get-url origin; git rev-parse master; git rev-parse HEAD ?
No response
Have you found anything relevant by searching the web?
No response
Any other information, logs, or outputs that you want to share?
No response