Skip to content

Unrecoverable error while evaluating node 'ActionLookupData{...}' breakages in nightly #5296

@jin

Description

@jin

https://buildkite.com/bazel/bazel-with-downstream-projects-bazel/builds/259

Same breakage affecting rules_go and rules_nodejs:

rules_go, 14.04:

Unhandled exception thrown during build; message: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//tests/core/go_path:go_path_test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false, actionIndex=9}' (requested by nodes 'tests/core/go_path/go_path_test/test.cache_status //tests/core/go_path:go_path_test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false')
--
  | INFO: Elapsed time: 1.780s, Critical Path: 0.89s
  | INFO: 77 processes: 8 remote cache hit, 69 linux-sandbox.
  | java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//tests/core/go_path:go_path_test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false, actionIndex=9}' (requested by nodes 'tests/core/go_path/go_path_test/test.cache_status //tests/core/go_path:go_path_test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false')
  | at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:460)
  | at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:355)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:748)
  | Caused by: java.lang.IllegalStateException: null for File:[[<execution_root>]bazel-out/k8-fastbuild/bin]tests/core/go_path/copy_path
  | at com.google.common.base.Preconditions.checkState(Preconditions.java:585)
  | at com.google.devtools.build.lib.skyframe.PerActionFileCache.getMetadata(PerActionFileCache.java:53)
  | at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$DelegatingPairFileCache.getMetadata(SkyframeActionExecutor.java:1272)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:324)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
...

rules_go, 16.04:


INFO: Elapsed time: 1.238s, Critical Path: 0.39s
--
  | INFO: 24 processes: 6 remote cache hit, 18 linux-sandbox.
  | java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//tests/core/stdlib:buildid_test BuildConfigurationValue.Key[31392ffa42da112162e5d2e8e2fdedd1] false, actionIndex=9}' (requested by nodes 'tests/core/stdlib/buildid_test/test.cache_status //tests/core/stdlib:buildid_test BuildConfigurationValue.Key[31392ffa42da112162e5d2e8e2fdedd1] false')
  | at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:460)
  | at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:355)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:748)
  | Caused by: java.lang.IllegalStateException: null for File:[[<execution_root>]bazel-out/k8-fastbuild/bin]external/io_bazel_rules_go/linux_amd64_stripped/stdlib~/pkg
  | at com.google.common.base.Preconditions.checkState(Preconditions.java:585)
  | at com.google.devtools.build.lib.skyframe.PerActionFileCache.getMetadata(PerActionFileCache.java:53)
  | at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$DelegatingPairFileCache.getMetadata(SkyframeActionExecutor.java:1272)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:324)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
...

rules_go, macOS:


Unhandled exception thrown during build; message: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//:vet BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false, actionIndex=5}' (requested by nodes 'vet/test.cache_status //:vet BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false')
--
  | INFO: Elapsed time: 1.733s, Critical Path: 0.84s
  | INFO: 5 processes: 1 remote cache hit, 4 darwin-sandbox.
  | java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//:vet BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false, actionIndex=5}' (requested by nodes 'vet/test.cache_status //:vet BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false')
  | at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:460)
  | at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:355)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:748)
  | Caused by: java.lang.IllegalStateException: null for File:[[<execution_root>]bazel-out/darwin-fastbuild/bin]all_srcs
  | at com.google.common.base.Preconditions.checkState(Preconditions.java:585)
  | at com.google.devtools.build.lib.skyframe.PerActionFileCache.getMetadata(PerActionFileCache.java:53)
  | at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$DelegatingPairFileCache.getMetadata(SkyframeActionExecutor.java:1272)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:324)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
...

rules_nodejs, 14.04:


Unhandled exception thrown during build; message: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//internal/npm_package/test:test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false, actionIndex=7}' (requested by nodes 'internal/npm_package/test/test/test.cache_status //internal/npm_package/test:test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false')
--
  | INFO: Elapsed time: 0.400s, Critical Path: 0.04s
  | INFO: 0 processes.
  | java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//internal/npm_package/test:test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false, actionIndex=7}' (requested by nodes 'internal/npm_package/test/test/test.cache_status //internal/npm_package/test:test BuildConfigurationValue.Key[fdb3894e6ebca3ad1d50fc951f8e9440] false')
  | at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:460)
  | at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:355)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:748)
  | Caused by: java.lang.IllegalStateException: null for File:[[<execution_root>]bazel-out/k8-fastbuild/bin]internal/npm_package/test/test_pkg
  | at com.google.common.base.Preconditions.checkState(Preconditions.java:585)
  | at com.google.devtools.build.lib.skyframe.PerActionFileCache.getMetadata(PerActionFileCache.java:53)
  | at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$DelegatingPairFileCache.getMetadata(SkyframeActionExecutor.java:1272)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:324)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
...

rules_nodejs, 16.04:

Unhandled exception thrown during build; message: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//internal/npm_package/test:test BuildConfigurationValue.Key[31392ffa42da112162e5d2e8e2fdedd1] false, actionIndex=7}' (requested by nodes 'internal/npm_package/test/test/test.cache_status //internal/npm_package/test:test BuildConfigurationValue.Key[31392ffa42da112162e5d2e8e2fdedd1] false')
--
  | INFO: Elapsed time: 0.451s, Critical Path: 0.04s
  | INFO: 0 processes.
  | java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//internal/npm_package/test:test BuildConfigurationValue.Key[31392ffa42da112162e5d2e8e2fdedd1] false, actionIndex=7}' (requested by nodes 'internal/npm_package/test/test/test.cache_status //internal/npm_package/test:test BuildConfigurationValue.Key[31392ffa42da112162e5d2e8e2fdedd1] false')
  | at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:460)
  | at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:355)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:748)
  | Caused by: java.lang.IllegalStateException: null for File:[[<execution_root>]bazel-out/k8-fastbuild/bin]internal/npm_package/test/test_pkg
  | at com.google.common.base.Preconditions.checkState(Preconditions.java:585)
  | at com.google.devtools.build.lib.skyframe.PerActionFileCache.getMetadata(PerActionFileCache.java:53)
  | at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$DelegatingPairFileCache.getMetadata(SkyframeActionExecutor.java:1272)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:324)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)

rules_nodejs, macOS:

Unhandled exception thrown during build; message: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//internal/npm_package/test:test BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false, actionIndex=7}' (requested by nodes 'internal/npm_package/test/test/test.cache_status //internal/npm_package/test:test BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false')
--
  | INFO: Elapsed time: 0.416s, Critical Path: 0.04s
  | INFO: 0 processes.
  | java.lang.RuntimeException: Unrecoverable error while evaluating node 'ActionLookupData{actionLookupKey=//internal/npm_package/test:test BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false, actionIndex=7}' (requested by nodes 'internal/npm_package/test/test/test.cache_status //internal/npm_package/test:test BuildConfigurationValue.Key[e0c2abb18e3342ac3d3a2f8207241cc4] false')
  | at com.google.devtools.build.skyframe.AbstractParallelEvaluator$Evaluate.run(AbstractParallelEvaluator.java:460)
  | at com.google.devtools.build.lib.concurrent.AbstractQueueVisitor$WrappedRunnable.run(AbstractQueueVisitor.java:355)
  | at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
  | at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
  | at java.lang.Thread.run(Thread.java:748)
  | Caused by: java.lang.IllegalStateException: null for File:[[<execution_root>]bazel-out/darwin-fastbuild/bin]internal/npm_package/test/test_pkg
  | at com.google.common.base.Preconditions.checkState(Preconditions.java:585)
  | at com.google.devtools.build.lib.skyframe.PerActionFileCache.getMetadata(PerActionFileCache.java:53)
  | at com.google.devtools.build.lib.skyframe.SkyframeActionExecutor$DelegatingPairFileCache.getMetadata(SkyframeActionExecutor.java:1272)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:324)
  | at com.google.devtools.build.lib.remote.TreeNodeRepository.buildParentNode(TreeNodeRepository.java:344)
...

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions