[POC][pytree] test C++ pytree in `torch.utils.pytree` by default #138056

XuehaiPan · 2024-10-16T04:22:44Z

Stack from ghstack (oldest at bottom):

cc @zou3519

[ghstack-poisoned]

pytorch-bot · 2024-10-16T04:22:47Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/138056

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 49 New Failures, 1 Unrelated Failure

As of commit dd748e1 with merge base 6a9a02a ():

NEW FAILURES - The following jobs have failed:

pull / cuda12.4-py3.10-gcc9-sm75 / test (pr_time_benchmarks, 1, 1, linux.g4dn.metal.nvidia.gpu) (gh)
TypeError: tree_unflatten(leaves, treespec): Expected treespec to be instance of TreeSpec but got item of type <class 'optree.PyTreeSpec'>.
pull / linux-focal-cuda11.8-py3.10-gcc9 / test (distributed, 2, 3, linux.g4dn.12xlarge.nvidia.gpu) (gh)
distributed/tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_attribute_access_on_intermediate
pull / linux-focal-cuda11.8-py3.10-gcc9 / test (distributed, 3, 3, linux.g4dn.12xlarge.nvidia.gpu) (gh)
distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_call_method_forward
pull / linux-focal-cuda12.4-py3.10-gcc9 / test (default, 1, 5, linux.4xlarge.nvidia.gpu) (gh)
test_transformers.py::TestAttnBiasCUDA::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape0_cuda
pull / linux-focal-cuda12.4-py3.10-gcc9 / test (default, 2, 5, linux.4xlarge.nvidia.gpu) (gh)
inductor/test_torchinductor.py::CpuTests::test_large_block_sizes_cpu
pull / linux-focal-cuda12.4-py3.10-gcc9 / test (default, 3, 5, linux.4xlarge.nvidia.gpu) (gh)
inductor/test_compiled_autograd.py::TestCompiledAutograd::test_accumulate_grad_accuracy
pull / linux-focal-cuda12.4-py3.10-gcc9 / test (default, 4, 5, linux.4xlarge.nvidia.gpu) (gh)
export/test_serdes.py::SerDesExportTestExport::test_allow_explicit_guards_as_runtime_asserts_serdes
pull / linux-focal-cuda12.4-py3.10-gcc9 / test (default, 5, 5, linux.4xlarge.nvidia.gpu) (gh)
inductor/test_compiled_autograd.py::TestCompiledAutograd::test_accumulate_without_zero
pull / linux-focal-cuda12.4-py3.10-gcc9-sm89 / test (default, 1, 5, linux.g6.4xlarge.experimental.nvidia.gpu) (gh)
test_transformers.py::TestAttnBiasCUDA::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape0_cuda
pull / linux-focal-cuda12.4-py3.10-gcc9-sm89 / test (default, 2, 5, linux.g6.4xlarge.experimental.nvidia.gpu) (gh)
inductor/test_aot_inductor_arrayref.py::AOTInductorTestABICompatibleCpuWithStackAllocation::test__int_mm_cpu_with_stack_allocation
pull / linux-focal-cuda12.4-py3.10-gcc9-sm89 / test (default, 3, 5, linux.g6.4xlarge.experimental.nvidia.gpu) (gh)
inductor/test_torchinductor.py::GPUTests::test_large_block_sizes_cuda
pull / linux-focal-cuda12.4-py3.10-gcc9-sm89 / test (default, 4, 5, linux.g6.4xlarge.experimental.nvidia.gpu) (gh)
inductor/test_torchinductor.py::CpuTests::test_large_block_sizes_cpu
pull / linux-focal-cuda12.4-py3.10-gcc9-sm89 / test (default, 5, 5, linux.g6.4xlarge.experimental.nvidia.gpu) (gh)
dynamo/test_interop.py::InteropTests::test_vmap_in_graph
pull / linux-focal-py3_9-clang9-xla / test (xla, 1, 1, linux.12xlarge) (gh)
ModuleNotFoundError: No module named 'optree'
pull / linux-focal-py3.13-clang10 / test (crossref, 1, 2, linux.2xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_1_shape1_cpu
pull / linux-focal-py3.13-clang10 / test (crossref, 2, 2, linux.2xlarge) (gh)
export/test_export.py::TestExport::test_allow_explicit_guards_as_runtime_asserts
pull / linux-focal-py3.13-clang10 / test (default, 1, 5, linux.4xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_1_shape0_cpu
pull / linux-focal-py3.13-clang10 / test (default, 2, 5, linux.4xlarge) (gh)
inductor/test_torchinductor.py::CpuTests::test_large_block_sizes_cpu
pull / linux-focal-py3.13-clang10 / test (default, 3, 5, linux.4xlarge) (gh)
export/test_retraceability.py::RetraceExportTestExport::test_allow_explicit_guards_as_runtime_asserts_retraceability
pull / linux-focal-py3.13-clang10 / test (default, 4, 5, linux.4xlarge) (gh)
inductor/test_aot_inductor_arrayref.py::AOTInductorTestABICompatibleCpuWithStackAllocation::test_amp_fallback_random_cpu_with_stack_allocation
pull / linux-focal-py3.13-clang10 / test (default, 5, 5, linux.4xlarge) (gh)
inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_double
pull / linux-focal-py3.13-clang10 / test (dynamo_wrapped, 2, 3, linux.2xlarge) (gh)
functorch/test_ops.py::TestOperatorsCPU::test_tensor_with_scalar_list_cpu
pull / linux-focal-py3.13-clang10 / test (dynamo_wrapped, 3, 3, linux.2xlarge) (gh)
test_legacy_vmap.py::TestVmapAPILegacy::test_fallback_atan2
pull / linux-focal-py3.9-clang10 / test (crossref, 1, 2, linux.2xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape0_cpu
pull / linux-focal-py3.9-clang10 / test (crossref, 2, 2, linux.2xlarge) (gh)
export/test_export.py::TestExport::test_allow_explicit_guards_as_runtime_asserts
pull / linux-focal-py3.9-clang10 / test (default, 1, 5, linux.4xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape0_cpu
pull / linux-focal-py3.9-clang10 / test (default, 2, 5, linux.4xlarge) (gh)
inductor/test_torchinductor.py::CpuTests::test_large_block_sizes_cpu
pull / linux-focal-py3.9-clang10 / test (default, 3, 5, linux.4xlarge) (gh)
export/test_serdes.py::SerDesExportTestExport::test_allow_explicit_guards_as_runtime_asserts_serdes
pull / linux-focal-py3.9-clang10 / test (default, 4, 5, linux.4xlarge) (gh)
inductor/test_aot_inductor_arrayref.py::AOTInductorTestABICompatibleCpuWithStackAllocation::test_amp_fallback_random_cpu_with_stack_allocation
pull / linux-focal-py3.9-clang10 / test (default, 5, 5, linux.4xlarge) (gh)
inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_double
pull / linux-focal-py3.9-clang10 / test (dynamo_wrapped, 1, 3, linux.2xlarge) (gh)
TypeError: tree_unflatten(leaves, treespec): Expected treespec to be instance of TreeSpec but got item of type <class 'optree.PyTreeSpec'>.
pull / linux-focal-py3.9-clang10 / test (dynamo_wrapped, 2, 3, linux.2xlarge) (gh)
TypeError: tree_unflatten(leaves, treespec): Expected treespec to be instance of TreeSpec but got item of type <class 'optree.PyTreeSpec'>.
pull / linux-focal-py3.9-clang10 / test (dynamo_wrapped, 3, 3, linux.2xlarge) (gh)
TypeError: tree_unflatten(leaves, treespec): Expected treespec to be instance of TreeSpec but got item of type <class 'optree.PyTreeSpec'>.
pull / linux-focal-py3.9-clang10-onnx / test (default, 2, 2, linux.2xlarge) (gh)
onnx/dynamo/test_dynamo_with_onnxruntime_backend.py::TestDynamoWithONNXRuntime::test_custom_onnx_transform
pull / linux-jammy-py3-clang12-executorch / test (executorch, 1, 1, linux.2xlarge) (gh)
exir/program/test/test_program.py::TestProgramManagers::test_issue_3659
pull / linux-jammy-py3.10-clang15-asan / test (default, 1, 6, linux.4xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_CausalVariant_UPPER_LEFT_shape0_cpu
pull / linux-jammy-py3.10-clang15-asan / test (default, 2, 6, linux.4xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape3_cpu
pull / linux-jammy-py3.10-clang15-asan / test (default, 3, 6, linux.4xlarge) (gh)
inductor/test_compiled_autograd.py::TestCompiledAutograd::test_accumulate_grad_accuracy
pull / linux-jammy-py3.10-clang15-asan / test (default, 4, 6, linux.4xlarge) (gh)
inductor/test_compiled_autograd.py::TestCompiledAutograd::test_accumulate_without_zero
pull / linux-jammy-py3.10-clang15-asan / test (default, 5, 6, linux.4xlarge) (gh)
inductor/test_torchinductor.py::SweepInputsCpuTest::test_cpu_broadcast1_transposed
pull / linux-jammy-py3.10-clang15-asan / test (default, 6, 6, linux.4xlarge) (gh)
export/test_retraceability.py::RetraceExportTestExport::test_allow_explicit_guards_as_runtime_asserts_retraceability
pull / linux-jammy-py3.9-gcc11 / test (default, 1, 5, linux.2xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape0_cpu
pull / linux-jammy-py3.9-gcc11 / test (default, 2, 5, linux.2xlarge) (gh)
test_transformers.py::TestAttnBiasCPU::test_causal_variants_compile_causal_variant_CausalVariant_LOWER_RIGHT_shape3_cpu
pull / linux-jammy-py3.9-gcc11 / test (default, 3, 5, linux.2xlarge) (gh)
inductor/test_aot_inductor_arrayref.py::AOTInductorTestABICompatibleCpuWithStackAllocation::test__int_mm_cpu_with_stack_allocation
pull / linux-jammy-py3.9-gcc11 / test (default, 4, 5, linux.2xlarge) (gh)
inductor/test_compiled_autograd.py::TestCompiledAutograd::test_accumulate_grad_accuracy
pull / linux-jammy-py3.9-gcc11 / test (default, 5, 5, linux.2xlarge) (gh)
export/test_retraceability.py::RetraceExportTestExport::test_allow_explicit_guards_as_runtime_asserts_retraceability
pull / linux-jammy-py3.9-gcc11 / test (distributed, 1, 2, linux.2xlarge) (gh)
distributed/test_dynamo_distributed.py::TestFakeDistributedSingleProc::test_call_method_forward
pull / linux-jammy-py3.9-gcc11 / test (distributed, 2, 2, linux.2xlarge) (gh)
distributed/tensor/test_dtensor_compile.py::TestDTensorCompile::test_dtensor_attribute_access_on_intermediate
pull / linux-jammy-py3.9-gcc11 / test (numpy_2_x, 1, 1, linux.2xlarge) (gh)
dynamo/test_unspec.py::UnspecTests::test_conv1d_symint_padding

FLAKY - The following job failed but was likely due to flakiness present on trunk:

pull / linux-focal-cuda11.8-py3.10-gcc9 / test (distributed, 1, 3, linux.g4dn.12xlarge.nvidia.gpu) (gh) (disabled by #145924)
distributed/tensor/parallel/test_micro_pipeline_tp.py::MicroPipelineTPTest::test_dtensor_seq_par_shard_dim_0

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[ghstack-poisoned]

ghstack-source-id: f8b2348 Pull Request resolved: #138056

[ghstack-poisoned]

ghstack-source-id: c8c6d49 Pull Request resolved: #138056

[ghstack-poisoned]

ghstack-source-id: 03334ed Pull Request resolved: #138056

[ghstack-poisoned]

ghstack-source-id: c83b57d Pull Request resolved: #138056

github-actions · 2025-04-10T17:35:30Z

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

Update

b961169

[ghstack-poisoned]

XuehaiPan mentioned this pull request Oct 16, 2024

[pytree][Easy] preserve dict keys in insertion order in CXX pytree #130140

Closed

XuehaiPan marked this pull request as draft October 16, 2024 04:23

XuehaiPan added module: pytree not4land topic: not user facing topic category labels Oct 16, 2024

pytorchbot added the open source label Oct 16, 2024

XuehaiPan changed the title ~~[POC][pytree] enable C++ pytree in torch.utils.pytree by default~~ [POC][pytree] test C++ pytree in torch.utils.pytree by default Oct 16, 2024

Update

fb73538

[ghstack-poisoned]

Update

a8db019

[ghstack-poisoned]

Update

58dc437

[ghstack-poisoned]

Update

a8ec0ff

[ghstack-poisoned]

XuehaiPan added the ci-test-showlocals Show local variables on test failures label Oct 16, 2024

Update

6c64657

[ghstack-poisoned]

Update

a7b6a50

[ghstack-poisoned]

Update

0b36b34

[ghstack-poisoned]

Update

e147ea7

[ghstack-poisoned]

Update

8e77ffe

[ghstack-poisoned]

Update

9d45cca

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jan 9, 2025

[POC][pytree] enable C++ pytree in torch.utils.pytree by default

2066770

ghstack-source-id: f8b2348 Pull Request resolved: #138056

Update

b153426

[ghstack-poisoned]

Update

5f5637e

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Jan 10, 2025

[POC][pytree] enable C++ pytree in torch.utils.pytree by default

dfede98

ghstack-source-id: c8c6d49 Pull Request resolved: #138056

Update

6bd2e43

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Feb 4, 2025

[POC][pytree] enable C++ pytree in torch.utils.pytree by default

b8e0eb5

ghstack-source-id: 03334ed Pull Request resolved: #138056

Update

38375e7

[ghstack-poisoned]

Update

dd748e1

[ghstack-poisoned]

XuehaiPan added a commit that referenced this pull request Feb 9, 2025

[POC][pytree] enable C++ pytree in torch.utils.pytree by default

8aa5e0d

ghstack-source-id: c83b57d Pull Request resolved: #138056

github-actions bot added the Stale label Apr 10, 2025

github-actions bot closed this May 10, 2025

github-actions bot deleted the gh/XuehaiPan/183/head branch June 12, 2025 02:18

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[POC][pytree] test C++ pytree in `torch.utils.pytree` by default #138056

[POC][pytree] test C++ pytree in `torch.utils.pytree` by default #138056

Uh oh!

XuehaiPan commented Oct 16, 2024 •

edited

Loading

Uh oh!

pytorch-bot bot commented Oct 16, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Apr 10, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

[POC][pytree] test C++ pytree in torch.utils.pytree by default #138056

[POC][pytree] test C++ pytree in torch.utils.pytree by default #138056

Uh oh!

Conversation

XuehaiPan commented Oct 16, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Oct 16, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/138056

❌ 49 New Failures, 1 Unrelated Failure

Uh oh!

github-actions bot commented Apr 10, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

[POC][pytree] test C++ pytree in `torch.utils.pytree` by default #138056

[POC][pytree] test C++ pytree in `torch.utils.pytree` by default #138056

XuehaiPan commented Oct 16, 2024 •

edited

Loading

pytorch-bot bot commented Oct 16, 2024 •

edited

Loading