Skip to content

support symfloats in translation validation #139457

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
bobrenjc93 wants to merge 9 commits into from
Closed

support symfloats in translation validation #139457

bobrenjc93 wants to merge 9 commits into from

Conversation

@bobrenjc93
Copy link
Contributor

@bobrenjc93 bobrenjc93 commented Nov 1, 2024 •
edited
Loading

Stack from ghstack (oldest at bottom):

fixes python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes when specialize_float=False

cc @ezyang @SherlockNoMad @EikanWang @jgong5 @wenzhe-nrv

This was referenced Nov 1, 2024
Closed
Closed
@pytorch-bot
Copy link

pytorch-bot bot commented Nov 1, 2024 •
edited
Loading

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/139457

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit b2fd399 with merge base e6ff07f (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@pytorch-bot pytorch-bot bot added ciflow/inductor release notes: fx release notes category labels Nov 1, 2024
bobrenjc93 added a commit that referenced this pull request Nov 1, 2024
@bobrenjc93
support symfloats in translation validation
5f652ba 
ghstack-source-id: 9241452
Pull Request resolved: #139457
@bobrenjc93 bobrenjc93 requested a review from ezyang November 1, 2024 03:00
@bobrenjc93 bobrenjc93 marked this pull request as ready for review November 1, 2024 03:01
@bobrenjc93
Update on "support symfloats in translation validation"
7934309 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
This was referenced Nov 1, 2024
Closed
Closed
Closed
Closed
Closed
Closed
@bobrenjc93
Update on "support symfloats in translation validation"
eef88f7 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
@bobrenjc93 bobrenjc93 mentioned this pull request Nov 1, 2024
Closed
@bobrenjc93
Update on "support symfloats in translation validation"
8e030d8 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
@bobrenjc93
Update on "support symfloats in translation validation"
dea0f55 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
This was referenced Nov 3, 2024
Closed
Closed
Closed
Closed
Closed
@bobrenjc93
Update on "support symfloats in translation validation"
05af066 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
@bobrenjc93 bobrenjc93 mentioned this pull request Nov 4, 2024
Closed
@bobrenjc93
Update on "support symfloats in translation validation"
3a3ab60 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
@bobrenjc93
Update on "support symfloats in translation validation"
8ee5134 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`


[ghstack-poisoned]
zero000064 pushed a commit to zero000064/pytorch that referenced this pull request Nov 14, 2024
@bobrenjc93 @zero000064
refuse to generate a symbolic variable if a float input is inf (pytor…
abf827d 
…ch#139846)

Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCPU.test_cauchy_cpu_float64` when `specialize_float=False`

Pull Request resolved: pytorch#139846
Approved by: https://github.com/ruidazeng, https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572
zero000064 pushed a commit to zero000064/pytorch that referenced this pull request Nov 14, 2024
@bobrenjc93 @zero000064
Trigger symfloat specialization in argument binding code (pytorch#139454
e6a6f61 
)

Fixes the test `python test/inductor/test_torchinductor.py CpuTests.test_upsample_cat_conv_cpu` when `specialize_float=False`

Pull Request resolved: pytorch#139454
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846
zero000064 pushed a commit to zero000064/pytorch that referenced this pull request Nov 14, 2024
@bobrenjc93 @zero000064
Don't wrap inf values as symfloat (pytorch#139896)
6647f55 
Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=7 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

Pull Request resolved: pytorch#139896
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454
zero000064 pushed a commit to zero000064/pytorch that referenced this pull request Nov 14, 2024
@bobrenjc93 @zero000064
specialize symfloats for wrapped_gradient in get_fake_value (pytorch#…
6a371a0 
…139935)

Fixes `PYTORCH_TEST_WITH_DYNAMO=1 python test/test_torch.py TestTorchDeviceTypeCPU.test_gradient_type_promotion_cpu` when `specialize_float=False`

Reviewers might wonder why we need to have this whitelist. Can't we rely on python_arg_parser.h to do the specialization generically? Alas this path doesn't actually FFI to C++ so we do need to do the specialization in pythonland.

Pull Request resolved: pytorch#139935
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896
zero000064 pushed a commit to zero000064/pytorch that referenced this pull request Nov 14, 2024
@bobrenjc93 @zero000064
Fix another item memo loss location + bool specialization bug (pytorc…
51491dc 
…h#139587)

This fix was a bit more involved:
1) It fixes a item_memo loss place.
2) It updates a test to be eager instead of aot_eager since it reveals a very obscure bug related to replacements that's not worth solving since in practice inductor will regenerate the runtime asserts anyways
3) It updates tensorify to specialize more places now that the aforementioned bug is fixed.

Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=6 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

while ensuring `python test/dynamo/test_dynamic_shapes.py DynamicShapesMiscTests.test_runtime_assert_replacement_dynamic_shapes` doesn't regress

Pull Request resolved: pytorch#139587
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935
zero000064 pushed a commit to zero000064/pytorch that referenced this pull request Nov 14, 2024
@bobrenjc93 @zero000064
add special case for __round__ constant variables (pytorch#139583)
54376d4 
Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCUDA.test_cauchy_cuda_float64` when specialize_float=False

Pull Request resolved: pytorch#139583
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935, pytorch#139587
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
support symfloats in translation validation (pytorch#139457)
a9922ce 
fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesHigherOrderOpTests.test_cond_pytree_operands_with_non_tensor_leaves_dynamic_shapes` when `specialize_float=False`

Pull Request resolved: pytorch#139457
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
don't run z3 analysis on backed symfloat nodes (pytorch#139568)
ea666d9 
Pull Request resolved: pytorch#139568
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
Specialize symfloats that flow through is_integer (pytorch#139572)
643e28d 
Fixes `python test/dynamo/test_dynamic_shapes.py DynamicShapesFunctionTests.test_number_method_method_is_integer_num_type6_dynamic_shapes` when specialize_float = False

Pull Request resolved: pytorch#139572
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
refuse to generate a symbolic variable if a float input is inf (pytor…
102c364 
…ch#139846)

Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCPU.test_cauchy_cpu_float64` when `specialize_float=False`

Pull Request resolved: pytorch#139846
Approved by: https://github.com/ruidazeng, https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
Trigger symfloat specialization in argument binding code (pytorch#139454
e88bee6 
)

Fixes the test `python test/inductor/test_torchinductor.py CpuTests.test_upsample_cat_conv_cpu` when `specialize_float=False`

Pull Request resolved: pytorch#139454
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
Don't wrap inf values as symfloat (pytorch#139896)
e0c2f53 
Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=7 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

Pull Request resolved: pytorch#139896
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
specialize symfloats for wrapped_gradient in get_fake_value (pytorch#…
fdbe6db 
…139935)

Fixes `PYTORCH_TEST_WITH_DYNAMO=1 python test/test_torch.py TestTorchDeviceTypeCPU.test_gradient_type_promotion_cpu` when `specialize_float=False`

Reviewers might wonder why we need to have this whitelist. Can't we rely on python_arg_parser.h to do the specialization generically? Alas this path doesn't actually FFI to C++ so we do need to do the specialization in pythonland.

Pull Request resolved: pytorch#139935
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
Fix another item memo loss location + bool specialization bug (pytorc…
cbdf326 
…h#139587)

This fix was a bit more involved:
1) It fixes a item_memo loss place.
2) It updates a test to be eager instead of aot_eager since it reveals a very obscure bug related to replacements that's not worth solving since in practice inductor will regenerate the runtime asserts anyways
3) It updates tensorify to specialize more places now that the aforementioned bug is fixed.

Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=6 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

while ensuring `python test/dynamo/test_dynamic_shapes.py DynamicShapesMiscTests.test_runtime_assert_replacement_dynamic_shapes` doesn't regress

Pull Request resolved: pytorch#139587
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935
Ryo-not-rio pushed a commit to Ryo-not-rio/pytorch that referenced this pull request Dec 2, 2024
@bobrenjc93 @Ryo-not-rio
add special case for __round__ constant variables (pytorch#139583)
bf80ad1 
Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCUDA.test_cauchy_cuda_float64` when specialize_float=False

Pull Request resolved: pytorch#139583
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935, pytorch#139587
@github-actions github-actions bot deleted the gh/bobrenjc93/100/head branch December 5, 2024 02:16
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
@bobrenjc93
refuse to generate a symbolic variable if a float input is inf (pytor…
ffa65c0 
…ch#139846)

Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCPU.test_cauchy_cpu_float64` when `specialize_float=False`

Pull Request resolved: pytorch#139846
Approved by: https://github.com/ruidazeng, https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
@bobrenjc93
Trigger symfloat specialization in argument binding code (pytorch#139454
1048c78 
)

Fixes the test `python test/inductor/test_torchinductor.py CpuTests.test_upsample_cat_conv_cpu` when `specialize_float=False`

Pull Request resolved: pytorch#139454
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
@bobrenjc93
Don't wrap inf values as symfloat (pytorch#139896)
a09c905 
Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=7 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

Pull Request resolved: pytorch#139896
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
@bobrenjc93
specialize symfloats for wrapped_gradient in get_fake_value (pytorch#…
b5d04fc 
…139935)

Fixes `PYTORCH_TEST_WITH_DYNAMO=1 python test/test_torch.py TestTorchDeviceTypeCPU.test_gradient_type_promotion_cpu` when `specialize_float=False`

Reviewers might wonder why we need to have this whitelist. Can't we rely on python_arg_parser.h to do the specialization generically? Alas this path doesn't actually FFI to C++ so we do need to do the specialization in pythonland.

Pull Request resolved: pytorch#139935
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
@bobrenjc93
Fix another item memo loss location + bool specialization bug (pytorc…
14d09fb 
…h#139587)

This fix was a bit more involved:
1) It fixes a item_memo loss place.
2) It updates a test to be eager instead of aot_eager since it reveals a very obscure bug related to replacements that's not worth solving since in practice inductor will regenerate the runtime asserts anyways
3) It updates tensorify to specialize more places now that the aforementioned bug is fixed.

Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=6 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

while ensuring `python test/dynamo/test_dynamic_shapes.py DynamicShapesMiscTests.test_runtime_assert_replacement_dynamic_shapes` doesn't regress

Pull Request resolved: pytorch#139587
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935
pobin6 pushed a commit to pobin6/pytorch that referenced this pull request Dec 5, 2024
@bobrenjc93
add special case for __round__ constant variables (pytorch#139583)
c107733 
Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCUDA.test_cauchy_cuda_float64` when specialize_float=False

Pull Request resolved: pytorch#139583
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935, pytorch#139587
fmo-mt pushed a commit to fmo-mt/pytorch that referenced this pull request Dec 11, 2024
@bobrenjc93 @fmo-mt
refuse to generate a symbolic variable if a float input is inf (pytor…
f4822ed 
…ch#139846)

Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCPU.test_cauchy_cpu_float64` when `specialize_float=False`

Pull Request resolved: pytorch#139846
Approved by: https://github.com/ruidazeng, https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572
fmo-mt pushed a commit to fmo-mt/pytorch that referenced this pull request Dec 11, 2024
@bobrenjc93 @fmo-mt
Trigger symfloat specialization in argument binding code (pytorch#139454
44c9fe6 
)

Fixes the test `python test/inductor/test_torchinductor.py CpuTests.test_upsample_cat_conv_cpu` when `specialize_float=False`

Pull Request resolved: pytorch#139454
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846
fmo-mt pushed a commit to fmo-mt/pytorch that referenced this pull request Dec 11, 2024
@bobrenjc93 @fmo-mt
Don't wrap inf values as symfloat (pytorch#139896)
ee95ee5 
Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=7 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

Pull Request resolved: pytorch#139896
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454
fmo-mt pushed a commit to fmo-mt/pytorch that referenced this pull request Dec 11, 2024
@bobrenjc93 @fmo-mt
specialize symfloats for wrapped_gradient in get_fake_value (pytorch#…
f20e53e 
…139935)

Fixes `PYTORCH_TEST_WITH_DYNAMO=1 python test/test_torch.py TestTorchDeviceTypeCPU.test_gradient_type_promotion_cpu` when `specialize_float=False`

Reviewers might wonder why we need to have this whitelist. Can't we rely on python_arg_parser.h to do the specialization generically? Alas this path doesn't actually FFI to C++ so we do need to do the specialization in pythonland.

Pull Request resolved: pytorch#139935
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896
fmo-mt pushed a commit to fmo-mt/pytorch that referenced this pull request Dec 11, 2024
@bobrenjc93 @fmo-mt
Fix another item memo loss location + bool specialization bug (pytorc…
78fed4b 
…h#139587)

This fix was a bit more involved:
1) It fixes a item_memo loss place.
2) It updates a test to be eager instead of aot_eager since it reveals a very obscure bug related to replacements that's not worth solving since in practice inductor will regenerate the runtime asserts anyways
3) It updates tensorify to specialize more places now that the aforementioned bug is fixed.

Fixes `PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=6 python test/inductor/test_torchinductor_opinfo.py TestInductorOpInfoCPU.test_comprehensive_linalg_norm_cpu_float16` when `specialize_float=False`

while ensuring `python test/dynamo/test_dynamic_shapes.py DynamicShapesMiscTests.test_runtime_assert_replacement_dynamic_shapes` doesn't regress

Pull Request resolved: pytorch#139587
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935
fmo-mt pushed a commit to fmo-mt/pytorch that referenced this pull request Dec 11, 2024
@bobrenjc93 @fmo-mt
add special case for __round__ constant variables (pytorch#139583)
ae3a94a 
Fixes `PYTORCH_TEST_WITH_INDUCTOR=1 tlp python test/test_torch.py TestTorchDeviceTypeCUDA.test_cauchy_cuda_float64` when specialize_float=False

Pull Request resolved: pytorch#139583
Approved by: https://github.com/ezyang
ghstack dependencies: pytorch#139569, pytorch#139457, pytorch#139568, pytorch#139572, pytorch#139846, pytorch#139454, pytorch#139896, pytorch#139935, pytorch#139587
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@ezyang ezyang ezyang approved these changes

Assignees

No one assigned

Labels

ciflow/inductor ciflow/trunk Trigger trunk jobs on your pull request fx Merged release notes: fx release notes category

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@bobrenjc93 @pytorchmergebot @ezyang @facebook-github-bot