[tests] add a test on torch compile for varied resolutions#11776
[tests] add a test on torch compile for varied resolutions#11776
Conversation
sayakpaul
added
performance
yiyixuxu
left a comment
yiyixuxu
left a comment
There was a problem hiding this comment.
thanks
we also can update the doc for hot swap lora then?
I haven't added a test for this in our Hotswap + Compilation tests: diffusers/tests/models/test_modeling_common.py Line 1971 in 7bc0a07 I will do so in a future PR. But meanwhile, let me update the docs: |
|
Cc: @AstraliteHeart this is how I envisioned the test for dynamic compilation. If you have time, it'd be great to have these tests enabled for AuraFlow, too :) |
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
Co-authored-by: Steven Liu <[email protected]>
4 participants
What does this PR do?
After #11360 and #11297, we can notice how
torch.compile()can also benefit scenarios that go through shape changes.This PR adds a test to catch recompilation errors on shape changes when compilation was performed with
dynamic=True. I think it mimics many practical user workflows.Requesting a review from Yiyi as you were interested in this feature.
Cc: @anijain2305 @StrongerXi for visibility.