Skip to content

Conversation

@jerryzh168
Copy link
Contributor

Summary:
We are relying on some private APIs from inductor and a recent refactor: pytorch/pytorch#125736 broken the do_bench API we rely on for autoquant, maybe we should use our own do_bench or rely on triton's directly?

Test Plan:
regression tests
python test/integration/test_integration.py -k test_autoquant_one_input_29_cuda

Reviewers:

Subscribers:

Tasks:

Tags:

Summary:
We are relying on some private APIs from inductor and a recent refactor: pytorch/pytorch#125736 broken the do_bench
API we rely on for autoquant, maybe we should use our own do_bench or rely on triton's directly?

Test Plan:
regression tests
python test/integration/test_integration.py -k test_autoquant_one_input_29_cuda

Reviewers:

Subscribers:

Tasks:

Tags:
@pytorch-bot
Copy link

pytorch-bot bot commented May 14, 2024

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/242

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit adb4b06 with merge base 6af40e5 (image):
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

@jerryzh168 jerryzh168 requested a review from cpuhrsch May 14, 2024 21:49
@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label May 14, 2024
@jerryzh168 jerryzh168 requested review from HDCharles and msaroufim May 14, 2024 21:49
@msaroufim msaroufim merged commit 8059da6 into pytorch:main May 14, 2024
lancerts pushed a commit to lancerts/ao that referenced this pull request May 17, 2024
Summary:
We are relying on some private APIs from inductor and a recent refactor: pytorch/pytorch#125736 broken the do_bench
API we rely on for autoquant, maybe we should use our own do_bench or rely on triton's directly?

Test Plan:
regression tests
python test/integration/test_integration.py -k test_autoquant_one_input_29_cuda

Reviewers:

Subscribers:

Tasks:

Tags:
@jerryzh168 jerryzh168 deleted the fix-ci branch July 15, 2024 23:16
yanbing-j pushed a commit to yanbing-j/ao that referenced this pull request Dec 9, 2024
* chat in browser

* remove jinja2 comment seems irrelavant

* remove jinja2 comment seems irrelavant

* remove debug prints

* use torchchat as entry point
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants