[inductor][cpp][gemm] improve cache blocking for small K and N #133755

jgong5 · 2024-08-17T05:45:48Z

Stack from ghstack (oldest at bottom):

cc @voznesenskym @penguinwu @EikanWang @Guobing-Chen @XiaobingSuper @zhuhaozhe @blzheng @wenzhe-nrv @jiayisunx @ipiszy @yf225 @chenyang78 @kadeng @muchulee8 @ColinPeppler @amjames @desertfire @chauhang @aakhundov

[ghstack-poisoned]

pytorch-bot · 2024-08-17T05:45:52Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/133755

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 22 New Failures

As of commit 776d741 with merge base 32f3af7 ():

NEW FAILURES - The following jobs have failed:

Check Labels / Check labels (gh)
# This PR needs a release notes: label
pull / linux-focal-py3.11-clang10 / test (default, 2, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_bfloat16'
pull / linux-focal-py3.11-clang10 / test (default, 3, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float32'
pull / linux-focal-py3.11-clang10 / test (default, 4, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float16'
pull / linux-focal-py3.12-clang10 / test (default, 2, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_float16'
pull / linux-focal-py3.12-clang10 / test (default, 3, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float32'
pull / linux-focal-py3.12-clang10 / test (default, 4, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float16'
pull / linux-focal-py3.12-clang10-experimental-split-build / test (default, 1, 3, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float16'
pull / linux-focal-py3.12-clang10-experimental-split-build / test (default, 2, 3, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_float16'
pull / linux-focal-py3.12-clang10-experimental-split-build / test (default, 3, 3, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float32'
pull / linux-focal-py3.9-clang10 / test (default, 2, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_bfloat16'
pull / linux-focal-py3.9-clang10 / test (default, 3, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float32'
pull / linux-focal-py3.9-clang10 / test (default, 4, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float16'
pull / linux-jammy-py3.10-clang15-asan / test (default, 1, 6, linux.4xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmDynamicShapesCPU::test_linear_thread_factors_dynamic_shapes_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_bfloat16'
pull / linux-jammy-py3.10-clang15-asan / test (default, 2, 6, linux.4xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float32'
pull / linux-jammy-py3.10-clang15-asan / test (default, 3, 6, linux.4xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_float16'
pull / linux-jammy-py3.10-clang15-asan / test (default, 4, 6, linux.4xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_float32'
pull / linux-jammy-py3.10-clang15-asan / test (default, 5, 6, linux.4xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmDynamicShapesCPU::test_linear_thread_factors_dynamic_shapes_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float16'
pull / linux-jammy-py3.10-clang15-asan / test (default, 6, 6, linux.4xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float16'
pull / linux-jammy-py3.9-gcc11 / test (default, 2, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_True_cpu_bfloat16'
pull / linux-jammy-py3.9-gcc11 / test (default, 3, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_bfloat16'
pull / linux-jammy-py3.9-gcc11 / test (default, 4, 4, linux.2xlarge) (gh)
'test/inductor/test_cpu_select_algorithm.py::TestSelectAlgorithmCPU::test_linear_thread_factors_batch_size_1024_in_features_1024_out_features_1024_bias_False_cpu_float32'

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[ghstack-poisoned]

ghstack-source-id: e217222 Pull Request resolved: #133755

ghstack-source-id: 6d4d2e1 Pull Request resolved: #133755

[ghstack-poisoned]

ghstack-source-id: 364f34a Pull Request resolved: #133755

[ghstack-poisoned]

ghstack-source-id: 39353e4 Pull Request resolved: #133755

[ghstack-poisoned]

ghstack-source-id: b34d569 Pull Request resolved: #133755

[ghstack-poisoned]

ghstack-source-id: 8eb235f Pull Request resolved: #133755

github-actions · 2024-11-06T11:33:56Z

Looks like this PR hasn't been updated in a while so we're going to go ahead and mark this as Stale.
Feel free to remove the Stale label if you feel this was a mistake.
If you are unable to remove the Stale label please contact a maintainer in order to do so.
If you want the bot to never mark this PR stale again, add the no-stale label.
Stale pull requests will automatically be closed after 30 days of inactivity.

Update

df681e0

[ghstack-poisoned]

jgong5 mentioned this pull request Aug 17, 2024

[inductor][cpp][gemm] easy: adjust indentation of template, var renaming etc. #133312

Closed

jgong5 mentioned this pull request Aug 17, 2024

[inductor] [cpp] improve cache blocking for is_dynamic_M #131306

Closed

pytorch-bot bot added ciflow/inductor module: inductor labels Aug 17, 2024

This was referenced Aug 17, 2024

[inductor][cpp][gemm] enable dynamic M for k-slicing #133447

Closed

[inductor][cpp][gemm] cache blocking config for dynamic shapes #133538

Closed

pytorchbot added the open source label Aug 17, 2024

jgong5 marked this pull request as draft August 17, 2024 05:46

Update

680986a

[ghstack-poisoned]

jgong5 pushed a commit that referenced this pull request Aug 17, 2024

[inductor][cpp][gemm] improve cache blocking for small K and N

b642cc2

ghstack-source-id: e217222 Pull Request resolved: #133755

chunyuan-w pushed a commit that referenced this pull request Aug 20, 2024

[inductor][cpp][gemm] improve cache blocking for small K and N

fd6d723

ghstack-source-id: 6d4d2e1 Pull Request resolved: #133755

chunyuan-w added 3 commits August 20, 2024 13:17

Update

cc541c6

[ghstack-poisoned]

Update

5909664

[ghstack-poisoned]

Update

1e13a7c

[ghstack-poisoned]

chunyuan-w pushed a commit that referenced this pull request Aug 21, 2024

[inductor][cpp][gemm] improve cache blocking for small K and N

3eecdd4

ghstack-source-id: 364f34a Pull Request resolved: #133755

chunyuan-w and others added 3 commits August 21, 2024 15:51

Update

cc3df10

[ghstack-poisoned]

Update

176ea0c

[ghstack-poisoned]

Update

7f5b244

[ghstack-poisoned]

Update

01bb38a

[ghstack-poisoned]

jgong5 mentioned this pull request Sep 5, 2024

[inductor][cpp][gemm] fix autotune runtime error from linear_binary fusion #135275

Closed

Update

b9e342d

[ghstack-poisoned]

jgong5 mentioned this pull request Sep 5, 2024

[inductor][cpp][gemm] reduce memory alloc overhead by allocating local acc once per thread #135277

Closed

jgong5 pushed a commit that referenced this pull request Sep 5, 2024

[inductor][cpp][gemm] improve cache blocking for small K and N

739aeed

ghstack-source-id: 39353e4 Pull Request resolved: #133755

Update

6960917

[ghstack-poisoned]

Update

6b7c076

[ghstack-poisoned]

Update

0b6f268

[ghstack-poisoned]

Update

712f0c2

[ghstack-poisoned]

Update

2393b00

[ghstack-poisoned]

jgong5 pushed a commit that referenced this pull request Sep 6, 2024

[inductor][cpp][gemm] improve cache blocking for small K and N

b6b1303

ghstack-source-id: b34d569 Pull Request resolved: #133755

Update

776d741

[ghstack-poisoned]

jgong5 pushed a commit that referenced this pull request Sep 7, 2024

[inductor][cpp][gemm] improve cache blocking for small K and N

32e434d

ghstack-source-id: 8eb235f Pull Request resolved: #133755

github-actions bot added the Stale label Nov 6, 2024

github-actions bot closed this Dec 6, 2024

github-actions bot deleted the gh/jgong5/69/head branch January 6, 2025 02:07

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

[inductor][cpp][gemm] improve cache blocking for small K and N #133755

[inductor][cpp][gemm] improve cache blocking for small K and N #133755

Uh oh!

jgong5 commented Aug 17, 2024 •

edited by pytorch-bot bot

Loading

Uh oh!

pytorch-bot bot commented Aug 17, 2024 •

edited

Loading

Uh oh!

github-actions bot commented Nov 6, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

[inductor][cpp][gemm] improve cache blocking for small K and N #133755

[inductor][cpp][gemm] improve cache blocking for small K and N #133755

Uh oh!

Conversation

jgong5 commented Aug 17, 2024 • edited by pytorch-bot bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Aug 17, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/133755

❌ 22 New Failures

Uh oh!

github-actions bot commented Nov 6, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

4 participants

jgong5 commented Aug 17, 2024 •

edited by pytorch-bot bot

Loading

pytorch-bot bot commented Aug 17, 2024 •

edited

Loading