[CI] change conda to miniforge for XPU images #134455

chuanqi129 · 2024-08-26T10:13:01Z

The .ci/docker change with ciflow/xpu label will trigger docker images rebuild on xpu runner, but xpu runner can't use miniconda, change to miniforge. Works for #114850

pytorch-bot · 2024-08-26T10:13:04Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/134455

📄 Preview Python docs built from this PR
📄 Preview C++ docs built from this PR
❓ Need help or want to give feedback on the CI? Visit the bot commands wiki or our office hours

Note: Links to docs will display an error until the docs builds have been completed.

❌ 1 Cancelled Job, 1 Unrelated Failure

As of commit 4b6b1ba with merge base 97c8a07 ():

CANCELLED JOB - The following job was cancelled. Please retry:

Check Labels / Check labels (gh)

BROKEN TRUNK - The following job failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

trunk / linux-focal-rocm6.1-py3.8 / test (default, 1, 2, linux.rocm.gpu) (gh) (trunk failure)
test_nn.py::TestNNDeviceTypeCUDA::test_transformerencoderlayer_cuda_float32

This comment was automatically generated by Dr. CI and updates every 15 minutes.

chuanqi129 · 2024-08-26T10:15:18Z

Refer the xpu test failure https://github.com/pytorch/pytorch/actions/runs/10553984824/job/29236258127?pr=134074

chuanqi129 · 2024-08-27T00:49:55Z

@pytorchbot rebase -b main

pytorchmergebot · 2024-08-27T00:51:29Z

@pytorchbot started a rebase job onto refs/remotes/origin/main. Check the current status here

pytorchmergebot · 2024-08-27T00:51:33Z

Successfully rebased xpu_docker_conda onto refs/remotes/origin/main, please pull locally before adding more changes (for example, via git checkout xpu_docker_conda && git pull --rebase)

Seeing failures like this: ``` #49 844.6 //build_scripts/manylinux1-check.py:6: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives ..... [python 3/3] RUN bash build_scripts/build.sh && rm -r build_scripts: 846.9 ...it did, yay. 846.9 + for PYTHON in '/opt/python/*/bin/python' 846.9 + /opt/python/cpython-3.12.0/bin/python build_scripts/manylinux1-check.py 847.0 Traceback (most recent call last): 847.0 File "//build_scripts/manylinux1-check.py", line 55, in <module> 847.0 if is_manylinux1_compatible(): 847.0 ^^^^^^^^^^^^^^^^^^^^^^^^^^ 847.0 File "//build_scripts/manylinux1-check.py", line 6, in is_manylinux1_compatible 847.0 from distutils.util import get_platform 847.0 ModuleNotFoundError: No module named 'distutils' ------ ``` PR: #134455 Pull Request resolved: #134595 Approved by: https://github.com/kit1980, https://github.com/seemethere, https://github.com/malfet

chuanqi129 · 2024-08-28T02:11:12Z

@pytorchbot rebase -b main

pytorchmergebot · 2024-08-28T02:12:37Z

@pytorchbot started a rebase job onto refs/remotes/origin/main. Check the current status here

pytorchmergebot · 2024-08-28T02:12:41Z

Successfully rebased xpu_docker_conda onto refs/remotes/origin/main, please pull locally before adding more changes (for example, via git checkout xpu_docker_conda && git pull --rebase)

chuanqi129 · 2024-08-28T05:22:43Z

@pytorchbot rebase -b viable/strict

pytorchmergebot · 2024-08-28T05:24:14Z

@pytorchbot started a rebase job onto refs/remotes/origin/viable/strict. Check the current status here

pytorchmergebot · 2024-08-28T05:24:17Z

Tried to rebase and push PR #134455, but it was already up to date. Try rebasing against main by issuing:
@pytorchbot rebase -b main

chuanqi129 · 2024-08-28T12:11:51Z

@pytorchbot rebase -b main

pytorchmergebot · 2024-08-28T12:13:16Z

@pytorchbot started a rebase job onto refs/remotes/origin/main. Check the current status here

pytorchmergebot · 2024-08-28T12:13:19Z

Successfully rebased xpu_docker_conda onto refs/remotes/origin/main, please pull locally before adding more changes (for example, via git checkout xpu_docker_conda && git pull --rebase)

chuanqi129 · 2024-08-28T14:11:32Z

@pytorchbot merge

pytorchmergebot · 2024-08-28T14:13:19Z

Merge started

Your change will be merged once all checks pass (ETA 0-4 Hours).

Learn more about merging in the wiki.

Questions? Feedback? Please reach out to the PyTorch DevX Team

Advanced Debugging

Check the merge workflow status
here

Seeing failures like this: ``` pytorch#49 844.6 //build_scripts/manylinux1-check.py:6: DeprecationWarning: The distutils package is deprecated and slated for removal in Python 3.12. Use setuptools or check PEP 632 for potential alternatives ..... [python 3/3] RUN bash build_scripts/build.sh && rm -r build_scripts: 846.9 ...it did, yay. 846.9 + for PYTHON in '/opt/python/*/bin/python' 846.9 + /opt/python/cpython-3.12.0/bin/python build_scripts/manylinux1-check.py 847.0 Traceback (most recent call last): 847.0 File "//build_scripts/manylinux1-check.py", line 55, in <module> 847.0 if is_manylinux1_compatible(): 847.0 ^^^^^^^^^^^^^^^^^^^^^^^^^^ 847.0 File "//build_scripts/manylinux1-check.py", line 6, in is_manylinux1_compatible 847.0 from distutils.util import get_platform 847.0 ModuleNotFoundError: No module named 'distutils' ------ ``` PR: pytorch#134455 Pull Request resolved: pytorch#134595 Approved by: https://github.com/kit1980, https://github.com/seemethere, https://github.com/malfet

The `.ci/docker` change with `ciflow/xpu` label will trigger docker images rebuild on xpu runner, but xpu runner can't use miniconda, change to miniforge. Works for pytorch#114850 Pull Request resolved: pytorch#134455 Approved by: https://github.com/atalman

chuanqi129 requested a review from jeffdaily as a code owner August 26, 2024 10:13

pytorch-bot bot added the topic: not user facing topic category label Aug 26, 2024

chuanqi129 requested review from EikanWang and atalman August 26, 2024 10:13

chuanqi129 added the ciflow/xpu Run XPU CI tasks label Aug 26, 2024

pytorchbot added the open source label Aug 26, 2024

pytorchmergebot force-pushed the xpu_docker_conda branch from 854dd0a to 24708ce Compare August 27, 2024 00:51

zou3519 added the triaged This issue has been looked at a team member, and triaged and prioritized into an appropriate module label Aug 27, 2024

atalman approved these changes Aug 27, 2024

View reviewed changes

atalman mentioned this pull request Aug 27, 2024

[CD] Fix docker builds by installing setuptools #134595

Closed

pytorchmergebot force-pushed the xpu_docker_conda branch from 24708ce to 292af25 Compare August 28, 2024 02:12

chuanqi129 added the ciflow/trunk Trigger trunk jobs on your pull request label Aug 28, 2024

[CI] change conda to miniforge for XPU images

4b6b1ba

pytorchmergebot force-pushed the xpu_docker_conda branch from 292af25 to 4b6b1ba Compare August 28, 2024 12:13

pytorchmergebot added the merging label Aug 28, 2024

pytorchmergebot added the Merged label Aug 28, 2024

pytorchmergebot removed the merging label Aug 28, 2024

pytorchmergebot closed this in 85d9946 Aug 28, 2024

[CI] change conda to miniforge for XPU images #134455

[CI] change conda to miniforge for XPU images #134455

Uh oh!

Conversation

chuanqi129 commented Aug 26, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Aug 26, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/134455

❌ 1 Cancelled Job, 1 Unrelated Failure

Uh oh!

chuanqi129 commented Aug 26, 2024

Uh oh!

chuanqi129 commented Aug 27, 2024

Uh oh!

pytorchmergebot commented Aug 27, 2024

Uh oh!

pytorchmergebot commented Aug 27, 2024

Uh oh!

chuanqi129 commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Uh oh!

chuanqi129 commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Uh oh!

chuanqi129 commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Uh oh!

chuanqi129 commented Aug 28, 2024

Uh oh!

pytorchmergebot commented Aug 28, 2024

Merge started

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

chuanqi129 commented Aug 26, 2024 •

edited

Loading

pytorch-bot bot commented Aug 26, 2024 •

edited

Loading