Skip to content

Commit 8804b1a

Browse files
authored
Shaves-off about 3 minutes from usage of ARM instances on CI (#24052)
Preparing airflow packages and provider packages does not need to be done on ARM and actually the ARM instance is idle while they are prepared during cache building. This change moves preparation of the packages to before the ARM instance is started which saves about 3 minutes of ARM instance time.
1 parent 2247b6d commit 8804b1a

File tree

1 file changed

+12
-12
lines changed

1 file changed

+12
-12
lines changed

.github/workflows/ci.yml

Lines changed: 12 additions & 12 deletions
Original file line numberDiff line numberDiff line change
@@ -1684,16 +1684,6 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
16841684
- run: ./scripts/ci/install_breeze.sh
16851685
- name: "Free space"
16861686
run: breeze free-space
1687-
- name: "Start ARM instance"
1688-
run: ./scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh
1689-
if: matrix.platform == 'linux/arm64'
1690-
- name: "Push CI cache ${{ matrix.python-version }} ${{ matrix.platform }}"
1691-
run: >
1692-
breeze build-image
1693-
--prepare-buildx-cache
1694-
--platform ${{ matrix.platform }}
1695-
env:
1696-
PYTHON_MAJOR_MINOR_VERSION: ${{ matrix.python-version }}
16971687
- name: >
16981688
Pull CI image for PROD build
16991689
${{ env.PYTHON_MAJOR_MINOR_VERSION }}:${{ env.IMAGE_TAG_FOR_THE_BUILD }}"
@@ -1704,17 +1694,27 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
17041694
IMAGE_TAG: ${{ env.IMAGE_TAG_FOR_THE_BUILD }}
17051695
- name: "Cleanup dist and context file"
17061696
run: rm -fv ./dist/* ./docker-context-files/*
1707-
- name: "Prepare providers packages"
1697+
- name: "Prepare providers packages for PROD build"
17081698
run: >
17091699
breeze prepare-provider-packages
17101700
--package-list-file ./scripts/ci/installed_providers.txt
17111701
--package-format wheel
17121702
env:
17131703
VERSION_SUFFIX_FOR_PYPI: "dev0"
1714-
- name: "Prepare airflow package"
1704+
- name: "Prepare airflow package for PROD build"
17151705
run: breeze prepare-airflow-package --package-format wheel
17161706
env:
17171707
VERSION_SUFFIX_FOR_PYPI: "dev0"
1708+
- name: "Start ARM instance"
1709+
run: ./scripts/ci/images/ci_start_arm_instance_and_connect_to_docker.sh
1710+
if: matrix.platform == 'linux/arm64'
1711+
- name: "Push CI cache ${{ matrix.python-version }} ${{ matrix.platform }}"
1712+
run: >
1713+
breeze build-image
1714+
--prepare-buildx-cache
1715+
--platform ${{ matrix.platform }}
1716+
env:
1717+
PYTHON_MAJOR_MINOR_VERSION: ${{ matrix.python-version }}
17181718
- name: "Move dist packages to docker-context files"
17191719
run: mv -v ./dist/*.whl ./docker-context-files
17201720
- name: "Push PROD cache ${{ matrix.python-version }} ${{ matrix.platform }}"

0 commit comments

Comments
 (0)