[SPARK-35119] Leverage the resources in the forked repository in GitHub Actions build - ASF Jira

XML

Word

Printable

JSON

Details

Type: Umbrella
Status: Resolved
Priority: Critical
Resolution: Done
Affects Version/s: 3.0.2, 3.1.1, 3.2.0
Fix Version/s: None
Component/s: Build, Project Infra
Labels:
None

Description

We're sharing resources allocated to one AS organisation, across all ASF projects.
Now the builds sometimes have to wait up to 6 ~ 8 hours.
This JIRA targets to run the workflows in forked repositories and distributes the overhead.

Attachments

Issue Links

contains

SPARK-35157 Have a way for other people to retrigger the build in GitHub Actions

Open

SPARK-35158 Add some guides for authors to retrigger the workflow run

Open

Sub-Tasks

1.	Add GitHub status check in PR instead of a comment	Resolved	Hyukjin Kwon
2.	Distribute GitHub Actions workflows to fork repositories to share the resources	Resolved	Hyukjin Kwon
3.	Use permissive and squashed merge when syncing to the latest branch in GitHub Actions testing	Resolved	Yikun Jiang
4.	Guide users to sync branch and enable GitHub Actions in their forked repository	Resolved	Hyukjin Kwon
5.	Allow the PR source branch to include slashes.	Resolved	Takuya Ueshin
6.	Follow checkout-merge way to use the latest commit for linter, or other workflows.	Resolved	Takuya Ueshin
7.	List Python 3.8 installed libraries in build_and_test workflow	Resolved	Unassigned
8.	List Python 3.9 installed libraries in build_and_test workflow	Resolved	Xinrong Meng
9.	List PyPy3 installed libraries in build_and_test workflow	Resolved	Yikun Jiang

Activity

People

Assignee:: Hyukjin Kwon

Reporter:: Hyukjin Kwon

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 18/Apr/21 02:58

Updated:: 12/Dec/22 18:10

Resolved:: 06/Jul/21 01:42