Skip to content

ARROW-17233: [Packaging][Linux] Update artifact patterns - #13740

Merged
kou merged 12 commits into
apache:masterfrom
kou:packaging-linux-verify-artifacts
Aug 18, 2022
Merged

ARROW-17233: [Packaging][Linux] Update artifact patterns#13740
kou merged 12 commits into
apache:masterfrom
kou:packaging-linux-verify-artifacts

Conversation

@kou

@kou kou commented Jul 29, 2022 •
edited
Loading

Copy link
Copy Markdown
Member

Add --validate option to archery crossbow status.
If --validate is specified and there are any missing artifacts, archery crossbow status --validate is existed
with non-zero exit code. We can use it for CI to detect missing artifacts.

We can't use @github-actions crossbow submit for this change because this isn't merged into the master branch
yet. See https://github.com/ursacomputing/crossbow/branches/all?query=build-674 that is submitted nightly-packages
manually.

@kou

kou commented Jul 29, 2022

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit ubuntu-bionic-*

@github-actions

github-actions Bot commented Jul 29, 2022

Copy link
Copy Markdown

https://issues.apache.org/jira/browse/ARROW-17233

@github-actions

github-actions Bot commented Jul 29, 2022

Copy link
Copy Markdown

⚠️ Ticket has not been started in JIRA, please click 'Start Progress'.

@github-actions

github-actions Bot commented Jul 29, 2022

Copy link
Copy Markdown

Revision: 67f4f02855ef443ec52ef4a0a93ce7a2e3cadafb

Submitted crossbow builds: ursacomputing/crossbow @ actions-29cbcd52c6

Task Status
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI

@kou

kou commented Jul 29, 2022

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit ubuntu-bionic-*

@github-actions

github-actions Bot commented Jul 29, 2022

Copy link
Copy Markdown

Revision: 96072aecb01733bae6555e8f61c1920b59dfa184

Submitted crossbow builds: ursacomputing/crossbow @ actions-8d44931495

Task Status
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI

@kou

kou commented Jul 29, 2022

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit ubuntu-bionic-*

@github-actions

github-actions Bot commented Jul 29, 2022

Copy link
Copy Markdown

Revision: 1676f0d621708b40375cb0861f3af456c735a3ed

Submitted crossbow builds: ursacomputing/crossbow @ actions-d5186f5644

Task Status
ubuntu-bionic-amd64 Github Actions
ubuntu-bionic-arm64 TravisCI

@kou

kou commented Aug 1, 2022

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit ubuntu-bionic-*

@github-actions

github-actions Bot commented Aug 1, 2022

Copy link
Copy Markdown 
Failed to render template `python-wheels/github.linux.amd64.yml` with UndefinedError: 'job' is undefined
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/2772041457

@kou

kou commented Aug 1, 2022

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit ubuntu-bionic-*

@github-actions

github-actions Bot commented Aug 1, 2022

Copy link
Copy Markdown 
Failed to render template `python-wheels/github.linux.amd64.yml` with UndefinedError: 'job' is undefined
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/2772061663

@kou

kou commented Aug 1, 2022

Copy link
Copy Markdown
Member Author

@github-actions crossbow submit ubuntu-bionic-*

@github-actions

github-actions Bot commented Aug 1, 2022

Copy link
Copy Markdown 
Failed to render template `python-wheels/github.linux.amd64.yml` with UndefinedError: 'job' is undefined
The Archery job run can be found at: https://github.com/apache/arrow/actions/runs/2772382646

@kou
kou force-pushed the packaging-linux-verify-artifacts branch from e5b7bca to f400098 Compare August 12, 2022 05:25
@kou
kou force-pushed the packaging-linux-verify-artifacts branch from f400098 to 0d46eef Compare August 14, 2022 05:38
@kou
kou requested a review from kszucs August 15, 2022 06:51
@kou

kou commented Aug 15, 2022

Copy link
Copy Markdown
Member Author

@kszucs Could you review this? See the pull request description for details.

kszucs
kszucs approved these changes Aug 17, 2022
View reviewed changes

@kszucs kszucs left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks @kou!

@kou
kou merged commit 6e8f0e4 into apache:master Aug 18, 2022
@kou
kou deleted the packaging-linux-verify-artifacts branch August 18, 2022 00:23
@ursabot

ursabot commented Aug 18, 2022

Copy link
Copy Markdown

Benchmark runs are scheduled for baseline = 70c6708 and contender = 6e8f0e4. 6e8f0e4 is a master commit associated with this PR. Results will be available as each benchmark for each run completes.
Conbench compare runs links:
[Finished ⬇️0.0% ⬆️0.0%] ec2-t3-xlarge-us-east-2
[Failed ⬇️0.71% ⬆️0.03%] test-mac-arm
[Failed ⬇️1.1% ⬆️0.0%] ursa-i9-9960x
[Finished ⬇️0.75% ⬆️0.18%] ursa-thinkcentre-m75q
Buildkite builds:
[Finished] 6e8f0e4d ec2-t3-xlarge-us-east-2
[Finished] 6e8f0e4d test-mac-arm
[Failed] 6e8f0e4d ursa-i9-9960x
[Finished] 6e8f0e4d ursa-thinkcentre-m75q
[Finished] 70c67086 ec2-t3-xlarge-us-east-2
[Failed] 70c67086 test-mac-arm
[Failed] 70c67086 ursa-i9-9960x
[Finished] 70c67086 ursa-thinkcentre-m75q
Supported benchmarks:
ec2-t3-xlarge-us-east-2: Supported benchmark langs: Python, R. Runs only benchmarks with cloud = True
test-mac-arm: Supported benchmark langs: C++, Python, R
ursa-i9-9960x: Supported benchmark langs: Python, R, JavaScript
ursa-thinkcentre-m75q: Supported benchmark langs: C++, Java

zagto pushed a commit to zagto/arrow that referenced this pull request Oct 7, 2022
@kou @zagto
ARROW-17233: [Packaging][Linux] Update artifact patterns (apache#13740)
0a9bca9 
Add `--validate` option to `archery crossbow status`.
If `--validate` is specified and there are any missing artifacts, `archery crossbow status --validate` is existed
with non-zero exit code. We can use it for CI to detect missing artifacts.

We can't use `@github-actions crossbow submit` for this change because this isn't merged into the master branch
yet. See https://github.com/ursacomputing/crossbow/branches/all?query=build-674 that is submitted `nightly-packages`
manually.

Authored-by: Sutou Kouhei <[email protected]>
Signed-off-by: Sutou Kouhei <[email protected]>
@kou kou mentioned this pull request Jun 22, 2025
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@kszucs kszucs kszucs approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

3 participants

@kou @ursabot @kszucs