Skip to content

apache-beam: 2.61.0 -> 2.62.0#379201

Merged
SuperSandro2000 merged 1 commit intoNixOS:masterfrom
apraga:apache-beam-2.62.0
Feb 6, 2025
Merged

apache-beam: 2.61.0 -> 2.62.0#379201
SuperSandro2000 merged 1 commit intoNixOS:masterfrom
apraga:apache-beam-2.62.0

Conversation

@apraga
Copy link
Copy Markdown
Contributor

@apraga apraga commented Feb 3, 2025

Here is my attempt to update this infamous package. I have excluded more tests to make it work. At the moment:
3128 passed, 973 skipped, 6015 warnings

My motivation is to avoid letting this package rot and this commit should be a starting point for future work to improve this package. Maybe opening an issue to track that would be great ?

Things done

  • Built on platform(s)
    • x86_64-linux
    • aarch64-linux
    • x86_64-darwin
    • aarch64-darwin
  • For non-Linux: Is sandboxing enabled in nix.conf? (See Nix manual)
    • sandbox = relaxed
    • sandbox = true
  • Tested, as applicable:
  • Tested compilation of all packages that depend on this change using nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD". Note: all changes have to be committed, also see nixpkgs-review usage nixpkgs_review.errors.NixpkgsReviewError: Failed to list packages: nix-env failed with exit code -9
  • Tested basic functionality of all binary files (usually in ./result/bin/) : not applicable (sdk)
  • 25.05 Release Notes (or backporting 24.11 and 25.05 Release notes)
    • (Package updates) Added a release notes entry if the change is major or breaking
    • (Module updates) Added a release notes entry if the change is significant
    • (Module addition) Added a release notes entry if adding a new NixOS module
  • Fits CONTRIBUTING.md.

@GaetanLepage for help and advice as promised !


Add a 👍 reaction to pull requests you find important.

@github-actions github-actions bot added the 6.topic: python Python is a high-level, general-purpose programming language. label Feb 3, 2025
@apraga apraga requested a review from GaetanLepage February 3, 2025 22:53
@apraga apraga force-pushed the apache-beam-2.62.0 branch from 5a2376b to a6b03b9 Compare February 3, 2025 22:55
@github-actions github-actions bot added 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux. labels Feb 3, 2025
@nix-owners nix-owners bot requested a review from ndl February 3, 2025 23:00
@GaetanLepage
Copy link
Copy Markdown
Contributor

I would encourage you to report as many failures as possible upstream.

@apraga apraga force-pushed the apache-beam-2.62.0 branch from a6b03b9 to b396e42 Compare February 3, 2025 23:14
@apraga
Copy link
Copy Markdown
Contributor Author

apraga commented Feb 3, 2025

Good point. I'll create some issues and update the PR with the links.

@apraga
Copy link
Copy Markdown
Contributor Author

apraga commented Feb 4, 2025

@GaetanLepage issues have been opened upstream ! If the changes are OK with you, could you run nix-shell -p nixpkgs-review --run "nixpkgs-review rev HEAD" for me please (it eats all my RAM...) ?

If that pass, could you tag someone for reviewing/merging (as you see fit) ? Thanks :)

@GaetanLepage
Copy link
Copy Markdown
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 379201


x86_64-linux

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

aarch64-linux

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

x86_64-darwin

❌ 4 packages failed to build:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist

aarch64-darwin

❌ 4 packages failed to build:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist

@apraga
Copy link
Copy Markdown
Contributor Author

apraga commented Feb 5, 2025

Thanks for the testing ! Are you okay with marking all 3.13 and all arch + darwin as broken ?

Copy link
Copy Markdown
Contributor

@GaetanLepage GaetanLepage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Also,

  • Remove with lib; in meta
  • propagatedBuildInputs -> dependencies.

@apraga apraga force-pushed the apache-beam-2.62.0 branch from 2523640 to c27ea0c Compare February 5, 2025 23:12
@apraga
Copy link
Copy Markdown
Contributor Author

apraga commented Feb 5, 2025

Updated with you corrections. Tests stlll pass on python312 x86_64

@GaetanLepage
Copy link
Copy Markdown
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 379201


x86_64-linux

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

aarch64-linux

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

x86_64-darwin

❌ 4 packages failed to build:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist

aarch64-darwin

❌ 4 packages failed to build:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist

@GaetanLepage
Copy link
Copy Markdown
Contributor

Updated with you corrections. Tests stlll pass on python312 x86_64

Thanks ! I'm diagnosing the remaining darwin failures.
Is it fine to you if I force-push my changes ?

@apraga
Copy link
Copy Markdown
Contributor Author

apraga commented Feb 6, 2025

Please do ! (Though I did not know it was possible as it’s my PR !).

@GaetanLepage
Copy link
Copy Markdown
Contributor

Please do ! (Though I did not know it was possible as it’s my PR !).

As I am a committer I can do that ;)

@ofborg ofborg bot added the 2.status: merge conflict This PR has merge conflicts with the target branch label Feb 6, 2025
@ofborg ofborg bot removed the 2.status: merge conflict This PR has merge conflicts with the target branch label Feb 6, 2025
@GaetanLepage GaetanLepage changed the title apache-beam: 2.59.0 -> 2.62.0 apache-beam: 2.61.0 -> 2.62.0 Feb 6, 2025
@GaetanLepage
Copy link
Copy Markdown
Contributor

nixpkgs-review result

Generated using nixpkgs-review.

Command: nixpkgs-review pr 379201


x86_64-linux

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

aarch64-linux

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

x86_64-darwin

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

aarch64-darwin

❌ 2 packages failed to build:
  • python313Packages.apache-beam
  • python313Packages.apache-beam.dist
✅ 2 packages built:
  • python312Packages.apache-beam
  • python312Packages.apache-beam.dist

Copy link
Copy Markdown
Contributor

@GaetanLepage GaetanLepage left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

There was the staging-next merge in the meantime.
I was able to adapt the PR and apache-beam now builds fine on all four platforms.
Python 3.13 cannot be tested as some dependencies are broken there.

Thank you @apraga for dealing with this package !

@apraga
Copy link
Copy Markdown
Contributor Author

apraga commented Feb 6, 2025 via email

@SuperSandro2000 SuperSandro2000 merged commit 8389c06 into NixOS:master Feb 6, 2025
@apraga apraga deleted the apache-beam-2.62.0 branch February 8, 2025 10:35
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

6.topic: python Python is a high-level, general-purpose programming language. 10.rebuild-darwin: 1-10 This PR causes between 1 and 10 packages to rebuild on Darwin. 10.rebuild-linux: 1-10 This PR causes between 1 and 10 packages to rebuild on Linux.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants