Skip to content

unpin pyarrow for windows - #42097

Merged
edoakes merged 2 commits into
ray-project:masterfrom
mattip:unpin-pyarrow
Jan 25, 2024
Merged

edoakes merged 2 commits into
ray-project:masterfrom
mattip:unpin-pyarrow

Conversation

@mattip

@mattip mattip commented Dec 26, 2023 •

Copy link
Copy Markdown
Contributor

Why are these changes needed?

Toward fixing #38300

PR #29993 added a local ray fix for issue apache/arrow#26685, but at the time windows failed the tests with pyarrow7. In issue #38300 the suggested fix was

  • release the pin
  • add a version check when serializing a pyarrow dataset
  • Handle any remaining behavior gap related to _register_arrow_data_serializer(), and include an environment variable to override the Pyarrow version check

Checks

@mattip

mattip commented Dec 26, 2023

Copy link
Copy Markdown
Contributor Author

step 1: release the pin. Let's see what tests fail?

@mattip

mattip commented Dec 26, 2023

Copy link
Copy Markdown
Contributor Author

I also ran the test added in #29993 locally and it passed.

@mattip

mattip commented Jan 22, 2024

Copy link
Copy Markdown
Contributor Author

cc @anyscalesam

@mattip

mattip commented Jan 22, 2024

Copy link
Copy Markdown
Contributor Author

I think releasing the pin is enough to solve the issue.

@mattip

mattip commented Jan 25, 2024

Copy link
Copy Markdown
Contributor Author

I don't think the CI failure is related. It would be nice to get some eyes on this.

@edoakes

edoakes commented Jan 25, 2024

Copy link
Copy Markdown
Collaborator

CI failure is likely unrelated. Updating branch to re-run

@scottjlee

scottjlee commented Jan 25, 2024 •

Copy link
Copy Markdown
Contributor

Contents of PR LGTM - I triggered a postmerge test to see how things look on windows tests.
https://buildkite.com/ray-project/postmerge/builds/2689

@scottjlee scottjlee left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, @c21 to approve and merge

@RocketRider

Copy link
Copy Markdown
Contributor

Could we pick that for 2.9.2?

@tonyhoo

tonyhoo commented Feb 29, 2024

Copy link
Copy Markdown

When will this fix be released. It introduced installation issue for AutoGluon on Windows platform with Python 3.11

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants