Repository navigation
chore: Extend pandas version support - #3664
sudohainguyen wants to merge 6 commits into
Conversation
53a5c0f to
eb39b04
Compare
|
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: adchia, sudohainguyen The full list of commands accepted by this bot can be found here. The pull request process is described here DetailsNeeds approval from an approver in each of these files:
Approvers can indicate their approval by writing |
|
hi @adchia java integration test failed |
eb39b04 to
793bd07
Compare
|
New changes are detected. LGTM label has been removed. |
|
just retriggered the pipelines, please approve again @adchia |
Signed-off-by: Hai Nguyen <[email protected]>
Signed-off-by: Danny C <[email protected]>
|
Turns out this was a legitimate error (the tests also showed an issue with the pyarrow version used in the java tests). Fixed it + updated teh requirements.txt files too |
|
Looks like there's some failing tests from the upgrade |
Signed-off-by: Hai Nguyen <[email protected]>
99c62e5 to
0773d25
Compare
Signed-off-by: Hai Nguyen <[email protected]>
Signed-off-by: Hai Nguyen <[email protected]>
|
looks like latest pyspark is not ready yet for pandas 2.0 (will be fixed in pyspark 4.0.0 apache/spark#42920) we're encountering the same issue with datetime64 dtype |
What this PR does / why we need it:
Which issue(s) this PR fixes:
Fixes #3709