Skip to content

Python pyarrow should include orc support #212863

@icyrockcom

Description

@icyrockcom

Describe the bug

A clear and concise description of what the bug is.

Python pyarrow package:

https://github.com/NixOS/nixpkgs/blob/def9e420d27c951026d57dc96ce0218c3131f412/pkgs/development/python-modules/pyarrow/default.nix

is not built with orc support. Orc support is built by default in the upstream wheel packaging:

https://github.com/apache/arrow/blob/fc55807143d93c1be65f7416965ac65243e27923/ci/scripts/python_wheel_manylinux_build.sh#L58

Steps To Reproduce

Steps to reproduce the behavior:

  1. ...
  2. ...
  3. ...
$ python
Python 3.10.8 (main, Oct 11 2022, 11:35:05) [GCC 11.3.0] on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import pyarrow.orc
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/nix/store/41w6myk53hrl5jjgwxgi7cydj9h3c2r4-python3-3.10.8-env/lib/python3.10/site-packages/pyarrow/orc.py", line 23, in <module>
    import pyarrow._orc as _orc
ModuleNotFoundError: No module named 'pyarrow._orc'
>>> 

Expected behavior

A clear and concise description of what you expected to happen.

Screenshots

If applicable, add screenshots to help explain your problem.

Additional context

Add any other context about the problem here.

A perhaps relevant arrow issue comment:

apache/arrow#24042 (comment)

Notify maintainers

@veprbl @cpcloud

Metadata

Please run nix-shell -p nix-info --run "nix-info -m" and paste the result.

[user@system:~]$ nix-shell -p nix-info --run "nix-info -m"
 - system: `"x86_64-linux"`
 - host os: `Linux 5.15.86, NixOS, 23.05 (Stoat), 23.05.20230104.9813adc`
 - multi-user?: `yes`
 - sandbox: `yes`
 - version: `nix-env (Nix) 2.12.0`
 - nixpkgs: `/nix/var/nix/profiles/per-user/root/channels/nixos`

Metadata

Metadata

Assignees

No one assigned

    Labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions