Skip to content

python: provide free-threaded wheels #3548

Closed

Description

@lidavidm

What feature or improvement would you like to see?

Our API surface is minimal so hopefully this should be straightforward, but we need Cython to provide support first. It appears some is provided but we may want to wait for a new release: https://cython.readthedocs.io/en/latest/src/userguide/freethreading.html

Activity

  1. lidavidm commented on Oct 8, 2025

    @lidavidm
    MemberAuthor

    Alternatively, we could explore nanobind etc...

  2. ngoldbaum commented on Oct 13, 2025

    @ngoldbaum

    Cython does support free-threading and you should be able to update your current code to work with the free-threaded build. Lots of other projects (numpy, pandas, scipy to name a few) are shipping free-threaded wheels on pypi using Cython's support.

    I'm one of the authors of the free-threaded Python guide which has a lot more advice for porting libraries to support the free-threaded build. I'm happy to answer questions.

  3. lidavidm commented on Oct 13, 2025

    @lidavidm
    MemberAuthor

    Ah, I thought I saw that they were using a prerelease Cython wheel from an alternate channel. If the standard conda-forge/pypi release supports it, then I'll give it a shot.

  4. self-assigned this
    on Oct 13, 2025
  5. added this to the ADBC Libraries 21 milestone on Oct 13, 2025
  6. added 2 commits that reference this issue on Oct 14, 2025
    790727a
    7876213
  7. paultiq commented on Oct 14, 2025

    @paultiq

    FYI, It doesn't look like there's CI for free threading though... at least, don't see it using the pyarrow nightly, unless I'm reading this wrong. Maybe in another issue perhaps, or change this issue title to be clearer (since it seems like the feature is done from the title).

    Pyarrow just added nightly's for free threading, DuckDB hasn't shipped any (it's in a branch I'm working on), etc.

    For my work, I've had to setup different workflows to pull the nightly's and test against the free threaded 3.14t.

    Edit: Nevermind, I see you added #3574

  8. lidavidm commented on Oct 14, 2025

    @lidavidm
    MemberAuthor

    Yeah, PyArrow is in the middle of the release process so then I can update. I figured it would be easier just to wait a couple weeks. (3.13t is being tested in CI too, at least with whatever version of PyArrow was uploaded - we don't exercise all that much of PyArrow so it seems to be OK.)

  9. paultiq commented on Oct 14, 2025

    @paultiq

    Thx, I'll test against main then

    I appreciate your work!

  10. lidavidm commented on Oct 14, 2025

    @lidavidm
    MemberAuthor

    We do publish nightlies as well: https://manage.fury.io/arrow-adbc-nightlies/python:adbc-driver-manager/

    (As of this writing they haven't updated for yesterday's changes yet, but should soon.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Labels

Type

No type

Projects

No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions