Skip to content

Build wheels in multiple platforms with QEMU#160

Merged
oschwald merged 2 commits intomaxmind:mainfrom
kpark-hrp:kpark/qemu-build-aarch64
Apr 12, 2024
Merged

Build wheels in multiple platforms with QEMU#160
oschwald merged 2 commits intomaxmind:mainfrom
kpark-hrp:kpark/qemu-build-aarch64

Conversation

@kpark-hrp
Copy link
Contributor

@kpark-hrp kpark-hrp commented Apr 11, 2024 •
edited
Loading

This will build Linux wheels in multiple platforms using QEMU.

Example from cibuildwheel

fixes #159

@kpark-hrp
Copy link
Contributor Author

kpark-hrp commented Apr 11, 2024

@oschwald Can you take a look at this PR? And after this PR is merged, can you do a release for updated/new wheels?

@oschwald
Copy link
Member

oschwald commented Apr 11, 2024

@kpark-hrp it still hasn't finished building. I think the 30+ minute builds will be an issue. Maybe we could just limit this to auto aarch64 for now and wait to see if anyone specifically requests the other platforms. s390x was discontinued in 2004, for instance.

@kpark-hrp
Copy link
Contributor Author

kpark-hrp commented Apr 11, 2024 •
edited
Loading

@oschwald Make sense. Pushed a commit to trim it down to auto aarch64. Let's see how long this one takes

@kpark-hrp
Copy link
Contributor Author

kpark-hrp commented Apr 11, 2024

@oschwald Still took a while, but brought it down to 17 minutes from 35 minutes. And it looks good to me.

39 wheels produced in 18 minutes:
  maxminddb-2.6.0-cp310-cp310-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                       87 kB
  maxminddb-2.6.0-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                         86 kB
  maxminddb-2.6.0-cp310-cp310-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl          85 kB
  maxminddb-2.6.0-cp310-cp310-musllinux_1_1_aarch64.whl                                                              91 kB
  maxminddb-2.6.0-cp310-cp310-musllinux_1_1_i686.whl                                                                 89 kB
  maxminddb-2.6.0-cp310-cp310-musllinux_1_1_x86_64.whl                                                               90 kB
  maxminddb-2.6.0-cp311-cp311-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                       87 kB
  maxminddb-2.6.0-cp311-cp311-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                         86 kB
  maxminddb-2.6.0-cp311-cp311-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl          85 kB
  maxminddb-2.6.0-cp311-cp311-musllinux_1_1_aarch64.whl                                                              92 kB
  maxminddb-2.6.0-cp311-cp311-musllinux_1_1_i686.whl                                                                 90 kB
  maxminddb-2.6.0-cp311-cp311-musllinux_1_1_x86_64.whl                                                               91 kB
  maxminddb-2.6.0-cp312-cp312-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                       88 kB
  maxminddb-2.6.0-cp312-cp312-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                         88 kB
  maxminddb-2.6.0-cp312-cp312-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl          86 kB
  maxminddb-2.6.0-cp312-cp312-musllinux_1_1_aarch64.whl                                                              93 kB
  maxminddb-2.6.0-cp312-cp312-musllinux_1_1_i686.whl                                                                 91 kB
  maxminddb-2.6.0-cp312-cp312-musllinux_1_1_x86_64.whl                                                               92 kB
  maxminddb-2.6.0-cp38-cp38-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                         88 kB
  maxminddb-2.6.0-cp38-cp38-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                           87 kB
  maxminddb-2.6.0-cp38-cp38-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl            86 kB
  maxminddb-2.6.0-cp38-cp38-musllinux_1_1_aarch64.whl                                                                92 kB
  maxminddb-2.6.0-cp38-cp38-musllinux_1_1_i686.whl                                                                   90 kB
  maxminddb-2.6.0-cp38-cp38-musllinux_1_1_x86_64.whl                                                                 91 kB
  maxminddb-2.6.0-cp39-cp39-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                         87 kB
  maxminddb-2.6.0-cp39-cp39-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                           86 kB
  maxminddb-2.6.0-cp39-cp39-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl            84 kB
  maxminddb-2.6.0-cp39-cp39-musllinux_1_1_aarch64.whl                                                                91 kB
  maxminddb-2.6.0-cp39-cp39-musllinux_1_1_i686.whl                                                                   89 kB
  maxminddb-2.6.0-cp39-cp39-musllinux_1_1_x86_64.whl                                                                 90 kB
  maxminddb-2.6.0-pp310-pypy310_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                37 kB
  maxminddb-2.6.0-pp310-pypy310_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                  37 kB
  maxminddb-2.6.0-pp310-pypy310_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl   38 kB
  maxminddb-2.6.0-pp38-pypy38_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                  37 kB
  maxminddb-2.6.0-pp38-pypy38_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                    37 kB
  maxminddb-2.6.0-pp38-pypy38_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl     38 kB
  maxminddb-2.6.0-pp39-pypy39_pp73-manylinux_2_17_aarch64.manylinux2014_aarch64.whl                                  37 kB
  maxminddb-2.6.0-pp39-pypy39_pp73-manylinux_2_17_x86_64.manylinux2014_x86_64.whl                                    37 kB
  maxminddb-2.6.0-pp39-pypy39_pp73-manylinux_2_5_i686.manylinux1_i686.manylinux_2_17_i686.manylinux2014_i686.whl     38 kB

@oschwald
Copy link
Member

oschwald commented Apr 12, 2024

17 minutes isn't ideal, but it also isn't that bad. Thanks !

@oschwald oschwald merged commit 0ceb187 into maxmind:main Apr 12, 2024
@kpark-hrp kpark-hrp deleted the kpark/qemu-build-aarch64 branch April 12, 2024 18:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@oschwald oschwald oschwald approved these changes

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

Linux aarch64/arm64 whl releases

2 participants

@kpark-hrp @oschwald