Skip to content

[major?][GH rate limit] Authenticate virtualenv provisioning downloads in CI? #2765

@webknjaz

Description

@webknjaz

Description

People have started seeing GH rate limiting unauthenticated downloads in GHA lately: https://github.com/community/maintainers/discussions/723. I thought it might just be me but this seems like a global thing.

Here's what it looks like:

Setting up build environment...

  + Download https://github.com/pypa/get-virtualenv/blob/20.26.6/public/virtualenv.pyz?raw=true to /Users/runner/Library/Caches/cibuildwheel/virtualenv-20.26.6.pyz
  Traceback (most recent call last):
    File "/Users/runner/work/_temp/cibw/bin/cibuildwheel", line 6, in <module>
      sys.exit(main())
               ^^^^^^
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/__main__.py", line 49, in main
      main_inner(global_options)
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/__main__.py", line 204, in main_inner
      build_in_directory(args)
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/__main__.py", line 351, in build_in_directory
      platform_module.build(options, tmp_path)
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/macos.py", line 444, in build
      base_python, env = setup_python(
                         ^^^^^^^^^^^^^
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/macos.py", line 234, in setup_python
      env = virtualenv(
            ^^^^^^^^^^^
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/util.py", line 682, in virtualenv
      virtualenv_app = _ensure_virtualenv(version)
                       ^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/util.py", line 613, in _ensure_virtualenv
      download(url, path)
    File "/Users/runner/work/_temp/cibw/lib/python3.12/site-packages/cibuildwheel/util.py", line 338, in download
      with urllib.request.urlopen(url, context=context) as response:
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/urllib/request.py", line 215, in urlopen
      return opener.open(url, data, timeout)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
    File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/urllib/request.py", line 521, in open
      response = meth(req, response)
                 ^^^^^^^^^^^^^^^^^^^
    File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/urllib/request.py", line 630, in http_response
      response = self.parent.error(
                 ^^^^^^^^^^^^^^^^^^
    File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/urllib/request.py", line 559, in error
      return self._call_chain(*args)
             ^^^^^^^^^^^^^^^^^^^^^^^
    File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/urllib/request.py", line 492, in _call_chain
      result = func(*args)
               ^^^^^^^^^^^
    File "/Library/Frameworks/Python.framework/Versions/3.12/lib/python3.12/urllib/request.py", line 639, in http_error_default
      raise HTTPError(req.full_url, code, msg, hdrs, fp)
  urllib.error.HTTPError: HTTP Error 429: Too Many Requests

Build log

https://github.com/ansible/pylibssh/actions/runs/22877040123/job/66371279101?pr=648#step:6:275

CI config

(not really relevant but feel free to check the repo)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions