Skip to content

Migrate google + pagerduty + anthropic providers to httpx2 - #72111

Merged
potiuk merged 3 commits into
apache:mainfrom
DataDog:zo/initial-httpx2-support
Sep 9, 2026
Merged

potiuk merged 3 commits into
apache:mainfrom
DataDog:zo/initial-httpx2-support

Conversation

@zach-overflow

@zach-overflow zach-overflow commented Aug 26, 2026 •

Copy link
Copy Markdown
Contributor

What?

  • Modifies these provider package' dependency on httpx → httpx2:

    1. apache-airflow-providers-google
    2. apache-airflow-providers-pagerduty
    3. apache-airflow-providers-anthropic
  • Adds comments on remaining providers which have httpx references which cannot cleanly be removed until their deps are updated.

  • Adds a pre-commit check to prevent re-introducing httpx in any additional provider packages. Runs via ast-grep for super fast import checks.

Why?


Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)
  • Generated-by: Claude Code following the guidelines
  • Scope of AI use:
    • I provided Claude Code with the list of provider directories where there was httpx usage, and claude did the per-file import replacements
    • Troubleshooting the provider packages where httpx was a transitive dependency
    • Manually found the list of providers using httpx (via ast-grep + verified in IDE).
    • Manually cleaned up the AI comments noise as needed.
    • Personally wrote the PR description.

@potiuk

potiuk commented Aug 27, 2026

Copy link
Copy Markdown
Member

If it's green, I am all in

@zach-overflow zach-overflow changed the title Migrate google + pagerduty providers to httpx2 Migrate google + pagerduty + anthropic providers to httpx2 Aug 28, 2026
Comment thread providers/.ast-grep/sgconfig.yml Resolved
@zach-overflow
zach-overflow force-pushed the zo/initial-httpx2-support branch from 9f5c64d to 54b074d Compare August 31, 2026 13:51
@zach-overflow
zach-overflow requested a review from eladkal August 31, 2026 14:09
@github-actions

github-actions Bot commented Sep 8, 2026

Copy link
Copy Markdown
Contributor

uv.lock on main just moved via #72094 ("Migrate anthropic provider to use anthropic 1.x SDK"), commit 5677af3 and this PR currently conflicts.

Quickest fix:

git fetch upstream main && git rebase upstream/main
rm uv.lock && uv lock
git add uv.lock && git rebase --continue
git push --force-with-lease

Automated nudge — ignore if you're not ready to rebase. This comment is updated in place on future uv.lock bumps.

The `httpx` package is unmaintained and Airflow is moving to the `httpx2` fork,
so providers already migrated must not drift back.

The check exempts `airbyte`, `common/ai`, `weaviate` and `microsoft/azure`,
whose third-party SDKs are still built on `httpx`. Their objects cross that
boundary, and the two packages' classes are distinct, so switching those
providers would break at runtime rather than fail loudly.
@zach-overflow
zach-overflow force-pushed the zo/initial-httpx2-support branch from 54b074d to 7a6990a Compare September 8, 2026 14:25
@zach-overflow

Copy link
Copy Markdown
Contributor Author

cc @eladkal thanks for the review. If you have a moment, do you mind taking another look?

@potiuk
potiuk merged commit 251cd91 into apache:main Sep 9, 2026
98 checks passed
imrichardwu pushed a commit to imrichardwu/airflow that referenced this pull request Sep 11, 2026
…72111)

* Migrate google + pagerduty providers to `httpx2`

* Add a prek check that keeps providers on `httpx2`

The `httpx` package is unmaintained and Airflow is moving to the `httpx2` fork,
so providers already migrated must not drift back.

The check exempts `airbyte`, `common/ai`, `weaviate` and `microsoft/azure`,
whose third-party SDKs are still built on `httpx`. Their objects cross that
boundary, and the two packages' classes are distinct, so switching those
providers would break at runtime rather than fail loudly.

* Address feedback on ast-grep pre-commit hook
xvega pushed a commit to xvega/airflow that referenced this pull request Sep 13, 2026
…72111)

* Migrate google + pagerduty providers to `httpx2`

* Add a prek check that keeps providers on `httpx2`

The `httpx` package is unmaintained and Airflow is moving to the `httpx2` fork,
so providers already migrated must not drift back.

The check exempts `airbyte`, `common/ai`, `weaviate` and `microsoft/azure`,
whose third-party SDKs are still built on `httpx`. Their objects cross that
boundary, and the two packages' classes are distinct, so switching those
providers would break at runtime rather than fail loudly.

* Address feedback on ast-grep pre-commit hook
@zach-overflow zach-overflow mentioned this pull request Sep 14, 2026
1 task done
@potiuk potiuk mentioned this pull request Sep 21, 2026
1 task done
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants