[main] Upgrade important CI environment - #73822

…#75231)

* [v3-4-test] Make airflow-core typing hold for SQLAlchemy 2.0 and 2.1 (#74629)

SQLAlchemy 2.1 turns Select/Row/Result into TypeVarTuple generics, so
`Select[tuple[X]]` now means a one-column select of a tuple, and rows
unpack to the real (possibly nullable) column types instead of Any.

No parameterised `Select` spelling is valid on both versions, so helpers
that only refine a select they receive are generic over it, and helpers
that build their own select return an unparameterised `Select`. Nullable
columns are narrowed with `is None` checks rather than cast; the pool and
asset-event queries already exclude NULL there, while get_authorized_pools
now skips pools whose name is NULL. The 12-column task instance row, beyond
SQLAlchemy's typed select() overloads, is unpacked into locals declared
with their column types.

Type-checks with mypy on both SQLAlchemy 2.0.54 and 2.1.4.

(cherry picked from commit 675b02a)
Generated-by: Claude Opus 5

* [v3-4-test] Cap SQLAlchemy below 2.1 and type models for 2.0 and 2.1

The v3-4-test lock resolved SQLAlchemy 2.1.4, which snowflake-sqlalchemy cannot import and which broke mypy in the CI image. This ports the parts of #73822 that main uses for the same upgrade: the snowflake provider cap that keeps the workspace lock on SQLAlchemy 2.0.54, and the hybrid-expression typing in DagRun, DagModel and Backfill that holds on both versions.

Generated-by: Claude Opus 5

---------

Co-authored-by: Dev-iL <[email protected]>

…#75231)

* [v3-4-test] Make airflow-core typing hold for SQLAlchemy 2.0 and 2.1 (#74629)

SQLAlchemy 2.1 turns Select/Row/Result into TypeVarTuple generics, so
`Select[tuple[X]]` now means a one-column select of a tuple, and rows
unpack to the real (possibly nullable) column types instead of Any.

No parameterised `Select` spelling is valid on both versions, so helpers
that only refine a select they receive are generic over it, and helpers
that build their own select return an unparameterised `Select`. Nullable
columns are narrowed with `is None` checks rather than cast; the pool and
asset-event queries already exclude NULL there, while get_authorized_pools
now skips pools whose name is NULL. The 12-column task instance row, beyond
SQLAlchemy's typed select() overloads, is unpacked into locals declared
with their column types.

Type-checks with mypy on both SQLAlchemy 2.0.54 and 2.1.4.

(cherry picked from commit 675b02a)
Generated-by: Claude Opus 5

* [v3-4-test] Cap SQLAlchemy below 2.1 and type models for 2.0 and 2.1

The v3-4-test lock resolved SQLAlchemy 2.1.4, which snowflake-sqlalchemy cannot import and which broke mypy in the CI image. This ports the parts of #73822 that main uses for the same upgrade: the snowflake provider cap that keeps the workspace lock on SQLAlchemy 2.0.54, and the hybrid-expression typing in DagRun, DagModel and Backfill that holds on both versions.

Generated-by: Claude Opus 5

---------

Co-authored-by: Dev-iL <[email protected]>