Skip to content

Make the SerializedDAG & SerializedBaseOp be independent of Task SDK's DAG & BaseOP #52141

Closed

Description

@kaxil

Currently, models.BaseOperator and models.DAG use the Task SDK classes.

This was done to maintain backwards-compat and to get 3.0 in a timely manner.

However, we don't want to depend on Task SDK in the Scheduler or the API-server (airflow-core package) - at least not a required dependency.

We only need to ensure we have enough information for the Scheduler & API-server for a DAG & the Operator. This is done via the SerializedDAG & SerializedBaseOp.

So this task involves: figuring out how we can consolidate: SerializedDAG, models.DAG by not inheriting Task SDK; and same for SerializedBaseOp and models.BaseOperator

To do (not ordered by dependency):

Activity

  1. converted this from a draft issue on Jun 24, 2025
  2. added this to the Airflow 3.1.0 milestone on Jun 24, 2025
  3. moved this from Next 2 Weeks to In Progress in AIP-72 - Task Execution Interface and SDKon Jun 24, 2025
  4. self-assigned this
    on Aug 12, 2025
  5. uranusjr commented on Aug 13, 2025

    @uranusjr
    Member
    • BaseOperator
    • MappedOperator
    • DAG
  6. kaxil commented on Aug 31, 2025

    @kaxil
    MemberAuthor
    • Param
    • ParamsDict
    • TaskGroup
  7. 23 remaining items

  8. uranusjr commented on Oct 21, 2025

    @uranusjr
    Member

    Not done

  9. amoghrajesh commented on Nov 12, 2025

    @amoghrajesh
    Contributor

    @uranusjr we should also add an issue for BaseTrigger/BaseEventTrigger?

  10. uranusjr commented on Nov 13, 2025

    @uranusjr
    Member

    We should eventually, but I’m not sure what to do with triggerer things yet. Let’s put them off for now until we figure triggerer and dag processor split out.

  11. uranusjr commented on Jan 6, 2026

    @uranusjr
    Member

    I’m going to call this one finished. The remaining two tasks (DeadlineAlert and Partitions) are blocked by other works, and will be tracked in the parent issue instead.

  12. kaxil commented on Jan 6, 2026

    @kaxil
    MemberAuthor

    Finally 🎉

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

Type

No type

Projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions