Skip to content

Clearing the parent dag will not clear child dag's mapped tasks #27462

@zhiyong-ong

Description

@zhiyong-ong

Apache Airflow version

2.4.2

What happened

In the scenario where we have 2 dags, 1 dag dependent on the other by having an ExternalTaskMarker on the parent dag pointing to the child dag and we have some number of mapped tasks in the child dag that have been expanded (map_index is not -1).
If we were to clear the parent dag, the child dag's mapped tasks will NOT be cleared. It will not appear in the "Task instances to be cleared" list

What you think should happen instead

I believe the behaviour should be having the child dag's mapped tasks cleared when the parent dag is cleared.

How to reproduce

  1. Create a parent dag with an ExternalTaskMarker
  2. Create a child dag which has some ExternalTaskSensor that the ExternalTaskMarker is pointing to
  3. Add any number of mapped tasks downstream of that ExternalTaskSensor
  4. Clear the parent dag's ExternalTaskMarker (or any task upstream of it)

Operating System

Mac OS Monterey 12.6

Versions of Apache Airflow Providers

No response

Deployment

Official Apache Airflow Helm Chart

Deployment details

No response

Anything else

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions