-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Closed
Labels
Description
Apache Airflow version
2.4.2
What happened
In the scenario where we have 2 dags, 1 dag dependent on the other by having an ExternalTaskMarker on the parent dag pointing to the child dag and we have some number of mapped tasks in the child dag that have been expanded (map_index is not -1).
If we were to clear the parent dag, the child dag's mapped tasks will NOT be cleared. It will not appear in the "Task instances to be cleared" list
What you think should happen instead
I believe the behaviour should be having the child dag's mapped tasks cleared when the parent dag is cleared.
How to reproduce
- Create a parent dag with an ExternalTaskMarker
- Create a child dag which has some ExternalTaskSensor that the ExternalTaskMarker is pointing to
- Add any number of mapped tasks downstream of that ExternalTaskSensor
- Clear the parent dag's ExternalTaskMarker (or any task upstream of it)
Operating System
Mac OS Monterey 12.6
Versions of Apache Airflow Providers
No response
Deployment
Official Apache Airflow Helm Chart
Deployment details
No response
Anything else
No response
Are you willing to submit PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct