Skip to content

Ensure dynamic tasks inside dynamic task group only marks the corresponding EmptyOperator in downstream as success.#32354

Merged
potiuk merged 1 commit into
apache:mainfrom
tirkarthi:fix-empty-task-dynamic-tasks
Jul 5, 2023
Merged

Ensure dynamic tasks inside dynamic task group only marks the corresponding EmptyOperator in downstream as success.#32354
potiuk merged 1 commit into
apache:mainfrom
tirkarthi:fix-empty-task-dynamic-tasks

Conversation

@tirkarthi

Copy link
Copy Markdown
Contributor

Ensure dynamic tasks inside dynamic task group only marks the corresponding EmptyOperator in downstream as success in the query using map_index instead of marking all EmptyOperator's in downstream as success.

Fixes #32283

@tirkarthi
tirkarthi requested review from XD-DENG, ashb and kaxil as code owners July 4, 2023 20:32
corresponding EmptyOperator in downstream as success.
@tirkarthi
tirkarthi force-pushed the fix-empty-task-dynamic-tasks branch from c7ff0dc to 03357eb Compare July 4, 2023 20:32
@potiuk

potiuk commented Jul 5, 2023

Copy link
Copy Markdown
Member

Confirmed by the user. Thanks @tirkarthi !

@potiuk
potiuk merged commit 7722b6f into apache:main Jul 5, 2023
@seeholza

seeholza commented Jul 5, 2023

Copy link
Copy Markdown

I am impressed by the turnaround time here, thanks @potiuk and @tirkarthi!

@tirkarthi
tirkarthi deleted the fix-empty-task-dynamic-tasks branch July 6, 2023 11:59
@ephraimbuddy ephraimbuddy added this to the Airlfow 2.6.3 milestone Jul 6, 2023
@ephraimbuddy ephraimbuddy added the type:bug-fix Changelog: Bug Fixes label Jul 6, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

type:bug-fix Changelog: Bug Fixes

Projects

None yet

Development

Successfully merging this pull request may close these issues.

EmptyOperator in dynamically mapped TaskGroups does not respect upstream dependencies

4 participants