Empty Log w/ Failed Tasks #50853
Unanswered
marshalljacobs12
asked this question in
Q&A
Replies: 1 comment
-
|
is this related to #31764? I have Airflow 2.10.5 version and still have the issue with empty logs on retry processes |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Airflow Version: 3.0.1
When triggering ~50 dag runs from the REST API (
/api/v2/dags/{dag_id}/dagRunscalled ~50 times), the first ~35 tasks queue and run successfully (in my airflow.cfg,parallelism=32). However, as the Airflow server continues to make its way through the tasks in all the dag runs, tasks start failing with empty logs. Additionally, my DAG definition hasdefault_args={"retries": 1, "trigger_rule": "all_success"},On the tasks that leave no log file (second attempt), I also have no data about the first attempt.
All the failures happen with ECSRunTaskOperator tasks
Has anyone encountered anything similar?
Beta Was this translation helpful? Give feedback.
All reactions