Allow to set execution_timeout default value in airflow.cfg #18578
Description
Discussed in #18411
Originally posted by alexInhert September 21, 2021
Description
Currently the default value of execution_timeout in base operator is None
airflow/airflow/models/baseoperator.py
Line 502 in c686241
This means that a task will run without limit till finished.
Use case/motivation
The problem is that there is no way to overwrite this default for all dags. This causes problems where we find that tasks run sometimes for 1 week!!! for no reason. They are just stuck. This mostly happens with tasks that submit work to some 3rd party resource. The 3rd party had some error and terminated but the Airflow task for some reason did not.
This can be handled in cluster policy however it feels that cluster policy is more to enforce something but less about setting defaults values.
Related issues
No response
Are you willing to submit a PR?
- Yes I am willing to submit a PR!
Code of Conduct
- I agree to follow this project's Code of Conduct