-
Notifications
You must be signed in to change notification settings - Fork 16.3k
Description
I am not sure whether to put this as a bug or feature request (depends on how you see this).
As this might be completely independent from versions, os, k8s, ... I will not add this detail here.
Short: When trying to trigger a DAG via the REST API interface more than once per second the Airflow returns a HTTP 500 error code.
Long: When using Airflow REST API I can send any amount of POST calls, but when sending more calls per second returning an HTTP 500 might be very misleading. If it is expected to not send more requests as 1 per second, it should return an HTTP 400 and have a good error message. If it is intended to be able to send more than 1 POST call per second, I would expect this to be a bug and hopefully be fixed. AFAIK Airflow inside its implementation uses a timestamp with precision of seconds to create a DAG run. But this might not be fitting to having received multiple requests in the same second, since then the uniqueness requirement might be failing.