Skip to content

Cannot trigger multiple DAG runs per second #9790

@FelixReuthlingerBMW

Description

@FelixReuthlingerBMW

I am not sure whether to put this as a bug or feature request (depends on how you see this).
As this might be completely independent from versions, os, k8s, ... I will not add this detail here.

Short: When trying to trigger a DAG via the REST API interface more than once per second the Airflow returns a HTTP 500 error code.

Long: When using Airflow REST API I can send any amount of POST calls, but when sending more calls per second returning an HTTP 500 might be very misleading. If it is expected to not send more requests as 1 per second, it should return an HTTP 400 and have a good error message. If it is intended to be able to send more than 1 POST call per second, I would expect this to be a bug and hopefully be fixed. AFAIK Airflow inside its implementation uses a timestamp with precision of seconds to create a DAG run. But this might not be fitting to having received multiple requests in the same second, since then the uniqueness requirement might be failing.

Metadata

Metadata

Assignees

No one assigned

    Labels

    area:APIAirflow's REST/HTTP APIkind:bugThis is a clearly a bug

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions