Skip to content

Scheduling frequency #7

Closed
Closed

Description

@dirkgently007

Is there a way to schedule jobs/dags on specific time of the day? Also, on a related note, can DAGs be scheduled on some other frequency - such as hourly, weekly etc?

Apologies if I missed it in the documentation.

Activity

  1. mistercrunch commented on Jun 5, 2015

    @mistercrunch
    Member

    Check out the DAG's schedule_interval parameter, it receives a python datetime.timedelta object:
    http://pythonhosted.org/airflow/code.html#airflow.models.DAG

    I believe at the moment heterogenous schedules within a DAG are not supported, but it should be easy to restore (used to work).

    We tend to use sensors to wait for actual files to land in HDFS / S3 or partitions to land in Hive, but it's also possible to wait for a specific time using a TimeSensor, which shows up as any other node in the DAG. http://pythonhosted.org/airflow/code.html#airflow.operators.TimeSensor

  2. added a commit that references this issue on Apr 10, 2020
  3. added 2 commits that reference this issue on Jan 4, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions