Skip to content

support loading DAG definitions from GCS buckets #561

@thesuperzapper

Description

@thesuperzapper

Checks

Motivation

Currently, we support git-sync with the dags.gitSync.* values, but we can probably do something similar for GCS buckets. That is, let people store their dags in a folder on a GCS bucket.

This is similar to how we are proposing support for S3 buckets in #249.

Alternatively, we could use a non-sync approach by using Google's GCS FUSE to transparently mount the bucket as a filesystem folder.

Implementation

No response

Are you willing & able to help?

  • I am able to submit a PR!
  • I can help test the feature!

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions