Skip to content

Secrets does not work with the ‘env’ provider and a scheduled DAG #1864

@abylon-io

Description

@abylon-io

Hi,
Secrets seem to stop working when the dag is launched at the scheduled time.

Exemple:

name: test3-main
schedule: "CRON_TZ=Europe/Paris 01 14 * * 2-6"

secrets:
  - name: DEFAULT_SMTP_PASSWORD
    provider: env
    key: SECRET_SMTP_PASS

params:
  - name: SMTP_PASSWORD_OVERRIDE
    type: string
    description: Password override

steps:
  - name: param_check
    command: |
      SMTPPASSWORD=${SMTP_PASSWORD_OVERRIDE:-$DEFAULT_SMTP_PASSWORD}
      echo "SMTPPASSWORD param '${SMTPPASSWORD}'"

  - env

Works perfectly when launched manually via the graphical interface, but crashes when launched via the task scheduler.

Error:

time=2026-03-27T13:01:00.020Z level=ERROR msg="Failed to execute dag-run" dag=test3-main run-id=019d2f62-3ae1-7000-8e19-ae3f7cc72b6b err="failed to resolve secrets: failed to resolve secret \"DEFAULT_SMTP_PASSWORD\" from provider \"env\": environment variable \"SECRET_SMTP_PASS\" is not set"

Thanks
(v2.3.8)

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions