Repository navigation
Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator #53843
Closed as not planned
Description
I'm trying to run Dataform in "Full Refresh" mode with this Airflow Operator definition and it straight up doesn't work. It only runs the repo in non-full refresh mode. This leaves us with effectively no way to run our production DAG via "Full Refresh". I tried sorting through the code but I can't see where the arg is getting dropped.
create_workflow_invocation_full_refresh = DataformCreateWorkflowInvocationOperator(
task_id="create_workflow_invocation_full_refresh",
project_id=PROJECT_ID,
region=DATAFORM_REGION,
repository_id=REPOSITORY_ID,
workflow_invocation={
"compilation_result": "{{ task_instance.xcom_pull('create_compilation_result')['name'] }}",
"invocation_config": {
"fully_refresh_incremental_tables_enabled": True,
}
}
)
Class Definition:
Activity
boring-cyborg commentedon Jul 29, 2025
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
Preserve Dataform workflow invocation config (#53843) (#69161)
Preserve Dataform workflow invocation config (apache#53843) (apache#6…
shahar1 commentedon Jul 24, 2026
I'm not entirely sure that #69161 actually fixed this issue - might have been a Dataform SDK issue, and in any case more details are needed to actually reproduce it.
Detect linked issues at the end of PR bodies in provider testing issue
Detect linked issues at the end of PR bodies in provider testing issue (
Revert Dataform workflow invocation dict normalization (#69161) (#70395)
Detect linked issues at the end of PR bodies in provider testing issue (
Revert Dataform workflow invocation dict normalization (apache#69161) (…
Revert Dataform workflow invocation dict normalization (apache#69161) (…