You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "rsenseman (via GitHub)" <gi...@apache.org> on 2025/07/29 00:37:58 UTC

[I] Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator [airflow]

rsenseman opened a new issue, #53843:
URL: https://github.com/apache/airflow/issues/53843

   I'm trying to run Dataform in "Full Refresh" mode with this Airflow Operator definition and it straight up doesn't work. It only runs the repo in non-full refresh mode. This leaves us with effectively no way to run our production DAG via "Full Refresh". I tried sorting through the code but I can't see where the arg is getting dropped. 
   
   ```
           create_workflow_invocation_full_refresh = DataformCreateWorkflowInvocationOperator(
               task_id="create_workflow_invocation_full_refresh",
               project_id=PROJECT_ID,
               region=DATAFORM_REGION,
               repository_id=REPOSITORY_ID,
               
               workflow_invocation={
                   "compilation_result": "{{ task_instance.xcom_pull('create_compilation_result')['name'] }}",
                   "invocation_config": {
                       "fully_refresh_incremental_tables_enabled": True,
                   }
               }
           )
   ```
   
   Class Definition: https://github.com/apache/airflow/blob/34ed71e52c1d8356194d34cb5018ff4032d66e2f/providers/google/src/airflow/providers/google/cloud/operators/dataform.py#L187


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator [airflow]

Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #53843:
URL: https://github.com/apache/airflow/issues/53843#issuecomment-3130210546

   Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator [airflow]

Posted by "shahar1 (via GitHub)" <gi...@apache.org>.
shahar1 commented on issue #53843:
URL: https://github.com/apache/airflow/issues/53843#issuecomment-5071196090

   I'm not entirely sure that #69161 actually fixed this issue - might have been a Dataform SDK issue, and in any case more details are needed to actually reproduce it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator [airflow]

Posted by "shahar1 (via GitHub)" <gi...@apache.org>.
shahar1 closed issue #53843: Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator
URL: https://github.com/apache/airflow/issues/53843


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator [airflow]

Posted by "shahar1 (via GitHub)" <gi...@apache.org>.
shahar1 closed issue #53843: Full Refresh arg in invocation_config does not work via DataformCreateWorkflowInvocationOperator
URL: https://github.com/apache/airflow/issues/53843


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org