You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "rafalh (via GitHub)" <gi...@apache.org> on 2023/03/09 18:21:41 UTC

[GitHub] [airflow] rafalh commented on pull request #28970: Fix support for macros with dots in DataProcJobBuilder

rafalh commented on PR #28970:
URL: https://github.com/apache/airflow/pull/28970#issuecomment-1462558228

   @Taragolis I am aware of those things. In our case we use non-deprecated `DataprocSubmitJobOperator` but to avoid creating untyped `job` dict by hand we use `DataProcJobBuilder` which AFAIK is not deprecated. If it was deprecated we wouldn't have used it and this issue wouldn't occur. We configure `DataProcJobBuilder` during DAG parsing time and expect to have all templates passed down to `job` dict and resolved during operator execution. It worked that way until sanitization was added to the builder.
   Example of code:
   ```
   task1 = DataprocSubmitJobOperator(
       task_id="foo",
       job=DataProcJobBuilder(task_id="{{ task.task_id }}", ...).build(),
       ...
   )
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org