[GitHub] [airflow] potiuk commented on issue #17032: Improved SQL rendering within BigQueryInsertJobOperator

[GitBox <gi...@apache.org>]

potiuk commented on issue #17032:
URL: https://github.com/apache/airflow/issues/17032#issuecomment-880795289


   How about adding a general capability of having "view" on parameters that will not require copying? 
   
   Simply add possibility of specifying jsonpath (https://goessner.net/articles/JsonPath/) expression that could generate a virtual parameter to render. This could be done on the operator static fields rather than as parameter. We could take kwargs and convert them to - essentially - json, using some well defined serialization (maybe even current serializaton we use would do).
   
   I imagine something like that at operator level:
   
   
   ```
   renderable_values= [
      ('sql', '$.configuration.query.query', 'sql'),
   ]
   ```
   where 'renderable values will be an array of tuples ("<NAME>", "<JSONPATH>", "<RENDERER>"),
   
   That would be very natural extension of the current rendering approach and something that can be generalized and easy to add for a number of operators (and no need for optional parameters).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org