You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/05/17 16:44:58 UTC
[GitHub] [airflow] mik-laj opened a new issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
mik-laj opened a new issue #8893:
URL: https://github.com/apache/airflow/issues/8893
Hello,
We have script that allows us to display class names.
https://github.com/apache/airflow/blob/master/scripts/list-integrations.py
It would be nice if it were possible to display template fields and constructor parameters. This should be available when you run this script with an additional option. The output should be available as CSV or JSON or JSONL. Constructor parameters from BaseOperator or BaseSensor should be ignored.
This tool is needed to review all operators to eliminate missing template fields in existing operators.
Related PR:
https://github.com/apache/airflow/pull/8870
https://github.com/apache/airflow/pull/8840
https://github.com/apache/airflow/pull/7198
https://github.com/apache/airflow/pull/7127
https://github.com/apache/airflow/pull/6656
https://github.com/apache/airflow/pull/5718
https://github.com/apache/airflow/pull/5490
https://github.com/apache/airflow/pull/5248
https://github.com/apache/airflow/pull/5097
https://github.com/apache/airflow/pull/4920
https://github.com/apache/airflow/pull/4691
https://github.com/apache/airflow/pull/3305
https://github.com/apache/airflow/pull/2981
https://github.com/apache/airflow/pull/2549
https://github.com/apache/airflow/pull/2480
https://github.com/apache/airflow/pull/2235
https://github.com/apache/airflow/pull/1808
https://github.com/apache/airflow/pull/996
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] maverick12345678 commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
maverick12345678 commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-637914952
> This file? What exactly code?
> https://github.com/apache/airflow/blob/master/scripts/list-integrations.py
>
> I want to have the following output or equivalent:
>
> ```
> airflow.providers.google.cloud.operators.datacatalog.CloudDataCatalogCreateEntryOperator;location,entry_group,entry_id,entry,project_id,retry,timeout,metadata,gcp_conn_id;,location,entry_group,entry_id,entry,project_id,retry,timeout,metadata,gcp_conn_id
> ```
>
> First column - full qualified class name
> Second column - template fields (comma separated)
> Third column - constructor parameters - excluding BaseOperator (comma separated)
>
> This will facilitate my further analysis of these operators, but for now we have to collect the data.
Okay ! Thanks for the heads up !
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] maverick12345678 commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
maverick12345678 commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-639654746
I will convey the message. I am looking into the matter. Sorry for the delay
On Fri, 5 Jun, 2020, 10:46 AM Kamil Breguła, <no...@github.com>
wrote:
> @maverick12345678 <https://github.com/maverick12345678> Do you need any
> help?
>
> Users report related errors to us all the time. Here a new ticket from
> yesterday.
> #9146 <https://github.com/apache/airflow/issues/9146>
>
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/airflow/issues/8893#issuecomment-639263703>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/AJ4OG5DWKUJB7FFTLNHSLWLRVB5SNANCNFSM4NDOWDAA>
> .
>
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj edited a comment on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
mik-laj edited a comment on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-635508132
This file? What exactly code?
https://github.com/apache/airflow/blob/master/scripts/list-integrations.py
I want to have the following output or equivalent:
```
airflow.providers.google.cloud.operators.datacatalog.CloudDataCatalogCreateEntryOperator;location,entry_group,entry_id,entry,project_id,retry,timeout,metadata,gcp_conn_id;,location,entry_group,entry_id,entry,project_id,retry,timeout,metadata,gcp_conn_id
```
First column - full qualified class name
Second column - template fields (comma separated)
Third column - constructor parameters - excluding BaseOperator (comma separated)
This will facilitate my further analysis of these operators, but for now we have to collect the data.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-639263703
@maverick12345678 Do you need any help?
Users report related errors to us all the time. Here a new ticket from yesterday.
https://github.com/apache/airflow/issues/9146
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-631009751
@maverick12345678 Assigned. It really will be very helpful for me.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] maverick12345678 commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
maverick12345678 commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-630997909
Hey , I would like to work on it .
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] mik-laj commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-635508132
This file? What exactly code?
https://github.com/apache/airflow/blob/master/scripts/list-integrations.py
I want to have the following output or equivalent:
```
airflow.providers.google.cloud.operators.datacatalog.CloudDataCatalogCreateEntryOperator;location,entry_group,entry_id,entry,project_id,retry,timeout,metadata,gcp_conn_id;,location,entry_group,entry_id,entry,project_id,retry,timeout,metadata,gcp_conn_id
```
First column - full qualified class name
Second column - template fields (comma separated)
Third column - constructor parameters - excluding BaseOperator (comma separated)
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] maverick12345678 commented on issue #8893: Displaying field templates and constructor parameters in scripts/list-integration.py
Posted by GitBox <gi...@apache.org>.
maverick12345678 commented on issue #8893:
URL: https://github.com/apache/airflow/issues/8893#issuecomment-635503974
I would like to have some insight on what exactly is having in this code ? @mik-laj
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org