You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/06/02 19:34:59 UTC

[GitHub] [airflow] pegerto opened a new issue #9117: Apache beam issue extracting job from monitoring page

pegerto opened a new issue #9117:
URL: https://github.com/apache/airflow/issues/9117


   
   
   **Apache Airflow version**: 1.10.10 and 1.10.9 has been verify
   
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl version`):
   no kube
   
   **Environment**:
   
   - **Others**: docker enviroment with java 1.8
   
   **What happened**:
   
   The existing function to extract a job id from the monitoring page is no longer compatible with new beam 2.20:
   
   https://github.com/apache/airflow/blob/96697180d79bfc90f6964a8e99f9dd441789177c/airflow/contrib/hooks/gcp_dataflow_hook.py#L142-L148
   
   The monitoring page includes the zone as part of the URL causing the regex to extract always the `zone` instead of the `job_id`
   
   A new regex compatible with the new and old monitoring url need to be added to the operator.
   
   https://github.com/apache/airflow/blob/96697180d79bfc90f6964a8e99f9dd441789177c/airflow/contrib/hooks/gcp_dataflow_hook.py#L142-L148
   
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj closed issue #9117: Apache beam issue extracting job from monitoring page

Posted by GitBox <gi...@apache.org>.
mik-laj closed issue #9117:
URL: https://github.com/apache/airflow/issues/9117


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #9117: Apache beam issue extracting job from monitoring page

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #9117:
URL: https://github.com/apache/airflow/issues/9117#issuecomment-637762162


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] mik-laj commented on issue #9117: Apache beam issue extracting job from monitoring page

Posted by GitBox <gi...@apache.org>.
mik-laj commented on issue #9117:
URL: https://github.com/apache/airflow/issues/9117#issuecomment-638113053


   Duplicated: https://github.com/apache/airflow/issues?q=is%3Aissue+is%3Aopen+Dataflow


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org