[jira] [Commented] (BEAM-14147) Log GCS upload ID for Python GCS connector

["Yi Hu (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-14147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17517115#comment-17517115 ] 

Yi Hu commented on BEAM-14147:
------------------------------

Seems this task is blocked by BEAM-3177.

I get a working version and testing with dataflow runner and see that the debug logging does not appear in Cloud log even if I set logging level as DEBUG. Using direct runner or set output with logging.info works fine (saw output log). Finally I find this documentation:

[https://cloud.google.com/dataflow/docs/guides/logging#python_4]

"This feature (Set pipeline worker log levels) is not yet available in the Apache Beam SDK for Python."

> Log GCS upload ID for Python GCS connector
> ------------------------------------------
>
>                 Key: BEAM-14147
>                 URL: https://issues.apache.org/jira/browse/BEAM-14147
>             Project: Beam
>          Issue Type: New Feature
>          Components: io-py-gcp
>            Reporter: Chamikara Madhusanka Jayalath
>            Assignee: Yi Hu
>            Priority: P2
>              Labels: newbie, starter
>
> We already do this for Java: https://github.com/apache/beam/blob/master/sdks/java/extensions/google-cloud-platform-core/src/main/java/org/apache/beam/sdk/extensions/gcp/util/UploadIdResponseInterceptor.java
> To prevent excessive logging, this should only be done when DEBUG logs are enabled.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)