You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@beam.apache.org by GitBox <gi...@apache.org> on 2022/06/04 12:53:38 UTC

[GitHub] [beam] damccorm opened a new issue, #19711: Dataflow Python SDK logging: step_id is always empty string

damccorm opened a new issue, #19711:
URL: https://github.com/apache/beam/issues/19711

   Using the dataflow runner, log messages always show up in stackdriver with the step_id as the empty string, so filtering log messages for a step doesn't work.
   ```
   
   resource: {
     labels: {
       job_id: "<job id>" 
       job_name: "<job name>" 
       project_id: "<project
   id>" 
       region: "<region>" 
       step_id: "" 
     }
     type: "dataflow_step" 
   }
   ```
   
   Another user seems to have posted in the old github repo and appears to be seeing the same problem based on their output:
   
   [https://github.com/GoogleCloudPlatform/DataflowPythonSDK/issues/62](https://github.com/GoogleCloudPlatform/DataflowPythonSDK/issues/62)
   
   From what I can tell is only affecting streaming pipelines
   
   Imported from Jira [BEAM-7934](https://issues.apache.org/jira/browse/BEAM-7934). Original Jira may contain additional context.
   Reported by: jimpremise.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] hughack commented on issue #19711: Dataflow Python SDK logging: step_id is always empty string

Posted by "hughack (via GitHub)" <gi...@apache.org>.
hughack commented on issue #19711:
URL: https://github.com/apache/beam/issues/19711#issuecomment-1487789203

   Also keen on an update. Should this be here or is it more of a Google thing to fix?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] BjornPrime commented on issue #19711: Dataflow Python SDK logging: step_id is always empty string

Posted by "BjornPrime (via GitHub)" <gi...@apache.org>.
BjornPrime commented on issue #19711:
URL: https://github.com/apache/beam/issues/19711#issuecomment-1489188163

   .take-issue


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] hughack commented on issue #19711: Dataflow Python SDK logging: step_id is always empty string

Posted by "hughack (via GitHub)" <gi...@apache.org>.
hughack commented on issue #19711:
URL: https://github.com/apache/beam/issues/19711#issuecomment-1491152288

   I've just realised the `step_id` is only missing for logs in the `DoFn.setup`. Logs in `process` do appear to have it set correctly for me. It is less of an issue but would be nice to have it in the setup as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [beam] dakl commented on issue #19711: Dataflow Python SDK logging: step_id is always empty string

Posted by GitBox <gi...@apache.org>.
dakl commented on issue #19711:
URL: https://github.com/apache/beam/issues/19711#issuecomment-1283639908

   Any updated on this? It's an amazingly annoying bug.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Dataflow Python SDK logging: step_id is always empty string [beam]

Posted by "pierresegonne (via GitHub)" <gi...@apache.org>.
pierresegonne commented on issue #19711:
URL: https://github.com/apache/beam/issues/19711#issuecomment-1825292039

   Any update on this? :)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org