You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/07/09 16:40:00 UTC

[jira] [Work logged] (BEAM-12395) Support google cloud profiler in python sdk

     [ https://issues.apache.org/jira/browse/BEAM-12395?focusedWorklogId=621063&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-621063 ]

ASF GitHub Bot logged work on BEAM-12395:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 09/Jul/21 16:39
            Start Date: 09/Jul/21 16:39
    Worklog Time Spent: 10m 
      Work Description: jli commented on pull request #14877:
URL: https://github.com/apache/beam/pull/14877#issuecomment-877313929


   Could you describe the benefit of adding Cloud Profiler? Does this enable automatic instrumentation of Beam pipelines running on GCP? My team would actually benefit from having that feature :)
   
   FWIW, adding `google-cloud-profiler` makes using apache-beam within Docker more difficult.
   
   `google-cloud-profiler` doesn't provide wheels, so upgrading `apache-beam` from 2.30.0 to 2.31.0 requires adding a compiler toolchain to the Docker build. To avoid bloating the final Docker image, that means setting up multi-stage builds in the Dockerfile. Multi-stage builds to build a Python library is a little obscure. The Cloud Profiler docs does have [good documentation for it](https://cloud.google.com/profiler/docs/profiling-python#running_with_linux_alpine), but it's a new step all Beam Docker users will need to deal with.
   
   It would have been nice to have this change flagged in the release notes (https://github.com/apache/beam/releases/tag/v2.31.0).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 621063)
    Time Spent: 1.5h  (was: 1h 20m)

> Support google cloud profiler in python sdk
> -------------------------------------------
>
>                 Key: BEAM-12395
>                 URL: https://issues.apache.org/jira/browse/BEAM-12395
>             Project: Beam
>          Issue Type: New Feature
>          Components: sdk-py-harness
>            Reporter: Yichi Zhang
>            Assignee: Yichi Zhang
>            Priority: P2
>             Fix For: 2.31.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)