You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@beam.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/07/01 16:28:00 UTC

[jira] [Work logged] (BEAM-12503) Process Support for ExternalWorkerService

     [ https://issues.apache.org/jira/browse/BEAM-12503?focusedWorklogId=617686&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-617686 ]

ASF GitHub Bot logged work on BEAM-12503:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 01/Jul/21 16:27
            Start Date: 01/Jul/21 16:27
    Worklog Time Spent: 10m 
      Work Description: lukecwik commented on pull request #15081:
URL: https://github.com/apache/beam/pull/15081#issuecomment-872386593


   > I am curious why artifact staging does not work with threads? I wonder if we should fix that instead of introducing yet more complexity to this already complex API.
   > 
   > In Python, I thought we used processes instead of threads because of the GIL. But Java has no GIL, so I'm not sure there is an advantage to using processes.
   
   Using threads still makes sense for IO bound tasks in Python since Python can parallelize IO effectively. Python's GIL is problematic for CPU bound tasks.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 617686)
    Time Spent: 2h  (was: 1h 50m)

> Process Support for ExternalWorkerService
> -----------------------------------------
>
>                 Key: BEAM-12503
>                 URL: https://issues.apache.org/jira/browse/BEAM-12503
>             Project: Beam
>          Issue Type: Sub-task
>          Components: sdk-java-harness
>            Reporter: Ke Wu
>            Assignee: Ke Wu
>            Priority: P3
>          Time Spent: 2h
>  Remaining Estimate: 0h
>
> Process mode support to invoke artifact staging after starting external worker pool service.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)