[jira] [Commented] (PIG-5217) Pig Streaming over python multiprocessing

["Daniel Dai (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-5217?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15966570#comment-15966570 ] 

Daniel Dai commented on PIG-5217:
---------------------------------

Are you able to give an example? Pig shall run python as an external process and I don't see a reason why Pig shall disrupt multiprocessing. Do you have a sense why?

> Pig Streaming over python multiprocessing
> -----------------------------------------
>
>                 Key: PIG-5217
>                 URL: https://issues.apache.org/jira/browse/PIG-5217
>             Project: Pig
>          Issue Type: Bug
>          Components: internal-udfs
>    Affects Versions: 0.15.0
>         Environment: python 2.7,pig 0.15.0,multi-core processor
>            Reporter: bharatpattani
>
> python multiprocessing is not working with pig streaming.
> Following are the steps for that:
> 1. Create python script with "multiprocessing" which can utilise at least two cores of the processor.
> 2. Create an pig script which will call python script which mentioned in above step.
> Please have a look at it and do need full for the same. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)