You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2019/07/08 21:21:00 UTC

[jira] [Updated] (PIG-5391) Race condition in InternalSortedBag and InternalDistinctBag

     [ https://issues.apache.org/jira/browse/PIG-5391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated PIG-5391:
------------------------------
    Attachment: pig-5391-v01.patch

Copying back the original source by comparing 
InternalSortedBag&SortedDataBag
and
InternalDistinctBag&DistinctDataBag

I haven't gone through the changes carefully.  
This is more for others to point me to right direction.  I'm still hoping this jira to be invalid.  Otherwise, this would mean we had this race condition for years...

> Race condition in InternalSortedBag and InternalDistinctBag
> -----------------------------------------------------------
>
>                 Key: PIG-5391
>                 URL: https://issues.apache.org/jira/browse/PIG-5391
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Koji Noguchi
>            Assignee: Koji Noguchi
>            Priority: Major
>         Attachments: pig-5391-v01.patch
>
>
> InternalSortedBag and InternalDistinctBag were designed with single-thread access in mind (version 0.6) but later added back to SpillableMemoryManager for multi-threads access (PIG-2923).  Synchronization were added back in  PIG-3212 and PIG-3466 respectively but it seems like we missed a couple of code that original implementation had.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)