[jira] Commented: (PIG-1185) Data bags do not close spill files after using iterator to read tuples

["Ying He (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-1185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12799502#action_12799502 ] 

Ying He commented on PIG-1185:
------------------------------

this patch doesn't contain any junit test, because I can't verify the files are still used by an application from java, and the name of spill files are not available. I've manually checked the files are not used by any process after iteration is done.



> Data bags do not close spill files after using iterator to read tuples
> ----------------------------------------------------------------------
>
>                 Key: PIG-1185
>                 URL: https://issues.apache.org/jira/browse/PIG-1185
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ying He
>         Attachments: PIG_1185.patch
>
>
> spill files are not closed after reading the tuples from iterator. When large number of spill files exists, this can exceed specified max number of open files on the system and therefore, cause application failure.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.