[jira] Commented: (PIG-1447) Tune memory usage of InternalCachedBag

["Thejas M Nair (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/PIG-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12899576#action_12899576 ] 

Thejas M Nair commented on PIG-1447:
------------------------------------

I ran L15_modified after applying patch in PIG-1524, which gives number of bags that spilled, and total number of records that spilled -
||query || spills with 0.1f || spills with 0.2f ||
| L15_modified | 1.2 million bags containing total of  5million records. in range of 500mb  | 413k bags containing 3 million records . in range of 300mb|


> Tune memory usage of InternalCachedBag
> --------------------------------------
>
>                 Key: PIG-1447
>                 URL: https://issues.apache.org/jira/browse/PIG-1447
>             Project: Pig
>          Issue Type: Improvement
>          Components: impl
>    Affects Versions: 0.7.0
>            Reporter: Daniel Dai
>            Assignee: Thejas M Nair
>             Fix For: 0.8.0
>
>         Attachments: L15_modified.pig
>
>
> We need to find a better value for "pig.cachedbag.memusage".

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.