You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@pig.apache.org by "Dmitriy V. Ryaboy (Updated) (JIRA)" <ji...@apache.org> on 2012/01/17 02:41:38 UTC

[jira] [Updated] (PIG-2359) Support more efficient Tuples when schemas are known

     [ https://issues.apache.org/jira/browse/PIG-2359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dmitriy V. Ryaboy updated PIG-2359:
-----------------------------------

       Resolution: Fixed
    Fix Version/s: 0.11
     Release Note: 
newTupleForSchema(Schema s) and newTupleForSchema(byte... types) methods are introduced to TupleFactory, allowing Pig to choose optimized Tuple implementations for specific schemas, when those are available.

Two optimized implementations are introduced:
- single-value Tuples (tuples which only hold a single int, double, String, etc
- primitive-value Tuples (tuples which only hold values that can be represented by a fixed-width datatype in Java: int, long, double, boolean, float).

Using such tuples can result in significant memory utilization improvements.
           Status: Resolved  (was: Patch Available)

Committed to trunk.
                
> Support more efficient Tuples when schemas are known
> ----------------------------------------------------
>
>                 Key: PIG-2359
>                 URL: https://issues.apache.org/jira/browse/PIG-2359
>             Project: Pig
>          Issue Type: New Feature
>            Reporter: Dmitriy V. Ryaboy
>            Assignee: Dmitriy V. Ryaboy
>             Fix For: 0.11
>
>         Attachments: PIG-2359.1.patch, PIG-2359.2.patch, PIG-2359.3.patch, PIG-2359.4.patch
>
>
> Pig Tuples have significant overhead due to the fact that all the fields are Objects.
> When a Tuple only contains primitive fields (ints, longs, etc), it's possible to avoid this overhead, which would result in significant memory savings.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira