You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Yan Zhou (JIRA)" <ji...@apache.org> on 2010/02/09 19:57:29 UTC

[jira] Created: (PIG-1232) [zebra] Column Group schema file versioning

[zebra] Column Group schema file versioning
-------------------------------------------

                 Key: PIG-1232
                 URL: https://issues.apache.org/jira/browse/PIG-1232
             Project: Pig
          Issue Type: Improvement
    Affects Versions: 0.6.0
            Reporter: Yan Zhou
            Priority: Minor


This missing versioning in column group schema makes it difficult to evolve the index. For instance, prior to fix of PIG-1201, the index is empty for unsorted tables. However the index is useful even for unsorted tables to save a listStatus call to name node, which has been found expensive for directories of many disk entries inside it. As part of that fix, an index is built.. Without versioning but with the demand to support backward compatibility, another non-classical approach has to be figured out to build index when necessary. As part of this fix, we may also want to address that issue too.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.