[jira] Updated: (PIG-1712) Pig Illustrate rework

["Yan Zhou (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/PIG-1712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yan Zhou updated PIG-1712:
--------------------------

    Attachment: illustrator_1.patch

illustrator_1 has the local Map/Reduce simulator and all illustrator-specific method in Physical Operators.

Currently, LOAD, FILTER, UNION, SORT, COGROUP are working.

JOIN is not quite working yet as there are more than necessary rows for the illustration purpose.

LIMIT, FOREACH, DISTINCT,  nested generate block in FOREACH, CROSS, script illustration are not working yet.

The manual Hudson results are as follows:

     [exec] -1 overall.
     [exec]
     [exec]     +1 @author.  The patch does not contain any @author tags.
     [exec]
     [exec]     +1 tests included.  The patch appears to include 21 new or modified tests.
     [exec]
     [exec]     -1 javadoc.  The javadoc tool appears to have generated 1 warning messages.
     [exec]
     [exec]     +1 javac.  The applied patch does not increase the total number of javac compiler warnings.
     [exec]
     [exec]     +1 findbugs.  The patch does not introduce any new Findbugs warnings.
     [exec]
     [exec]     -1 release audit.  The applied patch generated 495 release audit warnings (more than the trunk's current 461 warnings).


The release audit warnings are all on html files.

The javadoc warnings seem to be unrelated to this patch.

> Pig Illustrate rework
> ---------------------
>
>                 Key: PIG-1712
>                 URL: https://issues.apache.org/jira/browse/PIG-1712
>             Project: Pig
>          Issue Type: Bug
>    Affects Versions: 0.9.0
>            Reporter: Yan Zhou
>            Assignee: Yan Zhou
>             Fix For: 0.9.0
>
>         Attachments: illustrator_1.patch
>
>
> PigPen has been found to be a usable feature. The underlying PIG functionality, ILLUSTRATE, however, has not been stable and complete. It also has unique access paths that  are not shared by the mainstream PIG call paths, which makes it hard if not impossible to maintain as the PIG evolves along.
> The purpose of this work is to use the common access paths yet still follow the performance-sensitive criteria for ILLUSTRATE, complete support for as many logical operators as theoretically possible,
> plus algorithm polishes and bug fixes as necessary. Details can be found in http://wiki.apache.org/pig/PigIllustrate
> Pig-366 has been for the PigPen in general, and was used for the previous ILLUSTRATE work too. With this JIRA, the work on ILLUSTRATE will be separated.
> This JIRA also serves as an umbrella for existing issues in ILLUSTRATE. Specifically, PIG-502, PIG-903, PIG-1066 should all fold into this issue.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.