You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Ashutosh Chauhan (JIRA)" <ji...@apache.org> on 2011/02/26 00:14:21 UTC

[jira] Commented: (PIG-1871) Dont throw exception if partition filters cannot be pushed up.

    [ https://issues.apache.org/jira/browse/PIG-1871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12999630#comment-12999630 ] 

Ashutosh Chauhan commented on PIG-1871:
---------------------------------------

a = load 'mydata' USING MyLoader();
b0 = filter a BY
    (   (ds < '20091103' )
     or (action == 'continue' )
    );
b = filter b0 BY
    (   (ds < '20091103' and age < 50)
     or (action == 'continue' and age > 100)
    );
c = foreach b generate ds, action, age, data;
store c into ':OUTPATH:';
...

fails with message:

Grunt - ERROR 1112: 
Unsupported query: 
You have an partition column (datestamp ) in a construction like: (pcond  and ...) or (pcond and ...) where pcond is a condition on a partition column.

In this testcase ds and action are partition columns while age is not. So, pig decided it cannot split the filter and can't push the partition filter to the loader. In such a condition instead of dying, Pig should disable partition filter push up and continue.

> Dont throw exception if partition filters  cannot be pushed up. 
> ----------------------------------------------------------------
>
>                 Key: PIG-1871
>                 URL: https://issues.apache.org/jira/browse/PIG-1871
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Ashutosh Chauhan
>            Priority: Minor
>
> Instead don't try to push partition filters up and continue execution.

-- 
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira