[jira] [Created] (PIG-3172) Partition filter push down does not happen when there is a non partition key filter

["Rohini Palaniswamy (JIRA)" <ji...@apache.org>]

Rohini Palaniswamy created PIG-3172:
---------------------------------------

             Summary: Partition filter push down does not happen when there is a non partition key filter
                 Key: PIG-3172
                 URL: https://issues.apache.org/jira/browse/PIG-3172
             Project: Pig
          Issue Type: Bug
    Affects Versions: 0.10.1
            Reporter: Rohini Palaniswamy


A = LOAD 'job_confs' USING org.apache.hcatalog.pig.HCatLoader();
B = FILTER A by grid == 'cluster1' and dt < '2012_12_01' and dt > '2012_11_20';
C = FILTER B by params#'mapreduce.job.user.name' == 'userx';
D = FOREACH B generate dt, grid, params#'mapreduce.job.user.name' as user,
params#'mapreduce.job.name' as job_name, job_id,
params#'mapreduce.job.cache.files';
dump D;

The query gives the below warning and ends up scanning the whole table instead of pushing the partition key filters grid and dt.

[main] WARN  org.apache.pig.newplan.PColFilterExtractor - No partition filter
push down: Internal error while processing any partition filter conditions in
the filter after the load

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira