You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by Chin Wei Low <lo...@gmail.com> on 2015/02/26 10:29:45 UTC

Column with OriginalType INT_8 failed at filtering

Hi,

I hit the following error when apply a filter predicate on a column with
PrimitiveType = INT32 & OriginalType equal to INT_8.

java.lang.IllegalArgumentException: FilterPredicate column: c's declared
type (java.lang.Integer) does not match the schema found in file metadata.
Column c is of type: FullTypeDescriptor(PrimitiveType: INT32, OriginalType:
INT_8)
Valid types for this column are: null
at
parquet.filter2.predicate.ValidTypeMap.assertTypeValid(ValidTypeMap.java:114)

* I am on Parquet 1.6 RC3

Regards,
Chin Wei

Re: Column with OriginalType INT_8 failed at filtering

Posted by Chin Wei Low <lo...@gmail.com>.

Created issue https://issues.apache.org/jira/browse/PARQUET-201

On Thu, Mar 5, 2015 at 8:05 AM, Alex Levenson <
alexlevenson@twitter.com.invalid> wrote:

> Thanks, looks like we need to add some more original types to this
> assertion, or actually make this assertion less strict.
>
> On Wed, Mar 4, 2015 at 2:34 PM, Julien Le Dem <ju...@twitter.com> wrote:
>
> > Please open a PARQUET JIRA about this.
> > Probably ping alex levenson in the jira
> >
> > On Thu, Feb 26, 2015 at 1:29 AM, Chin Wei Low <lo...@gmail.com>
> > wrote:
> >
> >> Hi,
> >>
> >> I hit the following error when apply a filter predicate on a column with
> >> PrimitiveType = INT32 & OriginalType equal to INT_8.
> >>
> >> java.lang.IllegalArgumentException: FilterPredicate column: c's declared
> >> type (java.lang.Integer) does not match the schema found in file
> metadata.
> >> Column c is of type: FullTypeDescriptor(PrimitiveType: INT32,
> >> OriginalType:
> >> INT_8)
> >> Valid types for this column are: null
> >> at
> >>
> >>
> parquet.filter2.predicate.ValidTypeMap.assertTypeValid(ValidTypeMap.java:114)
> >>
> >> * I am on Parquet 1.6 RC3
> >>
> >> Regards,
> >> Chin Wei
> >>
> >
> >
>
>
> --
> Alex Levenson
> @THISWILLWORK
>

Re: Column with OriginalType INT_8 failed at filtering

Posted by Alex Levenson <al...@twitter.com.INVALID>.

Thanks, looks like we need to add some more original types to this
assertion, or actually make this assertion less strict.

On Wed, Mar 4, 2015 at 2:34 PM, Julien Le Dem <ju...@twitter.com> wrote:

> Please open a PARQUET JIRA about this.
> Probably ping alex levenson in the jira
>
> On Thu, Feb 26, 2015 at 1:29 AM, Chin Wei Low <lo...@gmail.com>
> wrote:
>
>> Hi,
>>
>> I hit the following error when apply a filter predicate on a column with
>> PrimitiveType = INT32 & OriginalType equal to INT_8.
>>
>> java.lang.IllegalArgumentException: FilterPredicate column: c's declared
>> type (java.lang.Integer) does not match the schema found in file metadata.
>> Column c is of type: FullTypeDescriptor(PrimitiveType: INT32,
>> OriginalType:
>> INT_8)
>> Valid types for this column are: null
>> at
>>
>> parquet.filter2.predicate.ValidTypeMap.assertTypeValid(ValidTypeMap.java:114)
>>
>> * I am on Parquet 1.6 RC3
>>
>> Regards,
>> Chin Wei
>>
>
>


-- 
Alex Levenson
@THISWILLWORK

Re: Column with OriginalType INT_8 failed at filtering

Posted by Julien Le Dem <ju...@twitter.com.INVALID>.

Please open a PARQUET JIRA about this.
Probably ping alex levenson in the jira

On Thu, Feb 26, 2015 at 1:29 AM, Chin Wei Low <lo...@gmail.com> wrote:

> Hi,
>
> I hit the following error when apply a filter predicate on a column with
> PrimitiveType = INT32 & OriginalType equal to INT_8.
>
> java.lang.IllegalArgumentException: FilterPredicate column: c's declared
> type (java.lang.Integer) does not match the schema found in file metadata.
> Column c is of type: FullTypeDescriptor(PrimitiveType: INT32, OriginalType:
> INT_8)
> Valid types for this column are: null
> at
>
> parquet.filter2.predicate.ValidTypeMap.assertTypeValid(ValidTypeMap.java:114)
>
> * I am on Parquet 1.6 RC3
>
> Regards,
> Chin Wei
>