You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@drill.apache.org by Usman Ali <us...@platalytics.com> on 2015/08/19 18:55:00 UTC

Error While Querying Parquet

Hi,
       I received following error while querying a parquet file stored on
S3.
Any Help?

Regards,
Usman Ali

Re: Error While Querying Parquet

Posted by Usman Ali <us...@platalytics.com>.

Edit:
Here is the error:

Error: SYSTEM ERROR:
org.apache.drill.common.exceptions.DrillRuntimeException: Error in parquet
record reader.
Message:
Hadoop path: /data/1440002040405/part-r-00001.parquet
Total records read: 0
Mock records read: 0
Records to read: 32768
Row group index: 0
Records in row group: 343411
Parquet Metadata: ParquetMetaData{FileMetaData{schema: message root {
  optional binary PROVDATAPOINTID (UTF8);
  optional binary ARRIVALDTUTC (UTF8);
  optional binary CAPTURETIMEUTC (UTF8);
  optional binary LATITUDE (UTF8);
  optional binary LONGITUDE (UTF8);
  optional binary SPEED (UTF8);
  optional binary HEADING (UTF8);
  optional binary UNITID (UTF8);
}
, metadata:
{org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"PROVDATAPOINTID","type":"string","nullable":true,"metadata":{"name":"PROVDATAPOINTID"}},{"name":"ARRIVALDTUTC","type":"string","nullable":true,"metadata":{"name":"ARRIVALDTUTC"}},{"name":"CAPTURETIMEUTC","type":"string","nullable":true,"metadata":{"name":"CAPTURETIMEUTC"}},{"name":"LATITUDE","type":"string","nullable":true,"metadata":{"name":"LATITUDE"}},{"name":"LONGITUDE","type":"string","nullable":true,"metadata":{"name":"LONGITUDE"}},{"name":"SPEED","type":"string","nullable":true,"metadata":{"name":"SPEED"}},{"name":"HEADING","type":"string","nullable":true,"metadata":{"name":"HEADING"}},{"name":"UNITID","type":"string","nullable":true,"metadata":{"name":"UNITID"}}]}}},
blocks: [BlockMetaData{343411, 5831751 [ColumnMetaData{GZIP
[PROVDATAPOINTID] BINARY  [RLE, PLAIN, BIT_PACKED], 4}, ColumnMetaData{GZIP
[ARRIVALDTUTC] BINARY  [RLE, PLAIN_DICTIONARY, BIT_PACKED], 265676},
ColumnMetaData{GZIP [CAPTURETIMEUTC] BINARY  [RLE, PLAIN_DICTIONARY,
BIT_PACKED], 266187}, ColumnMetaData{GZIP [LATITUDE] BINARY  [RLE,
PLAIN_DICTIONARY, BIT_PACKED], 358091}, ColumnMetaData{GZIP [LONGITUDE]
BINARY  [RLE, PLAIN_DICTIONARY, BIT_PACKED], 884833}, ColumnMetaData{GZIP
[SPEED] BINARY  [RLE, PLAIN_DICTIONARY, BIT_PACKED], 1422417},
ColumnMetaData{GZIP [HEADING] BINARY  [RLE, PLAIN_DICTIONARY, BIT_PACKED],
1494318}, ColumnMetaData{GZIP [UNITID] BINARY  [RLE, PLAIN_DICTIONARY,
BIT_PACKED], 1605213}]}]}

Regards,
Usman Ali

On Wed, Aug 19, 2015 at 9:55 PM, Usman Ali <us...@platalytics.com>
wrote:

> Hi,
>        I received following error while querying a parquet file stored on
> S3.
> Any Help?
>
> Regards,
> Usman Ali
>

Re: Error While Querying Parquet

Posted by Kristine Hahn <kh...@maprtech.com>.

We can't see the error that I guess you posted as an image. Images don't
work on the list.

Kristine Hahn
Sr. Technical Writer
415-497-8107 @krishahn skype:krishahn

On Wed, Aug 19, 2015 at 9:55 AM, Usman Ali <us...@platalytics.com>
wrote:

> Hi,
>        I received following error while querying a parquet file stored on
> S3.
> Any Help?
>
> Regards,
> Usman Ali
>