You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2019/03/14 22:54:00 UTC

[jira] [Resolved] (IMPALA-8109) Impala cannot read the gzip files bigger than 2 GB

     [ https://issues.apache.org/jira/browse/IMPALA-8109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Joe McDonnell resolved IMPALA-8109.
-----------------------------------
       Resolution: Fixed
    Fix Version/s: Impala 3.1.0

This was fixed by IMPALA-7543

> Impala cannot read the gzip files bigger than 2 GB
> --------------------------------------------------
>
>                 Key: IMPALA-8109
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8109
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Backend
>    Affects Versions: Impala 2.12.0
>            Reporter: hakki
>            Priority: Major
>             Fix For: Impala 3.1.0
>
>
> When querying a partition containing gzip files, the query fails with the error below: 
> WARNINGS: Disk I/O error: Error seeking to -2147483648 in file: hdfs://HADOOP_CLUSTER/user/hive/AAA/BBB/datehour=20180910/XXXXXXX.gz: 
> Error(255): Unknown error 255
> Root cause: EOFException: Cannot seek to negative offset
> hdfs://HADOOP_CLUSTER/user/hive/AAA/BBB/datehour=20180910/XXXXXXX.gz file is a delimited text file and has a size of bigger than 2 GB (approx: 2.4 GB) The uncompressed size is ~13GB
> The impalad version is : 2.12.0-cdh5.15.0



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)