You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Tim Armstrong (JIRA)" <ji...@apache.org> on 2017/06/16 17:13:00 UTC

[jira] [Resolved] (IMPALA-2597) Impala should skip a bad parquet file instead of aborting the query

     [ https://issues.apache.org/jira/browse/IMPALA-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tim Armstrong resolved IMPALA-2597.
-----------------------------------
    Resolution: Duplicate

This mostly already happens. There are some specific cases where it doesn't. See IMPALA-3773

> Impala should skip a bad parquet file instead of aborting the query
> -------------------------------------------------------------------
>
>                 Key: IMPALA-2597
>                 URL: https://issues.apache.org/jira/browse/IMPALA-2597
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Backend
>    Affects Versions: Impala 2.2.4
>            Reporter: Alan Choi
>            Priority: Minor
>              Labels: ramp-up, usability
>
> *Problem Statement:*
> For text file, if a row is bad, Impala will skip it.
> However, for parquet file, if the file is bad, Impala will abort the query. For big and long queries, missing a few bad files is usually ok. 
> *Potential Solution*
> Have an option to allow user to skip the bad files instead of aborting the query.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)