You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Csaba Ringhofer (Jira)" <ji...@apache.org> on 2021/01/29 16:40:00 UTC
[jira] [Created] (IMPALA-10466) Handle deprecated TWO_LEVEL Parquet
arrays more gracefully
Csaba Ringhofer created IMPALA-10466:
----------------------------------------
Summary: Handle deprecated TWO_LEVEL Parquet arrays more gracefully
Key: IMPALA-10466
URL: https://issues.apache.org/jira/browse/IMPALA-10466
Project: IMPALA
Issue Type: Improvement
Reporter: Csaba Ringhofer
The default of PARQUET_ARRAY_RESOLUTION was changed from TWO_LEVEL_THEN_THREE_LEVEL to THREE_LEVEL in IMPALA-4725. This solved incorrectly detecting some ambiguous cases, but now old TWO_LEVEL Parquet lists are not read correctly by default, replacing values with NULL without any error message.
I would prefer a solution that:
a. detects the correct resolution when possible
b. returns a clear warning/error when resolution is not possible or ambiguous, and points the user toward the query option that needs to be set manually
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org