You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Manish Maheshwari (Jira)" <ji...@apache.org> on 2024/01/02 12:27:00 UTC
[jira] [Updated] (IMPALA-10021) Rewrite ds_kll_* functions to use Binary
[ https://issues.apache.org/jira/browse/IMPALA-10021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Manish Maheshwari updated IMPALA-10021:
---------------------------------------
Description:
Once Impala supports BINARY type the ds_kll_* could use it instead of STRING to receive/return serialized KLL sketches.
To follow the BINARY support implementation - https://issues.apache.org/jira/browse/IMPALA-9579
Currently when sketches are written by Hive as BINARY to ORC table and this table is loaded to Impala where the sketch columns are STRINGs then we get an error
{code:java}
ERROR: Type mismatch: table column STRING is map to column binary in ORC file
{code}
Interestingly the works with Parquet format. Once we have binary support make sure to add coverage for ORC table where the table is created and populated by Hive and read for estimating by Impala.
was:
Once Impala supports BINARY type the ds_kll_* could use it instead of STRING to receive/return serialized KLL sketches.
To follow the BINARY support implementation:
https://issues.apache.org/jira/browse/IMPALA-9579
Currently when sketches are written by Hive as BINARY to ORC table and this table is loaded to Impala where the sketch columns are STRINGs then we get an error
{code:java}
ERROR: Type mismatch: table column STRING is map to column binary in ORC file
{code}
Interestingly the works with Parquet format.
Once we have binary support make sure to add coverage for ORC table where the table is created and populated by Hive and read for estimating by Impala.
> Rewrite ds_kll_* functions to use Binary
> ----------------------------------------
>
> Key: IMPALA-10021
> URL: https://issues.apache.org/jira/browse/IMPALA-10021
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend, Frontend
> Reporter: Gabor Kaszab
> Priority: Major
>
> Once Impala supports BINARY type the ds_kll_* could use it instead of STRING to receive/return serialized KLL sketches.
> To follow the BINARY support implementation - https://issues.apache.org/jira/browse/IMPALA-9579
> Currently when sketches are written by Hive as BINARY to ORC table and this table is loaded to Impala where the sketch columns are STRINGs then we get an error
> {code:java}
> ERROR: Type mismatch: table column STRING is map to column binary in ORC file
> {code}
> Interestingly the works with Parquet format. Once we have binary support make sure to add coverage for ORC table where the table is created and populated by Hive and read for estimating by Impala.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org