You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@impala.apache.org by "Peter Rozsa (Jira)" <ji...@apache.org> on 2026/10/07 12:36:00 UTC
[jira] [Resolved] (IMPALA-9821) Rewrite ds_hll_sketch() and ds_hll_union() and other datasketch generating functions to return Binary
[ https://issues.apache.org/jira/browse/IMPALA-9821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Rozsa resolved IMPALA-9821.
---------------------------------
Resolution: Fixed
> Rewrite ds_hll_sketch() and ds_hll_union() and other datasketch generating functions to return Binary
> -----------------------------------------------------------------------------------------------------
>
> Key: IMPALA-9821
> URL: https://issues.apache.org/jira/browse/IMPALA-9821
> Project: IMPALA
> Issue Type: New Feature
> Components: Backend
> Reporter: Gabor Kaszab
> Assignee: Mihaly Szjatinya
> Priority: Blocker
>
> Until Binary implementation is ongoing ds_hll_sketch() and ds_hll_union() functions return serialized sketches in String format. Once Binary is available in Impala these can return the serialized sketches in Binary format.
> Currently when sketches are written by Hive as BINARY to ORC table and this table is loaded to Impala where the sketch columns are STRINGs then we get an error
> {code:java}
> ERROR: Type mismatch: table column STRING is map to column binary in ORC file
> {code}
> Interestingly the works with Parquet format.
> Once we have binary support make sure to add coverage for ORC table where the table is created and populated by Hive and read for estimating by Impala.
> UPDATE: since BINARY type support was added in IMPALA-9482, the error above is not reproducable.
> Currently (2026 September) what remains is the incompatibility between datasketches function signatures, as Impala uses STRING in places where Hive used BINARY.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)