You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2026/06/24 17:16:00 UTC
[jira] [Commented] (IMPALA-15067) Add backend support for VARIANTs
[ https://issues.apache.org/jira/browse/IMPALA-15067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18091259#comment-18091259 ]
ASF subversion and git services commented on IMPALA-15067:
----------------------------------------------------------
Commit e5727bb7176294114651785a24fb27f4a6bc47e5 in impala's branch refs/heads/master from Zoltan Borok-Nagy
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=e5727bb71 ]
IMPALA-15067: Add VariantValue and basic decoding functions
Adds the backend implementation for decoding VARIANT binary blobs:
- variant-value.h: Defines VariantMetadata (field name dictionary
parser) and VariantValue (value decoder with object/array accessors
and path navigation). Supports all variant physical types defined by
the Parquet Variant spec.
- variant-util.cc/h: Implements VariantToJson() which serializes a
variant (metadata + value blobs) to JSON. Supported types include
null, booleans, int8/16/32/64, float, double, decimal4/8/16,
short/long strings, objects, arrays, TIMESTAMPNTZ (micros), and
TIMESTAMPNTZ_NANOS. BINARY values are base64-encoded. TIMESTAMPTZ,
TIME, and UUID remain unsupported.
- variant-functions-ir.cc/h: Implements the variant_to_json(BINARY,
BINARY)->STRING builtin expression function.
Testing
- Unit tests covering metadata parsing, all primitive types, objects,
arrays, path navigation, and JSON serialization. Includes test cases
extracted from Hive-written and DuckDB Parquet test files for
cross-engine compatibility validation.
Generated-by: Claude Opus 4.8 (Max effort)
Change-Id: I904618570e8c21d099c9a96b496d85e9246483de
Reviewed-on: http://gerrit.cloudera.org:8080/24392
Reviewed-by: Peter Rozsa <pr...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>
> Add backend support for VARIANTs
> --------------------------------
>
> Key: IMPALA-15067
> URL: https://issues.apache.org/jira/browse/IMPALA-15067
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Zoltán Borók-Nagy
> Assignee: Zoltán Borók-Nagy
> Priority: Major
> Labels: impala-iceberg, impala-iceberg-active-backlog
>
> Define VariantValue and utilty functions to convert it to JSON.
> Add unit tests.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org