[jira] [Commented] (IMPALA-11158) Add support for Iceberg tables with AVRO data files

["ASF subversion and git services (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-11158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17644602#comment-17644602 ] 

ASF subversion and git services commented on IMPALA-11158:
----------------------------------------------------------

Commit 80fc49abe6c574f8d6bea8bb56ff4917f6281a41 in impala's branch refs/heads/master from noemi
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=80fc49abe ]

IMPALA-11158: Add support for Iceberg tables with AVRO data files

Iceberg tables containing only AVRO files or no AVRO files at all
can now be read by Impala. Mixed file format tables with AVRO are
currently unsupported.
Impala uses its avro scanner to read AVRO files, therefore all the
avro related limitations apply here as well: writes/metadata
changes are not supported.

testing:
- created test tables: 'iceberg_avro_only' contains only AVRO files;
  'iceberg_avro_mixed' contains all file formats: avro+orc+parquet
- added E2E test that reads Avro-only table
- added test case to iceberg-negative.test that tries to read
  mixed file format table

Change-Id: I827e5707e54bebabc614e127daa48255f86f4c4f
Reviewed-on: http://gerrit.cloudera.org:8080/19084
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> Add support for Iceberg tables with AVRO data files
> ---------------------------------------------------
>
>                 Key: IMPALA-11158
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11158
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend, Frontend
>            Reporter: Zoltán Borók-Nagy
>            Assignee: Noemi Pap-Takacs
>            Priority: Major
>              Labels: impala-iceberg
>
> Impala currently only supports Iceberg tables with Parquet and ORC data files.
> The Iceberg spec also allows AVRO data files. Hive/Spark already support such tables.
> We should also add support for Iceberg tables using AVRO.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org