You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Zoltán Borók-Nagy (Jira)" <ji...@apache.org> on 2020/10/19 08:57:00 UTC

[jira] [Created] (IMPALA-10254) Load data files via Iceberg for Iceberg Tables

Zoltán Borók-Nagy created IMPALA-10254:
------------------------------------------

             Summary: Load data files via Iceberg for Iceberg Tables
                 Key: IMPALA-10254
                 URL: https://issues.apache.org/jira/browse/IMPALA-10254
             Project: IMPALA
          Issue Type: Bug
            Reporter: Zoltán Borók-Nagy


Currently we still load the file descriptors of an Iceberg table via recursive file listing.

This lists too many files, e.g. metadata files, files that are being written (can later throw checksum errors), files from aborted INSERTs, removed files, etc.

We should use the Iceberg API to load the file descriptors corresponding to the table snapshot.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org