You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@impala.apache.org by mi...@apache.org on 2026/01/06 18:06:58 UTC
(impala) 02/05: IMPALA-14627: Docs for Iceberg SHOW FILES IN table PARTITION
This is an automated email from the ASF dual-hosted git repository.
michaelsmith pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/impala.git
commit 043011b3442896328554d30734d1211c4443de5a
Author: Mihaly Szjatinya <ms...@pm.me>
AuthorDate: Fri Dec 12 13:22:57 2025 +0100
IMPALA-14627: Docs for Iceberg SHOW FILES IN table PARTITION
This patch adds a new section to the Iceberg topic about SHOW FILES IN
table PARTITION.
Change-Id: I1adeac55cde9c9b43f6b16c32348bde18a69713d
Reviewed-on: http://gerrit.cloudera.org:8080/23782
Tested-by: Impala Public Jenkins <im...@cloudera.com>
Reviewed-by: Noemi Pap-Takacs <np...@cloudera.com>
---
docs/impala_keydefs.ditamap | 1 +
docs/topics/impala_iceberg.xml | 51 ++++++++++++++++++++++++++++++++++++++++++
2 files changed, 52 insertions(+)
diff --git a/docs/impala_keydefs.ditamap b/docs/impala_keydefs.ditamap
index 919a8ebe1..b0f3b51f9 100644
--- a/docs/impala_keydefs.ditamap
+++ b/docs/impala_keydefs.ditamap
@@ -10537,6 +10537,7 @@ under the License.
<keydef href="https://issues.apache.org/jira/browse/IMPALA-9999" scope="external" format="html" keys="IMPALA-9999"/>
<!-- Short form of mapping from Impala release to vendor-specific releases, for use in headings. -->
+ <keydef keys="impala50"><topicmeta><keywords><keyword>Impala 5.0</keyword></keywords></topicmeta></keydef>
<keydef keys="impala45"><topicmeta><keywords><keyword>Impala 4.5</keyword></keywords></topicmeta></keydef>
<keydef keys="impala44"><topicmeta><keywords><keyword>Impala 4.4</keyword></keywords></topicmeta></keydef>
<keydef keys="impala43"><topicmeta><keywords><keyword>Impala 4.3</keyword></keywords></topicmeta></keydef>
diff --git a/docs/topics/impala_iceberg.xml b/docs/topics/impala_iceberg.xml
index 0892f04e0..f2d474032 100644
--- a/docs/topics/impala_iceberg.xml
+++ b/docs/topics/impala_iceberg.xml
@@ -552,6 +552,57 @@ ALTER TABLE ice_t DROP PARTITION (year(timestamp_col) = '2024');
</conbody>
</concept>
+ <concept id="iceberg_show_files_partition">
+ <title>Showing files in specific partitions of Iceberg tables</title>
+ <conbody>
+ <p>
+ Since <keyword keyref="impala50"/> Impala supports filtering by partition when displaying files in Iceberg tables
+ using the <codeph>SHOW FILES IN table PARTITION</codeph> statement. E.g.:
+ <codeblock>
+SHOW FILES IN ice_t PARTITION (i = 3);
+SHOW FILES IN ice_t PARTITION (identity_int = 1);
+SHOW FILES IN ice_t PARTITION (day(date_col) = '2023-12-01');
+SHOW FILES IN ice_t PARTITION (hour(timestamp_col) = '2023-06-02-0');
+SHOW FILES IN ice_t PARTITION (bucket(5, int_col) = 2);
+SHOW FILES IN ice_t PARTITION (truncate(5, string_col) = 'abcde');
+ </codeblock>
+ </p>
+ <p>
+ Partition transforms must be included in the partition selector to match the table's partition specification.
+ For identity partitions, the column name can be used directly. For other transforms like <codeph>day()</codeph>,
+ <codeph>hour()</codeph>, <codeph>bucket()</codeph>, or <codeph>truncate()</codeph>, the transform function
+ must be specified in the partition filter.
+ </p>
+ <p>
+ Operands for filtering date and timestamp-based columns with transforms must be provided as strings,
+ for example: <codeph>(day(date_col) = '2023-12-01')</codeph>, <codeph>(year(year_date) = '2077')</codeph>,
+ <codeph>(hour(timestamp_col) = '2023-06-02-0')</codeph>.
+ </p>
+ <p>
+ This statement only displays files that belong to partitions matching the specified filter criteria.
+ Complex expressions with multiple predicates are also supported, e.g.:
+ <codeblock>
+SHOW FILES IN ice_t PARTITION (identity_int = 1 AND identity_string = 'test');
+SHOW FILES IN ice_t PARTITION (identity_float < 3.0);
+SHOW FILES IN ice_t PARTITION (identity_double > 0.0);
+ </codeblock>
+ </p>
+ <p>
+ Limitations:
+ <ul>
+ <li>Binary filter predicates must consist of one partition selector and one constant expression;
+ e.g.: <codeph>(day(date_col) = '2023-12-01')</codeph> is allowed, but <codeph>(another_date_col = date_col)</codeph> is not allowed.</li>
+ <li>Filtering expressions must target the latest partition spec of the table.</li>
+ <li>Only partition columns can be used in the filter expressions.</li>
+ </ul>
+ </p>
+ <p>
+ More information about the <codeph>SHOW FILES</codeph> statement can be found at
+ <xref href="impala_show.xml"/>.
+ </p>
+ </conbody>
+ </concept>
+
<concept id="iceberg_update">
<title>Updating data in Iceberg tables</title>
<conbody>