[jira] [Created] (KUDU-3355) Move range partitions that are out of date to hdfs directly

["LiFu He (Jira)" <ji...@apache.org>]

LiFu He created KUDU-3355:
-----------------------------

             Summary: Move range partitions that are out of date to hdfs directly
                 Key: KUDU-3355
                 URL: https://issues.apache.org/jira/browse/KUDU-3355
             Project: Kudu
          Issue Type: New Feature
            Reporter: LiFu He


There is a feature in ClickHouse that allows MergeTree table to move range partitions from local disks to remote storage(hdfs/s3).

[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#table_engine-mergetree-creating-a-table]

[https://clickhouse.com/docs/en/engines/table-engines/mergetree-family/mergetree/#mergetree-table-ttl]

If kudu supports this type of functionarility, maybe it will make the combination of kudu and hdfs smoother, and even integrate into the data lake, compete with iceburg/hudi/delta.

I have read [~granthenke]'s blog [Transparent Hierarchical Storage Management with Apache Kudu and Impala|https://blog.cloudera.com/transparent-hierarchical-storage-management-with-apache-kudu-and-impala/], thanks for his detailed description, but I think this feature is another option. 

What's your opinion?

 



--
This message was sent by Atlassian Jira
(v8.20.1#820001)