You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "vinoyang (Jira)" <ji...@apache.org> on 2020/06/18 12:07:00 UTC

[jira] [Commented] (HUDI-1027) Introduce TimestampBasedComplexKeyGenerator to support timestamp-based complex key

    [ https://issues.apache.org/jira/browse/HUDI-1027?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17139365#comment-17139365 ] 

vinoyang commented on HUDI-1027:
--------------------------------

[~vinoth] Does this feature make sense to you?

> Introduce TimestampBasedComplexKeyGenerator to support timestamp-based complex key
> ----------------------------------------------------------------------------------
>
>                 Key: HUDI-1027
>                 URL: https://issues.apache.org/jira/browse/HUDI-1027
>             Project: Apache Hudi
>          Issue Type: Improvement
>            Reporter: wangxianghu
>            Assignee: wangxianghu
>            Priority: Major
>              Labels: pull-request-available
>
> In IoT scenarios, it's common to use device_id and timestamp to identify a record of the device data.
> When storing these records with hoodie, we usually use the device_time(timestamp format) as the partition field，device_id and device_time as record key.
> however, TimestampBasedKeyGenerator supports only SimpleKey, and ComplexKeyGenerator does not support the timestamp-based partition path. So we need a new KeyGenerator to support partition path in timestamp format and complex key.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)