You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Bhavani Sudha (Jira)" <ji...@apache.org> on 2020/08/24 18:29:00 UTC

[jira] [Reopened] (HUDI-728) Support for complex record keys with TimestampBasedKeyGenerator

     [ https://issues.apache.org/jira/browse/HUDI-728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Bhavani Sudha reopened HUDI-728:
--------------------------------

> Support for complex record keys with TimestampBasedKeyGenerator
> ---------------------------------------------------------------
>
>                 Key: HUDI-728
>                 URL: https://issues.apache.org/jira/browse/HUDI-728
>             Project: Apache Hudi
>          Issue Type: Improvement
>          Components: DeltaStreamer, Usability
>            Reporter: Pratyaksh Sharma
>            Assignee: Pratyaksh Sharma
>            Priority: Major
>              Labels: bug-bash-0.6.0, pull-request-available
>             Fix For: 0.6.0
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> We have TimestampBasedKeyGenerator for defining custom partition paths and we have ComplexKeyGenerator for supporting having combination of fields as record key or partition key. 
>  
> However we do not have support for the case where one wants to have combination of fields as record key along with being able to define custom partition paths. This use case recently came up at my organisation. 
>  
> How about having CustomTimestampBasedKeyGenerator which supports the above use case? This class can simply extend TimestampBasedKeyGenerator and allow users to have combination of fields as record key.
>  
> We will try to have the implementation as generic as possible. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)