You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Vinoth Chandar (Jira)" <ji...@apache.org> on 2021/07/20 02:58:00 UTC

[jira] [Created] (HUDI-2199) DynamoDB based external index implementation

Vinoth Chandar created HUDI-2199:
------------------------------------

             Summary: DynamoDB based external index implementation
                 Key: HUDI-2199
                 URL: https://issues.apache.org/jira/browse/HUDI-2199
             Project: Apache Hudi
          Issue Type: New Feature
          Components: Index
            Reporter: Vinoth Chandar
            Assignee: Biswajit mohapatra


We have a HBaseIndex, that provides uses with ability to store fileID <=> recordKey mappings in an external kv store, for fast lookups during upsert operations. We can potentially create a similar one for DynamoDB. 

We just use a single column family in HBase, so we should be able to largely re-use the code/key-value schema across them even. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)