You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "Biswajit mohapatra (Jira)" <ji...@apache.org> on 2021/08/01 09:54:00 UTC
[jira] [Commented] (HUDI-2199) DynamoDB based external index
implementation
[ https://issues.apache.org/jira/browse/HUDI-2199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17391128#comment-17391128 ]
Biswajit mohapatra commented on HUDI-2199:
------------------------------------------
so we will need properties for dynamodb also , like in emr we have a table name emrfs , can we have a table like that called as hudifs which gets created if the table doesn't exist ?
> DynamoDB based external index implementation
> --------------------------------------------
>
> Key: HUDI-2199
> URL: https://issues.apache.org/jira/browse/HUDI-2199
> Project: Apache Hudi
> Issue Type: New Feature
> Components: Index
> Reporter: Vinoth Chandar
> Assignee: Biswajit mohapatra
> Priority: Major
>
> We have a HBaseIndex, that provides uses with ability to store fileID <=> recordKey mappings in an external kv store, for fast lookups during upsert operations. We can potentially create a similar one for DynamoDB.
> We just use a single column family in HBase, so we should be able to largely re-use the code/key-value schema across them even.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)