[jira] [Commented] (CALCITE-1391) CRUD operations using Calcite for DRUID

["Julian Hyde (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CALCITE-1391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15530935#comment-15530935 ] 

Julian Hyde commented on CALCITE-1391:
--------------------------------------

If you were to implement INSERT, UPDATE and DELETE SQL commands against Druid, you would end up with a similar problem to the one Hive has: it is very inefficient to modify a single record in a (very large) segment. Hive's solution is [ACID|http://hortonworks.com/blog/adding-acid-to-apache-hive/], but it was a lot of work to merge deltas into every Hive read path.

What kind of performance characteristics are you aiming for? If  you're thinking of large, infrequent batch updates, then I think it could work. But frequent small updates would probably bring Druid to its knees. And I don't know whether Druid even supports updates and deletes.

[~nishantbangarwa] and [~bslim], what do you think?

> CRUD operations using Calcite for DRUID
> ---------------------------------------
>
>                 Key: CALCITE-1391
>                 URL: https://issues.apache.org/jira/browse/CALCITE-1391
>             Project: Calcite
>          Issue Type: Wish
>          Components: druid
>         Environment: Druid Production Environment
>            Reporter: Arvind
>            Assignee: Julian Hyde
>            Priority: Critical
>
> Hi Team,
> I know that we are able to read data from druid using Calcite SQLLINE command but I would like to know if we can insert, Update and delete segments in DRUID using Calcite. We are using DRUID as a reporting platform and for us to incrementally update, delete and append data we need these operations. As we are dealing with huge volumes of data we depend on DRUID and very badly need these Insert, Update and Delete.
> Any help is much appreciated.
> Thanks,
> Arvind



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)