[jira] [Commented] (STORM-3499) allow bulk indexing in elasticsearch

["Stig Rohde Døssing (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STORM-3499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16917007#comment-16917007 ] 

Stig Rohde Døssing commented on STORM-3499:
-------------------------------------------

Hi,

Have you checked whether the current storm-elasticsearch bolt (https://github.com/apache/storm/blob/master/external/storm-elasticsearch/src/main/java/org/apache/storm/elasticsearch/bolt/EsIndexBolt.java) does what you want?

You may also want to look at whether Elastic's own Storm bolt does the job https://www.elastic.co/guide/en/elasticsearch/hadoop/current/storm.html

If neither works for you, you should explain what your bolt does that can't be done by the other two. If you can explain why the new bolt is useful, it is more likely to get attention.

Also just to note, Storm is often used as an at-least-once system. I'm not sure we want to include a bolt that acks tuples before they are delivered, but if we do we definitely need to put it in giant flashing letters in the documentation, so it doesn't catch anyone by surprise.

> allow bulk indexing in elasticsearch
> ------------------------------------
>
>                 Key: STORM-3499
>                 URL: https://issues.apache.org/jira/browse/STORM-3499
>             Project: Apache Storm
>          Issue Type: Wish
>          Components: storm-elasticsearch
>            Reporter: Jay Bhavsar
>            Priority: Trivial
>              Labels: features, newbie
>   Original Estimate: 504h
>  Remaining Estimate: 504h
>
> For a particular use case, I created custom bolt that can push data to ES in bulk. It's quick and dirty code as of now. The bolt acks tuples as soon as it revives it, before sending to ES. (need more thoughts/suggestions on this behavior). Can we make this as feature of storm? I am willing to contribute.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)