You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "wolfgang hoschek (JIRA)" <ji...@apache.org> on 2014/03/03 21:16:22 UTC

[jira] [Commented] (FLUME-2340) Refactor to make room for Morphlines Elasticsearch Sink

    [ https://issues.apache.org/jira/browse/FLUME-2340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918531#comment-13918531 ] 

wolfgang hoschek commented on FLUME-2340:
-----------------------------------------

Here is what enabling ES would involve:

- Add a loadElasticSearch command in a corresponding kite-morphlines-elasticsearch maven module
- change kite-morphlines-all to kite-morphlines-all-except-solr in flume-ng-sinks/flume-ng-morphline-solr-sink/pom.xml
- add any necessary ES dependency jars to pom.xml
- add unit tests and integration tests

This doesn't require yet another sink - ES can be enabled with these packaging changes. 

> Refactor to make room for Morphlines Elasticsearch Sink
> -------------------------------------------------------
>
>                 Key: FLUME-2340
>                 URL: https://issues.apache.org/jira/browse/FLUME-2340
>             Project: Flume
>          Issue Type: Improvement
>          Components: Sinks+Sources
>            Reporter: Otis Gospodnetic
>             Fix For: v1.5.0
>
>
> Right now there are some non-Solr-specific classes in org.apache.flume.sink.solr.morphline  and everything assumes data will get loaded into Solr.  This should be refactored to make it possible to use Morphlines and send data to Elasticsearch, too, for example.
> See http://search-hadoop.com/m/Jrb3G1tSCQK1&subj=Re+Questions+about+Morphline+Solr+Sink+structure



--
This message was sent by Atlassian JIRA
(v6.2#6252)