You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Christophe Domas (JIRA)" <ji...@apache.org> on 2014/07/16 17:23:05 UTC

[jira] [Created] (FLUME-2424) allow index timestamp format option for ES sink

Christophe Domas created FLUME-2424:
---------------------------------------

             Summary: allow index timestamp format option for ES sink
                 Key: FLUME-2424
                 URL: https://issues.apache.org/jira/browse/FLUME-2424
             Project: Flume
          Issue Type: Improvement
          Components: Sinks+Sources
    Affects Versions: v1.5.0
            Reporter: Christophe Domas


I'm using a flume sink to elastic search with a "logstash" index name.

Flume ES sink creates an index with YYYY-MM-DD format. 
Logstash and kibana logstash uses YYYY.MM.DD format.

The workaround is to replace the timestamp format in kibana logstash dashboard as described in http://hortonworks.com/blog/configure-elastic-search-hadoop-hdp-2-0/

Is it possible to add an option in the conf to choose the timestamp format?
I find a git repo that allow that but it is not in the flume distrib:
https://github.com/DevOps-TangoMe/flume-elasticsearch



--
This message was sent by Atlassian JIRA
(v6.2#6252)