You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Julien Sobczak (JIRA)" <ji...@apache.org> on 2016/02/18 17:40:18 UTC

[jira] [Created] (FLUME-2884) Tag not allowed in ElasticSearch indexNameBuilder properties

Julien Sobczak created FLUME-2884:
-------------------------------------

             Summary: Tag not allowed in ElasticSearch indexNameBuilder properties
                 Key: FLUME-2884
                 URL: https://issues.apache.org/jira/browse/FLUME-2884
             Project: Flume
          Issue Type: Bug
          Components: Sinks+Sources
            Reporter: Julien Sobczak


Note: *The patch FLUME - 2207 is required to reproduce the issue.*

The following code causes the flume agent to crash a stack trace when starting (illegal pattern passed to {{FastDateFormat}}) : 
{code}
agent1.sinks.sinkEls.indexNameBuilder.dateFormat = %{format}
{code}

In practice, we need a variable to customize the index rotation (daily, weekly, monthly) from a header. (the header is defined in a morphline in our case, configured as an interceptor on the source)

The problem happens because the {{FastDateFormat}} is instanciated in the method {{configure}}. We could delay its instanciation inside the method {{getIndexName}} without decrease the performance of the agent ({{FastDateFormat}} uses caching extensively). I added a patch to present this implementation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)