You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Satoshi Iijima (JIRA)" <ji...@apache.org> on 2015/07/28 08:31:04 UTC
[jira] [Created] (FLUME-2750) Add an option to convert index name
to lower case in Elasticsearch sink
Satoshi Iijima created FLUME-2750:
-------------------------------------
Summary: Add an option to convert index name to lower case in Elasticsearch sink
Key: FLUME-2750
URL: https://issues.apache.org/jira/browse/FLUME-2750
Project: Flume
Issue Type: Improvement
Components: Sinks+Sources
Reporter: Satoshi Iijima
When capital letters is used for index name in header substitution, a below error occurs in Elasticsearch sink.
In Elasticsearch, a index name must be lower case.
By adding an option to convert index name to lower case, we can avoid this error.
The error log
{quote}
21 7 2015 17:55:35,499 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.sink.elasticsearch.ElasticSearchSink.process:225) - Failed to commit transaction. Transaction rolled back.
org.apache.flume.EventDeliveryException: failure in bulk execution:
[0]: index [INDEX-TEST-2015-07-21], type [nodeExists], id [null], message [RemoteTransportException[[test-node01][inet[/10.XXX.XXX.XXX:9300]][indices:admin/create]]; nested: InvalidIndexNameException[[INDEX-TEST-2015-07-21] Invalid index name [INDEX-TEST-2015-07-21], must be lowercase]; ]
[1]: index [INDEX-TEST-2015-07-21], type [select], id [null], message [RemoteTransportException[[test-node01][inet[/10.XXX.XXX.XXX:9300]][indices:admin/create]]; nested: InvalidIndexNameException[[INDEX-TEST-2015-07-21] Invalid index name [INDEX-TEST-2015-07-21], must be lowercase]; ]
at org.apache.flume.sink.elasticsearch.client.ElasticSearchTransportClient.execute(ElasticSearchTransportClient.java:183)
at org.apache.flume.sink.elasticsearch.ElasticSearchSink.process(ElasticSearchSink.java:205)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:68)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:722)
{quote}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)