You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by Luce Sylvain <sy...@gmail.com> on 2014/02/07 08:24:30 UTC
Error with Lucene
Hi all,
I'm using for few days apache flume with elasticsearch.
My source is a JMS queue
My sink is elasticsearch
In the flume's libdir, I copy activemq-all.jar and the
elasticsearch.0.90.10.jar
My conf file :
a1.sources = r1
a1.sinks = k1
a1.channels = c1
# Describe/configure the source
a1.sources.r1.type = jms
a1.sources.r1.initialContextFactory =
org.apache.activemq.jndi.ActiveMQInitialContextFactory
a1.sources.r1.providerURL = tcp://my_source:61616
a1.sources.r1.destinationName = foo
a1.sources.r1.destinationType = QUEUE
# Describe the sink
a1.sinks.k1.type = elasticsearch
a1.sinks.k1.hostNames = localhost:9300
a1.sinks.k1.batchSize = 500
a1.sinks.k1.ttl = 5
a1.sinks.k1.indexName = foo
# Use a channel which buffers events in memory
a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100
# Bind the source and sink to the channel
a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1
Apache Flume send me an error at startup :
2014-02-07 08:18:08,620 (lifecycleSupervisor-1-1) [ERROR -
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)]
Unable to start SinkRunner: {
policy:org.apache.flume.sink.DefaultSinkProcessor@1058c283 counterGroup:{
name:null counters:{} } } - Exception follows.
java.lang.NoSuchFieldError: org/apache/lucene/util/Version.LUCENE_44
at org.elasticsearch.Version.<clinit>(Version.java:130)
at java.lang.J9VMInternals.initializeImpl(Native Method)
at java.lang.J9VMInternals.initialize(J9VMInternals.java:237)
at
org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:164)
at
org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:120)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.openClient(ElasticSearchSink.java:371)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.openConnection(ElasticSearchSink.java:351)
at
org.apache.flume.sink.elasticsearch.ElasticSearchSink.start(ElasticSearchSink.java:326)
at
org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
at
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:482)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:315)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:189)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1156)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:626)
at java.lang.Thread.run(Thread.java:804)
Thanks for your help
Sylvain
Re: Error with Lucene
Posted by Luce Sylvain <sy...@gmail.com>.
Problem found and resolved... 2 versions on Lucene jar in the lib dir...
I delete the older... And it work fine !
Sorry,
Sylvain
Le 7 févr. 2014 08:24, "Luce Sylvain" <sy...@gmail.com> a écrit :
> Hi all,
>
> I'm using for few days apache flume with elasticsearch.
>
> My source is a JMS queue
> My sink is elasticsearch
>
>
> In the flume's libdir, I copy activemq-all.jar and the
> elasticsearch.0.90.10.jar
>
> My conf file :
>
> a1.sources = r1
> a1.sinks = k1
> a1.channels = c1
>
> # Describe/configure the source
>
> a1.sources.r1.type = jms
> a1.sources.r1.initialContextFactory =
> org.apache.activemq.jndi.ActiveMQInitialContextFactory
> a1.sources.r1.providerURL = tcp://my_source:61616
> a1.sources.r1.destinationName = foo
> a1.sources.r1.destinationType = QUEUE
>
> # Describe the sink
> a1.sinks.k1.type = elasticsearch
> a1.sinks.k1.hostNames = localhost:9300
> a1.sinks.k1.batchSize = 500
> a1.sinks.k1.ttl = 5
> a1.sinks.k1.indexName = foo
>
>
> # Use a channel which buffers events in memory
> a1.channels.c1.type = memory
> a1.channels.c1.capacity = 1000
> a1.channels.c1.transactionCapacity = 100
>
> # Bind the source and sink to the channel
> a1.sources.r1.channels = c1
> a1.sinks.k1.channel = c1
>
>
> Apache Flume send me an error at startup :
>
>
> 2014-02-07 08:18:08,620 (lifecycleSupervisor-1-1) [ERROR -
> org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:253)]
> Unable to start SinkRunner: {
> policy:org.apache.flume.sink.DefaultSinkProcessor@1058c283 counterGroup:{
> name:null counters:{} } } - Exception follows.
> java.lang.NoSuchFieldError: org/apache/lucene/util/Version.LUCENE_44
> at org.elasticsearch.Version.<clinit>(Version.java:130)
> at java.lang.J9VMInternals.initializeImpl(Native Method)
> at java.lang.J9VMInternals.initialize(J9VMInternals.java:237)
> at
> org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:164)
> at
> org.elasticsearch.client.transport.TransportClient.<init>(TransportClient.java:120)
> at
> org.apache.flume.sink.elasticsearch.ElasticSearchSink.openClient(ElasticSearchSink.java:371)
> at
> org.apache.flume.sink.elasticsearch.ElasticSearchSink.openConnection(ElasticSearchSink.java:351)
> at
> org.apache.flume.sink.elasticsearch.ElasticSearchSink.start(ElasticSearchSink.java:326)
> at
> org.apache.flume.sink.DefaultSinkProcessor.start(DefaultSinkProcessor.java:46)
> at org.apache.flume.SinkRunner.start(SinkRunner.java:79)
> at
> org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:482)
> at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:315)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:189)
> at
> java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:304)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1156)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:626)
> at java.lang.Thread.run(Thread.java:804)
>
>
> Thanks for your help
>
> Sylvain
>
>