You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Govindarajan Srinivasaraghavan <go...@gmail.com> on 2017/02/25 07:58:16 UTC
ElasticsearchSink Exception
Hi All,
I'm getting the below exception when I start my flink job. I have verified
the elastic search host and it seems to be working well. I have also tried
including the below dependecies to my project but nothing works. Need some
help. Thanks.
compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
compile group: 'org.elasticsearch', name: 'elasticsearch', version: '2.3.5'
*Sink Code:*
List<InetSocketAddress> transportAddresses = new ArrayList<>();
transportAddresses.add(new
InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
ElasticsearchSinkFunction<Object>() {
}
*Exception:*
java.lang.RuntimeException: Client is not connected to any Elasticsearch nodes!
at org.apache.flink.streaming.connectors.elasticsearch2.ElasticsearchSink.open(ElasticsearchSink.java:172)
at org.apache.flink.api.common.functions.util.FunctionUtils.openFunction(FunctionUtils.java:36)
at org.apache.flink.streaming.api.operators.AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
at org.apache.flink.streaming.runtime.tasks.StreamTask.openAllOperators(StreamTask.java:386)
at org.apache.flink.streaming.runtime.tasks.StreamTask.invoke(StreamTask.java:262)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
at java.lang.Thread.run(Thread.java:745)
Re: ElasticsearchSink Exception
Posted by "Tzu-Li (Gordon) Tai" <tz...@apache.org>.
Good to know it’s working! Thanks for the update :-)
On March 1, 2017 at 6:03:44 AM, Govindarajan Srinivasaraghavan (govindraghvan@gmail.com) wrote:
Hi Gordon/Flavio,
Found out the issue was because of elastic search version mismatch. Another person upgraded ES version to 5.x but I was using 2.x. After changing the version it worked. Thanks for the help.
On Mon, Feb 27, 2017 at 6:12 AM, Tzu-Li (Gordon) Tai <tz...@apache.org> wrote:
Hi!
Like wha Flavio suggested, at a first glance this looks like a problem with building the uber jar.
I haven’t bumped into the problem while testing out the connector on cluster submitted test jobs before, but I can try to test this quickly to make sure.
Could you tell me what your installed Elasticsearch version is? Also, how are you building your uber jar?
Cheers,
Gordon
On February 27, 2017 at 9:40:02 PM, Aljoscha Krettek (aljoscha@apache.org) wrote:
+Tzu-Li (Gordon) Tai Do you have any idea what could be causing this? I'm asking because you recently worked on the Elasticsearch connectors, right?
On Sun, 26 Feb 2017 at 04:26 Govindarajan Srinivasaraghavan <go...@gmail.com> wrote:
Thanks Flavio. I tried with multiple versions but still the same exception
and I was able to locate the class file inside my jar. Am I missing
something? Thanks for all the help.
On Sat, Feb 25, 2017 at 3:09 PM, Flavio Pompermaier <po...@okkam.it>
wrote:
> The exception you have (NoClassDefFoundError:
> org/elasticsearch/index/mapper/MapperParsingException) is usually caused
> by
> elasticsearch version conflict or a bad shading when creating the uber jar.
> Can you check if one of the 2 is causing the problem?
>
> On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
> govindraghvan@gmail.com> wrote:
>
> > Hi Flavio,
> >
> > I tried with both http port 9200 and tcp port 9300 and I see incoming
> > connections in the elasticserach node. Also I see the below errors in
> > taskmanager out logs. Below are the dependencies I have on my gradle
> > project. Am I missing something?
> >
> > Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> > java.lang.NoClassDefFoundError:
> > org/elasticsearch/index/mapper/MapperParsingException
> > at
> > org.elasticsearch.ElasticsearchException.<clinit>(
> > ElasticsearchException.java:597)
> > at
> > org.elasticsearch.transport.TransportService$Adapter$3.
> > run(TransportService.java:622)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.ClassNotFoundException:
> > org.elasticsearch.index.mapper.MapperParsingException
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > ... 5 more
> >
> >
> > Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> > java.lang.NoClassDefFoundError: Could not initialize class
> > org.elasticsearch.transport.NodeDisconnectedException
> > at
> > org.elasticsearch.transport.TransportService$Adapter$3.
> > run(TransportService.java:622)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> > version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> > compile group: 'org.apache.flink', name:
> > 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> > '1.2.0'
> >
> > compile group: 'org.apache.flink', name:
> > 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
> >
> >
> > On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <
> pompermaier@okkam.it>
> > wrote:
> >
> > > Are you sure that in elasticsearch.yml you've enabled ES to listen to
> the
> > > http port 9300?
> > >
> > > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > > govindraghvan@gmail.com> wrote:
> > >
> > > Hi All,
> > >
> > > I'm getting the below exception when I start my flink job. I have
> > verified
> > > the elastic search host and it seems to be working well. I have also
> > tried
> > > including the below dependecies to my project but nothing works. Need
> > some
> > > help. Thanks.
> > >
> > > compile group: 'org.apache.lucene', name: 'lucene-core', version:
> '5.5.0'
> > > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> > '2.3.5'
> > >
> > >
> > > *Sink Code:*
> > >
> > > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > > transportAddresses.add(new
> > > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> > >
> > > output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> > > ElasticsearchSinkFunction<Object>() {
> > >
> > > }
> > >
> > >
> > > *Exception:*
> > >
> > > java.lang.RuntimeException: Client is not connected to any
> Elasticsearch
> > > nodes!
> > > at org.apache.flink.streaming.connectors.elasticsearch2.
> > > ElasticsearchSink.open(ElasticsearchSink.java:172)
> > > at org.apache.flink.api.common.functions.util.FunctionUtils.
> > > openFunction(FunctionUtils.java:36)
> > > at org.apache.flink.streaming.api.operators.
> > > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > openAllOperators(StreamTask.java:386)
> > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > invoke(StreamTask.java:262)
> > > at org.apache.flink.runtime.taskmanager.Task.run(Task.
> java:655)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> >
>
Re: ElasticsearchSink Exception
Posted by Govindarajan Srinivasaraghavan <go...@gmail.com>.
Hi Gordon/Flavio,
Found out the issue was because of elastic search version mismatch. Another
person upgraded ES version to 5.x but I was using 2.x. After changing the
version it worked. Thanks for the help.
On Mon, Feb 27, 2017 at 6:12 AM, Tzu-Li (Gordon) Tai <tz...@apache.org>
wrote:
> Hi!
>
> Like wha Flavio suggested, at a first glance this looks like a problem
> with building the uber jar.
>
> I haven’t bumped into the problem while testing out the connector on
> cluster submitted test jobs before, but I can try to test this quickly to
> make sure.
>
> Could you tell me what your installed Elasticsearch version is? Also, how
> are you building your uber jar?
>
> Cheers,
> Gordon
>
>
> On February 27, 2017 at 9:40:02 PM, Aljoscha Krettek (aljoscha@apache.org)
> wrote:
>
> +Tzu-Li (Gordon) Tai <tz...@apache.org> Do you have any idea what
> could be causing this? I'm asking because you recently worked on the
> Elasticsearch connectors, right?
>
> On Sun, 26 Feb 2017 at 04:26 Govindarajan Srinivasaraghavan <
> govindraghvan@gmail.com> wrote:
>
>> Thanks Flavio. I tried with multiple versions but still the same exception
>> and I was able to locate the class file inside my jar. Am I missing
>> something? Thanks for all the help.
>>
>> On Sat, Feb 25, 2017 at 3:09 PM, Flavio Pompermaier <pompermaier@okkam.it
>> >
>> wrote:
>>
>> > The exception you have (NoClassDefFoundError:
>> > org/elasticsearch/index/mapper/MapperParsingException) is usually
>> caused
>> > by
>> > elasticsearch version conflict or a bad shading when creating the uber
>> jar.
>> > Can you check if one of the 2 is causing the problem?
>> >
>> > On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
>> > govindraghvan@gmail.com> wrote:
>> >
>> > > Hi Flavio,
>> > >
>> > > I tried with both http port 9200 and tcp port 9300 and I see incoming
>> > > connections in the elasticserach node. Also I see the below errors in
>> > > taskmanager out logs. Below are the dependencies I have on my gradle
>> > > project. Am I missing something?
>> > >
>> > > Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
>> > > java.lang.NoClassDefFoundError:
>> > > org/elasticsearch/index/mapper/MapperParsingException
>> > > at
>> > > org.elasticsearch.ElasticsearchException.<clinit>(
>> > > ElasticsearchException.java:597)
>> > > at
>> > > org.elasticsearch.transport.TransportService$Adapter$3.
>> > > run(TransportService.java:622)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > Caused by: java.lang.ClassNotFoundException:
>> > > org.elasticsearch.index.mapper.MapperParsingException
>> > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
>> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
>> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
>> > > ... 5 more
>> > >
>> > >
>> > > Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
>> > > java.lang.NoClassDefFoundError: Could not initialize class
>> > > org.elasticsearch.transport.NodeDisconnectedException
>> > > at
>> > > org.elasticsearch.transport.TransportService$Adapter$3.
>> > > run(TransportService.java:622)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > >
>> > >
>> > > compile group: 'org.apache.flink', name: 'flink-core', version:
>> '1.2.0'
>> > > compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
>> > > version: '1.2.0'
>> > > compile group: 'org.apache.flink', name: 'flink-java', version:
>> '1.2.0'
>> > > compile group: 'org.apache.flink', name:
>> > > 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
>> > > compile group: 'org.apache.flink', name: 'flink-clients_2.10',
>> version:
>> > > '1.2.0'
>> > >
>> > > compile group: 'org.apache.flink', name:
>> > > 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
>> > >
>> > >
>> > > On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <
>> > pompermaier@okkam.it>
>> > > wrote:
>> > >
>> > > > Are you sure that in elasticsearch.yml you've enabled ES to listen
>> to
>> > the
>> > > > http port 9300?
>> > > >
>> > > > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
>> > > > govindraghvan@gmail.com> wrote:
>> > > >
>> > > > Hi All,
>> > > >
>> > > > I'm getting the below exception when I start my flink job. I have
>> > > verified
>> > > > the elastic search host and it seems to be working well. I have also
>> > > tried
>> > > > including the below dependecies to my project but nothing works.
>> Need
>> > > some
>> > > > help. Thanks.
>> > > >
>> > > > compile group: 'org.apache.lucene', name: 'lucene-core', version:
>> > '5.5.0'
>> > > > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
>> > > '2.3.5'
>> > > >
>> > > >
>> > > > *Sink Code:*
>> > > >
>> > > > List<InetSocketAddress> transportAddresses = new ArrayList<>();
>> > > > transportAddresses.add(new
>> > > > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
>> > > >
>> > > > output.addSink(new ElasticsearchSink<>(config, transportAddresses,
>> new
>> > > > ElasticsearchSinkFunction<Object>() {
>> > > >
>> > > > }
>> > > >
>> > > >
>> > > > *Exception:*
>> > > >
>> > > > java.lang.RuntimeException: Client is not connected to any
>> > Elasticsearch
>> > > > nodes!
>> > > > at org.apache.flink.streaming.connectors.elasticsearch2.
>> > > > ElasticsearchSink.open(ElasticsearchSink.java:172)
>> > > > at org.apache.flink.api.common.
>> functions.util.FunctionUtils.
>> > > > openFunction(FunctionUtils.java:36)
>> > > > at org.apache.flink.streaming.api.operators.
>> > > > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
>> > > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
>> > > > openAllOperators(StreamTask.java:386)
>> > > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
>> > > > invoke(StreamTask.java:262)
>> > > > at org.apache.flink.runtime.taskmanager.Task.run(Task.
>> > java:655)
>> > > > at java.lang.Thread.run(Thread.java:745)
>> > > >
>> > >
>> >
>>
>
Re: ElasticsearchSink Exception
Posted by "Tzu-Li (Gordon) Tai" <tz...@apache.org>.
Hi!
Like wha Flavio suggested, at a first glance this looks like a problem with building the uber jar.
I haven’t bumped into the problem while testing out the connector on cluster submitted test jobs before, but I can try to test this quickly to make sure.
Could you tell me what your installed Elasticsearch version is? Also, how are you building your uber jar?
Cheers,
Gordon
On February 27, 2017 at 9:40:02 PM, Aljoscha Krettek (aljoscha@apache.org) wrote:
+Tzu-Li (Gordon) Tai Do you have any idea what could be causing this? I'm asking because you recently worked on the Elasticsearch connectors, right?
On Sun, 26 Feb 2017 at 04:26 Govindarajan Srinivasaraghavan <go...@gmail.com> wrote:
Thanks Flavio. I tried with multiple versions but still the same exception
and I was able to locate the class file inside my jar. Am I missing
something? Thanks for all the help.
On Sat, Feb 25, 2017 at 3:09 PM, Flavio Pompermaier <po...@okkam.it>
wrote:
> The exception you have (NoClassDefFoundError:
> org/elasticsearch/index/mapper/MapperParsingException) is usually caused
> by
> elasticsearch version conflict or a bad shading when creating the uber jar.
> Can you check if one of the 2 is causing the problem?
>
> On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
> govindraghvan@gmail.com> wrote:
>
> > Hi Flavio,
> >
> > I tried with both http port 9200 and tcp port 9300 and I see incoming
> > connections in the elasticserach node. Also I see the below errors in
> > taskmanager out logs. Below are the dependencies I have on my gradle
> > project. Am I missing something?
> >
> > Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> > java.lang.NoClassDefFoundError:
> > org/elasticsearch/index/mapper/MapperParsingException
> > at
> > org.elasticsearch.ElasticsearchException.<clinit>(
> > ElasticsearchException.java:597)
> > at
> > org.elasticsearch.transport.TransportService$Adapter$3.
> > run(TransportService.java:622)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.ClassNotFoundException:
> > org.elasticsearch.index.mapper.MapperParsingException
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > ... 5 more
> >
> >
> > Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> > java.lang.NoClassDefFoundError: Could not initialize class
> > org.elasticsearch.transport.NodeDisconnectedException
> > at
> > org.elasticsearch.transport.TransportService$Adapter$3.
> > run(TransportService.java:622)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> > version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> > compile group: 'org.apache.flink', name:
> > 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> > '1.2.0'
> >
> > compile group: 'org.apache.flink', name:
> > 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
> >
> >
> > On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <
> pompermaier@okkam.it>
> > wrote:
> >
> > > Are you sure that in elasticsearch.yml you've enabled ES to listen to
> the
> > > http port 9300?
> > >
> > > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > > govindraghvan@gmail.com> wrote:
> > >
> > > Hi All,
> > >
> > > I'm getting the below exception when I start my flink job. I have
> > verified
> > > the elastic search host and it seems to be working well. I have also
> > tried
> > > including the below dependecies to my project but nothing works. Need
> > some
> > > help. Thanks.
> > >
> > > compile group: 'org.apache.lucene', name: 'lucene-core', version:
> '5.5.0'
> > > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> > '2.3.5'
> > >
> > >
> > > *Sink Code:*
> > >
> > > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > > transportAddresses.add(new
> > > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> > >
> > > output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> > > ElasticsearchSinkFunction<Object>() {
> > >
> > > }
> > >
> > >
> > > *Exception:*
> > >
> > > java.lang.RuntimeException: Client is not connected to any
> Elasticsearch
> > > nodes!
> > > at org.apache.flink.streaming.connectors.elasticsearch2.
> > > ElasticsearchSink.open(ElasticsearchSink.java:172)
> > > at org.apache.flink.api.common.functions.util.FunctionUtils.
> > > openFunction(FunctionUtils.java:36)
> > > at org.apache.flink.streaming.api.operators.
> > > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > openAllOperators(StreamTask.java:386)
> > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > invoke(StreamTask.java:262)
> > > at org.apache.flink.runtime.taskmanager.Task.run(Task.
> java:655)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> >
>
Re: ElasticsearchSink Exception
Posted by Aljoscha Krettek <al...@apache.org>.
+Tzu-Li (Gordon) Tai <tz...@apache.org> Do you have any idea what could
be causing this? I'm asking because you recently worked on the
Elasticsearch connectors, right?
On Sun, 26 Feb 2017 at 04:26 Govindarajan Srinivasaraghavan <
govindraghvan@gmail.com> wrote:
> Thanks Flavio. I tried with multiple versions but still the same exception
> and I was able to locate the class file inside my jar. Am I missing
> something? Thanks for all the help.
>
> On Sat, Feb 25, 2017 at 3:09 PM, Flavio Pompermaier <po...@okkam.it>
> wrote:
>
> > The exception you have (NoClassDefFoundError:
> > org/elasticsearch/index/mapper/MapperParsingException) is usually caused
> > by
> > elasticsearch version conflict or a bad shading when creating the uber
> jar.
> > Can you check if one of the 2 is causing the problem?
> >
> > On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
> > govindraghvan@gmail.com> wrote:
> >
> > > Hi Flavio,
> > >
> > > I tried with both http port 9200 and tcp port 9300 and I see incoming
> > > connections in the elasticserach node. Also I see the below errors in
> > > taskmanager out logs. Below are the dependencies I have on my gradle
> > > project. Am I missing something?
> > >
> > > Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> > > java.lang.NoClassDefFoundError:
> > > org/elasticsearch/index/mapper/MapperParsingException
> > > at
> > > org.elasticsearch.ElasticsearchException.<clinit>(
> > > ElasticsearchException.java:597)
> > > at
> > > org.elasticsearch.transport.TransportService$Adapter$3.
> > > run(TransportService.java:622)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > Caused by: java.lang.ClassNotFoundException:
> > > org.elasticsearch.index.mapper.MapperParsingException
> > > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > > ... 5 more
> > >
> > >
> > > Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> > > java.lang.NoClassDefFoundError: Could not initialize class
> > > org.elasticsearch.transport.NodeDisconnectedException
> > > at
> > > org.elasticsearch.transport.TransportService$Adapter$3.
> > > run(TransportService.java:622)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> > >
> > > compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> > > compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> > > version: '1.2.0'
> > > compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> > > compile group: 'org.apache.flink', name:
> > > 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> > > compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> > > '1.2.0'
> > >
> > > compile group: 'org.apache.flink', name:
> > > 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
> > >
> > >
> > > On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <
> > pompermaier@okkam.it>
> > > wrote:
> > >
> > > > Are you sure that in elasticsearch.yml you've enabled ES to listen to
> > the
> > > > http port 9300?
> > > >
> > > > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > > > govindraghvan@gmail.com> wrote:
> > > >
> > > > Hi All,
> > > >
> > > > I'm getting the below exception when I start my flink job. I have
> > > verified
> > > > the elastic search host and it seems to be working well. I have also
> > > tried
> > > > including the below dependecies to my project but nothing works. Need
> > > some
> > > > help. Thanks.
> > > >
> > > > compile group: 'org.apache.lucene', name: 'lucene-core', version:
> > '5.5.0'
> > > > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> > > '2.3.5'
> > > >
> > > >
> > > > *Sink Code:*
> > > >
> > > > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > > > transportAddresses.add(new
> > > > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> > > >
> > > > output.addSink(new ElasticsearchSink<>(config, transportAddresses,
> new
> > > > ElasticsearchSinkFunction<Object>() {
> > > >
> > > > }
> > > >
> > > >
> > > > *Exception:*
> > > >
> > > > java.lang.RuntimeException: Client is not connected to any
> > Elasticsearch
> > > > nodes!
> > > > at org.apache.flink.streaming.connectors.elasticsearch2.
> > > > ElasticsearchSink.open(ElasticsearchSink.java:172)
> > > > at org.apache.flink.api.common.functions.util.FunctionUtils.
> > > > openFunction(FunctionUtils.java:36)
> > > > at org.apache.flink.streaming.api.operators.
> > > > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> > > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > > openAllOperators(StreamTask.java:386)
> > > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > > invoke(StreamTask.java:262)
> > > > at org.apache.flink.runtime.taskmanager.Task.run(Task.
> > java:655)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > >
> > >
> >
>
Re: ElasticsearchSink Exception
Posted by Govindarajan Srinivasaraghavan <go...@gmail.com>.
Thanks Flavio. I tried with multiple versions but still the same exception
and I was able to locate the class file inside my jar. Am I missing
something? Thanks for all the help.
On Sat, Feb 25, 2017 at 3:09 PM, Flavio Pompermaier <po...@okkam.it>
wrote:
> The exception you have (NoClassDefFoundError:
> org/elasticsearch/index/mapper/MapperParsingException) is usually caused
> by
> elasticsearch version conflict or a bad shading when creating the uber jar.
> Can you check if one of the 2 is causing the problem?
>
> On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
> govindraghvan@gmail.com> wrote:
>
> > Hi Flavio,
> >
> > I tried with both http port 9200 and tcp port 9300 and I see incoming
> > connections in the elasticserach node. Also I see the below errors in
> > taskmanager out logs. Below are the dependencies I have on my gradle
> > project. Am I missing something?
> >
> > Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> > java.lang.NoClassDefFoundError:
> > org/elasticsearch/index/mapper/MapperParsingException
> > at
> > org.elasticsearch.ElasticsearchException.<clinit>(
> > ElasticsearchException.java:597)
> > at
> > org.elasticsearch.transport.TransportService$Adapter$3.
> > run(TransportService.java:622)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.ClassNotFoundException:
> > org.elasticsearch.index.mapper.MapperParsingException
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> > ... 5 more
> >
> >
> > Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> > java.lang.NoClassDefFoundError: Could not initialize class
> > org.elasticsearch.transport.NodeDisconnectedException
> > at
> > org.elasticsearch.transport.TransportService$Adapter$3.
> > run(TransportService.java:622)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> >
> >
> > compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> > version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> > compile group: 'org.apache.flink', name:
> > 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> > compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> > '1.2.0'
> >
> > compile group: 'org.apache.flink', name:
> > 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
> >
> >
> > On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <
> pompermaier@okkam.it>
> > wrote:
> >
> > > Are you sure that in elasticsearch.yml you've enabled ES to listen to
> the
> > > http port 9300?
> > >
> > > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > > govindraghvan@gmail.com> wrote:
> > >
> > > Hi All,
> > >
> > > I'm getting the below exception when I start my flink job. I have
> > verified
> > > the elastic search host and it seems to be working well. I have also
> > tried
> > > including the below dependecies to my project but nothing works. Need
> > some
> > > help. Thanks.
> > >
> > > compile group: 'org.apache.lucene', name: 'lucene-core', version:
> '5.5.0'
> > > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> > '2.3.5'
> > >
> > >
> > > *Sink Code:*
> > >
> > > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > > transportAddresses.add(new
> > > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> > >
> > > output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> > > ElasticsearchSinkFunction<Object>() {
> > >
> > > }
> > >
> > >
> > > *Exception:*
> > >
> > > java.lang.RuntimeException: Client is not connected to any
> Elasticsearch
> > > nodes!
> > > at org.apache.flink.streaming.connectors.elasticsearch2.
> > > ElasticsearchSink.open(ElasticsearchSink.java:172)
> > > at org.apache.flink.api.common.functions.util.FunctionUtils.
> > > openFunction(FunctionUtils.java:36)
> > > at org.apache.flink.streaming.api.operators.
> > > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > openAllOperators(StreamTask.java:386)
> > > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > > invoke(StreamTask.java:262)
> > > at org.apache.flink.runtime.taskmanager.Task.run(Task.
> java:655)
> > > at java.lang.Thread.run(Thread.java:745)
> > >
> >
>
Re: ElasticsearchSink Exception
Posted by Flavio Pompermaier <po...@okkam.it>.
The exception you have (NoClassDefFoundError:
org/elasticsearch/index/mapper/MapperParsingException) is usually caused by
elasticsearch version conflict or a bad shading when creating the uber jar.
Can you check if one of the 2 is causing the problem?
On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
govindraghvan@gmail.com> wrote:
> Hi Flavio,
>
> I tried with both http port 9200 and tcp port 9300 and I see incoming
> connections in the elasticserach node. Also I see the below errors in
> taskmanager out logs. Below are the dependencies I have on my gradle
> project. Am I missing something?
>
> Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> java.lang.NoClassDefFoundError:
> org/elasticsearch/index/mapper/MapperParsingException
> at
> org.elasticsearch.ElasticsearchException.<clinit>(
> ElasticsearchException.java:597)
> at
> org.elasticsearch.transport.TransportService$Adapter$3.
> run(TransportService.java:622)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.elasticsearch.index.mapper.MapperParsingException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 5 more
>
>
> Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> java.lang.NoClassDefFoundError: Could not initialize class
> org.elasticsearch.transport.NodeDisconnectedException
> at
> org.elasticsearch.transport.TransportService$Adapter$3.
> run(TransportService.java:622)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
> compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> compile group: 'org.apache.flink', name:
> 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> '1.2.0'
>
> compile group: 'org.apache.flink', name:
> 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
>
>
> On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <po...@okkam.it>
> wrote:
>
> > Are you sure that in elasticsearch.yml you've enabled ES to listen to the
> > http port 9300?
> >
> > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > govindraghvan@gmail.com> wrote:
> >
> > Hi All,
> >
> > I'm getting the below exception when I start my flink job. I have
> verified
> > the elastic search host and it seems to be working well. I have also
> tried
> > including the below dependecies to my project but nothing works. Need
> some
> > help. Thanks.
> >
> > compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
> > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> '2.3.5'
> >
> >
> > *Sink Code:*
> >
> > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > transportAddresses.add(new
> > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> >
> > output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> > ElasticsearchSinkFunction<Object>() {
> >
> > }
> >
> >
> > *Exception:*
> >
> > java.lang.RuntimeException: Client is not connected to any Elasticsearch
> > nodes!
> > at org.apache.flink.streaming.connectors.elasticsearch2.
> > ElasticsearchSink.open(ElasticsearchSink.java:172)
> > at org.apache.flink.api.common.functions.util.FunctionUtils.
> > openFunction(FunctionUtils.java:36)
> > at org.apache.flink.streaming.api.operators.
> > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > openAllOperators(StreamTask.java:386)
> > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > invoke(StreamTask.java:262)
> > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
> > at java.lang.Thread.run(Thread.java:745)
> >
>
Re: ElasticsearchSink Exception
Posted by Flavio Pompermaier <po...@okkam.it>.
The exception you have (NoClassDefFoundError:
org/elasticsearch/index/mapper/MapperParsingException) is usually caused by
elasticsearch version conflict or a bad shading when creating the uber jar.
Can you check if one of the 2 is causing the problem?
On 25 Feb 2017 23:13, "Govindarajan Srinivasaraghavan" <
govindraghvan@gmail.com> wrote:
> Hi Flavio,
>
> I tried with both http port 9200 and tcp port 9300 and I see incoming
> connections in the elasticserach node. Also I see the below errors in
> taskmanager out logs. Below are the dependencies I have on my gradle
> project. Am I missing something?
>
> Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
> java.lang.NoClassDefFoundError:
> org/elasticsearch/index/mapper/MapperParsingException
> at
> org.elasticsearch.ElasticsearchException.<clinit>(
> ElasticsearchException.java:597)
> at
> org.elasticsearch.transport.TransportService$Adapter$3.
> run(TransportService.java:622)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> org.elasticsearch.index.mapper.MapperParsingException
> at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
> ... 5 more
>
>
> Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
> java.lang.NoClassDefFoundError: Could not initialize class
> org.elasticsearch.transport.NodeDisconnectedException
> at
> org.elasticsearch.transport.TransportService$Adapter$3.
> run(TransportService.java:622)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
>
>
> compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
> version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
> compile group: 'org.apache.flink', name:
> 'flink-connector-kafka-0.10_2.10', version: '1.2.0'
> compile group: 'org.apache.flink', name: 'flink-clients_2.10', version:
> '1.2.0'
>
> compile group: 'org.apache.flink', name:
> 'flink-connector-elasticsearch2_2.10', version: '1.2.0'
>
>
> On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <po...@okkam.it>
> wrote:
>
> > Are you sure that in elasticsearch.yml you've enabled ES to listen to the
> > http port 9300?
> >
> > On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> > govindraghvan@gmail.com> wrote:
> >
> > Hi All,
> >
> > I'm getting the below exception when I start my flink job. I have
> verified
> > the elastic search host and it seems to be working well. I have also
> tried
> > including the below dependecies to my project but nothing works. Need
> some
> > help. Thanks.
> >
> > compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
> > compile group: 'org.elasticsearch', name: 'elasticsearch', version:
> '2.3.5'
> >
> >
> > *Sink Code:*
> >
> > List<InetSocketAddress> transportAddresses = new ArrayList<>();
> > transportAddresses.add(new
> > InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
> >
> > output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> > ElasticsearchSinkFunction<Object>() {
> >
> > }
> >
> >
> > *Exception:*
> >
> > java.lang.RuntimeException: Client is not connected to any Elasticsearch
> > nodes!
> > at org.apache.flink.streaming.connectors.elasticsearch2.
> > ElasticsearchSink.open(ElasticsearchSink.java:172)
> > at org.apache.flink.api.common.functions.util.FunctionUtils.
> > openFunction(FunctionUtils.java:36)
> > at org.apache.flink.streaming.api.operators.
> > AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > openAllOperators(StreamTask.java:386)
> > at org.apache.flink.streaming.runtime.tasks.StreamTask.
> > invoke(StreamTask.java:262)
> > at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
> > at java.lang.Thread.run(Thread.java:745)
> >
>
Re: ElasticsearchSink Exception
Posted by Govindarajan Srinivasaraghavan <go...@gmail.com>.
Hi Flavio,
I tried with both http port 9200 and tcp port 9300 and I see incoming
connections in the elasticserach node. Also I see the below errors in
taskmanager out logs. Below are the dependencies I have on my gradle
project. Am I missing something?
Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
java.lang.NoClassDefFoundError:
org/elasticsearch/index/mapper/MapperParsingException
at
org.elasticsearch.ElasticsearchException.<clinit>(ElasticsearchException.java:597)
at
org.elasticsearch.transport.TransportService$Adapter$3.run(TransportService.java:622)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException:
org.elasticsearch.index.mapper.MapperParsingException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 5 more
Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
java.lang.NoClassDefFoundError: Could not initialize class
org.elasticsearch.transport.NodeDisconnectedException
at
org.elasticsearch.transport.TransportService$Adapter$3.run(TransportService.java:622)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
version: '1.2.0'
compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
compile group: 'org.apache.flink', name:
'flink-connector-kafka-0.10_2.10', version: '1.2.0'
compile group: 'org.apache.flink', name: 'flink-clients_2.10', version: '1.2.0'
compile group: 'org.apache.flink', name:
'flink-connector-elasticsearch2_2.10', version: '1.2.0'
On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <po...@okkam.it>
wrote:
> Are you sure that in elasticsearch.yml you've enabled ES to listen to the
> http port 9300?
>
> On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> govindraghvan@gmail.com> wrote:
>
> Hi All,
>
> I'm getting the below exception when I start my flink job. I have verified
> the elastic search host and it seems to be working well. I have also tried
> including the below dependecies to my project but nothing works. Need some
> help. Thanks.
>
> compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
> compile group: 'org.elasticsearch', name: 'elasticsearch', version: '2.3.5'
>
>
> *Sink Code:*
>
> List<InetSocketAddress> transportAddresses = new ArrayList<>();
> transportAddresses.add(new
> InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
>
> output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> ElasticsearchSinkFunction<Object>() {
>
> }
>
>
> *Exception:*
>
> java.lang.RuntimeException: Client is not connected to any Elasticsearch
> nodes!
> at org.apache.flink.streaming.connectors.elasticsearch2.
> ElasticsearchSink.open(ElasticsearchSink.java:172)
> at org.apache.flink.api.common.functions.util.FunctionUtils.
> openFunction(FunctionUtils.java:36)
> at org.apache.flink.streaming.api.operators.
> AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.
> openAllOperators(StreamTask.java:386)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.
> invoke(StreamTask.java:262)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
> at java.lang.Thread.run(Thread.java:745)
>
Re: ElasticsearchSink Exception
Posted by Govindarajan Srinivasaraghavan <go...@gmail.com>.
Hi Flavio,
I tried with both http port 9200 and tcp port 9300 and I see incoming
connections in the elasticserach node. Also I see the below errors in
taskmanager out logs. Below are the dependencies I have on my gradle
project. Am I missing something?
Exception in thread "elasticsearch[Madame Menace][generic][T#2]"
java.lang.NoClassDefFoundError:
org/elasticsearch/index/mapper/MapperParsingException
at
org.elasticsearch.ElasticsearchException.<clinit>(ElasticsearchException.java:597)
at
org.elasticsearch.transport.TransportService$Adapter$3.run(TransportService.java:622)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException:
org.elasticsearch.index.mapper.MapperParsingException
at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
... 5 more
Exception in thread "elasticsearch[Saint Elmo][generic][T#2]"
java.lang.NoClassDefFoundError: Could not initialize class
org.elasticsearch.transport.NodeDisconnectedException
at
org.elasticsearch.transport.TransportService$Adapter$3.run(TransportService.java:622)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
compile group: 'org.apache.flink', name: 'flink-core', version: '1.2.0'
compile group: 'org.apache.flink', name: 'flink-streaming-java_2.10',
version: '1.2.0'
compile group: 'org.apache.flink', name: 'flink-java', version: '1.2.0'
compile group: 'org.apache.flink', name:
'flink-connector-kafka-0.10_2.10', version: '1.2.0'
compile group: 'org.apache.flink', name: 'flink-clients_2.10', version: '1.2.0'
compile group: 'org.apache.flink', name:
'flink-connector-elasticsearch2_2.10', version: '1.2.0'
On Sat, Feb 25, 2017 at 1:26 AM, Flavio Pompermaier <po...@okkam.it>
wrote:
> Are you sure that in elasticsearch.yml you've enabled ES to listen to the
> http port 9300?
>
> On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
> govindraghvan@gmail.com> wrote:
>
> Hi All,
>
> I'm getting the below exception when I start my flink job. I have verified
> the elastic search host and it seems to be working well. I have also tried
> including the below dependecies to my project but nothing works. Need some
> help. Thanks.
>
> compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
> compile group: 'org.elasticsearch', name: 'elasticsearch', version: '2.3.5'
>
>
> *Sink Code:*
>
> List<InetSocketAddress> transportAddresses = new ArrayList<>();
> transportAddresses.add(new
> InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
>
> output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
> ElasticsearchSinkFunction<Object>() {
>
> }
>
>
> *Exception:*
>
> java.lang.RuntimeException: Client is not connected to any Elasticsearch
> nodes!
> at org.apache.flink.streaming.connectors.elasticsearch2.
> ElasticsearchSink.open(ElasticsearchSink.java:172)
> at org.apache.flink.api.common.functions.util.FunctionUtils.
> openFunction(FunctionUtils.java:36)
> at org.apache.flink.streaming.api.operators.
> AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.
> openAllOperators(StreamTask.java:386)
> at org.apache.flink.streaming.runtime.tasks.StreamTask.
> invoke(StreamTask.java:262)
> at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
> at java.lang.Thread.run(Thread.java:745)
>
Re: ElasticsearchSink Exception
Posted by Flavio Pompermaier <po...@okkam.it>.
Are you sure that in elasticsearch.yml you've enabled ES to listen to the
http port 9300?
On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
govindraghvan@gmail.com> wrote:
Hi All,
I'm getting the below exception when I start my flink job. I have verified
the elastic search host and it seems to be working well. I have also tried
including the below dependecies to my project but nothing works. Need some
help. Thanks.
compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
compile group: 'org.elasticsearch', name: 'elasticsearch', version: '2.3.5'
*Sink Code:*
List<InetSocketAddress> transportAddresses = new ArrayList<>();
transportAddresses.add(new
InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
ElasticsearchSinkFunction<Object>() {
}
*Exception:*
java.lang.RuntimeException: Client is not connected to any Elasticsearch
nodes!
at org.apache.flink.streaming.connectors.elasticsearch2.
ElasticsearchSink.open(ElasticsearchSink.java:172)
at org.apache.flink.api.common.functions.util.FunctionUtils.
openFunction(FunctionUtils.java:36)
at org.apache.flink.streaming.api.operators.
AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
at org.apache.flink.streaming.runtime.tasks.StreamTask.
openAllOperators(StreamTask.java:386)
at org.apache.flink.streaming.runtime.tasks.StreamTask.
invoke(StreamTask.java:262)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
at java.lang.Thread.run(Thread.java:745)
Re: ElasticsearchSink Exception
Posted by Flavio Pompermaier <po...@okkam.it>.
Are you sure that in elasticsearch.yml you've enabled ES to listen to the
http port 9300?
On 25 Feb 2017 08:58, "Govindarajan Srinivasaraghavan" <
govindraghvan@gmail.com> wrote:
Hi All,
I'm getting the below exception when I start my flink job. I have verified
the elastic search host and it seems to be working well. I have also tried
including the below dependecies to my project but nothing works. Need some
help. Thanks.
compile group: 'org.apache.lucene', name: 'lucene-core', version: '5.5.0'
compile group: 'org.elasticsearch', name: 'elasticsearch', version: '2.3.5'
*Sink Code:*
List<InetSocketAddress> transportAddresses = new ArrayList<>();
transportAddresses.add(new
InetSocketAddress(InetAddress.getByName(*hostName*), 9300));
output.addSink(new ElasticsearchSink<>(config, transportAddresses, new
ElasticsearchSinkFunction<Object>() {
}
*Exception:*
java.lang.RuntimeException: Client is not connected to any Elasticsearch
nodes!
at org.apache.flink.streaming.connectors.elasticsearch2.
ElasticsearchSink.open(ElasticsearchSink.java:172)
at org.apache.flink.api.common.functions.util.FunctionUtils.
openFunction(FunctionUtils.java:36)
at org.apache.flink.streaming.api.operators.
AbstractUdfStreamOperator.open(AbstractUdfStreamOperator.java:112)
at org.apache.flink.streaming.runtime.tasks.StreamTask.
openAllOperators(StreamTask.java:386)
at org.apache.flink.streaming.runtime.tasks.StreamTask.
invoke(StreamTask.java:262)
at org.apache.flink.runtime.taskmanager.Task.run(Task.java:655)
at java.lang.Thread.run(Thread.java:745)