You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@eagle.apache.org by 绿飕飕 <qi...@gmail.com> on 2018/01/01 12:16:32 UTC
Re: Topology spouts lag error
Happy New Year!
I met the error show on storm's web ui:
Topology spouts lag error: Offset lags for kafka not supported for older
versions.Please update kafka spout to latest version.
It say update the kafka spout , but which module I should update?
*There more info：*
--------------------------------------------
*Info1*. softerwares version:
The softerwares version runing normally (could alert the message on web):
jdk1.8.0_151
scala-2.11.8
apache-maven-3.5.2
*apache-storm-0.9.7*
hadoop-2.7.4
hbase-0.98.8-hadoop2
zookeeper-3.4.10
*kafka_2.11-0.10.1.1*
logstash-2.4.1
eagle-0.5.0
The softerwares version could send message to the storm's topology:
there the different:
* apache-storm-1.1.1 kafka_2.11-1.0.0*
--------------------------------------------
*Info2*. the error show on storm Web UI
Topology spouts lag error:
Id Type Message ingest KAFKA *Offset lags for
kafka not supported for older versions. Please update kafka spout to latest
version.*
[image: 内嵌图片 1]
Thanks,
Wuqize
2017-12-17 21:35 GMT+08:00 Hao Chen <cn...@gmail.com>:
> Could you please provide more details about the error?
>
>
> --
>
> Hao
>
>
> On Wed, Dec 13, 2017 at 5:14 PM, 绿飕飕 <qi...@gmail.com> wrote:
>
> > I am using eagle-0.5.0 and storm-0.9.7 and kafka_2.11-0.10.1.1;
> >
> > When I use storm-1.1.1 replace the storm-0.9.7 and get the error in the
> web
> > UI.
> >
> >
> > I had check the storm's web site page http://storm.apache.org/
> > releases/1.1.1/index.html,
> > and set :
> >
> > client.jartransformer.class:"org.apache.storm.hack.
> StormShadeTransformer"
> >
> > in storm.yaml in conf-directory of storm installed.
> > But seems not work.
> >
>
Re: Topology spouts lag error
Posted by Hao Chen <cn...@gmail.com>.
Please use *kafka 0.8.** which you are using *kafka **1.0.0,* as kafka consumer
API changed a lot since *kafka 0.9.**
There will be some work to do if we want support kafka 0.9 +, need to
upgrade the kafka version and corresponding storm version in eagle. If you
would like to contribute, could you please create a JIRA ticket for it?
Thanks,
Hao
On Thu, Jan 4, 2018 at 10:44 PM, 绿飕飕 <qi...@gmail.com> wrote:
>
> ---------- Forwarded message ----------
> From: 绿飕飕 <qi...@gmail.com>
> Date: 2018-01-01 20:16 GMT+08:00
> Subject: Re: Topology spouts lag error
> To: dev@eagle.apache.org
>
>
> Hello,
>
> I met the error show on storm's web ui:
>
> Topology spouts lag error: Offset lags for kafka not supported for older
> versions.Please update kafka spout to latest version.
>
> It say update the kafka spout , but which module I should update?
>
>
>
> *There more info：*
>
>
> --------------------------------------------
> *Info1*. softerwares version:
>
> The softerwares version runing normally (could alert the message on web):
>
> jdk1.8.0_151
> scala-2.11.8
> apache-maven-3.5.2
> *apache-storm-0.9.7*
> hadoop-2.7.4
> hbase-0.98.8-hadoop2
> zookeeper-3.4.10
> *kafka_2.11-0.10.1.1*
> logstash-2.4.1
> eagle-0.5.0
>
> The softerwares version could send message to the storm's topology:
> there the different:
>
> * apache-storm-1.1.1 kafka_2.11-1.0.0*
>
> --------------------------------------------
>
> *Info2*. the error show on storm Web UI
>
> Topology spouts lag error:
>
> Id Type Message ingest KAFKA *Offset lags for
> kafka not supported for older versions. Please update kafka spout to latest
> version.*
>
> [image: 内嵌图片 1]
>
> Thanks,
> Wuqize
>
>
>
>
> 2017-12-17 21:35 GMT+08:00 Hao Chen <cn...@gmail.com>:
>
>> Could you please provide more details about the error?
>>
>>
>> --
>>
>> Hao
>>
>>
>> On Wed, Dec 13, 2017 at 5:14 PM, 绿飕飕 <qi...@gmail.com> wrote:
>>
>> > I am using eagle-0.5.0 and storm-0.9.7 and kafka_2.11-0.10.1.1;
>> >
>> > When I use storm-1.1.1 replace the storm-0.9.7 and get the error in the
>> web
>> > UI.
>> >
>> >
>> > I had check the storm's web site page http://storm.apache.org/
>> > releases/1.1.1/index.html,
>> > and set :
>> >
>> > client.jartransformer.class:"org.apache.storm.hack.StormShad
>> eTransformer"
>> >
>> > in storm.yaml in conf-directory of storm installed.
>> > But seems not work.
>> >
>>
>
>
>
Fwd: Topology spouts lag error
Posted by 绿飕飕 <qi...@gmail.com>.
---------- Forwarded message ----------
From: 绿飕飕 <qi...@gmail.com>
Date: 2018-01-01 20:16 GMT+08:00
Subject: Re: Topology spouts lag error
To: dev@eagle.apache.org
Hello,
I met the error show on storm's web ui:
Topology spouts lag error: Offset lags for kafka not supported for older
versions.Please update kafka spout to latest version.
It say update the kafka spout , but which module I should update?
*There more info：*
--------------------------------------------
*Info1*. softerwares version:
The softerwares version runing normally (could alert the message on web):
jdk1.8.0_151
scala-2.11.8
apache-maven-3.5.2
*apache-storm-0.9.7*
hadoop-2.7.4
hbase-0.98.8-hadoop2
zookeeper-3.4.10
*kafka_2.11-0.10.1.1*
logstash-2.4.1
eagle-0.5.0
The softerwares version could send message to the storm's topology:
there the different:
* apache-storm-1.1.1 kafka_2.11-1.0.0*
--------------------------------------------
*Info2*. the error show on storm Web UI
Topology spouts lag error:
Id Type Message ingest KAFKA *Offset lags for
kafka not supported for older versions. Please update kafka spout to latest
version.*
[image: 内嵌图片 1]
Thanks,
Wuqize
2017-12-17 21:35 GMT+08:00 Hao Chen <cn...@gmail.com>:
> Could you please provide more details about the error?
>
>
> --
>
> Hao
>
>
> On Wed, Dec 13, 2017 at 5:14 PM, 绿飕飕 <qi...@gmail.com> wrote:
>
> > I am using eagle-0.5.0 and storm-0.9.7 and kafka_2.11-0.10.1.1;
> >
> > When I use storm-1.1.1 replace the storm-0.9.7 and get the error in the
> web
> > UI.
> >
> >
> > I had check the storm's web site page http://storm.apache.org/
> > releases/1.1.1/index.html,
> > and set :
> >
> > client.jartransformer.class:"org.apache.storm.hack.StormShad
> eTransformer"
> >
> > in storm.yaml in conf-directory of storm installed.
> > But seems not work.
> >
>