You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Swaroop Belur <sw...@gmail.com> on 2014/08/22 07:34:19 UTC
Trident aggregation - need help
Hi all
I have prototypes using bolts and spout for an aggregation on multiple
fields.
Works fine. when i try to do using trident, i seem to be stuck.
a. Looks like i would like to use Aggregator interface but this is not
supported in persistentAggregate methods.
b. Can one use a combination of Aggregator and persistentAggregate on
stream to do aggregation on multiple fields in set of tuples
c. Also i see number of examples using DRPC immediately after building
persistentAggregate code. But what i also read is that DRPC is deprecated.
This is confusing at the least.
Basically i am looking for a way to do agg on set of tuples grouped by
multi fields
in such a way that i can buffer for the current minute and flush for
previous minute
- like tick tuples in bolts.
Just that trident documentation seems to be confusing as of now. Any help
is appreciated.
--
Regards
Swaroop Belur
RE: Stable Apache Storm Version
Posted by Sridhar G <Sr...@microland.com>.
Hi Andrew ,
We tried our luck with Apache Storm 0.8.1 , 0.9.1, 0.9.2 .We are seeing issue with serialization where mismatch of serialvalueid is creating or acting as road block . STORM-448 is the issue raised in jira . thanks.
From: Andrew Xor [mailto:andreas.grammenos@gmail.com]
Sent: Friday, August 22, 2014 11:11 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Hi,
Could you please provide at least what versions you tried but didn't work and why? And to answer your question the latest stable version is 0.9.2 as far as I know.
Hope this helped.
On Friday, August 22, 2014, Sridhar G <Sr...@microland.com> wrote:
Hi All,
Which one is stable version of Apache Storm . I have tried various versions but do not find it go easy . Can you please suggest a better version that has worked well with you . Thanks.
Regards
Sridhar
The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
--
Kindly yours,
Andrew Grammenos
-- PGP PKey --
<https://www.dropbox.com/s/2kcxe59zsi9nrdt/pgpsig.txt>
https://www.dropbox.com/s/ei2nqsen641daei/pgpsig.txt
Re: Stable Apache Storm Version
Posted by Andrew Xor <an...@gmail.com>.
Hi,
Could you please provide at least what versions you tried but didn't work
and why? And to answer your question the latest stable version is 0.9.2 as
far as I know.
Hope this helped.
On Friday, August 22, 2014, Sridhar G <Sr...@microland.com> wrote:
> Hi All,
>
>
>
> Which one is stable version of Apache Storm . I have tried various
> versions but do not find it go easy . Can you please suggest a better
> version that has worked well with you . Thanks.
>
>
>
>
>
> Regards
>
> Sridhar
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message.
>
--
Kindly yours,
Andrew Grammenos
-- PGP PKey --
<https://www.dropbox.com/s/2kcxe59zsi9nrdt/pgpsig.txt>
https://www.dropbox.com/s/ei2nqsen641daei/pgpsig.txt
Re: Stable Apache Storm Version
Posted by Harsha <st...@harsha.io>.
Sridhar,
If possible can you share your config(storm.yaml) and
does it happen when you deploy a topology or when you start a
supervisor.
-Harsha
On Thu, Aug 21, 2014, at 11:02 PM, Sridhar G wrote:
Hi Anand,
We have single node running in local mode cluster and is of
same version.
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:29 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
This is strange. Are you sure that all the nodes are running
the same version of Storm.
On 22 August 2014 11:20, Sridhar G <[1...@microland.com>
wrote:
We have tried and it works but its temporary . I face same
issue for next run .
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:[2]anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:18 AM
To: [3]user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Can you try again after cleaning up your zookeeper storm data.
On 22 August 2014 11:12, Sridhar G <[4...@microland.com>
wrote:
Hi Anand ,
Thanks for quick response . We are facing below issue .
Description:
C:\Users\arjunkk\AppData\Local\Temp\SnipImage-{AEF691A0-75D0-4E
50-ADC3-85B947D6275A}.PNG
From: Anand Nalya [mailto:[5]anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:10 AM
To: [6]user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Hi Sridhar,
Storm 0.9.2-incubating is the stable version.What kind of
problems are you facing?
Regards,
Anand
On 22 August 2014 11:06, Sridhar G <[7...@microland.com>
wrote:
Hi All,
Which one is stable version of Apache Storm . I have tried
various versions but do not find it go easy . Can you please
suggest a better version that has worked well with you .
Thanks.
Regards
Sridhar
The information contained in this transmission may contain
privileged and confidential information of Microland Limited,
including information protected by privacy laws. It is intended
only for the use of Microland Limited. If you are not the
intended recipient, you are hereby notified that any review,
dissemination, distribution, or duplication of this
communication is strictly prohibited. If you are not the
intended recipient, please contact the sender by reply email
and destroy all copies of the original message.
Email had 1 attachment:
* image001.png
532k (image/png)
References
1. mailto:SridharG@microland.com
2. mailto:anand.nalya@gmail.com
3. mailto:user@storm.incubator.apache.org
4. mailto:SridharG@microland.com
5. mailto:anand.nalya@gmail.com
6. mailto:user@storm.incubator.apache.org
7. mailto:SridharG@microland.com
Re: Stable Apache Storm Version
Posted by Kishorkumar Patil <kp...@yahoo-inc.com>.
Sridhar,
Since any stale serialized heartbeats could cause the InvalidClassException, I would shutdown all processes/topologies and clean-up all storm-local directory and zk states.
Regards,
Kishor
From: Sridhar G <Sr...@microland.com>>
Reply-To: "user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>" <us...@storm.incubator.apache.org>>
Date: Friday, August 22, 2014 at 1:02 AM
To: "user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>" <us...@storm.incubator.apache.org>>
Subject: RE: Stable Apache Storm Version
Hi Anand,
We have single node running in local mode cluster and is of same version.
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:29 AM
To: user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>
Subject: Re: Stable Apache Storm Version
This is strange. Are you sure that all the nodes are running the same version of Storm.
On 22 August 2014 11:20, Sridhar G <Sr...@microland.com>> wrote:
We have tried and it works but its temporary . I face same issue for next run .
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:anand.nalya@gmail.com<ma...@gmail.com>]
Sent: Friday, August 22, 2014 11:18 AM
To: user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>
Subject: Re: Stable Apache Storm Version
Can you try again after cleaning up your zookeeper storm data.
On 22 August 2014 11:12, Sridhar G <Sr...@microland.com>> wrote:
Hi Anand ,
Thanks for quick response . We are facing below issue .
[Description: C:\Users\arjunkk\AppData\Local\Temp\SnipImage-{AEF691A0-75D0-4E50-ADC3-85B947D6275A}.PNG]
From: Anand Nalya [mailto:anand.nalya@gmail.com<ma...@gmail.com>]
Sent: Friday, August 22, 2014 11:10 AM
To: user@storm.incubator.apache.org<ma...@storm.incubator.apache.org>
Subject: Re: Stable Apache Storm Version
Hi Sridhar,
Storm 0.9.2-incubating is the stable version.What kind of problems are you facing?
Regards,
Anand
On 22 August 2014 11:06, Sridhar G <Sr...@microland.com>> wrote:
Hi All,
Which one is stable version of Apache Storm . I have tried various versions but do not find it go easy . Can you please suggest a better version that has worked well with you . Thanks.
Regards
Sridhar
The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
Re: Stable Apache Storm Version
Posted by Amila Suriarachchi <am...@gmail.com>.
Check whether your deployed jar has any storm classes. And also make sure
you clean all temp folders of
supervisors.
thanks,
Amila.
On Fri, Aug 22, 2014 at 12:02 AM, Sridhar G <Sr...@microland.com> wrote:
> Hi Anand,
>
>
>
> We have single node running in local mode cluster and is of same version.
>
>
>
> Regards,
>
> Sridhar
>
> *Believe in the impossible and remove the improbable*
>
>
>
> *From:* Anand Nalya [mailto:anand.nalya@gmail.com]
> *Sent:* Friday, August 22, 2014 11:29 AM
>
> *To:* user@storm.incubator.apache.org
> *Subject:* Re: Stable Apache Storm Version
>
>
>
> This is strange. Are you sure that all the nodes are running the same
> version of Storm.
>
>
>
> On 22 August 2014 11:20, Sridhar G <Sr...@microland.com> wrote:
>
> We have tried and it works but its temporary . I face same issue for next
> run .
>
>
>
> Regards,
>
> Sridhar
>
> *Believe in the impossible and remove the improbable*
>
>
>
> *From:* Anand Nalya [mailto:anand.nalya@gmail.com]
> *Sent:* Friday, August 22, 2014 11:18 AM
>
>
> *To:* user@storm.incubator.apache.org
> *Subject:* Re: Stable Apache Storm Version
>
>
>
> Can you try again after cleaning up your zookeeper storm data.
>
>
>
> On 22 August 2014 11:12, Sridhar G <Sr...@microland.com> wrote:
>
> Hi Anand ,
>
>
>
> Thanks for quick response . We are facing below issue .
>
>
>
> [image: Description:
> C:\Users\arjunkk\AppData\Local\Temp\SnipImage-{AEF691A0-75D0-4E50-ADC3-85B947D6275A}.PNG]
>
>
>
> *From:* Anand Nalya [mailto:anand.nalya@gmail.com]
> *Sent:* Friday, August 22, 2014 11:10 AM
> *To:* user@storm.incubator.apache.org
> *Subject:* Re: Stable Apache Storm Version
>
>
>
> Hi Sridhar,
>
>
>
> Storm 0.9.2-incubating is the stable version.What kind of problems are you
> facing?
>
>
>
> Regards,
>
> Anand
>
>
>
> On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
>
> Hi All,
>
>
>
> Which one is stable version of Apache Storm . I have tried various
> versions but do not find it go easy . Can you please suggest a better
> version that has worked well with you . Thanks.
>
>
>
>
>
> Regards
>
> Sridhar
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message.
>
>
>
>
>
>
>
--
Amila Suriarachchi
blog: http://amilachinthaka.blogspot.com/
RE: Stable Apache Storm Version
Posted by Sridhar G <Sr...@microland.com>.
Hi Anand,
We have single node running in local mode cluster and is of same version.
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:29 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
This is strange. Are you sure that all the nodes are running the same version of Storm.
On 22 August 2014 11:20, Sridhar G <Sr...@microland.com> wrote:
We have tried and it works but its temporary . I face same issue for next run .
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:18 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Can you try again after cleaning up your zookeeper storm data.
On 22 August 2014 11:12, Sridhar G <Sr...@microland.com> wrote:
Hi Anand ,
Thanks for quick response . We are facing below issue .
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:10 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Hi Sridhar,
Storm 0.9.2-incubating is the stable version.What kind of problems are you facing?
Regards,
Anand
On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
Hi All,
Which one is stable version of Apache Storm . I have tried various versions but do not find it go easy . Can you please suggest a better version that has worked well with you . Thanks.
Regards
Sridhar
The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
Re: Stable Apache Storm Version
Posted by Anand Nalya <an...@gmail.com>.
This is strange. Are you sure that all the nodes are running the same
version of Storm.
On 22 August 2014 11:20, Sridhar G <Sr...@microland.com> wrote:
> We have tried and it works but its temporary . I face same issue for next
> run .
>
>
>
> Regards,
>
> Sridhar
>
> *Believe in the impossible and remove the improbable*
>
>
>
> *From:* Anand Nalya [mailto:anand.nalya@gmail.com]
> *Sent:* Friday, August 22, 2014 11:18 AM
>
> *To:* user@storm.incubator.apache.org
> *Subject:* Re: Stable Apache Storm Version
>
>
>
> Can you try again after cleaning up your zookeeper storm data.
>
>
>
> On 22 August 2014 11:12, Sridhar G <Sr...@microland.com> wrote:
>
> Hi Anand ,
>
>
>
> Thanks for quick response . We are facing below issue .
>
>
>
> [image: Description:
> C:\Users\arjunkk\AppData\Local\Temp\SnipImage-{AEF691A0-75D0-4E50-ADC3-85B947D6275A}.PNG]
>
>
>
> *From:* Anand Nalya [mailto:anand.nalya@gmail.com]
> *Sent:* Friday, August 22, 2014 11:10 AM
> *To:* user@storm.incubator.apache.org
> *Subject:* Re: Stable Apache Storm Version
>
>
>
> Hi Sridhar,
>
>
>
> Storm 0.9.2-incubating is the stable version.What kind of problems are you
> facing?
>
>
>
> Regards,
>
> Anand
>
>
>
> On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
>
> Hi All,
>
>
>
> Which one is stable version of Apache Storm . I have tried various
> versions but do not find it go easy . Can you please suggest a better
> version that has worked well with you . Thanks.
>
>
>
>
>
> Regards
>
> Sridhar
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message.
>
>
>
>
>
RE: Stable Apache Storm Version
Posted by Sridhar G <Sr...@microland.com>.
We have tried and it works but its temporary . I face same issue for next run .
Regards,
Sridhar
Believe in the impossible and remove the improbable
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:18 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Can you try again after cleaning up your zookeeper storm data.
On 22 August 2014 11:12, Sridhar G <Sr...@microland.com> wrote:
Hi Anand ,
Thanks for quick response . We are facing below issue .
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:10 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Hi Sridhar,
Storm 0.9.2-incubating is the stable version.What kind of problems are you facing?
Regards,
Anand
On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
Hi All,
Which one is stable version of Apache Storm . I have tried various versions but do not find it go easy . Can you please suggest a better version that has worked well with you . Thanks.
Regards
Sridhar
The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
Re: Stable Apache Storm Version
Posted by Anand Nalya <an...@gmail.com>.
Can you try again after cleaning up your zookeeper storm data.
On 22 August 2014 11:12, Sridhar G <Sr...@microland.com> wrote:
> Hi Anand ,
>
>
>
> Thanks for quick response . We are facing below issue .
>
>
>
> [image: Description:
> C:\Users\arjunkk\AppData\Local\Temp\SnipImage-{AEF691A0-75D0-4E50-ADC3-85B947D6275A}.PNG]
>
>
>
> *From:* Anand Nalya [mailto:anand.nalya@gmail.com]
> *Sent:* Friday, August 22, 2014 11:10 AM
> *To:* user@storm.incubator.apache.org
> *Subject:* Re: Stable Apache Storm Version
>
>
>
> Hi Sridhar,
>
>
>
> Storm 0.9.2-incubating is the stable version.What kind of problems are you
> facing?
>
>
>
> Regards,
>
> Anand
>
>
>
> On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
>
> Hi All,
>
>
>
> Which one is stable version of Apache Storm . I have tried various
> versions but do not find it go easy . Can you please suggest a better
> version that has worked well with you . Thanks.
>
>
>
>
>
> Regards
>
> Sridhar
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message.
>
>
>
RE: Stable Apache Storm Version
Posted by Sridhar G <Sr...@microland.com>.
Hi Anand ,
Thanks for quick response . We are facing below issue .
From: Anand Nalya [mailto:anand.nalya@gmail.com]
Sent: Friday, August 22, 2014 11:10 AM
To: user@storm.incubator.apache.org
Subject: Re: Stable Apache Storm Version
Hi Sridhar,
Storm 0.9.2-incubating is the stable version.What kind of problems are you facing?
Regards,
Anand
On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
Hi All,
Which one is stable version of Apache Storm . I have tried various versions but do not find it go easy . Can you please suggest a better version that has worked well with you . Thanks.
Regards
Sridhar
The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.
Re: Stable Apache Storm Version
Posted by Anand Nalya <an...@gmail.com>.
Hi Sridhar,
Storm 0.9.2-incubating is the stable version.What kind of problems are you
facing?
Regards,
Anand
On 22 August 2014 11:06, Sridhar G <Sr...@microland.com> wrote:
> Hi All,
>
>
>
> Which one is stable version of Apache Storm . I have tried various
> versions but do not find it go easy . Can you please suggest a better
> version that has worked well with you . Thanks.
>
>
>
>
>
> Regards
>
> Sridhar
>
> The information contained in this transmission may contain privileged and
> confidential information of Microland Limited, including information
> protected by privacy laws. It is intended only for the use of Microland
> Limited. If you are not the intended recipient, you are hereby notified
> that any review, dissemination, distribution, or duplication of this
> communication is strictly prohibited. If you are not the intended
> recipient, please contact the sender by reply email and destroy all copies
> of the original message.
>
Stable Apache Storm Version
Posted by Sridhar G <Sr...@microland.com>.
Hi All,
Which one is stable version of Apache Storm . I have tried various versions but do not find it go easy . Can you please suggest a better version that has worked well with you . Thanks.
Regards
Sridhar
The information contained in this transmission may contain privileged and confidential information of Microland Limited, including information protected by privacy laws. It is intended only for the use of Microland Limited. If you are not the intended recipient, you are hereby notified that any review, dissemination, distribution, or duplication of this communication is strictly prohibited. If you are not the intended recipient, please contact the sender by reply email and destroy all copies of the original message.