You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by Nilay Binjola <ni...@media.net> on 2016/10/24 07:14:29 UTC
Trident DRPC In-Order Processing
Hi,
I have been trying to achieve a use-case of mine where I wanted a
synchronized call to an Exactly-Once In-Order Processed Trident Topology. I
tried using Storm Trident DRPC for the same. However, I was not able to use
partitionPersist for the in-order exactly-once part.
(InvalidTopologyException)
I did some research online and it seems partitionPersist is not allowed in
a DRPC stream. I wished to confirm if this was true.
*Also, any ideas on how to achieve my use-case?*
--
Regards,
Nilay Binjola
Re: Trident DRPC In-Order Processing
Posted by Nilay Binjola <ni...@media.net>.
It seems it can't be done. So, I used a Pub/Sub feedback loop to simulate
the synchronized processing feature of Storm DRPC. Any better ideas?
On Wed, Nov 2, 2016 at 11:15 AM, Nilay Binjola <ni...@media.net> wrote:
> Bump.
>
> I would really appreciate suggestions and ideas on this.
>
> On Mon, Oct 24, 2016 at 12:44 PM, Nilay Binjola <ni...@media.net> wrote:
>
>> Hi,
>>
>> I have been trying to achieve a use-case of mine where I wanted a
>> synchronized call to an Exactly-Once In-Order Processed Trident Topology. I
>> tried using Storm Trident DRPC for the same. However, I was not able to use
>> partitionPersist for the in-order exactly-once part.
>> (InvalidTopologyException)
>>
>> I did some research online and it seems partitionPersist is not allowed
>> in a DRPC stream. I wished to confirm if this was true.
>>
>> *Also, any ideas on how to achieve my use-case?*
>>
>> --
>> Regards,
>> Nilay Binjola
>>
>
>
>
> --
> Regards,
> Nilay Binjola
>
--
Regards,
Nilay Binjola
Re: Trident DRPC In-Order Processing
Posted by Nilay Binjola <ni...@media.net>.
Bump.
I would really appreciate suggestions and ideas on this.
On Mon, Oct 24, 2016 at 12:44 PM, Nilay Binjola <ni...@media.net> wrote:
> Hi,
>
> I have been trying to achieve a use-case of mine where I wanted a
> synchronized call to an Exactly-Once In-Order Processed Trident Topology. I
> tried using Storm Trident DRPC for the same. However, I was not able to use
> partitionPersist for the in-order exactly-once part.
> (InvalidTopologyException)
>
> I did some research online and it seems partitionPersist is not allowed in
> a DRPC stream. I wished to confirm if this was true.
>
> *Also, any ideas on how to achieve my use-case?*
>
> --
> Regards,
> Nilay Binjola
>
--
Regards,
Nilay Binjola