You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@apex.apache.org by "Raja.Aravapalli" <Ra...@target.com> on 2016/07/06 14:56:33 UTC
sticky partitioning
Hi,
Can some one please point me to a sample code/link that does uses the stickykey partitioning in Apex.
I couldn’t locate any..
Thanks a lot.
Regards,
Raja.
Re: sticky partitioning
Posted by "Raja.Aravapalli" <Ra...@target.com>.
Thanks Sandesh.
I will check this.
Regards,
Raja.
From: Sandesh Hegde <sa...@datatorrent.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Wednesday, July 6, 2016 at 10:51 AM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: sticky partitioning
Default implementation uses the hashcode of the tuple to select the partition, so it is sticky. If you want to do more than that, take look here https://github.com/DataTorrent/examples/tree/master/tutorials/partition
On Wed, Jul 6, 2016 at 8:34 AM Raja.Aravapalli <Ra...@target.com>> wrote:
Hi Sandesh,
Thanks for the response.
What I am looking for is StickKey partitioning!!
Something like….. Records with same key A goes into same instance of n operator !! [ Sticky Partition vs Round Robin @ http://docs.datatorrent.com/application_development/#sticky-partition-vs-round-robin]
Can you pls share some reference code link ?
Regards,
Raja.
From: Sandesh Hegde <sa...@datatorrent.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Wednesday, July 6, 2016 at 10:06 AM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: sticky partitioning
Default stateless partitioning is the one you want.
Here is the Sample code, which uses that.
https://github.com/DataTorrent/streaming-benchmarks/blob/master/apex-benchmarks/src/main/java/apex/benchmark/ApplicationWithGenerator.java
On Wed, Jul 6, 2016 at 7:57 AM Raja.Aravapalli <Ra...@target.com>> wrote:
Hi,
Can some one please point me to a sample code/link that does uses the stickykey partitioning in Apex.
I couldn’t locate any..
Thanks a lot.
Regards,
Raja.
Re: sticky partitioning
Posted by Sandesh Hegde <sa...@datatorrent.com>.
Default implementation uses the hashcode of the tuple to select the
partition, so it is sticky. If you want to do more than that, take look
here https://github.com/DataTorrent/examples/tree/master/tutorials/partition
On Wed, Jul 6, 2016 at 8:34 AM Raja.Aravapalli <Ra...@target.com>
wrote:
>
> Hi Sandesh,
>
> Thanks for the response.
>
> What I am looking for is StickKey partitioning!!
>
> Something like….. Records with same key A goes into same instance of n
> operator !!* [ Sticky Partition vs Round Robin @ *
> http://docs.datatorrent.com/application_development/#sticky-partition-vs-round-robin
> *] *
>
> Can you pls share some reference code link ?
>
>
> Regards,
> Raja.
>
> From: Sandesh Hegde <sa...@datatorrent.com>
> Reply-To: "users@apex.apache.org" <us...@apex.apache.org>
> Date: Wednesday, July 6, 2016 at 10:06 AM
> To: "users@apex.apache.org" <us...@apex.apache.org>
> Subject: Re: sticky partitioning
>
> Default stateless partitioning is the one you want.
>
> Here is the Sample code, which uses that.
>
>
> https://github.com/DataTorrent/streaming-benchmarks/blob/master/apex-benchmarks/src/main/java/apex/benchmark/ApplicationWithGenerator.java
>
>
>
>
> On Wed, Jul 6, 2016 at 7:57 AM Raja.Aravapalli <Ra...@target.com>
> wrote:
>
>>
>> Hi,
>>
>> Can some one please point me to a sample code/link that does uses the
>> *stickykey* partitioning in Apex.
>>
>> I couldn’t locate any..
>>
>> Thanks a lot.
>>
>>
>> Regards,
>> Raja.
>>
>
Re: sticky partitioning
Posted by "Raja.Aravapalli" <Ra...@target.com>.
Hi Sandesh,
Thanks for the response.
What I am looking for is StickKey partitioning!!
Something like….. Records with same key A goes into same instance of n operator !! [ Sticky Partition vs Round Robin @ http://docs.datatorrent.com/application_development/#sticky-partition-vs-round-robin]
Can you pls share some reference code link ?
Regards,
Raja.
From: Sandesh Hegde <sa...@datatorrent.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Wednesday, July 6, 2016 at 10:06 AM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: sticky partitioning
Default stateless partitioning is the one you want.
Here is the Sample code, which uses that.
https://github.com/DataTorrent/streaming-benchmarks/blob/master/apex-benchmarks/src/main/java/apex/benchmark/ApplicationWithGenerator.java
On Wed, Jul 6, 2016 at 7:57 AM Raja.Aravapalli <Ra...@target.com>> wrote:
Hi,
Can some one please point me to a sample code/link that does uses the stickykey partitioning in Apex.
I couldn’t locate any..
Thanks a lot.
Regards,
Raja.
Re: sticky partitioning
Posted by Sandesh Hegde <sa...@datatorrent.com>.
Default stateless partitioning is the one you want.
Here is the Sample code, which uses that.
https://github.com/DataTorrent/streaming-benchmarks/blob/master/apex-benchmarks/src/main/java/apex/benchmark/ApplicationWithGenerator.java
On Wed, Jul 6, 2016 at 7:57 AM Raja.Aravapalli <Ra...@target.com>
wrote:
>
> Hi,
>
> Can some one please point me to a sample code/link that does uses the
> *stickykey* partitioning in Apex.
>
> I couldn’t locate any..
>
> Thanks a lot.
>
>
> Regards,
> Raja.
>