You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Alejandro Santos <al...@gmail.com> on 2018/11/06 14:55:33 UTC
How does Ignite provides load balancing?
Hi all,
I've been reading the Ignite documentation and have some technical
questions. I need to evaluate massive storage systems for some
specific application and I would like to understand how ignite works.
My application needs a buffering space that write arbitrary values,
but then reads on average half of the values at most once. This is a
random process, and we can't really predict which keys will be read.
Is ignite the right tool for this application? Do you need more information?
Thank you,
--
Alejandro Santos
Re: How does Ignite provides load balancing?
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
There's a section in the docs:
https://apacheignite.readme.io/docs/affinity-collocation#section-affinity-function
You can always study
https://github.com/apache/ignite/blob/master/modules/core/src/main/java/org/apache/ignite/cache/affinity/rendezvous/RendezvousAffinityFunction.java
Note that Ignite does Rendezvous on per data partition basis and not on per
key basis.
Regards,
--
Ilya Kasnacheev
ср, 14 нояб. 2018 г. в 0:41, Alejandro Santos <al...@gmail.com>:
> Dear Ilya,
> This is exacly what I was looking for!
> I can't find much documentation about it in ignite docs, only posts in
> mailing list.
> Is there any paper that studies this for Ignite?
> Thanks
> Alejandro
>
>
> On Tue, Nov 13, 2018 at 5:34 PM Ilya Kasnacheev
> <il...@gmail.com> wrote:
> >
> > Hello!
> >
> > It will use Rendezvous hashing of keys:
> > https://en.wikipedia.org/wiki/Rendezvous_hashing
> >
> > Regards,
> > --
> > Ilya Kasnacheev
> >
> >
> > пт, 9 нояб. 2018 г. в 16:24, Alejandro Santos <al...@gmail.com>:
> >>
> >> Dear Denis,
> >>
> >> How does Ignite provides load balancing between nodes?
> >>
> >> Is it hash-based?
> >> Is it dynamically allocated?
> >> Is it something else?
> >>
> >> Thanks,
> >>
> >> On Thu, Nov 8, 2018 at 1:14 AM Denis Magda <dm...@apache.org> wrote:
> >> >
> >> > Hi,
> >> >
> >> > In general, the load is balanced because the data is distributed
> evenly across a cluster of machines. For instance, if you utilize key-value
> calls then each request goes to a specific node. If you're on SQL then a
> query might be broadcasted or sent to a specific node as well.
> >> >
> >> > Overall, yes, Ignite is the right solution if you need to scale and
> accelerate performance.
> >> >
> >> > --
> >> > Denis
> >> >
> >> > On Tue, Nov 6, 2018 at 6:55 AM Alejandro Santos <al...@gmail.com>
> wrote:
> >> >>
> >> >> Hi all,
> >> >>
> >> >> I've been reading the Ignite documentation and have some technical
> >> >> questions. I need to evaluate massive storage systems for some
> >> >> specific application and I would like to understand how ignite works.
> >> >>
> >> >> My application needs a buffering space that write arbitrary values,
> >> >> but then reads on average half of the values at most once. This is a
> >> >> random process, and we can't really predict which keys will be read.
> >> >>
> >> >> Is ignite the right tool for this application? Do you need more
> information?
> >> >>
> >> >> Thank you,
> >> >>
> >> >> --
> >> >> Alejandro Santos
> >>
> >>
> >>
> >> --
> >> Alejandro Santos
>
>
>
> --
> Alejandro Santos
>
Re: How does Ignite provides load balancing?
Posted by Alejandro Santos <al...@gmail.com>.
Dear Ilya,
This is exacly what I was looking for!
I can't find much documentation about it in ignite docs, only posts in
mailing list.
Is there any paper that studies this for Ignite?
Thanks
Alejandro
On Tue, Nov 13, 2018 at 5:34 PM Ilya Kasnacheev
<il...@gmail.com> wrote:
>
> Hello!
>
> It will use Rendezvous hashing of keys:
> https://en.wikipedia.org/wiki/Rendezvous_hashing
>
> Regards,
> --
> Ilya Kasnacheev
>
>
> пт, 9 нояб. 2018 г. в 16:24, Alejandro Santos <al...@gmail.com>:
>>
>> Dear Denis,
>>
>> How does Ignite provides load balancing between nodes?
>>
>> Is it hash-based?
>> Is it dynamically allocated?
>> Is it something else?
>>
>> Thanks,
>>
>> On Thu, Nov 8, 2018 at 1:14 AM Denis Magda <dm...@apache.org> wrote:
>> >
>> > Hi,
>> >
>> > In general, the load is balanced because the data is distributed evenly across a cluster of machines. For instance, if you utilize key-value calls then each request goes to a specific node. If you're on SQL then a query might be broadcasted or sent to a specific node as well.
>> >
>> > Overall, yes, Ignite is the right solution if you need to scale and accelerate performance.
>> >
>> > --
>> > Denis
>> >
>> > On Tue, Nov 6, 2018 at 6:55 AM Alejandro Santos <al...@gmail.com> wrote:
>> >>
>> >> Hi all,
>> >>
>> >> I've been reading the Ignite documentation and have some technical
>> >> questions. I need to evaluate massive storage systems for some
>> >> specific application and I would like to understand how ignite works.
>> >>
>> >> My application needs a buffering space that write arbitrary values,
>> >> but then reads on average half of the values at most once. This is a
>> >> random process, and we can't really predict which keys will be read.
>> >>
>> >> Is ignite the right tool for this application? Do you need more information?
>> >>
>> >> Thank you,
>> >>
>> >> --
>> >> Alejandro Santos
>>
>>
>>
>> --
>> Alejandro Santos
--
Alejandro Santos
Re: How does Ignite provides load balancing?
Posted by Ilya Kasnacheev <il...@gmail.com>.
Hello!
It will use Rendezvous hashing of keys:
https://en.wikipedia.org/wiki/Rendezvous_hashing
Regards,
--
Ilya Kasnacheev
пт, 9 нояб. 2018 г. в 16:24, Alejandro Santos <al...@gmail.com>:
> Dear Denis,
>
> How does Ignite provides load balancing between nodes?
>
> Is it hash-based?
> Is it dynamically allocated?
> Is it something else?
>
> Thanks,
>
> On Thu, Nov 8, 2018 at 1:14 AM Denis Magda <dm...@apache.org> wrote:
> >
> > Hi,
> >
> > In general, the load is balanced because the data is distributed evenly
> across a cluster of machines. For instance, if you utilize key-value calls
> then each request goes to a specific node. If you're on SQL then a query
> might be broadcasted or sent to a specific node as well.
> >
> > Overall, yes, Ignite is the right solution if you need to scale and
> accelerate performance.
> >
> > --
> > Denis
> >
> > On Tue, Nov 6, 2018 at 6:55 AM Alejandro Santos <al...@gmail.com>
> wrote:
> >>
> >> Hi all,
> >>
> >> I've been reading the Ignite documentation and have some technical
> >> questions. I need to evaluate massive storage systems for some
> >> specific application and I would like to understand how ignite works.
> >>
> >> My application needs a buffering space that write arbitrary values,
> >> but then reads on average half of the values at most once. This is a
> >> random process, and we can't really predict which keys will be read.
> >>
> >> Is ignite the right tool for this application? Do you need more
> information?
> >>
> >> Thank you,
> >>
> >> --
> >> Alejandro Santos
>
>
>
> --
> Alejandro Santos
>
Re: How does Ignite provides load balancing?
Posted by Alejandro Santos <al...@gmail.com>.
Dear Denis,
How does Ignite provides load balancing between nodes?
Is it hash-based?
Is it dynamically allocated?
Is it something else?
Thanks,
On Thu, Nov 8, 2018 at 1:14 AM Denis Magda <dm...@apache.org> wrote:
>
> Hi,
>
> In general, the load is balanced because the data is distributed evenly across a cluster of machines. For instance, if you utilize key-value calls then each request goes to a specific node. If you're on SQL then a query might be broadcasted or sent to a specific node as well.
>
> Overall, yes, Ignite is the right solution if you need to scale and accelerate performance.
>
> --
> Denis
>
> On Tue, Nov 6, 2018 at 6:55 AM Alejandro Santos <al...@gmail.com> wrote:
>>
>> Hi all,
>>
>> I've been reading the Ignite documentation and have some technical
>> questions. I need to evaluate massive storage systems for some
>> specific application and I would like to understand how ignite works.
>>
>> My application needs a buffering space that write arbitrary values,
>> but then reads on average half of the values at most once. This is a
>> random process, and we can't really predict which keys will be read.
>>
>> Is ignite the right tool for this application? Do you need more information?
>>
>> Thank you,
>>
>> --
>> Alejandro Santos
--
Alejandro Santos
Re: How does Ignite provides load balancing?
Posted by Denis Magda <dm...@apache.org>.
Hi,
In general, the load is balanced because the data is distributed evenly
across a cluster of machines. For instance, if you utilize key-value calls
then each request goes to a specific node. If you're on SQL then a query
might be broadcasted or sent to a specific node as well.
Overall, yes, Ignite is the right solution if you need to scale and
accelerate performance.
--
Denis
On Tue, Nov 6, 2018 at 6:55 AM Alejandro Santos <al...@gmail.com> wrote:
> Hi all,
>
> I've been reading the Ignite documentation and have some technical
> questions. I need to evaluate massive storage systems for some
> specific application and I would like to understand how ignite works.
>
> My application needs a buffering space that write arbitrary values,
> but then reads on average half of the values at most once. This is a
> random process, and we can't really predict which keys will be read.
>
> Is ignite the right tool for this application? Do you need more
> information?
>
> Thank you,
>
> --
> Alejandro Santos
>