You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Pradeep Badiger <Pr...@fico.com> on 2016/10/14 16:01:22 UTC
Improve performance of ignite cluster
Hi,
I am seeing a big drop in performance when more two or more ignite instances embedded within JVMs form a cluster. The throughput I get is 1/10 of what I used to get when working with only one embedded ignite instance inside the application.
Can anyone help me in tuning this thing?
Thanks,
Pradeep V.B.
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
RE: Improve performance of ignite cluster
Posted by Pradeep Badiger <Pr...@fico.com>.
Thanks Andrey.
From: Andrey Kornev [mailto:andrewkornev@hotmail.com]
Sent: Friday, October 14, 2016 12:45 PM
To: user@ignite.apache.org
Subject: Re: Improve performance of ignite cluster
Pradeep,
Even though you did not provide any details on how you measure the throughout, I think the drop is expected. It is because as soon as a second (and the third and so on) node joins the Ignite cluster, most of Ignite operations become distributed and involve remote calls.
There are ways to minimize the performance impact -- for example, ensuring that the processing is colocated with the data to be processed as opposed to bring the data to a single processing node, etc -- but in all cases it's very application specific.
Regards
Andrey
________________________________
From: Pradeep Badiger <Pr...@fico.com>>
Sent: Friday, October 14, 2016 9:23 AM
To: user@ignite.apache.org<ma...@ignite.apache.org>
Subject: RE: Improve performance of ignite cluster
No, I mean I have one ignite instance running in one JVM and there are several application JVMs that have one embedded instance on each of them and they all talk to each other.
From: Alexey Kuznetsov [mailto:akuznetsov@apache.org]
Sent: Friday, October 14, 2016 12:20 PM
To: user@ignite.apache.org<ma...@ignite.apache.org>
Subject: Re: Improve performance of ignite cluster
Hi Pradeep,
Why did you start several Ignite instances in one JVM?
AFAIK it is recommended only for testing.
In production it is recommended to start separate JVMs.
On Fri, Oct 14, 2016 at 11:01 PM, Pradeep Badiger <Pr...@fico.com>> wrote:
Hi,
I am seeing a big drop in performance when more two or more ignite instances embedded within JVMs form a cluster. The throughput I get is 1/10 of what I used to get when working with only one embedded ignite instance inside the application.
Can anyone help me in tuning this thing?
Thanks,
Pradeep V.B.
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
--
Alexey Kuznetsov
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
Re: Improve performance of ignite cluster
Posted by Andrey Kornev <an...@hotmail.com>.
Pradeep,
Even though you did not provide any details on how you measure the throughout, I think the drop is expected. It is because as soon as a second (and the third and so on) node joins the Ignite cluster, most of Ignite operations become distributed and involve remote calls.
There are ways to minimize the performance impact -- for example, ensuring that the processing is colocated with the data to be processed as opposed to bring the data to a single processing node, etc -- but in all cases it's very application specific.
Regards
Andrey
________________________________
From: Pradeep Badiger <Pr...@fico.com>
Sent: Friday, October 14, 2016 9:23 AM
To: user@ignite.apache.org
Subject: RE: Improve performance of ignite cluster
No, I mean I have one ignite instance running in one JVM and there are several application JVMs that have one embedded instance on each of them and they all talk to each other.
From: Alexey Kuznetsov [mailto:akuznetsov@apache.org]
Sent: Friday, October 14, 2016 12:20 PM
To: user@ignite.apache.org
Subject: Re: Improve performance of ignite cluster
Hi Pradeep,
Why did you start several Ignite instances in one JVM?
AFAIK it is recommended only for testing.
In production it is recommended to start separate JVMs.
On Fri, Oct 14, 2016 at 11:01 PM, Pradeep Badiger <Pr...@fico.com>> wrote:
Hi,
I am seeing a big drop in performance when more two or more ignite instances embedded within JVMs form a cluster. The throughput I get is 1/10 of what I used to get when working with only one embedded ignite instance inside the application.
Can anyone help me in tuning this thing?
Thanks,
Pradeep V.B.
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
--
Alexey Kuznetsov
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
RE: Improve performance of ignite cluster
Posted by Pradeep Badiger <Pr...@fico.com>.
No, I mean I have one ignite instance running in one JVM and there are several application JVMs that have one embedded instance on each of them and they all talk to each other.
From: Alexey Kuznetsov [mailto:akuznetsov@apache.org]
Sent: Friday, October 14, 2016 12:20 PM
To: user@ignite.apache.org
Subject: Re: Improve performance of ignite cluster
Hi Pradeep,
Why did you start several Ignite instances in one JVM?
AFAIK it is recommended only for testing.
In production it is recommended to start separate JVMs.
On Fri, Oct 14, 2016 at 11:01 PM, Pradeep Badiger <Pr...@fico.com>> wrote:
Hi,
I am seeing a big drop in performance when more two or more ignite instances embedded within JVMs form a cluster. The throughput I get is 1/10 of what I used to get when working with only one embedded ignite instance inside the application.
Can anyone help me in tuning this thing?
Thanks,
Pradeep V.B.
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
--
Alexey Kuznetsov
This email and any files transmitted with it are confidential, proprietary and intended solely for the individual or entity to whom they are addressed. If you have received this email in error please delete it immediately.
Re: Improve performance of ignite cluster
Posted by Alexey Kuznetsov <ak...@apache.org>.
Hi Pradeep,
Why did you start several Ignite instances in one JVM?
AFAIK it is recommended only for testing.
In production it is recommended to start separate JVMs.
On Fri, Oct 14, 2016 at 11:01 PM, Pradeep Badiger <Pr...@fico.com>
wrote:
> Hi,
>
>
>
> I am seeing a big drop in performance when more two or more ignite
> instances embedded within JVMs form a cluster. The throughput I get is 1/10
> of what I used to get when working with only one embedded ignite instance
> inside the application.
>
>
>
> Can anyone help me in tuning this thing?
>
>
>
> Thanks,
> Pradeep V.B.
> This email and any files transmitted with it are confidential, proprietary
> and intended solely for the individual or entity to whom they are
> addressed. If you have received this email in error please delete it
> immediately.
>
--
Alexey Kuznetsov