You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by Shawn Du <sh...@neulion.com.cn> on 2017/01/18 10:42:52 UTC

答复: how to increase CPU utilization to increase compute performance

This is the configuration. All just default.

 

<property name="discoverySpi">

            <bean class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">

                <property name="ipFinder">

                    <bean class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">

                        <property name="addresses">

                            <list>

                                <value>localhost:47500..47509</value>

                            </list>

                        </property>

                    </bean>

                </property>

            </bean>

        </property>

 

When running the job, both IO and CPU load are very low. 

Now I am testing split less jobs. Also tune the publicThreadPoolSize.  It seems that splitting less jobs has positive effect.

Tune the publicThreadPoolSize high has negative effect.  Please confirm and give suggestions.

 

Thanks

Shawn

 

发件人: Artem Schitow [mailto:artem.schitow@gmail.com] 
发送时间: 2017年1月18日 18:08
收件人: user@ignite.apache.org
主题: Re: how to increase CPU utilization to increase compute performance

 

Hi, Shawn!

 

Can you please attach you Ignite configuration? What are your disk I/O load and CPU load when you’re running the job?


—

Artem Schitow

artem.schitow@gmail.com <ma...@gmail.com> 

 

 

 

On 18 Jan 2017, at 13:02, Shawn Du <shawn.du@neulion.com.cn <ma...@neulion.com.cn> > wrote:

 

Hi, 

 

I have a task to compute on ignite. My Service has 8 cores. I split the task into more than 1K jobs and merge the result.

From client see, the task run more than 3 seconds, and sometimes more than 10 seconds. The ignite server load is very slow.

I wonder to know how to increase the CPU utilization to increase the performance?

 

Thanks

Shawn

Re: 答复: how to increase CPU utilization to increase compute performance

Posted by Vladislav Pyatkov <vl...@gmail.com>.
Hi,

If you want to estimate a reason you need to use profile and after make a
conclusion.

You should to check your application (using flight recorder[1] for example)
and make a investigation where are threads stopping. How long do threads
spend time in parking state? What is reason of this?

[1]:
https://apacheignite.readme.io/docs/jvm-and-system-tuning#section-detailed-garbage-collection-stats

On Wed, Jan 18, 2017 at 1:42 PM, Shawn Du <sh...@neulion.com.cn> wrote:

> This is the configuration. All just default.
>
>
>
> <property name="discoverySpi">
>
>             <bean class="org.apache.ignite.spi.
> discovery.tcp.TcpDiscoverySpi">
>
>                 <property name="ipFinder">
>
>                     <bean class="org.apache.ignite.spi.
> discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
>
>                         <property name="addresses">
>
>                             <list>
>
>                                 <value>localhost:47500..47509</value>
>
>                             </list>
>
>                         </property>
>
>                     </bean>
>
>                 </property>
>
>             </bean>
>
>         </property>
>
>
>
> When running the job, both IO and CPU load are very low.
>
> Now I am testing split less jobs. Also tune the publicThreadPoolSize.  It
> seems that splitting less jobs has positive effect.
>
> Tune the publicThreadPoolSize high has negative effect.  Please confirm
> and give suggestions.
>
>
>
> Thanks
>
> Shawn
>
>
>
> *发件人:* Artem Schitow [mailto:artem.schitow@gmail.com]
> *发送时间:* 2017年1月18日 18:08
> *收件人:* user@ignite.apache.org
> *主题:* Re: how to increase CPU utilization to increase compute performance
>
>
>
> Hi, Shawn!
>
>
>
> Can you please attach you Ignite configuration? What are your disk I/O
> load and CPU load when you’re running the job?
>
>
> —
>
> Artem Schitow
>
> artem.schitow@gmail.com
>
>
>
>
>
>
>
> On 18 Jan 2017, at 13:02, Shawn Du <sh...@neulion.com.cn> wrote:
>
>
>
> Hi,
>
>
>
> I have a task to compute on ignite. My Service has 8 cores. I split the
> task into more than 1K jobs and merge the result.
>
> From client see, the task run more than 3 seconds, and sometimes more than
> 10 seconds. The ignite server load is very slow.
>
> I wonder to know how to increase the CPU utilization to increase the
> performance?
>
>
>
> Thanks
>
> Shawn
>
>
>



-- 
Vladislav Pyatkov