You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Peter Liu (JIRA)" <ji...@apache.org> on 2016/07/16 20:06:20 UTC
[jira] [Updated] (SPARK-16332) the history server of
spark2.0-preview (may-24 build) consumes more than 1000% cpu
[ https://issues.apache.org/jira/browse/SPARK-16332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Peter Liu updated SPARK-16332:
------------------------------
Attachment: graycol.gif
Hi Sean,
I have a general question:
Is there a limit for reporting issues?
I was able to create the current two issue tickets with a link under "my
open issues" tab (using this JIRA service) "Try modifying your search
criteria or creating a new issue".
However, this link "creating a new issue" has now disappeared under "my
open issues" tab.
Thanks for any information/help.
Best Regards,
Peter G. Liu
STG Power System Performance
IBM Toronto Lab
Phone: 905-413-3132
email: gliu@ca.ibm.com
From: "Sean Owen (JIRA)" <ji...@apache.org>
To: Gang L Liu/Toronto/IBM@IBMCA
Date: 06/30/2016 04:00 PM
Subject: [jira] [Commented] (SPARK-16332) the history server of
spark2.0-preview (may-24 build) consumes more than 1000% cpu
[
https://issues.apache.org/jira/browse/SPARK-16332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15357759#comment-15357759
]
Sean Owen commented on SPARK-16332:
-----------------------------------
I'm not sure that's an issue per se. It might consume a lot at startup, or
when processing lots of events. Or if under GC load. Without more detail
it's hard to say that's a problem.
1000% cpu
----------------------------------------------------------------------------------
E5-2699 ) and ppc platform IBM Power8 Habanero (Model: 8348-21C), Red Hat
Enterprise Linux Server release 7.2 (Maipo), Spark2.0.0-preview (May-24,
2016)
build) consumes more than 1000% cpu without the spark standalone cluster
(of 6 nodes) being under load.
instance of the Spark history server of spark2.0-preview consumes 2000% cpu
(as seen with "top" on linux 3.10)
issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
> the history server of spark2.0-preview (may-24 build) consumes more than 1000% cpu
> ----------------------------------------------------------------------------------
>
> Key: SPARK-16332
> URL: https://issues.apache.org/jira/browse/SPARK-16332
> Project: Spark
> Issue Type: Bug
> Components: Spark Core
> Affects Versions: 2.0.0
> Environment: this is seen on both x86 (Intel(R) Xeon(R), E5-2699 ) and ppc platform IBM Power8 Habanero (Model: 8348-21C), Red Hat Enterprise Linux Server release 7.2 (Maipo), Spark2.0.0-preview (May-24, 2016)
> Reporter: Peter Liu
> Attachments: graycol.gif
>
>
> the JVM instance of the Spark history server of spark2.0-preview (may-24 build) consumes more than 1000% cpu without the spark standalone cluster (of 6 nodes) being under load.
> When under load (1TB input data for a SQL query scenario), the JVM instance of the Spark history server of spark2.0-preview consumes 2000% cpu (as seen with "top" on linux 3.10)
> Note: can't see a proper Component selection here, surely not a Web GUI issue.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org