You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Apache Spark (JIRA)" <ji...@apache.org> on 2019/04/27 13:43:00 UTC
[jira] [Commented] (SPARK-27583) Optimize strongly connected
components
[ https://issues.apache.org/jira/browse/SPARK-27583?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16827606#comment-16827606 ]
Apache Spark commented on SPARK-27583:
--------------------------------------
User 'jmzhoulab' has created a pull request for this issue:
https://github.com/apache/spark/pull/24479
> Optimize strongly connected components
> --------------------------------------
>
> Key: SPARK-27583
> URL: https://issues.apache.org/jira/browse/SPARK-27583
> Project: Spark
> Issue Type: Improvement
> Components: GraphX
> Affects Versions: 2.4.2
> Reporter: jiamuzhou
> Priority: Major
> Attachments: image-2019-04-27-20-06-31-587.png
>
>
> Currently, when I use function of strongly connected components in graph (0.1billion vertices and 0.15 billion edges) found that memory storage of RDDs is growing during the iteration, which lead to running very slow or failure of the job.
>
> !image-2019-04-27-20-06-31-587.png!
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org