You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Dongjoon Hyun (JIRA)" <ji...@apache.org> on 2019/07/16 16:42:14 UTC

[jira] [Updated] (SPARK-27583) Optimize strongly connected components

     [ https://issues.apache.org/jira/browse/SPARK-27583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dongjoon Hyun updated SPARK-27583:
----------------------------------
    Affects Version/s:     (was: 2.4.2)
                       3.0.0

> Optimize strongly connected components
> --------------------------------------
>
>                 Key: SPARK-27583
>                 URL: https://issues.apache.org/jira/browse/SPARK-27583
>             Project: Spark
>          Issue Type: Improvement
>          Components: GraphX
>    Affects Versions: 3.0.0
>            Reporter: jiamuzhou
>            Priority: Major
>         Attachments: image-2019-04-27-20-06-31-587.png
>
>
> Currently, when I use function of strongly connected components in graph (0.1billion vertices and 0.15 billion edges) found that memory storage of RDDs is growing during the iteration, which lead to running very slow or failure of the job.
>  
> !image-2019-04-27-20-06-31-587.png!



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org