You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Santoshakhilesh <sa...@huawei.com> on 2016/06/06 01:39:26 UTC
RE: GraphX Java API
Ok , thanks for letting me know. Yes Since Java and scala programs ultimately runs on JVM. So the APIs written in one language can be called from other.
When I had used GraphX (around 2015 beginning) the Java Native APIs were not available for GraphX.
So I chose to develop my application in scala and it turned out much simpler to develop in scala due to some of its powerful functions like lambda , map , filter etc… which were not available to me in Java 7.
Regards,
Santosh Akhilesh
From: Sonal Goyal [mailto:sonalgoyal4@gmail.com]
Sent: 01 June 2016 00:56
To: Santoshakhilesh
Cc: Kumar, Abhishek (US - Bengaluru); user@spark.apache.org; Golatkar, Jayesh (US - Bengaluru); Soni, Akhil Dharamprakash (US - Bengaluru); Matta, Rishul (US - Bengaluru); Aich, Risha (US - Bengaluru); Kumar, Rajinish (US - Bengaluru); Jain, Isha (US - Bengaluru); Kumar, Sandeep (US - Bengaluru)
Subject: Re: GraphX Java API
Its very much possible to use GraphX through Java, though some boilerplate may be needed. Here is an example.
Create a graph from edge and vertex RDD (JavaRDD<Tuple2<Object, Long>> vertices, JavaRDD<Edge<Long>> edges )
<code>
ClassTag longTag = scala.reflect.ClassTag$.MODULE$.apply(Long.class);
Graph<Long,Float> graph = Graph.apply(vertices.rdd(),
edges.rdd(), 0L, StorageLevel.MEMORY_ONLY(), StorageLevel.MEMORY_ONLY(),
longTag, longTag);
</code>
Then basically you can call graph.ops() and do available operations like triangleCounting etc,
Best Regards,
Sonal
Founder, Nube Technologies<http://www.nubetech.co>
Reifier at Strata Hadoop World<https://www.youtube.com/watch?v=eD3LkpPQIgM>
Reifier at Spark Summit 2015<https://spark-summit.org/2015/events/real-time-fuzzy-matching-with-spark-and-elastic-search/>
On Tue, May 31, 2016 at 11:40 AM, Santoshakhilesh <sa...@huawei.com>> wrote:
Hi ,
Scala has similar package structure as java and finally it runs on JVM so probably you get an impression that its in Java.
As far as I know there are no Java API for GraphX. I had used GraphX last year and at that time I had to code in Scala to use the GraphX APIs.
Regards,
Santosh Akhilesh
From: Kumar, Abhishek (US - Bengaluru) [mailto:abhishekkumar42@deloitte.com<ma...@deloitte.com>]
Sent: 30 May 2016 13:24
To: Santoshakhilesh; user@spark.apache.org<ma...@spark.apache.org>
Cc: Golatkar, Jayesh (US - Bengaluru); Soni, Akhil Dharamprakash (US - Bengaluru); Matta, Rishul (US - Bengaluru); Aich, Risha (US - Bengaluru); Kumar, Rajinish (US - Bengaluru); Jain, Isha (US - Bengaluru); Kumar, Sandeep (US - Bengaluru)
Subject: RE: GraphX Java API
Hey,
• I see some graphx packages listed here:
http://spark.apache.org/docs/latest/api/java/index.html
• org.apache.spark.graphx<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/package-frame.html>
• org.apache.spark.graphx.impl<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/impl/package-frame.html>
• org.apache.spark.graphx.lib<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/lib/package-frame.html>
• org.apache.spark.graphx.util<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/util/package-frame.html>
Aren’t they meant to be used with JAVA?
Thanks
From: Santoshakhilesh [mailto:santosh.akhilesh@huawei.com]
Sent: Friday, May 27, 2016 4:52 PM
To: Kumar, Abhishek (US - Bengaluru) <ab...@deloitte.com>>; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: GraphX Java API
GraphX APis are available only in Scala. If you need to use GraphX you need to switch to Scala.
From: Kumar, Abhishek (US - Bengaluru) [mailto:abhishekkumar42@deloitte.com]
Sent: 27 May 2016 19:59
To: user@spark.apache.org<ma...@spark.apache.org>
Subject: GraphX Java API
Hi,
We are trying to consume the Java API for GraphX, but there is no documentation available online on the usage or examples. It would be great if we could get some examples in Java.
Thanks and regards,
Abhishek Kumar
This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and any disclosure, copying, or distribution of this message, or the taking of any action based on it, by you is strictly prohibited.
v.E.1
RE: GraphX Java API
Posted by Felix Cheung <fe...@hotmail.com>.
You might want to check out GraphFrames
graphframes.github.io
On Sun, Jun 5, 2016 at 6:40 PM -0700, "Santoshakhilesh" <sa...@huawei.com> wrote:
Ok , thanks for letting me know. Yes Since Java and scala programs ultimately runs on JVM. So the APIs written in one language can be called from other.
When I had used GraphX (around 2015 beginning) the Java Native APIs were not available for GraphX.
So I chose to develop my application in scala and it turned out much simpler to develop in scala due to some of its powerful functions like lambda , map , filter etc… which were not available to me in Java 7.
Regards,
Santosh Akhilesh
From: Sonal Goyal [mailto:sonalgoyal4@gmail.com]
Sent: 01 June 2016 00:56
To: Santoshakhilesh
Cc: Kumar, Abhishek (US - Bengaluru); user@spark.apache.org; Golatkar, Jayesh (US - Bengaluru); Soni, Akhil Dharamprakash (US - Bengaluru); Matta, Rishul (US - Bengaluru); Aich, Risha (US - Bengaluru); Kumar, Rajinish (US - Bengaluru); Jain, Isha (US - Bengaluru); Kumar, Sandeep (US - Bengaluru)
Subject: Re: GraphX Java API
Its very much possible to use GraphX through Java, though some boilerplate may be needed. Here is an example.
Create a graph from edge and vertex RDD (JavaRDD<Tuple2<Object, Long>> vertices, JavaRDD<Edge<Long>> edges )
<code>
ClassTag longTag = scala.reflect.ClassTag$.MODULE$.apply(Long.class);
Graph<Long,Float> graph = Graph.apply(vertices.rdd(),
edges.rdd(), 0L, StorageLevel.MEMORY_ONLY(), StorageLevel.MEMORY_ONLY(),
longTag, longTag);
</code>
Then basically you can call graph.ops() and do available operations like triangleCounting etc,
Best Regards,
Sonal
Founder, Nube Technologies<http://www.nubetech.co>
Reifier at Strata Hadoop World<https://www.youtube.com/watch?v=eD3LkpPQIgM>
Reifier at Spark Summit 2015<https://spark-summit.org/2015/events/real-time-fuzzy-matching-with-spark-and-elastic-search/>
On Tue, May 31, 2016 at 11:40 AM, Santoshakhilesh <sa...@huawei.com>> wrote:
Hi ,
Scala has similar package structure as java and finally it runs on JVM so probably you get an impression that its in Java.
As far as I know there are no Java API for GraphX. I had used GraphX last year and at that time I had to code in Scala to use the GraphX APIs.
Regards,
Santosh Akhilesh
From: Kumar, Abhishek (US - Bengaluru) [mailto:abhishekkumar42@deloitte.com<ma...@deloitte.com>]
Sent: 30 May 2016 13:24
To: Santoshakhilesh; user@spark.apache.org<ma...@spark.apache.org>
Cc: Golatkar, Jayesh (US - Bengaluru); Soni, Akhil Dharamprakash (US - Bengaluru); Matta, Rishul (US - Bengaluru); Aich, Risha (US - Bengaluru); Kumar, Rajinish (US - Bengaluru); Jain, Isha (US - Bengaluru); Kumar, Sandeep (US - Bengaluru)
Subject: RE: GraphX Java API
Hey,
• I see some graphx packages listed here:
http://spark.apache.org/docs/latest/api/java/index.html
• org.apache.spark.graphx<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/package-frame.html>
• org.apache.spark.graphx.impl<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/impl/package-frame.html>
• org.apache.spark.graphx.lib<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/lib/package-frame.html>
• org.apache.spark.graphx.util<http://spark.apache.org/docs/latest/api/java/org/apache/spark/graphx/util/package-frame.html>
Aren’t they meant to be used with JAVA?
Thanks
From: Santoshakhilesh [mailto:santosh.akhilesh@huawei.com]
Sent: Friday, May 27, 2016 4:52 PM
To: Kumar, Abhishek (US - Bengaluru) <ab...@deloitte.com>>; user@spark.apache.org<ma...@spark.apache.org>
Subject: RE: GraphX Java API
GraphX APis are available only in Scala. If you need to use GraphX you need to switch to Scala.
From: Kumar, Abhishek (US - Bengaluru) [mailto:abhishekkumar42@deloitte.com]
Sent: 27 May 2016 19:59
To: user@spark.apache.org<ma...@spark.apache.org>
Subject: GraphX Java API
Hi,
We are trying to consume the Java API for GraphX, but there is no documentation available online on the usage or examples. It would be great if we could get some examples in Java.
Thanks and regards,
Abhishek Kumar
This message (including any attachments) contains confidential information intended for a specific individual and purpose, and is protected by law. If you are not the intended recipient, you should delete this message and any disclosure, copying, or distribution of this message, or the taking of any action based on it, by you is strictly prohibited.
v.E.1