You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Jason Hong <be...@gmail.com> on 2014/12/30 14:27:03 UTC

Is it possible to store graph directly into HDFS?

Dear all:)

We're trying to make a graph using large input data and get a subgraph
applied some filter.

Now, we wanna save this graph to HDFS so that we can load later.

Is it possible to store graph or subgraph directly into HDFS and load it as
a graph for future use?

We will be glad for your suggestion.

Best regards.

Jason Hong







--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-it-possible-to-store-graph-directly-into-HDFS-tp20908.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org

Re: Is it possible to store graph directly into HDFS?

Posted by Jason Hong <be...@gmail.com>.

Thanks for your answer, Xuefeng Wu.

But, I don't understand how to save a graph as object. :(

Do you have any sample codes?

2014-12-31 13:27 GMT+09:00 Jason Hong <be...@gmail.com>:

> Thanks for your answer, Xuefeng Wu.
>
> But, I don't understand how to save a graph as object. :(
>
> Do you have any sample codes?
>
> Jason Hong
>
> 2014-12-30 22:31 GMT+09:00 Xuefeng Wu <be...@gmail.com>:
>
>> how about save as object?
>>
>>
>> Yours, Xuefeng Wu 吴雪峰 敬上
>>
>> > On 2014年12月30日, at 下午9:27, Jason Hong <be...@gmail.com> wrote:
>> >
>> > Dear all:)
>> >
>> > We're trying to make a graph using large input data and get a subgraph
>> > applied some filter.
>> >
>> > Now, we wanna save this graph to HDFS so that we can load later.
>> >
>> > Is it possible to store graph or subgraph directly into HDFS and load
>> it as
>> > a graph for future use?
>> >
>> > We will be glad for your suggestion.
>> >
>> > Best regards.
>> >
>> > Jason Hong
>> >
>> >
>> >
>> >
>> >
>> >
>> >
>> > --
>> > View this message in context:
>> http://apache-spark-user-list.1001560.n3.nabble.com/Is-it-possible-to-store-graph-directly-into-HDFS-tp20908.html
>> > Sent from the Apache Spark User List mailing list archive at Nabble.com.
>> >
>> > ---------------------------------------------------------------------
>> > To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> > For additional commands, e-mail: user-help@spark.apache.org
>> >
>>
>
>

Re: Is it possible to store graph directly into HDFS?

Posted by Xuefeng Wu <be...@gmail.com>.

how about save as object?


Yours, Xuefeng Wu 吴雪峰 敬上

> On 2014年12月30日, at 下午9:27, Jason Hong <be...@gmail.com> wrote:
> 
> Dear all:)
> 
> We're trying to make a graph using large input data and get a subgraph
> applied some filter.
> 
> Now, we wanna save this graph to HDFS so that we can load later.
> 
> Is it possible to store graph or subgraph directly into HDFS and load it as
> a graph for future use?
> 
> We will be glad for your suggestion.
> 
> Best regards.
> 
> Jason Hong
> 
> 
> 
> 
> 
> 
> 
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Is-it-possible-to-store-graph-directly-into-HDFS-tp20908.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
> 
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org