You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@graphar.apache.org by Muniraju Pulipalyam <mu...@hotmail.com> on 2024/07/28 14:09:17 UTC

Persisting GraphAr to S3 object store

Hello,

 Is there any sample that shows storing/retrieving GraphAr graphs to/from S3 or Minio or other object stores?

Thanks,
Muni

Re: Persisting GraphAr to S3 object store

Posted by Zhe Wang <sp...@apache.org>.

Hello, there is a test case about S3 for C++ library, maybe that is what you need:

https://github.com/apache/incubator-graphar/blob/c7450037b92065d6d1f3ff9c3e59458c716592d3/cpp/test/test_info.cc#L777-L790

Best,
John

On 2024/07/28 14:09:17 Muniraju Pulipalyam wrote:
> Hello,
> 
>  Is there any sample that shows storing/retrieving GraphAr graphs to/from S3 or Minio or other object stores?
> 
> Thanks,
> Muni
> 

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@graphar.apache.org
For additional commands, e-mail: dev-help@graphar.apache.org

Re: Persisting GraphAr to S3 object store

Posted by Muniraju Pulipalyam <mu...@hotmail.com>.

Thanks Sem. I am currently working on C++ library. Is that supported to work with S3?


________________________________
From: Sem <ss...@apache.org>
Sent: Sunday, July 28, 2024 7:49 PM
To: dev@graphar.apache.org <de...@graphar.apache.org>
Subject: Re: Persisting GraphAr to S3 object store

At the moment, GraphAr scala is based on Apache Spark, so you can check
the documentation of Spark, related to working with cloud file systems:

https://na01.safelinks.protection.outlook.com/?url=https%3A%2F%2Fspark.apache.org%2Fdocs%2Flatest%2Fcloud-integration.html%23committing-work-into-cloud-storage-safely-and-fast&data=05%7C02%7C%7C5c6d6682291d4f7a6e0708dcaf1057a4%7C84df9e7fe9f640afb435aaaaaaaaaaaa%7C1%7C0%7C638577731930247309%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C0%7C%7C%7C&sdata=Z2HhMIu7klYR5x25byOroKytsxSkZmPUeSSt9kCrZ7Y%3D&reserved=0<https://spark.apache.org/docs/latest/cloud-integration.html#committing-work-into-cloud-storage-safely-and-fast>

On Sun, 2024-07-28 at 14:09 +0000, Muniraju Pulipalyam wrote:
> Hello,
>
>  Is there any sample that shows storing/retrieving GraphAr graphs
> to/from S3 or Minio or other object stores?
>
> Thanks,
> Muni


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@graphar.apache.org
For additional commands, e-mail: dev-help@graphar.apache.org

Re: Persisting GraphAr to S3 object store

Posted by Sem <ss...@apache.org>.

At the moment, GraphAr scala is based on Apache Spark, so you can check
the documentation of Spark, related to working with cloud file systems:

https://spark.apache.org/docs/latest/cloud-integration.html#committing-work-into-cloud-storage-safely-and-fast

On Sun, 2024-07-28 at 14:09 +0000, Muniraju Pulipalyam wrote:
> Hello,
> 
>  Is there any sample that shows storing/retrieving GraphAr graphs
> to/from S3 or Minio or other object stores?
> 
> Thanks,
> Muni


---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@graphar.apache.org
For additional commands, e-mail: dev-help@graphar.apache.org