You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by kathleen li <ka...@gmail.com> on 2018/09/14 14:26:55 UTC

What is the best way for Spark to read HDF5@scale?

Hi,
Any Spark-connector for HDF5?

The following link does not work anymore?

https://www.hdfgroup.org/downloads/spark-connector/
down vo

Thanks,

Kathleen

Re: What is the best way for Spark to read HDF5@scale?

Posted by Saurav Sinha <sa...@gmail.com>.

Here is the solution

sc.textFile("hdfs://nn1home:8020/input/war-and-peace.txt")

How did I find out nn1home:8020?

Just search for the file core-site.xml and look for xml element fs.defaultFS

On Fri, Sep 14, 2018 at 7:57 PM kathleen li <ka...@gmail.com> wrote:

> Hi,
> Any Spark-connector for HDF5?
>
> The following link does not work anymore?
>
> https://www.hdfgroup.org/downloads/spark-connector/
> down vo
>
> Thanks,
>
> Kathleen
>


-- 
Thanks and Regards,

Saurav Sinha

Contact: 9742879062