You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Joe L <se...@yahoo.com> on 2014/04/25 14:38:03 UTC

read file from hdfs

I have just 2 two questions?

sc.textFile("hdfs://host:port/user/matei/whatever.txt")

Is host master node?
What port we should use?




--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/read-file-from-hdfs-tp4824.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

Re: read file from hdfs

Posted by Christophe Préaud <ch...@kelkoo.com>.

You should use the values defined in the 'fs.defaultFS' property (in hadoop
core-site.xml file).

Christophe.

On 25/04/2014 14:38, Joe L wrote:
> I have just 2 two questions?
>
> sc.textFile("hdfs://host:port/user/matei/whatever.txt")
>
> Is host master node?
> What port we should use?
>
>
>
>
> --
> View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/read-file-from-hdfs-tp4824.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.

Kelkoo SAS
Société par Actions Simplifiée
Au capital de € 4.168.964,30
Siège social : 8, rue du Sentier 75002 Paris
425 093 069 RCS Paris

Ce message et les pièces jointes sont confidentiels et établis à l'attention exclusive de leurs destinataires. Si vous n'êtes pas le destinataire de ce message, merci de le détruire et d'en avertir l'expéditeur.