You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Kayode Odeyemi <dr...@gmail.com> on 2015/10/26 14:58:34 UTC

Loading binary files from NFS share

Hi,

Is it possible to load binary files from NFS share like this:

sc.binaryFiles("nfs://host/mountpath")

I understand that it takes a path, but want to know if it allows protocol.

Appreciate your help.

RE: Loading binary files from NFS share

Posted by Andrianasolo Fanilo <fa...@worldline.com>.

Hi,

I believe binaryFiles uses a custom Hadoop Input Format, so it can only read specific Hadoop protocols.

You can find the full list of supported protocols by typing “Hadoop filesystems hdfs hftp” in Google (the link I found is a little bit long and references the Hadoop Definitive Guide, but here it is shortened ☺ : http://bit.ly/1PNWEeN, I couldn’t find a more direct link to the Hadoop website or Wiki though).

I will assume that nfs is not possible given this list.

Best Regards,

Fanilo

De : Kayode Odeyemi [mailto:dreyemi@gmail.com]
Envoyé : lundi 26 octobre 2015 14:59
À : user
Objet : Loading binary files from NFS share

Hi,

Is it possible to load binary files from NFS share like this:

sc.binaryFiles("nfs://host/mountpath")

I understand that it takes a path, but want to know if it allows protocol.

Appreciate your help.

________________________________

Ce message et les pièces jointes sont confidentiels et réservés à l'usage exclusif de ses destinataires. Il peut également être protégé par le secret professionnel. Si vous recevez ce message par erreur, merci d'en avertir immédiatement l'expéditeur et de le détruire. L'intégrité du message ne pouvant être assurée sur Internet, la responsabilité de Worldline ne pourra être recherchée quant au contenu de ce message. Bien que les meilleurs efforts soient faits pour maintenir cette transmission exempte de tout virus, l'expéditeur ne donne aucune garantie à cet égard et sa responsabilité ne saurait être recherchée pour tout dommage résultant d'un virus transmis.

This e-mail and the documents attached are confidential and intended solely for the addressee; it may also be privileged. If you receive this e-mail in error, please notify the sender immediately and destroy it. As its integrity cannot be secured on the Internet, the Worldline liability cannot be triggered for the message content. Although the sender endeavours to maintain a computer virus-free network, the sender does not warrant that this transmission is virus-free and will not be liable for any damages resulting from any virus transmitted.