You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@zeppelin.apache.org by IT CTO <go...@gmail.com> on 2015/10/20 09:49:41 UTC
How to access files on hdfs
Hi,
I am using zeppelin to access files on hdfs
var myRDD = sc.textFile("hdfs://*nameserive1*:8020/data/myfile.txt")
This method works perfectly on spark-shell, also no problem accessing the
file using hadool CLI
hadoop fs -ls hdfs://*nameserive1*:8020/data/myfile.txt
but on zeppelin return an error:
*UnknownHostException nameservice1*
What is wrong here?
Eran
--
Eran | "You don't need eyes to see, you need vision" (Faithless)
Re: How to access files on hdfs
Posted by IT CTO <go...@gmail.com>.
Hi,
I just updated to the latest version and now I have nameservice1 working in
zeppelin as well.
Thanks
On Tue, Oct 20, 2015 at 1:28 PM tog <gu...@gmail.com> wrote:
> Hi Eran
>
> There are typo in your example above.
> Are you sure nameservice1 is accessible from all your machines ?
>
> Cheers
> Guillaume
>
> On 20 October 2015 at 08:49, IT CTO <go...@gmail.com> wrote:
>
>> Hi,
>> I am using zeppelin to access files on hdfs
>>
>> var myRDD = sc.textFile("hdfs://*nameserive1*:8020/data/myfile.txt")
>> This method works perfectly on spark-shell, also no problem accessing the
>> file using hadool CLI
>> hadoop fs -ls hdfs://*nameserive1*:8020/data/myfile.txt
>>
>> but on zeppelin return an error:
>> *UnknownHostException nameservice1*
>>
>> What is wrong here?
>> Eran
>> --
>> Eran | "You don't need eyes to see, you need vision" (Faithless)
>>
>
>
>
> --
> PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net
>
--
Eran | "You don't need eyes to see, you need vision" (Faithless)
Re: How to access files on hdfs
Posted by IT CTO <go...@gmail.com>.
Hi,
I just updated to the latest version and now I have nameservice1 working in
zeppelin as well.
Thanks
On Tue, Oct 20, 2015 at 1:28 PM tog <gu...@gmail.com> wrote:
> Hi Eran
>
> There are typo in your example above.
> Are you sure nameservice1 is accessible from all your machines ?
>
> Cheers
> Guillaume
>
> On 20 October 2015 at 08:49, IT CTO <go...@gmail.com> wrote:
>
>> Hi,
>> I am using zeppelin to access files on hdfs
>>
>> var myRDD = sc.textFile("hdfs://*nameserive1*:8020/data/myfile.txt")
>> This method works perfectly on spark-shell, also no problem accessing the
>> file using hadool CLI
>> hadoop fs -ls hdfs://*nameserive1*:8020/data/myfile.txt
>>
>> but on zeppelin return an error:
>> *UnknownHostException nameservice1*
>>
>> What is wrong here?
>> Eran
>> --
>> Eran | "You don't need eyes to see, you need vision" (Faithless)
>>
>
>
>
> --
> PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net
>
--
Eran | "You don't need eyes to see, you need vision" (Faithless)
Re: How to access files on hdfs
Posted by tog <gu...@gmail.com>.
Hi Eran
There are typo in your example above.
Are you sure nameservice1 is accessible from all your machines ?
Cheers
Guillaume
On 20 October 2015 at 08:49, IT CTO <go...@gmail.com> wrote:
> Hi,
> I am using zeppelin to access files on hdfs
>
> var myRDD = sc.textFile("hdfs://*nameserive1*:8020/data/myfile.txt")
> This method works perfectly on spark-shell, also no problem accessing the
> file using hadool CLI
> hadoop fs -ls hdfs://*nameserive1*:8020/data/myfile.txt
>
> but on zeppelin return an error:
> *UnknownHostException nameservice1*
>
> What is wrong here?
> Eran
> --
> Eran | "You don't need eyes to see, you need vision" (Faithless)
>
--
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net
Re: How to access files on hdfs
Posted by tog <gu...@gmail.com>.
Hi Eran
There are typo in your example above.
Are you sure nameservice1 is accessible from all your machines ?
Cheers
Guillaume
On 20 October 2015 at 08:49, IT CTO <go...@gmail.com> wrote:
> Hi,
> I am using zeppelin to access files on hdfs
>
> var myRDD = sc.textFile("hdfs://*nameserive1*:8020/data/myfile.txt")
> This method works perfectly on spark-shell, also no problem accessing the
> file using hadool CLI
> hadoop fs -ls hdfs://*nameserive1*:8020/data/myfile.txt
>
> but on zeppelin return an error:
> *UnknownHostException nameservice1*
>
> What is wrong here?
> Eran
> --
> Eran | "You don't need eyes to see, you need vision" (Faithless)
>
--
PGP KeyID: 2048R/EA31CFC9 subkeys.pgp.net