You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Robin Verlangen <ro...@us2.nl> on 2012/09/14 15:16:43 UTC

Hadoop filesystem shows local files on one node

Hi there,

I was working on our Hadoop cluster today (CDH4) and noticed that on one
node the local file system gets listed when I run "hdfs dfs -ls /"

Does anyone have a clue what happens here? Even better, how to resolve it?

Best regards,

Robin Verlangen
*Software engineer*
*
*
W http://www.robinverlangen.nl
E robin@us2.nl

Disclaimer: The information contained in this message and attachments is
intended solely for the attention and use of the named addressee and may be
confidential. If you are not the intended recipient, you are reminded that
the information remains the property of the sender. You must not use,
disclose, distribute, copy, print or rely on this e-mail. If you have
received this message in error, please contact the sender immediately and
irrevocably delete this message and any copies.

Re: Hadoop filesystem shows local files on one node

Posted by Mohammad Tariq <do...@gmail.com>.
Hello Robin,

      Was your cluster working fine till now?I mean did you notice anything
unusual apart from this?Are you able to see that node in your Namenode web
UI?

Regards,
    Mohammad Tariq



On Fri, Sep 14, 2012 at 7:15 PM, Sandeep Reddy P <
sandeepreddy.3647@gmail.com> wrote:

> Hi,
> Try exporting HADOOP_CLASSPATH
>
>
> On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:
>
>> Hi there,
>>
>> I was working on our Hadoop cluster today (CDH4) and noticed that on one
>> node the local file system gets listed when I run "hdfs dfs -ls /"
>>
>> Does anyone have a clue what happens here? Even better, how to resolve it?
>>
>> Best regards,
>>
>> Robin Verlangen
>> *Software engineer*
>> *
>> *
>> W http://www.robinverlangen.nl
>> E robin@us2.nl
>>
>> Disclaimer: The information contained in this message and attachments is
>> intended solely for the attention and use of the named addressee and may be
>> confidential. If you are not the intended recipient, you are reminded that
>> the information remains the property of the sender. You must not use,
>> disclose, distribute, copy, print or rely on this e-mail. If you have
>> received this message in error, please contact the sender immediately and
>> irrevocably delete this message and any copies.
>>
>>
>
>
> --
> Thanks,
> sandeep
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Mohammad Tariq <do...@gmail.com>.
Hello Robin,

      Was your cluster working fine till now?I mean did you notice anything
unusual apart from this?Are you able to see that node in your Namenode web
UI?

Regards,
    Mohammad Tariq



On Fri, Sep 14, 2012 at 7:15 PM, Sandeep Reddy P <
sandeepreddy.3647@gmail.com> wrote:

> Hi,
> Try exporting HADOOP_CLASSPATH
>
>
> On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:
>
>> Hi there,
>>
>> I was working on our Hadoop cluster today (CDH4) and noticed that on one
>> node the local file system gets listed when I run "hdfs dfs -ls /"
>>
>> Does anyone have a clue what happens here? Even better, how to resolve it?
>>
>> Best regards,
>>
>> Robin Verlangen
>> *Software engineer*
>> *
>> *
>> W http://www.robinverlangen.nl
>> E robin@us2.nl
>>
>> Disclaimer: The information contained in this message and attachments is
>> intended solely for the attention and use of the named addressee and may be
>> confidential. If you are not the intended recipient, you are reminded that
>> the information remains the property of the sender. You must not use,
>> disclose, distribute, copy, print or rely on this e-mail. If you have
>> received this message in error, please contact the sender immediately and
>> irrevocably delete this message and any copies.
>>
>>
>
>
> --
> Thanks,
> sandeep
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Mohammad Tariq <do...@gmail.com>.
Hello Robin,

      Was your cluster working fine till now?I mean did you notice anything
unusual apart from this?Are you able to see that node in your Namenode web
UI?

Regards,
    Mohammad Tariq



On Fri, Sep 14, 2012 at 7:15 PM, Sandeep Reddy P <
sandeepreddy.3647@gmail.com> wrote:

> Hi,
> Try exporting HADOOP_CLASSPATH
>
>
> On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:
>
>> Hi there,
>>
>> I was working on our Hadoop cluster today (CDH4) and noticed that on one
>> node the local file system gets listed when I run "hdfs dfs -ls /"
>>
>> Does anyone have a clue what happens here? Even better, how to resolve it?
>>
>> Best regards,
>>
>> Robin Verlangen
>> *Software engineer*
>> *
>> *
>> W http://www.robinverlangen.nl
>> E robin@us2.nl
>>
>> Disclaimer: The information contained in this message and attachments is
>> intended solely for the attention and use of the named addressee and may be
>> confidential. If you are not the intended recipient, you are reminded that
>> the information remains the property of the sender. You must not use,
>> disclose, distribute, copy, print or rely on this e-mail. If you have
>> received this message in error, please contact the sender immediately and
>> irrevocably delete this message and any copies.
>>
>>
>
>
> --
> Thanks,
> sandeep
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Mohammad Tariq <do...@gmail.com>.
Hello Robin,

      Was your cluster working fine till now?I mean did you notice anything
unusual apart from this?Are you able to see that node in your Namenode web
UI?

Regards,
    Mohammad Tariq



On Fri, Sep 14, 2012 at 7:15 PM, Sandeep Reddy P <
sandeepreddy.3647@gmail.com> wrote:

> Hi,
> Try exporting HADOOP_CLASSPATH
>
>
> On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:
>
>> Hi there,
>>
>> I was working on our Hadoop cluster today (CDH4) and noticed that on one
>> node the local file system gets listed when I run "hdfs dfs -ls /"
>>
>> Does anyone have a clue what happens here? Even better, how to resolve it?
>>
>> Best regards,
>>
>> Robin Verlangen
>> *Software engineer*
>> *
>> *
>> W http://www.robinverlangen.nl
>> E robin@us2.nl
>>
>> Disclaimer: The information contained in this message and attachments is
>> intended solely for the attention and use of the named addressee and may be
>> confidential. If you are not the intended recipient, you are reminded that
>> the information remains the property of the sender. You must not use,
>> disclose, distribute, copy, print or rely on this e-mail. If you have
>> received this message in error, please contact the sender immediately and
>> irrevocably delete this message and any copies.
>>
>>
>
>
> --
> Thanks,
> sandeep
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Sandeep Reddy P <sa...@gmail.com>.
Hi,
Try exporting HADOOP_CLASSPATH

On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>


-- 
Thanks,
sandeep

Re: Hadoop filesystem shows local files on one node

Posted by Steve Loughran <st...@hortonworks.com>.
that box's config files aren't set up to point to HDFS -and are defaulting
to file:// ?

On 14 September 2012 14:16, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Steve Loughran <st...@hortonworks.com>.
that box's config files aren't set up to point to HDFS -and are defaulting
to file:// ?

On 14 September 2012 14:16, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Steve Loughran <st...@hortonworks.com>.
that box's config files aren't set up to point to HDFS -and are defaulting
to file:// ?

On 14 September 2012 14:16, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Sandeep Reddy P <sa...@gmail.com>.
Hi,
Try exporting HADOOP_CLASSPATH

On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>


-- 
Thanks,
sandeep

Re: Hadoop filesystem shows local files on one node

Posted by Steve Loughran <st...@hortonworks.com>.
that box's config files aren't set up to point to HDFS -and are defaulting
to file:// ?

On 14 September 2012 14:16, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>

Re: Hadoop filesystem shows local files on one node

Posted by Sandeep Reddy P <sa...@gmail.com>.
Hi,
Try exporting HADOOP_CLASSPATH

On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>


-- 
Thanks,
sandeep

Re: Hadoop filesystem shows local files on one node

Posted by Sandeep Reddy P <sa...@gmail.com>.
Hi,
Try exporting HADOOP_CLASSPATH

On Fri, Sep 14, 2012 at 9:16 AM, Robin Verlangen <ro...@us2.nl> wrote:

> Hi there,
>
> I was working on our Hadoop cluster today (CDH4) and noticed that on one
> node the local file system gets listed when I run "hdfs dfs -ls /"
>
> Does anyone have a clue what happens here? Even better, how to resolve it?
>
> Best regards,
>
> Robin Verlangen
> *Software engineer*
> *
> *
> W http://www.robinverlangen.nl
> E robin@us2.nl
>
> Disclaimer: The information contained in this message and attachments is
> intended solely for the attention and use of the named addressee and may be
> confidential. If you are not the intended recipient, you are reminded that
> the information remains the property of the sender. You must not use,
> disclose, distribute, copy, print or rely on this e-mail. If you have
> received this message in error, please contact the sender immediately and
> irrevocably delete this message and any copies.
>
>


-- 
Thanks,
sandeep