You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by Xiaobin She <xi...@gmail.com> on 2013/12/13 10:57:25 UTC
how to create symbolic link in hdfs with c++ code or webhdfs interface?
I'm writting an c++ programme, and I need to deal with hdfs.
What I need is to create some file in hdfs and read the status of these
files.
And I need to be able to create sym link in hdfs and need to know if an
file in hdfs is an sym link file or not.
According to what I have known, the c client lib of hdfs ( which is
libhdfs) does not support sym link.
And I have notice that there is an webhdfs interface for hdfs.
According to this page, it does support sym link.
http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
But I have try this, and I got the following message.
{"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
not supported"}}
Does this means webhdfs does not support sym link too ?
So if this true, how can I create an sym link and get the status of this
file in c++ code?
thank you very much for your help.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
to azuryyyu,
to enable symlink support in hdfs.
Or is there an non-testing option for symlink?
thanks.
2013/12/16 Azuryy Yu <az...@gmail.com>
> Why enable test flag under non-test environment?
>
>
> On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com>wrote:
>
>> To Vinod,
>>
>> thank you for your reply, I found that I got this error message because I
>> did not add the following property in the hdfs-site.xml file
>>
>> 28 <property>
>> 29 <name>test.SymlinkEnabledForTesting</name>
>> 30 <value>true</value>
>> 31 </property>
>>
>>
>> now the problem is solved.
>>
>> thanks again.
>>
>>
>>
>>
>>
>> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>>
>>> What version of Hadoop?
>>>
>>> Thanks,
>>> +Vinod
>>>
>>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>>
>>> I'm writting an c++ programme, and I need to deal with hdfs.
>>>
>>> What I need is to create some file in hdfs and read the status of these
>>> files.
>>>
>>> And I need to be able to create sym link in hdfs and need to know if an
>>> file in hdfs is an sym link file or not.
>>>
>>> According to what I have known, the c client lib of hdfs ( which is
>>> libhdfs) does not support sym link.
>>>
>>> And I have notice that there is an webhdfs interface for hdfs.
>>>
>>> According to this page, it does support sym link.
>>>
>>>
>>>
>>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>>
>>>
>>> But I have try this, and I got the following message.
>>>
>>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>>> not supported"}}
>>>
>>>
>>> Does this means webhdfs does not support sym link too ?
>>>
>>> So if this true, how can I create an sym link and get the status of this
>>> file in c++ code?
>>>
>>> thank you very much for your help.
>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
to azuryyyu,
to enable symlink support in hdfs.
Or is there an non-testing option for symlink?
thanks.
2013/12/16 Azuryy Yu <az...@gmail.com>
> Why enable test flag under non-test environment?
>
>
> On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com>wrote:
>
>> To Vinod,
>>
>> thank you for your reply, I found that I got this error message because I
>> did not add the following property in the hdfs-site.xml file
>>
>> 28 <property>
>> 29 <name>test.SymlinkEnabledForTesting</name>
>> 30 <value>true</value>
>> 31 </property>
>>
>>
>> now the problem is solved.
>>
>> thanks again.
>>
>>
>>
>>
>>
>> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>>
>>> What version of Hadoop?
>>>
>>> Thanks,
>>> +Vinod
>>>
>>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>>
>>> I'm writting an c++ programme, and I need to deal with hdfs.
>>>
>>> What I need is to create some file in hdfs and read the status of these
>>> files.
>>>
>>> And I need to be able to create sym link in hdfs and need to know if an
>>> file in hdfs is an sym link file or not.
>>>
>>> According to what I have known, the c client lib of hdfs ( which is
>>> libhdfs) does not support sym link.
>>>
>>> And I have notice that there is an webhdfs interface for hdfs.
>>>
>>> According to this page, it does support sym link.
>>>
>>>
>>>
>>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>>
>>>
>>> But I have try this, and I got the following message.
>>>
>>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>>> not supported"}}
>>>
>>>
>>> Does this means webhdfs does not support sym link too ?
>>>
>>> So if this true, how can I create an sym link and get the status of this
>>> file in c++ code?
>>>
>>> thank you very much for your help.
>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
to azuryyyu,
to enable symlink support in hdfs.
Or is there an non-testing option for symlink?
thanks.
2013/12/16 Azuryy Yu <az...@gmail.com>
> Why enable test flag under non-test environment?
>
>
> On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com>wrote:
>
>> To Vinod,
>>
>> thank you for your reply, I found that I got this error message because I
>> did not add the following property in the hdfs-site.xml file
>>
>> 28 <property>
>> 29 <name>test.SymlinkEnabledForTesting</name>
>> 30 <value>true</value>
>> 31 </property>
>>
>>
>> now the problem is solved.
>>
>> thanks again.
>>
>>
>>
>>
>>
>> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>>
>>> What version of Hadoop?
>>>
>>> Thanks,
>>> +Vinod
>>>
>>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>>
>>> I'm writting an c++ programme, and I need to deal with hdfs.
>>>
>>> What I need is to create some file in hdfs and read the status of these
>>> files.
>>>
>>> And I need to be able to create sym link in hdfs and need to know if an
>>> file in hdfs is an sym link file or not.
>>>
>>> According to what I have known, the c client lib of hdfs ( which is
>>> libhdfs) does not support sym link.
>>>
>>> And I have notice that there is an webhdfs interface for hdfs.
>>>
>>> According to this page, it does support sym link.
>>>
>>>
>>>
>>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>>
>>>
>>> But I have try this, and I got the following message.
>>>
>>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>>> not supported"}}
>>>
>>>
>>> Does this means webhdfs does not support sym link too ?
>>>
>>> So if this true, how can I create an sym link and get the status of this
>>> file in c++ code?
>>>
>>> thank you very much for your help.
>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
to azuryyyu,
to enable symlink support in hdfs.
Or is there an non-testing option for symlink?
thanks.
2013/12/16 Azuryy Yu <az...@gmail.com>
> Why enable test flag under non-test environment?
>
>
> On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com>wrote:
>
>> To Vinod,
>>
>> thank you for your reply, I found that I got this error message because I
>> did not add the following property in the hdfs-site.xml file
>>
>> 28 <property>
>> 29 <name>test.SymlinkEnabledForTesting</name>
>> 30 <value>true</value>
>> 31 </property>
>>
>>
>> now the problem is solved.
>>
>> thanks again.
>>
>>
>>
>>
>>
>> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>>
>>> What version of Hadoop?
>>>
>>> Thanks,
>>> +Vinod
>>>
>>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>>
>>> I'm writting an c++ programme, and I need to deal with hdfs.
>>>
>>> What I need is to create some file in hdfs and read the status of these
>>> files.
>>>
>>> And I need to be able to create sym link in hdfs and need to know if an
>>> file in hdfs is an sym link file or not.
>>>
>>> According to what I have known, the c client lib of hdfs ( which is
>>> libhdfs) does not support sym link.
>>>
>>> And I have notice that there is an webhdfs interface for hdfs.
>>>
>>> According to this page, it does support sym link.
>>>
>>>
>>>
>>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>>
>>>
>>> But I have try this, and I got the following message.
>>>
>>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>>> not supported"}}
>>>
>>>
>>> Does this means webhdfs does not support sym link too ?
>>>
>>> So if this true, how can I create an sym link and get the status of this
>>> file in c++ code?
>>>
>>> thank you very much for your help.
>>>
>>>
>>>
>>> CONFIDENTIALITY NOTICE
>>> NOTICE: This message is intended for the use of the individual or entity
>>> to which it is addressed and may contain information that is confidential,
>>> privileged and exempt from disclosure under applicable law. If the reader
>>> of this message is not the intended recipient, you are hereby notified that
>>> any printing, copying, dissemination, distribution, disclosure or
>>> forwarding of this communication is strictly prohibited. If you have
>>> received this communication in error, please contact the sender immediately
>>> and delete it from your system. Thank You.
>>
>>
>>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Azuryy Yu <az...@gmail.com>.
Why enable test flag under non-test environment?
On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com> wrote:
> To Vinod,
>
> thank you for your reply, I found that I got this error message because I
> did not add the following property in the hdfs-site.xml file
>
> 28 <property>
> 29 <name>test.SymlinkEnabledForTesting</name>
> 30 <value>true</value>
> 31 </property>
>
>
> now the problem is solved.
>
> thanks again.
>
>
>
>
>
> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>
>> What version of Hadoop?
>>
>> Thanks,
>> +Vinod
>>
>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>
>> I'm writting an c++ programme, and I need to deal with hdfs.
>>
>> What I need is to create some file in hdfs and read the status of these
>> files.
>>
>> And I need to be able to create sym link in hdfs and need to know if an
>> file in hdfs is an sym link file or not.
>>
>> According to what I have known, the c client lib of hdfs ( which is
>> libhdfs) does not support sym link.
>>
>> And I have notice that there is an webhdfs interface for hdfs.
>>
>> According to this page, it does support sym link.
>>
>>
>>
>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>
>>
>> But I have try this, and I got the following message.
>>
>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>> not supported"}}
>>
>>
>> Does this means webhdfs does not support sym link too ?
>>
>> So if this true, how can I create an sym link and get the status of this
>> file in c++ code?
>>
>> thank you very much for your help.
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Azuryy Yu <az...@gmail.com>.
Why enable test flag under non-test environment?
On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com> wrote:
> To Vinod,
>
> thank you for your reply, I found that I got this error message because I
> did not add the following property in the hdfs-site.xml file
>
> 28 <property>
> 29 <name>test.SymlinkEnabledForTesting</name>
> 30 <value>true</value>
> 31 </property>
>
>
> now the problem is solved.
>
> thanks again.
>
>
>
>
>
> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>
>> What version of Hadoop?
>>
>> Thanks,
>> +Vinod
>>
>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>
>> I'm writting an c++ programme, and I need to deal with hdfs.
>>
>> What I need is to create some file in hdfs and read the status of these
>> files.
>>
>> And I need to be able to create sym link in hdfs and need to know if an
>> file in hdfs is an sym link file or not.
>>
>> According to what I have known, the c client lib of hdfs ( which is
>> libhdfs) does not support sym link.
>>
>> And I have notice that there is an webhdfs interface for hdfs.
>>
>> According to this page, it does support sym link.
>>
>>
>>
>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>
>>
>> But I have try this, and I got the following message.
>>
>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>> not supported"}}
>>
>>
>> Does this means webhdfs does not support sym link too ?
>>
>> So if this true, how can I create an sym link and get the status of this
>> file in c++ code?
>>
>> thank you very much for your help.
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Azuryy Yu <az...@gmail.com>.
Why enable test flag under non-test environment?
On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com> wrote:
> To Vinod,
>
> thank you for your reply, I found that I got this error message because I
> did not add the following property in the hdfs-site.xml file
>
> 28 <property>
> 29 <name>test.SymlinkEnabledForTesting</name>
> 30 <value>true</value>
> 31 </property>
>
>
> now the problem is solved.
>
> thanks again.
>
>
>
>
>
> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>
>> What version of Hadoop?
>>
>> Thanks,
>> +Vinod
>>
>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>
>> I'm writting an c++ programme, and I need to deal with hdfs.
>>
>> What I need is to create some file in hdfs and read the status of these
>> files.
>>
>> And I need to be able to create sym link in hdfs and need to know if an
>> file in hdfs is an sym link file or not.
>>
>> According to what I have known, the c client lib of hdfs ( which is
>> libhdfs) does not support sym link.
>>
>> And I have notice that there is an webhdfs interface for hdfs.
>>
>> According to this page, it does support sym link.
>>
>>
>>
>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>
>>
>> But I have try this, and I got the following message.
>>
>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>> not supported"}}
>>
>>
>> Does this means webhdfs does not support sym link too ?
>>
>> So if this true, how can I create an sym link and get the status of this
>> file in c++ code?
>>
>> thank you very much for your help.
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Azuryy Yu <az...@gmail.com>.
Why enable test flag under non-test environment?
On Mon, Dec 16, 2013 at 11:10 AM, Xiaobin She <xi...@gmail.com> wrote:
> To Vinod,
>
> thank you for your reply, I found that I got this error message because I
> did not add the following property in the hdfs-site.xml file
>
> 28 <property>
> 29 <name>test.SymlinkEnabledForTesting</name>
> 30 <value>true</value>
> 31 </property>
>
>
> now the problem is solved.
>
> thanks again.
>
>
>
>
>
> 2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
>
>> What version of Hadoop?
>>
>> Thanks,
>> +Vinod
>>
>> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>>
>> I'm writting an c++ programme, and I need to deal with hdfs.
>>
>> What I need is to create some file in hdfs and read the status of these
>> files.
>>
>> And I need to be able to create sym link in hdfs and need to know if an
>> file in hdfs is an sym link file or not.
>>
>> According to what I have known, the c client lib of hdfs ( which is
>> libhdfs) does not support sym link.
>>
>> And I have notice that there is an webhdfs interface for hdfs.
>>
>> According to this page, it does support sym link.
>>
>>
>>
>> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>>
>>
>> But I have try this, and I got the following message.
>>
>> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
>> not supported"}}
>>
>>
>> Does this means webhdfs does not support sym link too ?
>>
>> So if this true, how can I create an sym link and get the status of this
>> file in c++ code?
>>
>> thank you very much for your help.
>>
>>
>>
>> CONFIDENTIALITY NOTICE
>> NOTICE: This message is intended for the use of the individual or entity
>> to which it is addressed and may contain information that is confidential,
>> privileged and exempt from disclosure under applicable law. If the reader
>> of this message is not the intended recipient, you are hereby notified that
>> any printing, copying, dissemination, distribution, disclosure or
>> forwarding of this communication is strictly prohibited. If you have
>> received this communication in error, please contact the sender immediately
>> and delete it from your system. Thank You.
>
>
>
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
To Vinod,
thank you for your reply, I found that I got this error message because I
did not add the following property in the hdfs-site.xml file
28 <property>
29 <name>test.SymlinkEnabledForTesting</name>
30 <value>true</value>
31 </property>
now the problem is solved.
thanks again.
2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
> What version of Hadoop?
>
> Thanks,
> +Vinod
>
> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these
> files.
>
> And I need to be able to create sym link in hdfs and need to know if an
> file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is
> libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
> not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this
> file in c++ code?
>
> thank you very much for your help.
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
To Vinod,
thank you for your reply, I found that I got this error message because I
did not add the following property in the hdfs-site.xml file
28 <property>
29 <name>test.SymlinkEnabledForTesting</name>
30 <value>true</value>
31 </property>
now the problem is solved.
thanks again.
2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
> What version of Hadoop?
>
> Thanks,
> +Vinod
>
> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these
> files.
>
> And I need to be able to create sym link in hdfs and need to know if an
> file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is
> libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
> not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this
> file in c++ code?
>
> thank you very much for your help.
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
To Vinod,
thank you for your reply, I found that I got this error message because I
did not add the following property in the hdfs-site.xml file
28 <property>
29 <name>test.SymlinkEnabledForTesting</name>
30 <value>true</value>
31 </property>
now the problem is solved.
thanks again.
2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
> What version of Hadoop?
>
> Thanks,
> +Vinod
>
> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these
> files.
>
> And I need to be able to create sym link in hdfs and need to know if an
> file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is
> libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
> not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this
> file in c++ code?
>
> thank you very much for your help.
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Xiaobin She <xi...@gmail.com>.
To Vinod,
thank you for your reply, I found that I got this error message because I
did not add the following property in the hdfs-site.xml file
28 <property>
29 <name>test.SymlinkEnabledForTesting</name>
30 <value>true</value>
31 </property>
now the problem is solved.
thanks again.
2013/12/14 Vinod Kumar Vavilapalli <vi...@hortonworks.com>
> What version of Hadoop?
>
> Thanks,
> +Vinod
>
> On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
>
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these
> files.
>
> And I need to be able to create sym link in hdfs and need to know if an
> file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is
> libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks
> not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this
> file in c++ code?
>
> thank you very much for your help.
>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
What version of Hadoop?
Thanks,
+Vinod
On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these files.
>
> And I need to be able to create sym link in hdfs and need to know if an file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this file in c++ code?
>
> thank you very much for your help.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
What version of Hadoop?
Thanks,
+Vinod
On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these files.
>
> And I need to be able to create sym link in hdfs and need to know if an file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this file in c++ code?
>
> thank you very much for your help.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
What version of Hadoop?
Thanks,
+Vinod
On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these files.
>
> And I need to be able to create sym link in hdfs and need to know if an file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this file in c++ code?
>
> thank you very much for your help.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: how to create symbolic link in hdfs with c++ code or webhdfs interface?
Posted by Vinod Kumar Vavilapalli <vi...@hortonworks.com>.
What version of Hadoop?
Thanks,
+Vinod
On Dec 13, 2013, at 1:57 AM, Xiaobin She <xi...@gmail.com> wrote:
> I'm writting an c++ programme, and I need to deal with hdfs.
>
> What I need is to create some file in hdfs and read the status of these files.
>
> And I need to be able to create sym link in hdfs and need to know if an file in hdfs is an sym link file or not.
>
> According to what I have known, the c client lib of hdfs ( which is libhdfs) does not support sym link.
>
> And I have notice that there is an webhdfs interface for hdfs.
>
> According to this page, it does support sym link.
>
>
> http://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-hdfs/WebHDFS.html#Create_a_Symbolic_Link
>
>
> But I have try this, and I got the following message.
>
> {"RemoteException":{"exception":"UnsupportedOperationException","javaClassName":"java.lang.UnsupportedOperationException","message":"Symlinks not supported"}}
>
>
> Does this means webhdfs does not support sym link too ?
>
> So if this true, how can I create an sym link and get the status of this file in c++ code?
>
> thank you very much for your help.
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.