You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by Gautam Hegde <ga...@aralitechnologies.com> on 2014/11/07 06:40:32 UTC
Error while writing to HDFS NFS from windows
Hi All,
I have a use case where I need to transfer files from windows to HDFS. I
cannot use flume because the folder and file structure need to be
replicated as they are.
HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
on windows, but when I try to write to it I get the following error.
ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when creating
file: New Text Document.txt dir fileId:463160
Is there any way to resolve this, so that I can successfully write from
windows to HDFS NFS?
Thanks in advance
Gautam Hegde
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Brandon,
Wasn't trying to update a file. The error came up when I was trying to
copy/create a file on the NFS share from windows.
I have tried all of the steps/settings which were listed in the Hortonworks
NFS setup page, still no dice.
On Tue, Nov 11, 2014 at 12:16 AM, Brandon Li <br...@hortonworks.com>
wrote:
> Hi Gautam,
>
> File update is not supported by the NFS gateway. You may want to delete
> original testnfs.txt before re-creating it.
>
> Thanks,
> Brandon
>
> On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Did you set access privileges in hdfs-site.xml ? If access privileges are
>> not set, by default it's read only as i can remember. Please add following
>> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
>> --------------------------------------------------------------
>>
>> <property>
>> <name>dfs.nfs.exports.allowed.hosts</name>
>> <value>* rw</value>
>> </property>
>>
>> --------------------------------------------------------------
>>
>> Regards,
>>
>> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi Pumudu,
>>>
>>> Thanks for your reply.
>>>
>>> The command that was used to mount on windows was
>>>
>>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>>
>>> I was able to browse, but unable to write files. When I try to
>>> create/write a file, it gives me the following error,
>>>
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: testnfs.txt dir fileId:463160
>>>
>>> Would like to use NFS itself, since we need to recreate the exact
>>> folder/file structure on hdfs.
>>>
>>> With Regards,
>>> Gautam Hegde
>>>
>>>
>>>
>>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>>> wrote:
>>>
>>>> Hi Gautam,
>>>>
>>>> Can you please give more details of what you tried ? What's the command
>>>> you execute to create? Were you able to browse hdfs through mount point ?
>>>> As a alternative have you tried WebHDFS[1
>>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>>> calls)
>>>>
>>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>>
>>>> Regards,
>>>>
>>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>>> I cannot use flume because the folder and file structure need to be
>>>>> replicated as they are.
>>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>>> creating file: New Text Document.txt dir fileId:463160
>>>>>
>>>>>
>>>>> Is there any way to resolve this, so that I can successfully write
>>>>> from windows to HDFS NFS?
>>>>>
>>>>> Thanks in advance
>>>>> Gautam Hegde
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Pumudu Ruhunage
>>>>
>>>> email : pumudu88@gmail.com
>>>> work email : pumudu@wso2.com
>>>> Blog : http://pumuduruhunage.blogspot.com/
>>>>
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Brandon,
Wasn't trying to update a file. The error came up when I was trying to
copy/create a file on the NFS share from windows.
I have tried all of the steps/settings which were listed in the Hortonworks
NFS setup page, still no dice.
On Tue, Nov 11, 2014 at 12:16 AM, Brandon Li <br...@hortonworks.com>
wrote:
> Hi Gautam,
>
> File update is not supported by the NFS gateway. You may want to delete
> original testnfs.txt before re-creating it.
>
> Thanks,
> Brandon
>
> On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Did you set access privileges in hdfs-site.xml ? If access privileges are
>> not set, by default it's read only as i can remember. Please add following
>> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
>> --------------------------------------------------------------
>>
>> <property>
>> <name>dfs.nfs.exports.allowed.hosts</name>
>> <value>* rw</value>
>> </property>
>>
>> --------------------------------------------------------------
>>
>> Regards,
>>
>> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi Pumudu,
>>>
>>> Thanks for your reply.
>>>
>>> The command that was used to mount on windows was
>>>
>>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>>
>>> I was able to browse, but unable to write files. When I try to
>>> create/write a file, it gives me the following error,
>>>
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: testnfs.txt dir fileId:463160
>>>
>>> Would like to use NFS itself, since we need to recreate the exact
>>> folder/file structure on hdfs.
>>>
>>> With Regards,
>>> Gautam Hegde
>>>
>>>
>>>
>>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>>> wrote:
>>>
>>>> Hi Gautam,
>>>>
>>>> Can you please give more details of what you tried ? What's the command
>>>> you execute to create? Were you able to browse hdfs through mount point ?
>>>> As a alternative have you tried WebHDFS[1
>>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>>> calls)
>>>>
>>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>>
>>>> Regards,
>>>>
>>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>>> I cannot use flume because the folder and file structure need to be
>>>>> replicated as they are.
>>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>>> creating file: New Text Document.txt dir fileId:463160
>>>>>
>>>>>
>>>>> Is there any way to resolve this, so that I can successfully write
>>>>> from windows to HDFS NFS?
>>>>>
>>>>> Thanks in advance
>>>>> Gautam Hegde
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Pumudu Ruhunage
>>>>
>>>> email : pumudu88@gmail.com
>>>> work email : pumudu@wso2.com
>>>> Blog : http://pumuduruhunage.blogspot.com/
>>>>
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Brandon,
Wasn't trying to update a file. The error came up when I was trying to
copy/create a file on the NFS share from windows.
I have tried all of the steps/settings which were listed in the Hortonworks
NFS setup page, still no dice.
On Tue, Nov 11, 2014 at 12:16 AM, Brandon Li <br...@hortonworks.com>
wrote:
> Hi Gautam,
>
> File update is not supported by the NFS gateway. You may want to delete
> original testnfs.txt before re-creating it.
>
> Thanks,
> Brandon
>
> On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Did you set access privileges in hdfs-site.xml ? If access privileges are
>> not set, by default it's read only as i can remember. Please add following
>> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
>> --------------------------------------------------------------
>>
>> <property>
>> <name>dfs.nfs.exports.allowed.hosts</name>
>> <value>* rw</value>
>> </property>
>>
>> --------------------------------------------------------------
>>
>> Regards,
>>
>> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi Pumudu,
>>>
>>> Thanks for your reply.
>>>
>>> The command that was used to mount on windows was
>>>
>>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>>
>>> I was able to browse, but unable to write files. When I try to
>>> create/write a file, it gives me the following error,
>>>
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: testnfs.txt dir fileId:463160
>>>
>>> Would like to use NFS itself, since we need to recreate the exact
>>> folder/file structure on hdfs.
>>>
>>> With Regards,
>>> Gautam Hegde
>>>
>>>
>>>
>>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>>> wrote:
>>>
>>>> Hi Gautam,
>>>>
>>>> Can you please give more details of what you tried ? What's the command
>>>> you execute to create? Were you able to browse hdfs through mount point ?
>>>> As a alternative have you tried WebHDFS[1
>>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>>> calls)
>>>>
>>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>>
>>>> Regards,
>>>>
>>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>>> I cannot use flume because the folder and file structure need to be
>>>>> replicated as they are.
>>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>>> creating file: New Text Document.txt dir fileId:463160
>>>>>
>>>>>
>>>>> Is there any way to resolve this, so that I can successfully write
>>>>> from windows to HDFS NFS?
>>>>>
>>>>> Thanks in advance
>>>>> Gautam Hegde
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Pumudu Ruhunage
>>>>
>>>> email : pumudu88@gmail.com
>>>> work email : pumudu@wso2.com
>>>> Blog : http://pumuduruhunage.blogspot.com/
>>>>
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Brandon,
Wasn't trying to update a file. The error came up when I was trying to
copy/create a file on the NFS share from windows.
I have tried all of the steps/settings which were listed in the Hortonworks
NFS setup page, still no dice.
On Tue, Nov 11, 2014 at 12:16 AM, Brandon Li <br...@hortonworks.com>
wrote:
> Hi Gautam,
>
> File update is not supported by the NFS gateway. You may want to delete
> original testnfs.txt before re-creating it.
>
> Thanks,
> Brandon
>
> On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Did you set access privileges in hdfs-site.xml ? If access privileges are
>> not set, by default it's read only as i can remember. Please add following
>> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
>> --------------------------------------------------------------
>>
>> <property>
>> <name>dfs.nfs.exports.allowed.hosts</name>
>> <value>* rw</value>
>> </property>
>>
>> --------------------------------------------------------------
>>
>> Regards,
>>
>> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi Pumudu,
>>>
>>> Thanks for your reply.
>>>
>>> The command that was used to mount on windows was
>>>
>>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>>
>>> I was able to browse, but unable to write files. When I try to
>>> create/write a file, it gives me the following error,
>>>
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: testnfs.txt dir fileId:463160
>>>
>>> Would like to use NFS itself, since we need to recreate the exact
>>> folder/file structure on hdfs.
>>>
>>> With Regards,
>>> Gautam Hegde
>>>
>>>
>>>
>>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>>> wrote:
>>>
>>>> Hi Gautam,
>>>>
>>>> Can you please give more details of what you tried ? What's the command
>>>> you execute to create? Were you able to browse hdfs through mount point ?
>>>> As a alternative have you tried WebHDFS[1
>>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>>> calls)
>>>>
>>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>>
>>>> Regards,
>>>>
>>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>>> wrote:
>>>>
>>>>> Hi All,
>>>>>
>>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>>> I cannot use flume because the folder and file structure need to be
>>>>> replicated as they are.
>>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>>> creating file: New Text Document.txt dir fileId:463160
>>>>>
>>>>>
>>>>> Is there any way to resolve this, so that I can successfully write
>>>>> from windows to HDFS NFS?
>>>>>
>>>>> Thanks in advance
>>>>> Gautam Hegde
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Pumudu Ruhunage
>>>>
>>>> email : pumudu88@gmail.com
>>>> work email : pumudu@wso2.com
>>>> Blog : http://pumuduruhunage.blogspot.com/
>>>>
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
> CONFIDENTIALITY NOTICE
> NOTICE: This message is intended for the use of the individual or entity
> to which it is addressed and may contain information that is confidential,
> privileged and exempt from disclosure under applicable law. If the reader
> of this message is not the intended recipient, you are hereby notified that
> any printing, copying, dissemination, distribution, disclosure or
> forwarding of this communication is strictly prohibited. If you have
> received this communication in error, please contact the sender immediately
> and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Brandon Li <br...@hortonworks.com>.
Hi Gautam,
File update is not supported by the NFS gateway. You may want to delete
original testnfs.txt before re-creating it.
Thanks,
Brandon
On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Did you set access privileges in hdfs-site.xml ? If access privileges are
> not set, by default it's read only as i can remember. Please add following
> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
> --------------------------------------------------------------
>
> <property>
> <name>dfs.nfs.exports.allowed.hosts</name>
> <value>* rw</value>
> </property>
>
> --------------------------------------------------------------
>
> Regards,
>
> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi Pumudu,
>>
>> Thanks for your reply.
>>
>> The command that was used to mount on windows was
>>
>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>
>> I was able to browse, but unable to write files. When I try to
>> create/write a file, it gives me the following error,
>>
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: testnfs.txt dir fileId:463160
>>
>> Would like to use NFS itself, since we need to recreate the exact
>> folder/file structure on hdfs.
>>
>> With Regards,
>> Gautam Hegde
>>
>>
>>
>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>> wrote:
>>
>>> Hi Gautam,
>>>
>>> Can you please give more details of what you tried ? What's the command
>>> you execute to create? Were you able to browse hdfs through mount point ?
>>> As a alternative have you tried WebHDFS[1
>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>> calls)
>>>
>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>
>>> Regards,
>>>
>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>> I cannot use flume because the folder and file structure need to be
>>>> replicated as they are.
>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>> creating file: New Text Document.txt dir fileId:463160
>>>>
>>>>
>>>> Is there any way to resolve this, so that I can successfully write from
>>>> windows to HDFS NFS?
>>>>
>>>> Thanks in advance
>>>> Gautam Hegde
>>>>
>>>>
>>>
>>>
>>> --
>>> Pumudu Ruhunage
>>>
>>> email : pumudu88@gmail.com
>>> work email : pumudu@wso2.com
>>> Blog : http://pumuduruhunage.blogspot.com/
>>>
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Brandon Li <br...@hortonworks.com>.
Hi Gautam,
File update is not supported by the NFS gateway. You may want to delete
original testnfs.txt before re-creating it.
Thanks,
Brandon
On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Did you set access privileges in hdfs-site.xml ? If access privileges are
> not set, by default it's read only as i can remember. Please add following
> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
> --------------------------------------------------------------
>
> <property>
> <name>dfs.nfs.exports.allowed.hosts</name>
> <value>* rw</value>
> </property>
>
> --------------------------------------------------------------
>
> Regards,
>
> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi Pumudu,
>>
>> Thanks for your reply.
>>
>> The command that was used to mount on windows was
>>
>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>
>> I was able to browse, but unable to write files. When I try to
>> create/write a file, it gives me the following error,
>>
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: testnfs.txt dir fileId:463160
>>
>> Would like to use NFS itself, since we need to recreate the exact
>> folder/file structure on hdfs.
>>
>> With Regards,
>> Gautam Hegde
>>
>>
>>
>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>> wrote:
>>
>>> Hi Gautam,
>>>
>>> Can you please give more details of what you tried ? What's the command
>>> you execute to create? Were you able to browse hdfs through mount point ?
>>> As a alternative have you tried WebHDFS[1
>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>> calls)
>>>
>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>
>>> Regards,
>>>
>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>> I cannot use flume because the folder and file structure need to be
>>>> replicated as they are.
>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>> creating file: New Text Document.txt dir fileId:463160
>>>>
>>>>
>>>> Is there any way to resolve this, so that I can successfully write from
>>>> windows to HDFS NFS?
>>>>
>>>> Thanks in advance
>>>> Gautam Hegde
>>>>
>>>>
>>>
>>>
>>> --
>>> Pumudu Ruhunage
>>>
>>> email : pumudu88@gmail.com
>>> work email : pumudu@wso2.com
>>> Blog : http://pumuduruhunage.blogspot.com/
>>>
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Brandon Li <br...@hortonworks.com>.
Hi Gautam,
File update is not supported by the NFS gateway. You may want to delete
original testnfs.txt before re-creating it.
Thanks,
Brandon
On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Did you set access privileges in hdfs-site.xml ? If access privileges are
> not set, by default it's read only as i can remember. Please add following
> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
> --------------------------------------------------------------
>
> <property>
> <name>dfs.nfs.exports.allowed.hosts</name>
> <value>* rw</value>
> </property>
>
> --------------------------------------------------------------
>
> Regards,
>
> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi Pumudu,
>>
>> Thanks for your reply.
>>
>> The command that was used to mount on windows was
>>
>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>
>> I was able to browse, but unable to write files. When I try to
>> create/write a file, it gives me the following error,
>>
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: testnfs.txt dir fileId:463160
>>
>> Would like to use NFS itself, since we need to recreate the exact
>> folder/file structure on hdfs.
>>
>> With Regards,
>> Gautam Hegde
>>
>>
>>
>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>> wrote:
>>
>>> Hi Gautam,
>>>
>>> Can you please give more details of what you tried ? What's the command
>>> you execute to create? Were you able to browse hdfs through mount point ?
>>> As a alternative have you tried WebHDFS[1
>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>> calls)
>>>
>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>
>>> Regards,
>>>
>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>> I cannot use flume because the folder and file structure need to be
>>>> replicated as they are.
>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>> creating file: New Text Document.txt dir fileId:463160
>>>>
>>>>
>>>> Is there any way to resolve this, so that I can successfully write from
>>>> windows to HDFS NFS?
>>>>
>>>> Thanks in advance
>>>> Gautam Hegde
>>>>
>>>>
>>>
>>>
>>> --
>>> Pumudu Ruhunage
>>>
>>> email : pumudu88@gmail.com
>>> work email : pumudu@wso2.com
>>> Blog : http://pumuduruhunage.blogspot.com/
>>>
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Brandon Li <br...@hortonworks.com>.
Hi Gautam,
File update is not supported by the NFS gateway. You may want to delete
original testnfs.txt before re-creating it.
Thanks,
Brandon
On Sun, Nov 9, 2014 at 10:34 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Did you set access privileges in hdfs-site.xml ? If access privileges are
> not set, by default it's read only as i can remember. Please add following
> property in "hdfs-site.xml" and restart hdfs and nfs gateway.
> --------------------------------------------------------------
>
> <property>
> <name>dfs.nfs.exports.allowed.hosts</name>
> <value>* rw</value>
> </property>
>
> --------------------------------------------------------------
>
> Regards,
>
> On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi Pumudu,
>>
>> Thanks for your reply.
>>
>> The command that was used to mount on windows was
>>
>> mount -o nolock mtype=hard 10.66.27.171:/! W:
>>
>> I was able to browse, but unable to write files. When I try to
>> create/write a file, it gives me the following error,
>>
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: testnfs.txt dir fileId:463160
>>
>> Would like to use NFS itself, since we need to recreate the exact
>> folder/file structure on hdfs.
>>
>> With Regards,
>> Gautam Hegde
>>
>>
>>
>> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
>> wrote:
>>
>>> Hi Gautam,
>>>
>>> Can you please give more details of what you tried ? What's the command
>>> you execute to create? Were you able to browse hdfs through mount point ?
>>> As a alternative have you tried WebHDFS[1
>>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>>> calls)
>>>
>>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>>
>>> Regards,
>>>
>>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>>> wrote:
>>>
>>>> Hi All,
>>>>
>>>> I have a use case where I need to transfer files from windows to HDFS.
>>>> I cannot use flume because the folder and file structure need to be
>>>> replicated as they are.
>>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>>> hdfs on windows, but when I try to write to it I get the following error.
>>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>>> creating file: New Text Document.txt dir fileId:463160
>>>>
>>>>
>>>> Is there any way to resolve this, so that I can successfully write from
>>>> windows to HDFS NFS?
>>>>
>>>> Thanks in advance
>>>> Gautam Hegde
>>>>
>>>>
>>>
>>>
>>> --
>>> Pumudu Ruhunage
>>>
>>> email : pumudu88@gmail.com
>>> work email : pumudu@wso2.com
>>> Blog : http://pumuduruhunage.blogspot.com/
>>>
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Did you set access privileges in hdfs-site.xml ? If access privileges are
not set, by default it's read only as i can remember. Please add following
property in "hdfs-site.xml" and restart hdfs and nfs gateway.
--------------------------------------------------------------
<property>
<name>dfs.nfs.exports.allowed.hosts</name>
<value>* rw</value>
</property>
--------------------------------------------------------------
Regards,
On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
wrote:
> Hi Pumudu,
>
> Thanks for your reply.
>
> The command that was used to mount on windows was
>
> mount -o nolock mtype=hard 10.66.27.171:/! W:
>
> I was able to browse, but unable to write files. When I try to
> create/write a file, it gives me the following error,
>
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: testnfs.txt dir fileId:463160
>
> Would like to use NFS itself, since we need to recreate the exact
> folder/file structure on hdfs.
>
> With Regards,
> Gautam Hegde
>
>
>
> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Can you please give more details of what you tried ? What's the command
>> you execute to create? Were you able to browse hdfs through mount point ?
>> As a alternative have you tried WebHDFS[1
>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>> calls)
>>
>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>
>> Regards,
>>
>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have a use case where I need to transfer files from windows to HDFS. I
>>> cannot use flume because the folder and file structure need to be
>>> replicated as they are.
>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>> hdfs on windows, but when I try to write to it I get the following error.
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: New Text Document.txt dir fileId:463160
>>>
>>>
>>> Is there any way to resolve this, so that I can successfully write from
>>> windows to HDFS NFS?
>>>
>>> Thanks in advance
>>> Gautam Hegde
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Did you set access privileges in hdfs-site.xml ? If access privileges are
not set, by default it's read only as i can remember. Please add following
property in "hdfs-site.xml" and restart hdfs and nfs gateway.
--------------------------------------------------------------
<property>
<name>dfs.nfs.exports.allowed.hosts</name>
<value>* rw</value>
</property>
--------------------------------------------------------------
Regards,
On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
wrote:
> Hi Pumudu,
>
> Thanks for your reply.
>
> The command that was used to mount on windows was
>
> mount -o nolock mtype=hard 10.66.27.171:/! W:
>
> I was able to browse, but unable to write files. When I try to
> create/write a file, it gives me the following error,
>
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: testnfs.txt dir fileId:463160
>
> Would like to use NFS itself, since we need to recreate the exact
> folder/file structure on hdfs.
>
> With Regards,
> Gautam Hegde
>
>
>
> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Can you please give more details of what you tried ? What's the command
>> you execute to create? Were you able to browse hdfs through mount point ?
>> As a alternative have you tried WebHDFS[1
>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>> calls)
>>
>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>
>> Regards,
>>
>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have a use case where I need to transfer files from windows to HDFS. I
>>> cannot use flume because the folder and file structure need to be
>>> replicated as they are.
>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>> hdfs on windows, but when I try to write to it I get the following error.
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: New Text Document.txt dir fileId:463160
>>>
>>>
>>> Is there any way to resolve this, so that I can successfully write from
>>> windows to HDFS NFS?
>>>
>>> Thanks in advance
>>> Gautam Hegde
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Did you set access privileges in hdfs-site.xml ? If access privileges are
not set, by default it's read only as i can remember. Please add following
property in "hdfs-site.xml" and restart hdfs and nfs gateway.
--------------------------------------------------------------
<property>
<name>dfs.nfs.exports.allowed.hosts</name>
<value>* rw</value>
</property>
--------------------------------------------------------------
Regards,
On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
wrote:
> Hi Pumudu,
>
> Thanks for your reply.
>
> The command that was used to mount on windows was
>
> mount -o nolock mtype=hard 10.66.27.171:/! W:
>
> I was able to browse, but unable to write files. When I try to
> create/write a file, it gives me the following error,
>
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: testnfs.txt dir fileId:463160
>
> Would like to use NFS itself, since we need to recreate the exact
> folder/file structure on hdfs.
>
> With Regards,
> Gautam Hegde
>
>
>
> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Can you please give more details of what you tried ? What's the command
>> you execute to create? Were you able to browse hdfs through mount point ?
>> As a alternative have you tried WebHDFS[1
>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>> calls)
>>
>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>
>> Regards,
>>
>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have a use case where I need to transfer files from windows to HDFS. I
>>> cannot use flume because the folder and file structure need to be
>>> replicated as they are.
>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>> hdfs on windows, but when I try to write to it I get the following error.
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: New Text Document.txt dir fileId:463160
>>>
>>>
>>> Is there any way to resolve this, so that I can successfully write from
>>> windows to HDFS NFS?
>>>
>>> Thanks in advance
>>> Gautam Hegde
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Did you set access privileges in hdfs-site.xml ? If access privileges are
not set, by default it's read only as i can remember. Please add following
property in "hdfs-site.xml" and restart hdfs and nfs gateway.
--------------------------------------------------------------
<property>
<name>dfs.nfs.exports.allowed.hosts</name>
<value>* rw</value>
</property>
--------------------------------------------------------------
Regards,
On 10 November 2014 10:53, Gautam Hegde <ga...@aralitechnologies.com>
wrote:
> Hi Pumudu,
>
> Thanks for your reply.
>
> The command that was used to mount on windows was
>
> mount -o nolock mtype=hard 10.66.27.171:/! W:
>
> I was able to browse, but unable to write files. When I try to
> create/write a file, it gives me the following error,
>
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: testnfs.txt dir fileId:463160
>
> Would like to use NFS itself, since we need to recreate the exact
> folder/file structure on hdfs.
>
> With Regards,
> Gautam Hegde
>
>
>
> On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com>
> wrote:
>
>> Hi Gautam,
>>
>> Can you please give more details of what you tried ? What's the command
>> you execute to create? Were you able to browse hdfs through mount point ?
>> As a alternative have you tried WebHDFS[1
>> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
>> using windows it'll be easy if you try to use webhdfs as it's based on rest
>> calls)
>>
>> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>>
>> Regards,
>>
>> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
>> wrote:
>>
>>> Hi All,
>>>
>>> I have a use case where I need to transfer files from windows to HDFS. I
>>> cannot use flume because the folder and file structure need to be
>>> replicated as they are.
>>> HDFS NFS is the perfect thing for this use case, I was able to mount
>>> hdfs on windows, but when I try to write to it I get the following error.
>>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>>> creating file: New Text Document.txt dir fileId:463160
>>>
>>>
>>> Is there any way to resolve this, so that I can successfully write from
>>> windows to HDFS NFS?
>>>
>>> Thanks in advance
>>> Gautam Hegde
>>>
>>>
>>
>>
>> --
>> Pumudu Ruhunage
>>
>> email : pumudu88@gmail.com
>> work email : pumudu@wso2.com
>> Blog : http://pumuduruhunage.blogspot.com/
>>
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Pumudu,
Thanks for your reply.
The command that was used to mount on windows was
mount -o nolock mtype=hard 10.66.27.171:/! W:
I was able to browse, but unable to write files. When I try to create/write
a file, it gives me the following error,
ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
creating file: testnfs.txt dir fileId:463160
Would like to use NFS itself, since we need to recreate the exact
folder/file structure on hdfs.
With Regards,
Gautam Hegde
On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Can you please give more details of what you tried ? What's the command
> you execute to create? Were you able to browse hdfs through mount point ?
> As a alternative have you tried WebHDFS[1
> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
> using windows it'll be easy if you try to use webhdfs as it's based on rest
> calls)
>
> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>
> Regards,
>
> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi All,
>>
>> I have a use case where I need to transfer files from windows to HDFS. I
>> cannot use flume because the folder and file structure need to be
>> replicated as they are.
>> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
>> on windows, but when I try to write to it I get the following error.
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: New Text Document.txt dir fileId:463160
>>
>>
>> Is there any way to resolve this, so that I can successfully write from
>> windows to HDFS NFS?
>>
>> Thanks in advance
>> Gautam Hegde
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Pumudu,
Thanks for your reply.
The command that was used to mount on windows was
mount -o nolock mtype=hard 10.66.27.171:/! W:
I was able to browse, but unable to write files. When I try to create/write
a file, it gives me the following error,
ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
creating file: testnfs.txt dir fileId:463160
Would like to use NFS itself, since we need to recreate the exact
folder/file structure on hdfs.
With Regards,
Gautam Hegde
On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Can you please give more details of what you tried ? What's the command
> you execute to create? Were you able to browse hdfs through mount point ?
> As a alternative have you tried WebHDFS[1
> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
> using windows it'll be easy if you try to use webhdfs as it's based on rest
> calls)
>
> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>
> Regards,
>
> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi All,
>>
>> I have a use case where I need to transfer files from windows to HDFS. I
>> cannot use flume because the folder and file structure need to be
>> replicated as they are.
>> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
>> on windows, but when I try to write to it I get the following error.
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: New Text Document.txt dir fileId:463160
>>
>>
>> Is there any way to resolve this, so that I can successfully write from
>> windows to HDFS NFS?
>>
>> Thanks in advance
>> Gautam Hegde
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Pumudu,
Thanks for your reply.
The command that was used to mount on windows was
mount -o nolock mtype=hard 10.66.27.171:/! W:
I was able to browse, but unable to write files. When I try to create/write
a file, it gives me the following error,
ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
creating file: testnfs.txt dir fileId:463160
Would like to use NFS itself, since we need to recreate the exact
folder/file structure on hdfs.
With Regards,
Gautam Hegde
On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Can you please give more details of what you tried ? What's the command
> you execute to create? Were you able to browse hdfs through mount point ?
> As a alternative have you tried WebHDFS[1
> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
> using windows it'll be easy if you try to use webhdfs as it's based on rest
> calls)
>
> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>
> Regards,
>
> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi All,
>>
>> I have a use case where I need to transfer files from windows to HDFS. I
>> cannot use flume because the folder and file structure need to be
>> replicated as they are.
>> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
>> on windows, but when I try to write to it I get the following error.
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: New Text Document.txt dir fileId:463160
>>
>>
>> Is there any way to resolve this, so that I can successfully write from
>> windows to HDFS NFS?
>>
>> Thanks in advance
>> Gautam Hegde
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
Re: Error while writing to HDFS NFS from windows
Posted by Gautam Hegde <ga...@aralitechnologies.com>.
Hi Pumudu,
Thanks for your reply.
The command that was used to mount on windows was
mount -o nolock mtype=hard 10.66.27.171:/! W:
I was able to browse, but unable to write files. When I try to create/write
a file, it gives me the following error,
ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
creating file: testnfs.txt dir fileId:463160
Would like to use NFS itself, since we need to recreate the exact
folder/file structure on hdfs.
With Regards,
Gautam Hegde
On Fri, Nov 7, 2014 at 10:56 PM, Pumudu ruhunage <pu...@gmail.com> wrote:
> Hi Gautam,
>
> Can you please give more details of what you tried ? What's the command
> you execute to create? Were you able to browse hdfs through mount point ?
> As a alternative have you tried WebHDFS[1
> <http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're
> using windows it'll be easy if you try to use webhdfs as it's based on rest
> calls)
>
> [1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
>
> Regards,
>
> On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com>
> wrote:
>
>> Hi All,
>>
>> I have a use case where I need to transfer files from windows to HDFS. I
>> cannot use flume because the folder and file structure need to be
>> replicated as they are.
>> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
>> on windows, but when I try to write to it I get the following error.
>> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
>> creating file: New Text Document.txt dir fileId:463160
>>
>>
>> Is there any way to resolve this, so that I can successfully write from
>> windows to HDFS NFS?
>>
>> Thanks in advance
>> Gautam Hegde
>>
>>
>
>
> --
> Pumudu Ruhunage
>
> email : pumudu88@gmail.com
> work email : pumudu@wso2.com
> Blog : http://pumuduruhunage.blogspot.com/
>
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Can you please give more details of what you tried ? What's the command you
execute to create? Were you able to browse hdfs through mount point ?
As a alternative have you tried WebHDFS[1
<http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're using
windows it'll be easy if you try to use webhdfs as it's based on rest calls)
[1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
Regards,
On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com> wrote:
> Hi All,
>
> I have a use case where I need to transfer files from windows to HDFS. I
> cannot use flume because the folder and file structure need to be
> replicated as they are.
> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
> on windows, but when I try to write to it I get the following error.
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: New Text Document.txt dir fileId:463160
>
>
> Is there any way to resolve this, so that I can successfully write from
> windows to HDFS NFS?
>
> Thanks in advance
> Gautam Hegde
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Can you please give more details of what you tried ? What's the command you
execute to create? Were you able to browse hdfs through mount point ?
As a alternative have you tried WebHDFS[1
<http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're using
windows it'll be easy if you try to use webhdfs as it's based on rest calls)
[1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
Regards,
On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com> wrote:
> Hi All,
>
> I have a use case where I need to transfer files from windows to HDFS. I
> cannot use flume because the folder and file structure need to be
> replicated as they are.
> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
> on windows, but when I try to write to it I get the following error.
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: New Text Document.txt dir fileId:463160
>
>
> Is there any way to resolve this, so that I can successfully write from
> windows to HDFS NFS?
>
> Thanks in advance
> Gautam Hegde
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Can you please give more details of what you tried ? What's the command you
execute to create? Were you able to browse hdfs through mount point ?
As a alternative have you tried WebHDFS[1
<http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're using
windows it'll be easy if you try to use webhdfs as it's based on rest calls)
[1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
Regards,
On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com> wrote:
> Hi All,
>
> I have a use case where I need to transfer files from windows to HDFS. I
> cannot use flume because the folder and file structure need to be
> replicated as they are.
> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
> on windows, but when I try to write to it I get the following error.
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: New Text Document.txt dir fileId:463160
>
>
> Is there any way to resolve this, so that I can successfully write from
> windows to HDFS NFS?
>
> Thanks in advance
> Gautam Hegde
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/
Re: Error while writing to HDFS NFS from windows
Posted by Pumudu ruhunage <pu...@gmail.com>.
Hi Gautam,
Can you please give more details of what you tried ? What's the command you
execute to create? Were you able to browse hdfs through mount point ?
As a alternative have you tried WebHDFS[1
<http://hadoop.apache.org/docs/r1.0.4/webhdfs.html>] ? (Since you're using
windows it'll be easy if you try to use webhdfs as it's based on rest calls)
[1] http://hadoop.apache.org/docs/r1.0.4/webhdfs.html
Regards,
On 7 November 2014 11:10, Gautam Hegde <ga...@aralitechnologies.com> wrote:
> Hi All,
>
> I have a use case where I need to transfer files from windows to HDFS. I
> cannot use flume because the folder and file structure need to be
> replicated as they are.
> HDFS NFS is the perfect thing for this use case, I was able to mount hdfs
> on windows, but when I try to write to it I get the following error.
> ERROR nfs3.RpcProgramNfs3: Setting file size is not supported when
> creating file: New Text Document.txt dir fileId:463160
>
>
> Is there any way to resolve this, so that I can successfully write from
> windows to HDFS NFS?
>
> Thanks in advance
> Gautam Hegde
>
>
--
Pumudu Ruhunage
email : pumudu88@gmail.com
work email : pumudu@wso2.com
Blog : http://pumuduruhunage.blogspot.com/