You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by lijinlong <wa...@163.com> on 2013/04/19 13:00:41 UTC
Create and write files on mounted HDFS via java api
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Thank you for your reply.Would you please stick out your environments such as the jdk version,OS version,Hadoop version and the main configuration
of hadoop,fuse(or fuse-dfs ) configurations and some other configurations you did in order that I can compare with mine.Thank you!
> From: harsh@cloudera.com
> Date: Sat, 20 Apr 2013 21:56:19 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> To: user@hadoop.apache.org
>
> The program (the one on the SO question) seems to work alright for me
> when run on a 2.x FUSE mounted HDFS:
>
> ➜ ~ java Test
> true
>
> Not currently sure on what the presented error on SO means, but
> perhaps it was a permissions error? You can check the fuse_dfs' output
> or the NN log for more info on what is really failing cause I think it
> should work alright.
>
> On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> > Hi Hemanth
> > I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> > here http://wiki.apache.org/hadoop/MountableHDFS
> > There are various ways mounting HDFS as the url described
> > Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> > I just wonder if mounted HDFS supports the way I use,because I didn't see
> > anyone done that before.
> > ________________________________
> > Date: Sat, 20 Apr 2013 17:01:19 +0530
> >
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> > Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> > no other way of mounting HDFS.. Basically was wondering if some libraries
> > needed to be system path for the Java programs to work.
> >
> > From your response looks like you aren't using FUSE. So what are you using
> > to mount ?
> >
> > Hemanth
> >
> >
> > On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> >
> > Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> > do you know why?
> >
> > ________________________________
> > Date: Sat, 20 Apr 2013 15:48:36 +0530
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> >
> > Are you using Fuse for mounting HDFS ?
> >
> >
> > On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> >
> > I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> > the basic file operation such as create ,remove,copy etc just using linux
> > command and GUI.But when I tried to do the same thing in the mounted
> > directory via java api(not hadoop api),I got exceptions.The detail
> > information can be senn here.
> > http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> > .
> > Now my question is that if I can do file operactions to the mounted hdfs via
> > java api that I wrote in the url.If not,what should be the proper way to
> > acomplish that?
> >
> >
> >
> >
>
>
>
> --
> Harsh J
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Thank you for your reply.Would you please stick out your environments such as the jdk version,OS version,Hadoop version and the main configuration
of hadoop,fuse(or fuse-dfs ) configurations and some other configurations you did in order that I can compare with mine.Thank you!
> From: harsh@cloudera.com
> Date: Sat, 20 Apr 2013 21:56:19 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> To: user@hadoop.apache.org
>
> The program (the one on the SO question) seems to work alright for me
> when run on a 2.x FUSE mounted HDFS:
>
> ➜ ~ java Test
> true
>
> Not currently sure on what the presented error on SO means, but
> perhaps it was a permissions error? You can check the fuse_dfs' output
> or the NN log for more info on what is really failing cause I think it
> should work alright.
>
> On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> > Hi Hemanth
> > I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> > here http://wiki.apache.org/hadoop/MountableHDFS
> > There are various ways mounting HDFS as the url described
> > Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> > I just wonder if mounted HDFS supports the way I use,because I didn't see
> > anyone done that before.
> > ________________________________
> > Date: Sat, 20 Apr 2013 17:01:19 +0530
> >
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> > Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> > no other way of mounting HDFS.. Basically was wondering if some libraries
> > needed to be system path for the Java programs to work.
> >
> > From your response looks like you aren't using FUSE. So what are you using
> > to mount ?
> >
> > Hemanth
> >
> >
> > On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> >
> > Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> > do you know why?
> >
> > ________________________________
> > Date: Sat, 20 Apr 2013 15:48:36 +0530
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> >
> > Are you using Fuse for mounting HDFS ?
> >
> >
> > On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> >
> > I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> > the basic file operation such as create ,remove,copy etc just using linux
> > command and GUI.But when I tried to do the same thing in the mounted
> > directory via java api(not hadoop api),I got exceptions.The detail
> > information can be senn here.
> > http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> > .
> > Now my question is that if I can do file operactions to the mounted hdfs via
> > java api that I wrote in the url.If not,what should be the proper way to
> > acomplish that?
> >
> >
> >
> >
>
>
>
> --
> Harsh J
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Thank you for your reply.Would you please stick out your environments such as the jdk version,OS version,Hadoop version and the main configuration
of hadoop,fuse(or fuse-dfs ) configurations and some other configurations you did in order that I can compare with mine.Thank you!
> From: harsh@cloudera.com
> Date: Sat, 20 Apr 2013 21:56:19 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> To: user@hadoop.apache.org
>
> The program (the one on the SO question) seems to work alright for me
> when run on a 2.x FUSE mounted HDFS:
>
> ➜ ~ java Test
> true
>
> Not currently sure on what the presented error on SO means, but
> perhaps it was a permissions error? You can check the fuse_dfs' output
> or the NN log for more info on what is really failing cause I think it
> should work alright.
>
> On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> > Hi Hemanth
> > I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> > here http://wiki.apache.org/hadoop/MountableHDFS
> > There are various ways mounting HDFS as the url described
> > Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> > I just wonder if mounted HDFS supports the way I use,because I didn't see
> > anyone done that before.
> > ________________________________
> > Date: Sat, 20 Apr 2013 17:01:19 +0530
> >
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> > Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> > no other way of mounting HDFS.. Basically was wondering if some libraries
> > needed to be system path for the Java programs to work.
> >
> > From your response looks like you aren't using FUSE. So what are you using
> > to mount ?
> >
> > Hemanth
> >
> >
> > On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> >
> > Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> > do you know why?
> >
> > ________________________________
> > Date: Sat, 20 Apr 2013 15:48:36 +0530
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> >
> > Are you using Fuse for mounting HDFS ?
> >
> >
> > On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> >
> > I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> > the basic file operation such as create ,remove,copy etc just using linux
> > command and GUI.But when I tried to do the same thing in the mounted
> > directory via java api(not hadoop api),I got exceptions.The detail
> > information can be senn here.
> > http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> > .
> > Now my question is that if I can do file operactions to the mounted hdfs via
> > java api that I wrote in the url.If not,what should be the proper way to
> > acomplish that?
> >
> >
> >
> >
>
>
>
> --
> Harsh J
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Thank you for your reply.Would you please stick out your environments such as the jdk version,OS version,Hadoop version and the main configuration
of hadoop,fuse(or fuse-dfs ) configurations and some other configurations you did in order that I can compare with mine.Thank you!
> From: harsh@cloudera.com
> Date: Sat, 20 Apr 2013 21:56:19 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> To: user@hadoop.apache.org
>
> The program (the one on the SO question) seems to work alright for me
> when run on a 2.x FUSE mounted HDFS:
>
> ➜ ~ java Test
> true
>
> Not currently sure on what the presented error on SO means, but
> perhaps it was a permissions error? You can check the fuse_dfs' output
> or the NN log for more info on what is really failing cause I think it
> should work alright.
>
> On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> > Hi Hemanth
> > I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> > here http://wiki.apache.org/hadoop/MountableHDFS
> > There are various ways mounting HDFS as the url described
> > Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> > I just wonder if mounted HDFS supports the way I use,because I didn't see
> > anyone done that before.
> > ________________________________
> > Date: Sat, 20 Apr 2013 17:01:19 +0530
> >
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> > Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> > no other way of mounting HDFS.. Basically was wondering if some libraries
> > needed to be system path for the Java programs to work.
> >
> > From your response looks like you aren't using FUSE. So what are you using
> > to mount ?
> >
> > Hemanth
> >
> >
> > On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> >
> > Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> > do you know why?
> >
> > ________________________________
> > Date: Sat, 20 Apr 2013 15:48:36 +0530
> > Subject: Re: Create and write files on mounted HDFS via java api
> > From: yhemanth@thoughtworks.com
> > To: user@hadoop.apache.org
> >
> >
> > Are you using Fuse for mounting HDFS ?
> >
> >
> > On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> >
> > I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> > the basic file operation such as create ,remove,copy etc just using linux
> > command and GUI.But when I tried to do the same thing in the mounted
> > directory via java api(not hadoop api),I got exceptions.The detail
> > information can be senn here.
> > http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> > .
> > Now my question is that if I can do file operactions to the mounted hdfs via
> > java api that I wrote in the url.If not,what should be the proper way to
> > acomplish that?
> >
> >
> >
> >
>
>
>
> --
> Harsh J
Re: Create and write files on mounted HDFS via java api
Posted by Harsh J <ha...@cloudera.com>.
The program (the one on the SO question) seems to work alright for me
when run on a 2.x FUSE mounted HDFS:
➜ ~ java Test
true
Not currently sure on what the presented error on SO means, but
perhaps it was a permissions error? You can check the fuse_dfs' output
or the NN log for more info on what is really failing cause I think it
should work alright.
On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> Hi Hemanth
> I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> here http://wiki.apache.org/hadoop/MountableHDFS
> There are various ways mounting HDFS as the url described
> Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> I just wonder if mounted HDFS supports the way I use,because I didn't see
> anyone done that before.
> ________________________________
> Date: Sat, 20 Apr 2013 17:01:19 +0530
>
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
> Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> no other way of mounting HDFS.. Basically was wondering if some libraries
> needed to be system path for the Java programs to work.
>
> From your response looks like you aren't using FUSE. So what are you using
> to mount ?
>
> Hemanth
>
>
> On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
>
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> do you know why?
>
> ________________________________
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs via
> java api that I wrote in the url.If not,what should be the proper way to
> acomplish that?
>
>
>
>
--
Harsh J
Re: Create and write files on mounted HDFS via java api
Posted by Harsh J <ha...@cloudera.com>.
The program (the one on the SO question) seems to work alright for me
when run on a 2.x FUSE mounted HDFS:
➜ ~ java Test
true
Not currently sure on what the presented error on SO means, but
perhaps it was a permissions error? You can check the fuse_dfs' output
or the NN log for more info on what is really failing cause I think it
should work alright.
On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> Hi Hemanth
> I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> here http://wiki.apache.org/hadoop/MountableHDFS
> There are various ways mounting HDFS as the url described
> Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> I just wonder if mounted HDFS supports the way I use,because I didn't see
> anyone done that before.
> ________________________________
> Date: Sat, 20 Apr 2013 17:01:19 +0530
>
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
> Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> no other way of mounting HDFS.. Basically was wondering if some libraries
> needed to be system path for the Java programs to work.
>
> From your response looks like you aren't using FUSE. So what are you using
> to mount ?
>
> Hemanth
>
>
> On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
>
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> do you know why?
>
> ________________________________
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs via
> java api that I wrote in the url.If not,what should be the proper way to
> acomplish that?
>
>
>
>
--
Harsh J
Re: Create and write files on mounted HDFS via java api
Posted by Harsh J <ha...@cloudera.com>.
The program (the one on the SO question) seems to work alright for me
when run on a 2.x FUSE mounted HDFS:
➜ ~ java Test
true
Not currently sure on what the presented error on SO means, but
perhaps it was a permissions error? You can check the fuse_dfs' output
or the NN log for more info on what is really failing cause I think it
should work alright.
On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> Hi Hemanth
> I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> here http://wiki.apache.org/hadoop/MountableHDFS
> There are various ways mounting HDFS as the url described
> Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> I just wonder if mounted HDFS supports the way I use,because I didn't see
> anyone done that before.
> ________________________________
> Date: Sat, 20 Apr 2013 17:01:19 +0530
>
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
> Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> no other way of mounting HDFS.. Basically was wondering if some libraries
> needed to be system path for the Java programs to work.
>
> From your response looks like you aren't using FUSE. So what are you using
> to mount ?
>
> Hemanth
>
>
> On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
>
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> do you know why?
>
> ________________________________
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs via
> java api that I wrote in the url.If not,what should be the proper way to
> acomplish that?
>
>
>
>
--
Harsh J
Re: Create and write files on mounted HDFS via java api
Posted by Harsh J <ha...@cloudera.com>.
The program (the one on the SO question) seems to work alright for me
when run on a 2.x FUSE mounted HDFS:
➜ ~ java Test
true
Not currently sure on what the presented error on SO means, but
perhaps it was a permissions error? You can check the fuse_dfs' output
or the NN log for more info on what is really failing cause I think it
should work alright.
On Sat, Apr 20, 2013 at 5:19 PM, 金龙 李 <wa...@live.com> wrote:
> Hi Hemanth
> I did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as
> here http://wiki.apache.org/hadoop/MountableHDFS
> There are various ways mounting HDFS as the url described
> Besides FUSE I tried hdfs-nfs-proxy，but both failed.
> I just wonder if mounted HDFS supports the way I use,because I didn't see
> anyone done that before.
> ________________________________
> Date: Sat, 20 Apr 2013 17:01:19 +0530
>
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
> Sorry - no. I just wanted to know if you were using FUSE, because I knew of
> no other way of mounting HDFS.. Basically was wondering if some libraries
> needed to be system path for the Java programs to work.
>
> From your response looks like you aren't using FUSE. So what are you using
> to mount ?
>
> Hemanth
>
>
> On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
>
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And
> do you know why?
>
> ________________________________
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs via
> java api that I wrote in the url.If not,what should be the proper way to
> acomplish that?
>
>
>
>
--
Harsh J
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Hi HemanthI did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as here http://wiki.apache.org/hadoop/MountableHDFSThere are various ways mounting HDFS as the url describedBesides FUSE I tried hdfs-nfs-proxy，but both failed.I just wonder if mounted HDFS supports the way I use,because I didn't see anyone done that before.
Date: Sat, 20 Apr 2013 17:01:19 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Sorry - no. I just wanted to know if you were using FUSE, because I knew of no other way of mounting HDFS.. Basically was wondering if some libraries needed to be system path for the Java programs to work.
From your response looks like you aren't using FUSE. So what are you using to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Hi HemanthI did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as here http://wiki.apache.org/hadoop/MountableHDFSThere are various ways mounting HDFS as the url describedBesides FUSE I tried hdfs-nfs-proxy，but both failed.I just wonder if mounted HDFS supports the way I use,because I didn't see anyone done that before.
Date: Sat, 20 Apr 2013 17:01:19 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Sorry - no. I just wanted to know if you were using FUSE, because I knew of no other way of mounting HDFS.. Basically was wondering if some libraries needed to be system path for the Java programs to work.
From your response looks like you aren't using FUSE. So what are you using to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Hi HemanthI did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as here http://wiki.apache.org/hadoop/MountableHDFSThere are various ways mounting HDFS as the url describedBesides FUSE I tried hdfs-nfs-proxy，but both failed.I just wonder if mounted HDFS supports the way I use,because I didn't see anyone done that before.
Date: Sat, 20 Apr 2013 17:01:19 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Sorry - no. I just wanted to know if you were using FUSE, because I knew of no other way of mounting HDFS.. Basically was wondering if some libraries needed to be system path for the Java programs to work.
From your response looks like you aren't using FUSE. So what are you using to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Hi HemanthI did used contrib/fuse-dfs to mount HDFS which is built on FUSE,I did it as here http://wiki.apache.org/hadoop/MountableHDFSThere are various ways mounting HDFS as the url describedBesides FUSE I tried hdfs-nfs-proxy，but both failed.I just wonder if mounted HDFS supports the way I use,because I didn't see anyone done that before.
Date: Sat, 20 Apr 2013 17:01:19 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Sorry - no. I just wanted to know if you were using FUSE, because I knew of no other way of mounting HDFS.. Basically was wondering if some libraries needed to be system path for the Java programs to work.
From your response looks like you aren't using FUSE. So what are you using to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Sorry - no. I just wanted to know if you were using FUSE, because I knew of
no other way of mounting HDFS.. Basically was wondering if some libraries
needed to be system path for the Java programs to work.
>From your response looks like you aren't using FUSE. So what are you using
to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this
> before?And do you know why?
>
> ------------------------------
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
>
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Sorry - no. I just wanted to know if you were using FUSE, because I knew of
no other way of mounting HDFS.. Basically was wondering if some libraries
needed to be system path for the Java programs to work.
>From your response looks like you aren't using FUSE. So what are you using
to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this
> before?And do you know why?
>
> ------------------------------
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
>
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Sorry - no. I just wanted to know if you were using FUSE, because I knew of
no other way of mounting HDFS.. Basically was wondering if some libraries
needed to be system path for the Java programs to work.
>From your response looks like you aren't using FUSE. So what are you using
to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this
> before?And do you know why?
>
> ------------------------------
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
>
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Sorry - no. I just wanted to know if you were using FUSE, because I knew of
no other way of mounting HDFS.. Basically was wondering if some libraries
needed to be system path for the Java programs to work.
>From your response looks like you aren't using FUSE. So what are you using
to mount ?
Hemanth
On Sat, Apr 20, 2013 at 4:24 PM, 金龙 李 <wa...@live.com> wrote:
> Yes,I tried both FUSE and NTFS,but all failed.Have you done this
> before?And do you know why?
>
> ------------------------------
> Date: Sat, 20 Apr 2013 15:48:36 +0530
> Subject: Re: Create and write files on mounted HDFS via java api
> From: yhemanth@thoughtworks.com
> To: user@hadoop.apache.org
>
>
> Are you using Fuse for mounting HDFS ?
>
>
> On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
>
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
>
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
RE: Create and write files on mounted HDFS via java api
Posted by 金龙 李 <wa...@live.com>.
Yes,I tried both FUSE and NTFS,but all failed.Have you done this before?And do you know why?
Date: Sat, 20 Apr 2013 15:48:36 +0530
Subject: Re: Create and write files on mounted HDFS via java api
From: yhemanth@thoughtworks.com
To: user@hadoop.apache.org
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do the basic file operation such as create ,remove,copy etc just using linux command and GUI.But when I tried to do the same thing in the mounted directory via java api(not hadoop api),I got exceptions.The detail information can be senn here. http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs .
Now my question is that if I can do file operactions to the mounted hdfs via java api that I wrote in the url.If not,what should be the proper way to acomplish that?
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>
Re: Create and write files on mounted HDFS via java api
Posted by Hemanth Yamijala <yh...@thoughtworks.com>.
Are you using Fuse for mounting HDFS ?
On Fri, Apr 19, 2013 at 4:30 PM, lijinlong <wa...@163.com> wrote:
> I mounted HDFS to a local directory for storage,that is /mnt/hdfs.I can do
> the basic file operation such as create ,remove,copy etc just using linux
> command and GUI.But when I tried to do the same thing in the mounted
> directory via java api(not hadoop api),I got exceptions.The detail
> information can be senn here.
> http://stackoverflow.com/questions/16083497/java-exception-when-creating-or-writing-files-on-mounted-hdfs
> .
> Now my question is that if I can do file operactions to the mounted hdfs
> via java api that I wrote in the url.If not,what should be the proper way
> to acomplish that?
>
>
>