You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by rab ra <ra...@gmail.com> on 2013/08/22 11:51:22 UTC
Fwd: Create a file in local file system in map method
---------- Forwarded message ----------
From: "rab ra" <ra...@gmail.com>
Date: 22 Aug 2013 15:14
Subject: Create a file in local file system in map method
To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
Hi
i am not able to create a file in my local file system from my map method.
Is there a way to do it? Please provide some links. My map need to generate
one file during execution. When executing in remote node it shoul generate
the file in a predefined location inthe execution node.
Thanks
Rab
Re: Create a file in local file system in map method
Posted by "Balachandar R.A." <ba...@gmail.com>.
Yes
It was permission issue. I could fix this now.
Thanks
On 22 Aug 2013 15:49, "Harsh J" <ha...@cloudera.com> wrote:
> Can you share what error you run into in trying to write to a local
> filesystem location from within a map task?
>
> Note that the map tasks will run as the same user as the TaskTracker
> daemon in insecure environments, or as the job submitting user in
> secure environments. The location you're writing to, should allow
> permissions appropriately depending on the above.
>
> On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 22 Aug 2013 15:14
> > Subject: Create a file in local file system in map method
> > To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hi
> >
> > i am not able to create a file in my local file system from my map
> method.
> > Is there a way to do it? Please provide some links. My map need to
> generate
> > one file during execution. When executing in remote node it shoul
> generate
> > the file in a predefined location inthe execution node.
> >
> > Thanks
> > Rab
>
>
>
> --
> Harsh J
>
Re: Create a file in local file system in map method
Posted by "Balachandar R.A." <ba...@gmail.com>.
Yes
It was permission issue. I could fix this now.
Thanks
On 22 Aug 2013 15:49, "Harsh J" <ha...@cloudera.com> wrote:
> Can you share what error you run into in trying to write to a local
> filesystem location from within a map task?
>
> Note that the map tasks will run as the same user as the TaskTracker
> daemon in insecure environments, or as the job submitting user in
> secure environments. The location you're writing to, should allow
> permissions appropriately depending on the above.
>
> On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 22 Aug 2013 15:14
> > Subject: Create a file in local file system in map method
> > To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hi
> >
> > i am not able to create a file in my local file system from my map
> method.
> > Is there a way to do it? Please provide some links. My map need to
> generate
> > one file during execution. When executing in remote node it shoul
> generate
> > the file in a predefined location inthe execution node.
> >
> > Thanks
> > Rab
>
>
>
> --
> Harsh J
>
Re: Create a file in local file system in map method
Posted by "Balachandar R.A." <ba...@gmail.com>.
Yes
It was permission issue. I could fix this now.
Thanks
On 22 Aug 2013 15:49, "Harsh J" <ha...@cloudera.com> wrote:
> Can you share what error you run into in trying to write to a local
> filesystem location from within a map task?
>
> Note that the map tasks will run as the same user as the TaskTracker
> daemon in insecure environments, or as the job submitting user in
> secure environments. The location you're writing to, should allow
> permissions appropriately depending on the above.
>
> On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 22 Aug 2013 15:14
> > Subject: Create a file in local file system in map method
> > To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hi
> >
> > i am not able to create a file in my local file system from my map
> method.
> > Is there a way to do it? Please provide some links. My map need to
> generate
> > one file during execution. When executing in remote node it shoul
> generate
> > the file in a predefined location inthe execution node.
> >
> > Thanks
> > Rab
>
>
>
> --
> Harsh J
>
Re: Create a file in local file system in map method
Posted by "Balachandar R.A." <ba...@gmail.com>.
Yes
It was permission issue. I could fix this now.
Thanks
On 22 Aug 2013 15:49, "Harsh J" <ha...@cloudera.com> wrote:
> Can you share what error you run into in trying to write to a local
> filesystem location from within a map task?
>
> Note that the map tasks will run as the same user as the TaskTracker
> daemon in insecure environments, or as the job submitting user in
> secure environments. The location you're writing to, should allow
> permissions appropriately depending on the above.
>
> On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> > ---------- Forwarded message ----------
> > From: "rab ra" <ra...@gmail.com>
> > Date: 22 Aug 2013 15:14
> > Subject: Create a file in local file system in map method
> > To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
> >
> > Hi
> >
> > i am not able to create a file in my local file system from my map
> method.
> > Is there a way to do it? Please provide some links. My map need to
> generate
> > one file during execution. When executing in remote node it shoul
> generate
> > the file in a predefined location inthe execution node.
> >
> > Thanks
> > Rab
>
>
>
> --
> Harsh J
>
Re: Create a file in local file system in map method
Posted by Harsh J <ha...@cloudera.com>.
Can you share what error you run into in trying to write to a local
filesystem location from within a map task?
Note that the map tasks will run as the same user as the TaskTracker
daemon in insecure environments, or as the job submitting user in
secure environments. The location you're writing to, should allow
permissions appropriately depending on the above.
On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 22 Aug 2013 15:14
> Subject: Create a file in local file system in map method
> To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hi
>
> i am not able to create a file in my local file system from my map method.
> Is there a way to do it? Please provide some links. My map need to generate
> one file during execution. When executing in remote node it shoul generate
> the file in a predefined location inthe execution node.
>
> Thanks
> Rab
--
Harsh J
Re: Create a file in local file system in map method
Posted by Harsh J <ha...@cloudera.com>.
Can you share what error you run into in trying to write to a local
filesystem location from within a map task?
Note that the map tasks will run as the same user as the TaskTracker
daemon in insecure environments, or as the job submitting user in
secure environments. The location you're writing to, should allow
permissions appropriately depending on the above.
On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 22 Aug 2013 15:14
> Subject: Create a file in local file system in map method
> To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hi
>
> i am not able to create a file in my local file system from my map method.
> Is there a way to do it? Please provide some links. My map need to generate
> one file during execution. When executing in remote node it shoul generate
> the file in a predefined location inthe execution node.
>
> Thanks
> Rab
--
Harsh J
Re: Create a file in local file system in map method
Posted by Harsh J <ha...@cloudera.com>.
Can you share what error you run into in trying to write to a local
filesystem location from within a map task?
Note that the map tasks will run as the same user as the TaskTracker
daemon in insecure environments, or as the job submitting user in
secure environments. The location you're writing to, should allow
permissions appropriately depending on the above.
On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 22 Aug 2013 15:14
> Subject: Create a file in local file system in map method
> To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hi
>
> i am not able to create a file in my local file system from my map method.
> Is there a way to do it? Please provide some links. My map need to generate
> one file during execution. When executing in remote node it shoul generate
> the file in a predefined location inthe execution node.
>
> Thanks
> Rab
--
Harsh J
Re: Create a file in local file system in map method
Posted by Harsh J <ha...@cloudera.com>.
Can you share what error you run into in trying to write to a local
filesystem location from within a map task?
Note that the map tasks will run as the same user as the TaskTracker
daemon in insecure environments, or as the job submitting user in
secure environments. The location you're writing to, should allow
permissions appropriately depending on the above.
On Thu, Aug 22, 2013 at 3:21 PM, rab ra <ra...@gmail.com> wrote:
> ---------- Forwarded message ----------
> From: "rab ra" <ra...@gmail.com>
> Date: 22 Aug 2013 15:14
> Subject: Create a file in local file system in map method
> To: "users@hadoop.apache.org" <us...@hadoop.apache.org>
>
> Hi
>
> i am not able to create a file in my local file system from my map method.
> Is there a way to do it? Please provide some links. My map need to generate
> one file during execution. When executing in remote node it shoul generate
> the file in a predefined location inthe execution node.
>
> Thanks
> Rab
--
Harsh J