You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Ranjitha Kashyap <ra...@gmail.com> on 2012/08/16 20:15:32 UTC
Deleting part files
I read that you can delete entire directory or files with proper file name,
but is it possible to remove files (like part*) in Oozie either with
<prepare> element or <fs> action?
Thanks,
Ranjitha
Re: Deleting part files
Posted by Mohammad Islam <mi...@yahoo.com>.
Ranjitha,
These are the alternatives:=0AIn Oozie 3.2, you should be able to run most of the commands using Shell Action including this.
For pre-3.2, you have to write your own java action to execute any hadoop fs command.
Regards,
Mohammad
________________________________
From: Ranjitha Kashyap <ra...@gmail.com>
To: oozie-users@incubator.apache.org
Sent: Thursday, August 16, 2012 3:23 PM
Subject: Re: Deleting part files
I cannot delete the entire directory as I have my final output in there.
For now, I have created a new action that calls the script to delete part-*
files.
It would be nice to have this feature in Oozie.
Thanks,
Ranjitha
On Thu, Aug 16, 2012 at 12:52 PM, Ben Flint <be...@gmail.com> wrote:
> Ranjitha,
> Would it be possible to structure your data and/or flow so that you could
> just delete the entire directory that contains the part* files?
> -Ben
>
> On Aug 16, 2012, at 12:48 PM, Ranjitha wrote:
>
> > Hi Robert,
> > You are right. I was looking for a feature to delete all the part-*
> files from Oozie.
> >
> > If convenient, please create a ticket on this.
> >
> > Thanks,
> > Ranjitha
> > On Aug 16, 2012, at 11:51 AM, Robert Kanter <rk...@cloudera.com>
> wrote:
> >
> >> I just tried deleting some files using a wildcard and it doesn't seem to
> >> work. If this is a feature you'd like, please create a JIRA for it (or
> I
> >> can create one for you if you prefer).
> >>
> >> If that wasn't your question, can you please clarify what you were
> asking?
> >>
> >> thanks
> >> - Robert
> >>
> >>
> >> On Thu, Aug 16, 2012 at 11:32 AM, Robert Kanter <rkanter@cloudera.com
> >wrote:
> >>
> >>> Hi,
> >>>
> >>> By part*, do you mean that you'd like to delete files using a wildcard?
> >>>
> >>> For example, if you had a a bunch of files named part-00000,
> part-00001,
> >>> part-00002, etc you want to be able to delete them all by telling
> Oozie to
> >>> delete part*. Is this what you're asking? Or did you mean something
> else?
> >>>
> >>>
> >>> thanks
> >>> - Robert
> >>>
> >>>
> >>>
> >>> On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <
> ranjithabv@gmail.com>wrote:
> >>>
> >>>> I read that you can delete entire directory or files with proper file
> >>>> name,
> >>>> but is it possible to remove files (like part*) in Oozie either with
> >>>> <prepare> element or <fs> action?
> >>>>
> >>>> Thanks,
> >>>> Ranjitha
> >>>>
> >>>
> >>>
>
>
Re: Deleting part files
Posted by Ranjitha Kashyap <ra...@gmail.com>.
I cannot delete the entire directory as I have my final output in there.
For now, I have created a new action that calls the script to delete part-*
files.
It would be nice to have this feature in Oozie.
Thanks,
Ranjitha
On Thu, Aug 16, 2012 at 12:52 PM, Ben Flint <be...@gmail.com> wrote:
> Ranjitha,
> Would it be possible to structure your data and/or flow so that you could
> just delete the entire directory that contains the part* files?
> -Ben
>
> On Aug 16, 2012, at 12:48 PM, Ranjitha wrote:
>
> > Hi Robert,
> > You are right. I was looking for a feature to delete all the part-*
> files from Oozie.
> >
> > If convenient, please create a ticket on this.
> >
> > Thanks,
> > Ranjitha
> > On Aug 16, 2012, at 11:51 AM, Robert Kanter <rk...@cloudera.com>
> wrote:
> >
> >> I just tried deleting some files using a wildcard and it doesn't seem to
> >> work. If this is a feature you'd like, please create a JIRA for it (or
> I
> >> can create one for you if you prefer).
> >>
> >> If that wasn't your question, can you please clarify what you were
> asking?
> >>
> >> thanks
> >> - Robert
> >>
> >>
> >> On Thu, Aug 16, 2012 at 11:32 AM, Robert Kanter <rkanter@cloudera.com
> >wrote:
> >>
> >>> Hi,
> >>>
> >>> By part*, do you mean that you'd like to delete files using a wildcard?
> >>>
> >>> For example, if you had a a bunch of files named part-00000,
> part-00001,
> >>> part-00002, etc you want to be able to delete them all by telling
> Oozie to
> >>> delete part*. Is this what you're asking? Or did you mean something
> else?
> >>>
> >>>
> >>> thanks
> >>> - Robert
> >>>
> >>>
> >>>
> >>> On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <
> ranjithabv@gmail.com>wrote:
> >>>
> >>>> I read that you can delete entire directory or files with proper file
> >>>> name,
> >>>> but is it possible to remove files (like part*) in Oozie either with
> >>>> <prepare> element or <fs> action?
> >>>>
> >>>> Thanks,
> >>>> Ranjitha
> >>>>
> >>>
> >>>
>
>
Re: Deleting part files
Posted by Ben Flint <be...@gmail.com>.
Ranjitha,
Would it be possible to structure your data and/or flow so that you could just delete the entire directory that contains the part* files?
-Ben
On Aug 16, 2012, at 12:48 PM, Ranjitha wrote:
> Hi Robert,
> You are right. I was looking for a feature to delete all the part-* files from Oozie.
>
> If convenient, please create a ticket on this.
>
> Thanks,
> Ranjitha
> On Aug 16, 2012, at 11:51 AM, Robert Kanter <rk...@cloudera.com> wrote:
>
>> I just tried deleting some files using a wildcard and it doesn't seem to
>> work. If this is a feature you'd like, please create a JIRA for it (or I
>> can create one for you if you prefer).
>>
>> If that wasn't your question, can you please clarify what you were asking?
>>
>> thanks
>> - Robert
>>
>>
>> On Thu, Aug 16, 2012 at 11:32 AM, Robert Kanter <rk...@cloudera.com>wrote:
>>
>>> Hi,
>>>
>>> By part*, do you mean that you'd like to delete files using a wildcard?
>>>
>>> For example, if you had a a bunch of files named part-00000, part-00001,
>>> part-00002, etc you want to be able to delete them all by telling Oozie to
>>> delete part*. Is this what you're asking? Or did you mean something else?
>>>
>>>
>>> thanks
>>> - Robert
>>>
>>>
>>>
>>> On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <ra...@gmail.com>wrote:
>>>
>>>> I read that you can delete entire directory or files with proper file
>>>> name,
>>>> but is it possible to remove files (like part*) in Oozie either with
>>>> <prepare> element or <fs> action?
>>>>
>>>> Thanks,
>>>> Ranjitha
>>>>
>>>
>>>
Re: Deleting part files
Posted by Alejandro Abdelnur <tu...@cloudera.com>.
Ranjitha,
Currently, Oozie FS operations don't support wildcards. You'd have to
delete the directory containing the part-* files.
Thx
On Thu, Aug 16, 2012 at 12:48 PM, Ranjitha <ra...@gmail.com> wrote:
> Hi Robert,
> You are right. I was looking for a feature to delete all the part-* files from Oozie.
>
> If convenient, please create a ticket on this.
>
> Thanks,
> Ranjitha
> On Aug 16, 2012, at 11:51 AM, Robert Kanter <rk...@cloudera.com> wrote:
>
>> I just tried deleting some files using a wildcard and it doesn't seem to
>> work. If this is a feature you'd like, please create a JIRA for it (or I
>> can create one for you if you prefer).
>>
>> If that wasn't your question, can you please clarify what you were asking?
>>
>> thanks
>> - Robert
>>
>>
>> On Thu, Aug 16, 2012 at 11:32 AM, Robert Kanter <rk...@cloudera.com>wrote:
>>
>>> Hi,
>>>
>>> By part*, do you mean that you'd like to delete files using a wildcard?
>>>
>>> For example, if you had a a bunch of files named part-00000, part-00001,
>>> part-00002, etc you want to be able to delete them all by telling Oozie to
>>> delete part*. Is this what you're asking? Or did you mean something else?
>>>
>>>
>>> thanks
>>> - Robert
>>>
>>>
>>>
>>> On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <ra...@gmail.com>wrote:
>>>
>>>> I read that you can delete entire directory or files with proper file
>>>> name,
>>>> but is it possible to remove files (like part*) in Oozie either with
>>>> <prepare> element or <fs> action?
>>>>
>>>> Thanks,
>>>> Ranjitha
>>>>
>>>
>>>
--
Alejandro
Re: Deleting part files
Posted by Ranjitha <ra...@gmail.com>.
Hi Robert,
You are right. I was looking for a feature to delete all the part-* files from Oozie.
If convenient, please create a ticket on this.
Thanks,
Ranjitha
On Aug 16, 2012, at 11:51 AM, Robert Kanter <rk...@cloudera.com> wrote:
> I just tried deleting some files using a wildcard and it doesn't seem to
> work. If this is a feature you'd like, please create a JIRA for it (or I
> can create one for you if you prefer).
>
> If that wasn't your question, can you please clarify what you were asking?
>
> thanks
> - Robert
>
>
> On Thu, Aug 16, 2012 at 11:32 AM, Robert Kanter <rk...@cloudera.com>wrote:
>
>> Hi,
>>
>> By part*, do you mean that you'd like to delete files using a wildcard?
>>
>> For example, if you had a a bunch of files named part-00000, part-00001,
>> part-00002, etc you want to be able to delete them all by telling Oozie to
>> delete part*. Is this what you're asking? Or did you mean something else?
>>
>>
>> thanks
>> - Robert
>>
>>
>>
>> On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <ra...@gmail.com>wrote:
>>
>>> I read that you can delete entire directory or files with proper file
>>> name,
>>> but is it possible to remove files (like part*) in Oozie either with
>>> <prepare> element or <fs> action?
>>>
>>> Thanks,
>>> Ranjitha
>>>
>>
>>
Re: Deleting part files
Posted by Robert Kanter <rk...@cloudera.com>.
I just tried deleting some files using a wildcard and it doesn't seem to
work. If this is a feature you'd like, please create a JIRA for it (or I
can create one for you if you prefer).
If that wasn't your question, can you please clarify what you were asking?
thanks
- Robert
On Thu, Aug 16, 2012 at 11:32 AM, Robert Kanter <rk...@cloudera.com>wrote:
> Hi,
>
> By part*, do you mean that you'd like to delete files using a wildcard?
>
> For example, if you had a a bunch of files named part-00000, part-00001,
> part-00002, etc you want to be able to delete them all by telling Oozie to
> delete part*. Is this what you're asking? Or did you mean something else?
>
>
> thanks
> - Robert
>
>
>
> On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <ra...@gmail.com>wrote:
>
>> I read that you can delete entire directory or files with proper file
>> name,
>> but is it possible to remove files (like part*) in Oozie either with
>> <prepare> element or <fs> action?
>>
>> Thanks,
>> Ranjitha
>>
>
>
Re: Deleting part files
Posted by Robert Kanter <rk...@cloudera.com>.
Hi,
By part*, do you mean that you'd like to delete files using a wildcard?
For example, if you had a a bunch of files named part-00000, part-00001,
part-00002, etc you want to be able to delete them all by telling Oozie to
delete part*. Is this what you're asking? Or did you mean something else?
thanks
- Robert
On Thu, Aug 16, 2012 at 11:15 AM, Ranjitha Kashyap <ra...@gmail.com>wrote:
> I read that you can delete entire directory or files with proper file name,
> but is it possible to remove files (like part*) in Oozie either with
> <prepare> element or <fs> action?
>
> Thanks,
> Ranjitha
>