You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hadoop.apache.org by feng jiang <ji...@gmail.com> on 2013/06/13 03:58:15 UTC
recovery accidently deleted pig script
Hi everyone,
We have a pig script scheduled running every 4 hours. Someone accidentally
deleted the pig script(rm). Is there any way to recover the script?
I am guessing Hadoop copy the program to every nodes before running. Just
in case it has any copy in the nodes.
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by Michel Segel <mi...@hotmail.com>.
Well if the script was sitting on the cluster... Then it would be a Hadoop question.
?How do you recover a file that was deleted on HDFS?
Which is an interesting question...
But the OP said it wasn't on HDFS, and to your point... One can only say sorry dude, bummer, rewrite it.
Sorry you're having a rough day.
This is why I usually say Embrace the suck.
Sent from a remote device. Please excuse any typos...
Mike Segel
On Jun 12, 2013, at 9:35 PM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> Where was the pig script? On HDFS?
>>
>> How often does your cluster clean up the trash?
>>
>> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
>> configurable setting so YMMV
>>
>> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> We have a pig script scheduled running every 4 hours. Someone accidentally
>>> deleted the pig script(rm). Is there any way to recover the script?
>>>
>>> I am guessing Hadoop copy the program to every nodes before running. Just
>>> in case it has any copy in the nodes.
>>>
>>>
>>> Best regards,
>>> Feng Jiang
>
Re: recovery accidently deleted pig script
Posted by Michel Segel <mi...@hotmail.com>.
Well if the script was sitting on the cluster... Then it would be a Hadoop question.
?How do you recover a file that was deleted on HDFS?
Which is an interesting question...
But the OP said it wasn't on HDFS, and to your point... One can only say sorry dude, bummer, rewrite it.
Sorry you're having a rough day.
This is why I usually say Embrace the suck.
Sent from a remote device. Please excuse any typos...
Mike Segel
On Jun 12, 2013, at 9:35 PM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> Where was the pig script? On HDFS?
>>
>> How often does your cluster clean up the trash?
>>
>> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
>> configurable setting so YMMV
>>
>> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> We have a pig script scheduled running every 4 hours. Someone accidentally
>>> deleted the pig script(rm). Is there any way to recover the script?
>>>
>>> I am guessing Hadoop copy the program to every nodes before running. Just
>>> in case it has any copy in the nodes.
>>>
>>>
>>> Best regards,
>>> Feng Jiang
>
Re: recovery accidently deleted pig script
Posted by Michel Segel <mi...@hotmail.com>.
Well if the script was sitting on the cluster... Then it would be a Hadoop question.
?How do you recover a file that was deleted on HDFS?
Which is an interesting question...
But the OP said it wasn't on HDFS, and to your point... One can only say sorry dude, bummer, rewrite it.
Sorry you're having a rough day.
This is why I usually say Embrace the suck.
Sent from a remote device. Please excuse any typos...
Mike Segel
On Jun 12, 2013, at 9:35 PM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> Where was the pig script? On HDFS?
>>
>> How often does your cluster clean up the trash?
>>
>> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
>> configurable setting so YMMV
>>
>> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> We have a pig script scheduled running every 4 hours. Someone accidentally
>>> deleted the pig script(rm). Is there any way to recover the script?
>>>
>>> I am guessing Hadoop copy the program to every nodes before running. Just
>>> in case it has any copy in the nodes.
>>>
>>>
>>> Best regards,
>>> Feng Jiang
>
RE: recovery accidently deleted pig script
Posted by zangxiangyu <za...@qiyi.com>.
Hi,
If the pig process is not closed ,try lsof may helpJ
The files used by one process
/proc/<pid>/fd/<file>,use lsof to find full path ,copy the file in memory to disk.
God bless you.
From: feng jiang [mailto:jiangfutian@gmail.com]
Sent: Thursday, June 13, 2013 5:33 PM
To: user@hadoop.apache.org; chris@embree.us
Subject: Re: recovery accidently deleted pig script
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
--
Best regards,
Feng Jiang
RE: recovery accidently deleted pig script
Posted by zangxiangyu <za...@qiyi.com>.
Hi,
If the pig process is not closed ,try lsof may helpJ
The files used by one process
/proc/<pid>/fd/<file>,use lsof to find full path ,copy the file in memory to disk.
God bless you.
From: feng jiang [mailto:jiangfutian@gmail.com]
Sent: Thursday, June 13, 2013 5:33 PM
To: user@hadoop.apache.org; chris@embree.us
Subject: Re: recovery accidently deleted pig script
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
Thanks Bertrand,
This is what I was thinking. But looks there is no way to recover the
script from interpretation one.
Thanks
Jeff
On Thu, Jun 13, 2013 at 5:54 PM, Bertrand Dechoux <de...@gmail.com>wrote:
> But no the script is not send to the cluster so you won't be able to
> recover from here because what is send is the 'interpretation' of the
> script.
> If that was the case, that would be a question for the pig mailing list.
>
> Regards
>
> Bertrand
>
>
> On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com>wrote:
>
>> The script is on local file system. it's on linux box.
>>
>> I totally agree we need version control for the source code. this is a
>> good example to show the importance of version control.
>>
>> Thank you Michael and Chris for your inputs anyway.
>>
>>
>>
>> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>>
>>> This is not a Hadoop question (IMHO).
>>>
>>> 2 words: Version Control
>>>
>>> Did the advent of Hadoop somehow circumvent all IT convention?
>>>
>>> Sorry folks, it's been a rough day.
>>>
>>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>>> > Where was the pig script? On HDFS?
>>> >
>>> > How often does your cluster clean up the trash?
>>> >
>>> > (Deleted stuff doesn't get cleaned up when the file is deleted... )
>>> Its a
>>> > configurable setting so YMMV
>>> >
>>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>> >
>>> >> Hi everyone,
>>> >>
>>> >> We have a pig script scheduled running every 4 hours. Someone
>>> accidentally
>>> >> deleted the pig script(rm). Is there any way to recover the script?
>>> >>
>>> >> I am guessing Hadoop copy the program to every nodes before running.
>>> Just
>>> >> in case it has any copy in the nodes.
>>> >>
>>> >>
>>> >> Best regards,
>>> >> Feng Jiang
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Best regards,
>> Feng Jiang
>>
>
>
>
> --
> Bertrand Dechoux
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
Thanks Bertrand,
This is what I was thinking. But looks there is no way to recover the
script from interpretation one.
Thanks
Jeff
On Thu, Jun 13, 2013 at 5:54 PM, Bertrand Dechoux <de...@gmail.com>wrote:
> But no the script is not send to the cluster so you won't be able to
> recover from here because what is send is the 'interpretation' of the
> script.
> If that was the case, that would be a question for the pig mailing list.
>
> Regards
>
> Bertrand
>
>
> On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com>wrote:
>
>> The script is on local file system. it's on linux box.
>>
>> I totally agree we need version control for the source code. this is a
>> good example to show the importance of version control.
>>
>> Thank you Michael and Chris for your inputs anyway.
>>
>>
>>
>> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>>
>>> This is not a Hadoop question (IMHO).
>>>
>>> 2 words: Version Control
>>>
>>> Did the advent of Hadoop somehow circumvent all IT convention?
>>>
>>> Sorry folks, it's been a rough day.
>>>
>>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>>> > Where was the pig script? On HDFS?
>>> >
>>> > How often does your cluster clean up the trash?
>>> >
>>> > (Deleted stuff doesn't get cleaned up when the file is deleted... )
>>> Its a
>>> > configurable setting so YMMV
>>> >
>>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>> >
>>> >> Hi everyone,
>>> >>
>>> >> We have a pig script scheduled running every 4 hours. Someone
>>> accidentally
>>> >> deleted the pig script(rm). Is there any way to recover the script?
>>> >>
>>> >> I am guessing Hadoop copy the program to every nodes before running.
>>> Just
>>> >> in case it has any copy in the nodes.
>>> >>
>>> >>
>>> >> Best regards,
>>> >> Feng Jiang
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Best regards,
>> Feng Jiang
>>
>
>
>
> --
> Bertrand Dechoux
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
Thanks Bertrand,
This is what I was thinking. But looks there is no way to recover the
script from interpretation one.
Thanks
Jeff
On Thu, Jun 13, 2013 at 5:54 PM, Bertrand Dechoux <de...@gmail.com>wrote:
> But no the script is not send to the cluster so you won't be able to
> recover from here because what is send is the 'interpretation' of the
> script.
> If that was the case, that would be a question for the pig mailing list.
>
> Regards
>
> Bertrand
>
>
> On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com>wrote:
>
>> The script is on local file system. it's on linux box.
>>
>> I totally agree we need version control for the source code. this is a
>> good example to show the importance of version control.
>>
>> Thank you Michael and Chris for your inputs anyway.
>>
>>
>>
>> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>>
>>> This is not a Hadoop question (IMHO).
>>>
>>> 2 words: Version Control
>>>
>>> Did the advent of Hadoop somehow circumvent all IT convention?
>>>
>>> Sorry folks, it's been a rough day.
>>>
>>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>>> > Where was the pig script? On HDFS?
>>> >
>>> > How often does your cluster clean up the trash?
>>> >
>>> > (Deleted stuff doesn't get cleaned up when the file is deleted... )
>>> Its a
>>> > configurable setting so YMMV
>>> >
>>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>> >
>>> >> Hi everyone,
>>> >>
>>> >> We have a pig script scheduled running every 4 hours. Someone
>>> accidentally
>>> >> deleted the pig script(rm). Is there any way to recover the script?
>>> >>
>>> >> I am guessing Hadoop copy the program to every nodes before running.
>>> Just
>>> >> in case it has any copy in the nodes.
>>> >>
>>> >>
>>> >> Best regards,
>>> >> Feng Jiang
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Best regards,
>> Feng Jiang
>>
>
>
>
> --
> Bertrand Dechoux
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
Thanks Bertrand,
This is what I was thinking. But looks there is no way to recover the
script from interpretation one.
Thanks
Jeff
On Thu, Jun 13, 2013 at 5:54 PM, Bertrand Dechoux <de...@gmail.com>wrote:
> But no the script is not send to the cluster so you won't be able to
> recover from here because what is send is the 'interpretation' of the
> script.
> If that was the case, that would be a question for the pig mailing list.
>
> Regards
>
> Bertrand
>
>
> On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com>wrote:
>
>> The script is on local file system. it's on linux box.
>>
>> I totally agree we need version control for the source code. this is a
>> good example to show the importance of version control.
>>
>> Thank you Michael and Chris for your inputs anyway.
>>
>>
>>
>> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>>
>>> This is not a Hadoop question (IMHO).
>>>
>>> 2 words: Version Control
>>>
>>> Did the advent of Hadoop somehow circumvent all IT convention?
>>>
>>> Sorry folks, it's been a rough day.
>>>
>>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>>> > Where was the pig script? On HDFS?
>>> >
>>> > How often does your cluster clean up the trash?
>>> >
>>> > (Deleted stuff doesn't get cleaned up when the file is deleted... )
>>> Its a
>>> > configurable setting so YMMV
>>> >
>>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>> >
>>> >> Hi everyone,
>>> >>
>>> >> We have a pig script scheduled running every 4 hours. Someone
>>> accidentally
>>> >> deleted the pig script(rm). Is there any way to recover the script?
>>> >>
>>> >> I am guessing Hadoop copy the program to every nodes before running.
>>> Just
>>> >> in case it has any copy in the nodes.
>>> >>
>>> >>
>>> >> Best regards,
>>> >> Feng Jiang
>>> >
>>> >
>>>
>>
>>
>>
>> --
>> Best regards,
>> Feng Jiang
>>
>
>
>
> --
> Bertrand Dechoux
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by Bertrand Dechoux <de...@gmail.com>.
But no the script is not send to the cluster so you won't be able to
recover from here because what is send is the 'interpretation' of the
script.
If that was the case, that would be a question for the pig mailing list.
Regards
Bertrand
On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com> wrote:
> The script is on local file system. it's on linux box.
>
> I totally agree we need version control for the source code. this is a
> good example to show the importance of version control.
>
> Thank you Michael and Chris for your inputs anyway.
>
>
>
> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>
>> This is not a Hadoop question (IMHO).
>>
>> 2 words: Version Control
>>
>> Did the advent of Hadoop somehow circumvent all IT convention?
>>
>> Sorry folks, it's been a rough day.
>>
>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> > Where was the pig script? On HDFS?
>> >
>> > How often does your cluster clean up the trash?
>> >
>> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its
>> a
>> > configurable setting so YMMV
>> >
>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>> >
>> >> Hi everyone,
>> >>
>> >> We have a pig script scheduled running every 4 hours. Someone
>> accidentally
>> >> deleted the pig script(rm). Is there any way to recover the script?
>> >>
>> >> I am guessing Hadoop copy the program to every nodes before running.
>> Just
>> >> in case it has any copy in the nodes.
>> >>
>> >>
>> >> Best regards,
>> >> Feng Jiang
>> >
>> >
>>
>
>
>
> --
> Best regards,
> Feng Jiang
>
--
Bertrand Dechoux
RE: recovery accidently deleted pig script
Posted by zangxiangyu <za...@qiyi.com>.
Hi,
If the pig process is not closed ,try lsof may helpJ
The files used by one process
/proc/<pid>/fd/<file>,use lsof to find full path ,copy the file in memory to disk.
God bless you.
From: feng jiang [mailto:jiangfutian@gmail.com]
Sent: Thursday, June 13, 2013 5:33 PM
To: user@hadoop.apache.org; chris@embree.us
Subject: Re: recovery accidently deleted pig script
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by Bertrand Dechoux <de...@gmail.com>.
But no the script is not send to the cluster so you won't be able to
recover from here because what is send is the 'interpretation' of the
script.
If that was the case, that would be a question for the pig mailing list.
Regards
Bertrand
On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com> wrote:
> The script is on local file system. it's on linux box.
>
> I totally agree we need version control for the source code. this is a
> good example to show the importance of version control.
>
> Thank you Michael and Chris for your inputs anyway.
>
>
>
> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>
>> This is not a Hadoop question (IMHO).
>>
>> 2 words: Version Control
>>
>> Did the advent of Hadoop somehow circumvent all IT convention?
>>
>> Sorry folks, it's been a rough day.
>>
>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> > Where was the pig script? On HDFS?
>> >
>> > How often does your cluster clean up the trash?
>> >
>> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its
>> a
>> > configurable setting so YMMV
>> >
>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>> >
>> >> Hi everyone,
>> >>
>> >> We have a pig script scheduled running every 4 hours. Someone
>> accidentally
>> >> deleted the pig script(rm). Is there any way to recover the script?
>> >>
>> >> I am guessing Hadoop copy the program to every nodes before running.
>> Just
>> >> in case it has any copy in the nodes.
>> >>
>> >>
>> >> Best regards,
>> >> Feng Jiang
>> >
>> >
>>
>
>
>
> --
> Best regards,
> Feng Jiang
>
--
Bertrand Dechoux
Re: recovery accidently deleted pig script
Posted by Bertrand Dechoux <de...@gmail.com>.
But no the script is not send to the cluster so you won't be able to
recover from here because what is send is the 'interpretation' of the
script.
If that was the case, that would be a question for the pig mailing list.
Regards
Bertrand
On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com> wrote:
> The script is on local file system. it's on linux box.
>
> I totally agree we need version control for the source code. this is a
> good example to show the importance of version control.
>
> Thank you Michael and Chris for your inputs anyway.
>
>
>
> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>
>> This is not a Hadoop question (IMHO).
>>
>> 2 words: Version Control
>>
>> Did the advent of Hadoop somehow circumvent all IT convention?
>>
>> Sorry folks, it's been a rough day.
>>
>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> > Where was the pig script? On HDFS?
>> >
>> > How often does your cluster clean up the trash?
>> >
>> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its
>> a
>> > configurable setting so YMMV
>> >
>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>> >
>> >> Hi everyone,
>> >>
>> >> We have a pig script scheduled running every 4 hours. Someone
>> accidentally
>> >> deleted the pig script(rm). Is there any way to recover the script?
>> >>
>> >> I am guessing Hadoop copy the program to every nodes before running.
>> Just
>> >> in case it has any copy in the nodes.
>> >>
>> >>
>> >> Best regards,
>> >> Feng Jiang
>> >
>> >
>>
>
>
>
> --
> Best regards,
> Feng Jiang
>
--
Bertrand Dechoux
Re: recovery accidently deleted pig script
Posted by Bertrand Dechoux <de...@gmail.com>.
But no the script is not send to the cluster so you won't be able to
recover from here because what is send is the 'interpretation' of the
script.
If that was the case, that would be a question for the pig mailing list.
Regards
Bertrand
On Thu, Jun 13, 2013 at 11:33 AM, feng jiang <ji...@gmail.com> wrote:
> The script is on local file system. it's on linux box.
>
> I totally agree we need version control for the source code. this is a
> good example to show the importance of version control.
>
> Thank you Michael and Chris for your inputs anyway.
>
>
>
> On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
>
>> This is not a Hadoop question (IMHO).
>>
>> 2 words: Version Control
>>
>> Did the advent of Hadoop somehow circumvent all IT convention?
>>
>> Sorry folks, it's been a rough day.
>>
>> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> > Where was the pig script? On HDFS?
>> >
>> > How often does your cluster clean up the trash?
>> >
>> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its
>> a
>> > configurable setting so YMMV
>> >
>> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>> >
>> >> Hi everyone,
>> >>
>> >> We have a pig script scheduled running every 4 hours. Someone
>> accidentally
>> >> deleted the pig script(rm). Is there any way to recover the script?
>> >>
>> >> I am guessing Hadoop copy the program to every nodes before running.
>> Just
>> >> in case it has any copy in the nodes.
>> >>
>> >>
>> >> Best regards,
>> >> Feng Jiang
>> >
>> >
>>
>
>
>
> --
> Best regards,
> Feng Jiang
>
--
Bertrand Dechoux
RE: recovery accidently deleted pig script
Posted by zangxiangyu <za...@qiyi.com>.
Hi,
If the pig process is not closed ,try lsof may helpJ
The files used by one process
/proc/<pid>/fd/<file>,use lsof to find full path ,copy the file in memory to disk.
God bless you.
From: feng jiang [mailto:jiangfutian@gmail.com]
Sent: Thursday, June 13, 2013 5:33 PM
To: user@hadoop.apache.org; chris@embree.us
Subject: Re: recovery accidently deleted pig script
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good
example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> > Where was the pig script? On HDFS?
> >
> > How often does your cluster clean up the trash?
> >
> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> > configurable setting so YMMV
> >
> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> >
> >> Hi everyone,
> >>
> >> We have a pig script scheduled running every 4 hours. Someone
> accidentally
> >> deleted the pig script(rm). Is there any way to recover the script?
> >>
> >> I am guessing Hadoop copy the program to every nodes before running.
> Just
> >> in case it has any copy in the nodes.
> >>
> >>
> >> Best regards,
> >> Feng Jiang
> >
> >
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good
example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> > Where was the pig script? On HDFS?
> >
> > How often does your cluster clean up the trash?
> >
> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> > configurable setting so YMMV
> >
> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> >
> >> Hi everyone,
> >>
> >> We have a pig script scheduled running every 4 hours. Someone
> accidentally
> >> deleted the pig script(rm). Is there any way to recover the script?
> >>
> >> I am guessing Hadoop copy the program to every nodes before running.
> Just
> >> in case it has any copy in the nodes.
> >>
> >>
> >> Best regards,
> >> Feng Jiang
> >
> >
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good
example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> > Where was the pig script? On HDFS?
> >
> > How often does your cluster clean up the trash?
> >
> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> > configurable setting so YMMV
> >
> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> >
> >> Hi everyone,
> >>
> >> We have a pig script scheduled running every 4 hours. Someone
> accidentally
> >> deleted the pig script(rm). Is there any way to recover the script?
> >>
> >> I am guessing Hadoop copy the program to every nodes before running.
> Just
> >> in case it has any copy in the nodes.
> >>
> >>
> >> Best regards,
> >> Feng Jiang
> >
> >
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by feng jiang <ji...@gmail.com>.
The script is on local file system. it's on linux box.
I totally agree we need version control for the source code. this is a good
example to show the importance of version control.
Thank you Michael and Chris for your inputs anyway.
On Thu, Jun 13, 2013 at 10:35 AM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> > Where was the pig script? On HDFS?
> >
> > How often does your cluster clean up the trash?
> >
> > (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> > configurable setting so YMMV
> >
> > On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> >
> >> Hi everyone,
> >>
> >> We have a pig script scheduled running every 4 hours. Someone
> accidentally
> >> deleted the pig script(rm). Is there any way to recover the script?
> >>
> >> I am guessing Hadoop copy the program to every nodes before running.
> Just
> >> in case it has any copy in the nodes.
> >>
> >>
> >> Best regards,
> >> Feng Jiang
> >
> >
>
--
Best regards,
Feng Jiang
Re: recovery accidently deleted pig script
Posted by Michel Segel <mi...@hotmail.com>.
Well if the script was sitting on the cluster... Then it would be a Hadoop question.
?How do you recover a file that was deleted on HDFS?
Which is an interesting question...
But the OP said it wasn't on HDFS, and to your point... One can only say sorry dude, bummer, rewrite it.
Sorry you're having a rough day.
This is why I usually say Embrace the suck.
Sent from a remote device. Please excuse any typos...
Mike Segel
On Jun 12, 2013, at 9:35 PM, Chris Embree <ce...@gmail.com> wrote:
> This is not a Hadoop question (IMHO).
>
> 2 words: Version Control
>
> Did the advent of Hadoop somehow circumvent all IT convention?
>
> Sorry folks, it's been a rough day.
>
> On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
>> Where was the pig script? On HDFS?
>>
>> How often does your cluster clean up the trash?
>>
>> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
>> configurable setting so YMMV
>>
>> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>>
>>> Hi everyone,
>>>
>>> We have a pig script scheduled running every 4 hours. Someone accidentally
>>> deleted the pig script(rm). Is there any way to recover the script?
>>>
>>> I am guessing Hadoop copy the program to every nodes before running. Just
>>> in case it has any copy in the nodes.
>>>
>>>
>>> Best regards,
>>> Feng Jiang
>
Re: recovery accidently deleted pig script
Posted by Chris Embree <ce...@gmail.com>.
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
Re: recovery accidently deleted pig script
Posted by Chris Embree <ce...@gmail.com>.
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
Re: recovery accidently deleted pig script
Posted by Chris Embree <ce...@gmail.com>.
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
Re: recovery accidently deleted pig script
Posted by Chris Embree <ce...@gmail.com>.
This is not a Hadoop question (IMHO).
2 words: Version Control
Did the advent of Hadoop somehow circumvent all IT convention?
Sorry folks, it's been a rough day.
On 6/12/13, Michael Segel <mi...@hotmail.com> wrote:
> Where was the pig script? On HDFS?
>
> How often does your cluster clean up the trash?
>
> (Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a
> configurable setting so YMMV
>
> On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
>
>> Hi everyone,
>>
>> We have a pig script scheduled running every 4 hours. Someone accidentally
>> deleted the pig script(rm). Is there any way to recover the script?
>>
>> I am guessing Hadoop copy the program to every nodes before running. Just
>> in case it has any copy in the nodes.
>>
>>
>> Best regards,
>> Feng Jiang
>
>
Re: recovery accidently deleted pig script
Posted by Michael Segel <mi...@hotmail.com>.
Where was the pig script? On HDFS?
How often does your cluster clean up the trash?
(Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a configurable setting so YMMV
On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> Hi everyone,
>
> We have a pig script scheduled running every 4 hours. Someone accidentally deleted the pig script(rm). Is there any way to recover the script?
>
> I am guessing Hadoop copy the program to every nodes before running. Just in case it has any copy in the nodes.
>
>
> Best regards,
> Feng Jiang
Re: recovery accidently deleted pig script
Posted by Michael Segel <mi...@hotmail.com>.
Where was the pig script? On HDFS?
How often does your cluster clean up the trash?
(Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a configurable setting so YMMV
On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> Hi everyone,
>
> We have a pig script scheduled running every 4 hours. Someone accidentally deleted the pig script(rm). Is there any way to recover the script?
>
> I am guessing Hadoop copy the program to every nodes before running. Just in case it has any copy in the nodes.
>
>
> Best regards,
> Feng Jiang
Re: recovery accidently deleted pig script
Posted by Michael Segel <mi...@hotmail.com>.
Where was the pig script? On HDFS?
How often does your cluster clean up the trash?
(Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a configurable setting so YMMV
On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> Hi everyone,
>
> We have a pig script scheduled running every 4 hours. Someone accidentally deleted the pig script(rm). Is there any way to recover the script?
>
> I am guessing Hadoop copy the program to every nodes before running. Just in case it has any copy in the nodes.
>
>
> Best regards,
> Feng Jiang
Re: recovery accidently deleted pig script
Posted by Michael Segel <mi...@hotmail.com>.
Where was the pig script? On HDFS?
How often does your cluster clean up the trash?
(Deleted stuff doesn't get cleaned up when the file is deleted... ) Its a configurable setting so YMMV
On Jun 12, 2013, at 8:58 PM, feng jiang <ji...@gmail.com> wrote:
> Hi everyone,
>
> We have a pig script scheduled running every 4 hours. Someone accidentally deleted the pig script(rm). Is there any way to recover the script?
>
> I am guessing Hadoop copy the program to every nodes before running. Just in case it has any copy in the nodes.
>
>
> Best regards,
> Feng Jiang