You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "Yiping Han (JIRA)" <ji...@apache.org> on 2009/01/07 22:24:44 UTC

[jira] Created: (PIG-610) Pig appears to continue when an underlying mapred job fails

Pig appears to continue when an underlying mapred job fails 
------------------------------------------------------------

                 Key: PIG-610
                 URL: https://issues.apache.org/jira/browse/PIG-610
             Project: Pig
          Issue Type: Bug
            Reporter: Yiping Han


We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662115#action_12662115 ] 

Olga Natkovich commented on PIG-610:
------------------------------------

I did exactly the same thing and I was not able to reproduce the problem. I have Hadoop 18.1 installation but not sure that it is relevant.

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Resolved: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Olga Natkovich resolved PIG-610.
--------------------------------

    Resolution: Duplicate

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Yiping Han (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Yiping Han updated PIG-610:
---------------------------

    Priority: Critical  (was: Major)

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662079#action_12662079 ] 

Olga Natkovich commented on PIG-610:
------------------------------------

What command do you use to kill the job?
What error you see from Pig?
Does this happen every time?
What version of Hadoop is your cluster on?
Are you using types branch of pig or the trunk?

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Yiping Han (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661823#action_12661823 ] 

Yiping Han commented on PIG-610:
--------------------------------

Create a pig job with multiple mapred jobs. Let the script run and then manually kill the running mapred job. Pig reports the failure of this mapred job but does not terminate itself. The next mapred job will be launched.

Pig should fail immediately.

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Yiping Han (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12662084#action_12662084 ] 

Yiping Han commented on PIG-610:
--------------------------------

We are on hadoop 0.18.2 and latest pig_types branch. We tried to do "hadoop job -kill xxxxx" through a different terminal. I believe this happens every time since Ralf gave me instruction yesterday and I can easily reproduce it.

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12666035#action_12666035 ] 

Olga Natkovich commented on PIG-610:
------------------------------------

We tracked the issue to multiple independent queries (stores/dumps) within the same script. Created a separate issue to address this: https://issues.apache.org/jira/browse/PIG-630

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>            Priority: Critical
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (PIG-610) Pig appears to continue when an underlying mapred job fails

Posted by "Olga Natkovich (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/PIG-610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12661726#action_12661726 ] 

Olga Natkovich commented on PIG-610:
------------------------------------

We would need a reproducible case to address this.

> Pig appears to continue when an underlying mapred job fails 
> ------------------------------------------------------------
>
>                 Key: PIG-610
>                 URL: https://issues.apache.org/jira/browse/PIG-610
>             Project: Pig
>          Issue Type: Bug
>            Reporter: Yiping Han
>
> We observed sometimes, pig appears to continue when an underlying mapred job fails.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.