You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Thomas Graves (JIRA)" <ji...@apache.org> on 2011/06/01 22:02:48 UTC
[jira] [Created] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
JvmInvalidate errors in the gridmix TT logs
-------------------------------------------
Key: MAPREDUCE-2555
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: tasktracker
Affects Versions: 0.20.204.0
Reporter: Thomas Graves
Assignee: Thomas Graves
Priority: Minor
Observing a lot of jvmValidate exceptions in TT logs for grid mix run
************************
2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:396)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
*********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042925#comment-13042925 ]
Todd Lipcon commented on MAPREDUCE-2555:
----------------------------------------
Can you please add a comment to MAPREDUCE-2429 as well so that we don't miss this in trunk?
Is Sidd still working on the forward-port?
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Attachments: MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042392#comment-13042392 ]
Thomas Graves commented on MAPREDUCE-2555:
------------------------------------------
The exceptions are generated by status updates sent by the child after it reports 'done' to the TaskTracker. Ideally
this should not happen.
The fix for MAPREDUCE-2429 is meant to ignore such calls (since the child jvm is effectively not supposed to exist after the done call is processed).
In previous versions - the statusUpdate RPC would return success but would ignore the request.
This exception is effectively replacing another message from previous version (Ignoring status-update since task is
'done'). With the current code - the statusUpdate RPC fails - which causes the Child to retry - effectively generating way more messages in the logs.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2555:
-------------------------------------
Fix Version/s: 0.20.205.0
Status: Patch Available (was: Open)
Tested manually via changing code as this is hard to reproduce.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2555:
-------------------------------------
Attachment: MAPREDUCE-2555-20security-v2.patch
fix a couple spacing issues.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated MAPREDUCE-2555:
-------------------------------------
Fix Version/s: (was: 0.20.205.0)
0.20.204.0
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.204.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Siddharth Seth (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043161#comment-13043161 ]
Siddharth Seth commented on MAPREDUCE-2555:
-------------------------------------------
@Todd, I am still working on the 2429 forward port.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042946#comment-13042946 ]
Thomas Graves commented on MAPREDUCE-2555:
------------------------------------------
Added comment to MAPREDUCE-2429. I'll ask Sidd about that forward-port.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042908#comment-13042908 ]
Thomas Graves commented on MAPREDUCE-2555:
------------------------------------------
Only adding patch for branch-0.20-security since MAPREDUCE-2429 not in trunk yet.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Attachments: MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated MAPREDUCE-2555:
-------------------------------------
Status: Open (was: Patch Available)
I committed this to the 20-security branch. I'll leave it open to track the forward-port
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042950#comment-13042950 ]
Hadoop QA commented on MAPREDUCE-2555:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12481267/MAPREDUCE-2555-20security-v2.patch
against trunk revision 1130554.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
-1 patch. The patch command could not apply the patch.
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/336//console
This message is automatically generated.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042455#comment-13042455 ]
Thomas Graves commented on MAPREDUCE-2555:
------------------------------------------
I think all we want to do is get the child to exit and not generate all the log messages. To do that we can have the TaskTracker::statusUpdate return false if the validateJVM throws. The only catch to that is the TaskTracker::commitPending call doesn't return boolean so will have to have it still throw.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042953#comment-13042953 ]
Thomas Graves commented on MAPREDUCE-2555:
------------------------------------------
Note this failed since patch is for branch-0.20-security.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Thomas Graves (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Graves updated MAPREDUCE-2555:
-------------------------------------
Attachment: MAPREDUCE-2555-20security.patch
This is the patch for the branch-0.20-security.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Attachments: MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2555) JvmInvalidate errors in the
gridmix TT logs
Posted by "Siddharth Seth (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043158#comment-13043158 ]
Siddharth Seth commented on MAPREDUCE-2555:
-------------------------------------------
+1 lgtm to get rid of the extra logging and to kill the child process.
> JvmInvalidate errors in the gridmix TT logs
> -------------------------------------------
>
> Key: MAPREDUCE-2555
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2555
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker
> Affects Versions: 0.20.204.0
> Reporter: Thomas Graves
> Assignee: Thomas Graves
> Priority: Minor
> Fix For: 0.20.205.0
>
> Attachments: MAPREDUCE-2555-20security-v2.patch, MAPREDUCE-2555-20security.patch
>
>
> Observing a lot of jvmValidate exceptions in TT logs for grid mix run
> ************************
> 2011-04-28 02:00:37,578 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 46121, call
> statusUpdate(attempt_201104270735_5993_m_003305_0, org.apache.hadoop.mapred.MapTaskStatus@1840a9c,
> org.apache.hadoop.mapred.JvmContext@1d4ab6b) from 127.0.0.1:50864: error: java.io.IOException: JvmValidate Failed.
> Ignoring request from task: attempt_201104270735_5993_m_003305_0, with JvmId:
> jvm_201104270735_5993_m_103399012gsbl20430: java.io.IOException: JvmValidate Failed. Ignoring request from task:
> attempt_201104270735_5993_m_003305_0, with JvmId: jvm_201104270735_5993_m_103399012gsbl20430: --
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1386)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:396)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1059)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1384)
> *********************
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira