You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ravi Gummadi (JIRA)" <ji...@apache.org> on 2009/12/09 12:52:18 UTC
[jira] Created: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
TestLocalizationWithLinuxTaskController fails
---------------------------------------------
Key: MAPREDUCE-1284
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
Project: Hadoop Map/Reduce
Issue Type: Bug
Affects Versions: 0.22.0
Reporter: Ravi Gummadi
Fix For: 0.22.0
With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788046#action_12788046 ]
Ravi Gummadi commented on MAPREDUCE-1284:
-----------------------------------------
log messages show the following:
-------------------------------------------------
[junit] 2009-12-09 17:07:16,371 INFO tasktracker.Localizer (Localizer.java:initializeUserDirs(202)) - Initializing user ravi_tmp on this TT.
[junit] 2009-12-09 17:07:16,390 WARN mapred.LinuxTaskController (LinuxTaskController.java:runCommand(192)) - Exit code from INITIALIZE_USER is : 139
[junit] 2009-12-09 17:07:16,391 WARN mapred.LinuxTaskController (LinuxTaskController.java:runCommand(194)) - Exception thrown by INITIALIZE_USER : org.apache.hadoop.util.Shell$ExitCodeException:
[junit] at org.apache.hadoop.util.Shell.runCommand(Shell.java:243)
[junit] at org.apache.hadoop.util.Shell.run(Shell.java:170)
[junit] at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:363)
[junit] at org.apache.hadoop.mapred.LinuxTaskController.runCommand(LinuxTaskController.java:190)
[junit] at org.apache.hadoop.mapred.LinuxTaskController.initializeUser(LinuxTaskController.java:425)
[junit] at org.apache.hadoop.mapred.ClusterWithLinuxTaskController$MyLinuxTaskController.initializeUser(ClusterWithLinuxTaskController.java:68)
[junit] at org.apache.hadoop.mapreduce.server.tasktracker.Localizer.initializeUserDirs(Localizer.java:271)
[junit] at org.apache.hadoop.mapred.TestTaskTrackerLocalization.testTaskLocalization(TestTaskTrackerLocalization.java:456)
[junit] at org.apache.hadoop.mapred.TestLocalizationWithLinuxTaskController.testTaskLocalization(TestLocalizationWithLinuxTaskController.java:223)
-------------------------------------------------------
fts_open() in secure_path() seem to be making task-controller exit.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Fix For: 0.22.0
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791294#action_12791294 ]
Ravi Gummadi commented on MAPREDUCE-1284:
-----------------------------------------
Contrib tests failures shown are not related to this patch.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinod K V updated MAPREDUCE-1284:
---------------------------------
Component/s: test
tasktracker
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788594#action_12788594 ]
Ravi Gummadi commented on MAPREDUCE-1284:
-----------------------------------------
The issue of "not having null-terminated array that is being passed to fts_open()" is caught now because of different code generated by gcc with the option -O2 added in task-controller's MakeFile.in in MAPREDUCE-1119.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-1284:
------------------------------------
Release Note: Fixes a bug in linux task controller by making the paths array passed to fts_open() as null-terminated as per the man page.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.21.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789157#action_12789157 ]
Ravi Gummadi commented on MAPREDUCE-1284:
-----------------------------------------
Unit tests passed on my local machine. Only failures are TestGridmixSubmission(MAPREDUCE-1124) and TestTrackerDistributedCacheManagerWithLinuxTaskController(MAPREDUCE-1289).
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi reassigned MAPREDUCE-1284:
---------------------------------------
Assignee: Ravi Gummadi
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12796742#action_12796742 ]
Hudson commented on MAPREDUCE-1284:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #196 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/196/])
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.21.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hemanth Yamijala updated MAPREDUCE-1284:
----------------------------------------
Resolution: Fixed
Fix Version/s: (was: 0.22.0)
0.21.0
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I committed this to trunk and branch 0.21. Thanks, Ravi !
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.21.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12791285#action_12791285 ]
Hadoop QA commented on MAPREDUCE-1284:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12427577/MR-1284.patch
against trunk revision 891111.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no new tests are needed for this patch.
Also please list what manual steps were performed to verify this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
-1 contrib tests. The patch failed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/200/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/200/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/200/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/200/console
This message is automatically generated.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Hemanth Yamijala (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12792366#action_12792366 ]
Hemanth Yamijala commented on MAPREDUCE-1284:
---------------------------------------------
+1 for the patch. Given the nature of the fix, and the fact that it fixes a broken test (which I verified by running manually), I think there is no need for additional tests. I will commit this.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: tasktracker, test
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Ravi Gummadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ravi Gummadi updated MAPREDUCE-1284:
------------------------------------
Attachment: MR-1284.patch
Attaching patch with the fix.
Problem was that the paths array passed to fts_open() should be null-terminated as per the man page.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789165#action_12789165 ]
Vinod K V commented on MAPREDUCE-1284:
--------------------------------------
+1 for the patch.
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12789164#action_12789164 ]
Vinod K V commented on MAPREDUCE-1284:
--------------------------------------
The reason I think why I didn't get this error is that I have more recent versions of the glibc(2.10-1) (which are more forgiving, perhaps).
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Amareshwari Sriramadasu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amareshwari Sriramadasu updated MAPREDUCE-1284:
-----------------------------------------------
Status: Patch Available (was: Open)
submitting for hudson
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Assignee: Ravi Gummadi
> Fix For: 0.22.0
>
> Attachments: MR-1284.patch
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1284)
TestLocalizationWithLinuxTaskController fails
Posted by "Vinod K V (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1284?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12788491#action_12788491 ]
Vinod K V commented on MAPREDUCE-1284:
--------------------------------------
The trunk test passes successfully for me. Some mistake in building the binary or using an old version of the binary? Can you recheck?
> TestLocalizationWithLinuxTaskController fails
> ---------------------------------------------
>
> Key: MAPREDUCE-1284
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1284
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.22.0
> Reporter: Ravi Gummadi
> Fix For: 0.22.0
>
>
> With current trunk, the testcase TestLocalizationWithLinuxTaskController fails with an exit code of 139 from task-controller when doing INITIALIZE_USER
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.