You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "lohit vijayarenu (JIRA)" <ji...@apache.org> on 2008/05/06 23:47:55 UTC
[jira] Commented: (HADOOP-3309) Unit test fails on Windows:
org.apache.hadoop.mapred.TestMiniMRDFSSort.unknown
[ https://issues.apache.org/jira/browse/HADOOP-3309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12594716#action_12594716 ]
lohit vijayarenu commented on HADOOP-3309:
------------------------------------------
After running the test for couple of times. This test passes something like 20% of the time. The rest of the time, it fails due to different reasons.
Some times, it fails throwing OutOfMemory Exception
Few times, I see DF throwing exception
{noformat}
[junit] 2008-05-06 13:01:12,183 WARN mapred.TaskTracker (TaskTracker.java:startNewTask(1281)) - Error initializing attempt_200805061258_0003_m_000009_0:
[junit] java.io.IOException: Expecting a line not the end of stream
[junit] at org.apache.hadoop.fs.DF.parseExecResult(DF.java:109)
[junit] at org.apache.hadoop.util.Shell.runCommand(Shell.java:182)
[junit] at org.apache.hadoop.util.Shell.run(Shell.java:134)
{noformat}
in task tracker
{noformat}
Path localJobFile = lDirAlloc.getLocalPathForWrite((getJobCacheSubdir()
+ Path.SEPARATOR + jobId
+ Path.SEPARATOR + "job.xml"),
jobFileSize, fConf);
RunningJob rjob = addTaskToJob(jobId, localJobFile, tip);
{noformat}
Similar error from TaskRunner
{noformat}
[junit] 2008-05-06 13:01:02,075 WARN mapred.TaskRunner (TaskRunner.java:run(402)) - attempt_200805061258_0003_m_000004_0 Child Error
[junit] java.io.IOException: Can't convert 'C:\cygwin\home\lohit\hadoop-core-trunk\build\test\logs\userlogs\attempt_200805061258_0003_m_000004_0\stdout to a cygwin path
[junit] at org.apache.hadoop.fs.FileUtil$CygPathCommand.parseExecResult(FileUtil.java:357)
{noformat}
Looks like cygwin's df returns empty string when back slashes are passed.
> Unit test fails on Windows: org.apache.hadoop.mapred.TestMiniMRDFSSort.unknown
> ------------------------------------------------------------------------------
>
> Key: HADOOP-3309
> URL: https://issues.apache.org/jira/browse/HADOOP-3309
> Project: Hadoop Core
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.18.0
> Environment: windows
> Reporter: Mukund Madhugiri
>
> Unit test fails on Windows: org.apache.hadoop.mapred.TestMiniMRDFSSort.unknown
> *Recent changes:*
> # HADOOP-3061. Writable types for doubles and bytes.
> # HADOOP-3300. Fix locking of explicit locks in NetworkTopology.
> # HADOOP-2910. Throttle IPC Clients during bursts of requests or server slowdown. Clients retry connection for up to 15 minutes when socket connection times out.
> # HADOOP-3285. Fix input split locality when the splits align to fsblocks.
> # HADOOP-3127. Deleting files in trash should really remove them.
> # HADOOP-3268. file:// URLs issue in TestUrlStreamHandler under Windows.
> # HADOOP-1979. Speed up fsck by adding a buffered stream.
> *Failed due to timeout*
> junit.framework.AssertionFailedError: Timeout occurred
> *Output from the console before it timed out:*
> [junit] 2008-04-24 13:24:09,556 INFO util.Container (Container.java:stop(156)) - Stopped org.mortbay.jetty.servlet.WebApplicationHandler@4ac216
> [junit] 2008-04-24 13:24:09,696 INFO util.Container (Container.java:stop(156)) - Stopped WebApplicationContext[/,/]
> [junit] 2008-04-24 13:24:09,852 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/logs,/logs]
> [junit] 2008-04-24 13:24:10,009 INFO util.Container (Container.java:stop(156)) - Stopped HttpContext[/static,/static]
> [junit] 2008-04-24 13:24:10,009 INFO util.Container (Container.java:stop(156)) - Stopped org.mortbay.jetty.Server@1b5340c
> [junit] 2008-04-24 13:24:10,009 INFO fs.FSNamesystem (FSEditLog.java:printStatistics(849)) - Number of transactions: 310 Total time for transactions(ms): 62 Number of syncs: 254 SyncTimes(ms): 23395 20970
> [junit] 2008-04-24 13:24:10,071 ERROR fs.FSNamesystem (FSNamesystem.java:run(1963)) - java.lang.InterruptedException
> [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:1741)
> [junit] at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1774)
> [junit] at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:359)
> [junit] at org.apache.hadoop.dfs.FSNamesystem$ResolutionMonitor.run(FSNamesystem.java:1940)
> [junit] at java.lang.Thread.run(Thread.java:595)
> [junit] 2008-04-24 13:24:10,321 INFO ipc.Server (Server.java:stop(1001)) - Stopping server on 3903
> [junit] 2008-04-24 13:24:10,321 INFO ipc.Server (Server.java:run(336)) - Stopping IPC Server listener on 3903
> [junit] 2008-04-24 13:24:10,321 INFO ipc.Server (Server.java:run(506)) - Stopping IPC Server Responder
> [junit] 2008-04-24 13:24:10,321 INFO mapred.MiniMRCluster (MiniMRCluster.java:waitUntilIdle(231)) - Waiting for task tracker tracker_buildsystem:localhost/127.0.0.1:3943 to be idle.
> [junit] 2008-04-24 13:24:10,321 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 0 on 3903: exiting
> [junit] 2008-04-24 13:24:10,321 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 1 on 3903: exiting
> [junit] 2008-04-24 13:24:10,321 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 2 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 9 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 3 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 4 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 5 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 8 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 6 on 3903: exiting
> [junit] 2008-04-24 13:24:10,337 INFO ipc.Server (Server.java:run(927)) - IPC Server handler 7 on 3903: exiting
> [junit] 2008-04-24 13:24:11,321 INFO mapred.MiniMRCluster (MiniMRCluster.java:waitUntilIdle(231)) - Waiting for task tracker tracker_buildsystem:localhost/127.0.0.1:3943 to be idle.
> [junit] 2008-04-24 13:24:12,321 INFO mapred.MiniMRCluster (MiniMRCluster.java:waitUntilIdle(231)) - Waiting for task tracker tracker_buildsystem:localhost/127.0.0.1:3943 to be idle.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.