You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by "Vinay Kumar Thota (JIRA)" <ji...@apache.org> on 2010/08/25 10:17:16 UTC
[jira] Created: (MAPREDUCE-2030) Throwing IOException while
submitting the gridmix jobs consecutively through ToolRunner.
Throwing IOException while submitting the gridmix jobs consecutively through ToolRunner.
----------------------------------------------------------------------------------------
Key: MAPREDUCE-2030
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2030
Project: Hadoop Map/Reduce
Issue Type: Bug
Components: contrib/gridmix
Reporter: Vinay Kumar Thota
Assignee: Ranjit Mathew
Gridmix throws an IOException while submitting the Gridmix jobs consecutively through ToolRunner. For job its works fine and for next job onwards, it throws the below exception.
[junit] java.io.IOException: Stream closed
[junit] at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:145)
[junit] at java.io.BufferedInputStream.read(BufferedInputStream.java:308)
[junit] at org.codehaus.jackson.impl.ByteSourceBootstrapper.ensureLoaded(ByteSourceBootstrapper.java:338)
[junit] at org.codehaus.jackson.impl.ByteSourceBootstrapper.detectEncoding(ByteSourceBootstrapper.java:116)
[junit] at org.codehaus.jackson.impl.ByteSourceBootstrapper.constructParser(ByteSourceBootstrapper.java:205)
[junit] at org.codehaus.jackson.JsonFactory._createJsonParser(JsonFactory.java:298)
[junit] at org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:251)
[junit] at org.apache.hadoop.tools.rumen.JsonObjectMapperParser.<init>(JsonObjectMapperParser.java:72)
[junit] at org.apache.hadoop.tools.rumen.JobTraceReader.<init>(JobTraceReader.java:49)
[junit] at org.apache.hadoop.tools.rumen.ZombieJobProducer.<init>(ZombieJobProducer.java:94)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix.createJobFactory(Gridmix.java:212)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix.startThreads(Gridmix.java:181)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:291)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:273)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:55)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:227)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:225)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at javax.security.auth.Subject.doAs(Subject.java:396)
[junit] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1021)
[junit] at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:225)
[junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
[junit] at org.apache.hadoop.mapred.gridmix.TestGridMixDataGeneration.testGenerateDataWithREPLAYSubmission(TestGridMixDataGeneration.java:173)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
[junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
[junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
[junit] at java.lang.reflect.Method.invoke(Method.java:597)
[junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
[junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
[junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
[junit] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
[junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
[junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
[junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:73)
[junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:46)
[junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:180)
[junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:41)
[junit] at org.junit.runners.ParentRunner$1.evaluate(ParentRunner.java:173)
[junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
[junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
[junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:220)
[junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
[junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
[junit] 10/08/25 07:05:13 ERROR gridmix.Gridmix: Startup failed
[junit] java.io.IOException: java.io.IOException: Stream closed
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAPREDUCE-2030) Throwing IOException while
submitting the gridmix jobs consecutively through ToolRunner.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat resolved MAPREDUCE-2030.
-----------------------------------
Resolution: Invalid
I have opened MAPREDUCE-2044 and MAPREDUCE-2045 to address this. '-' should be used only when the input trace is expected via standard input (System.in).
> Throwing IOException while submitting the gridmix jobs consecutively through ToolRunner.
> ----------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-2030
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2030
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Ranjit Mathew
>
> Gridmix throws an IOException while submitting the Gridmix jobs consecutively through ToolRunner. For first job its works fine and for next job onwards, it throws the below exception.
> [junit] java.io.IOException: Stream closed
> [junit] at java.io.BufferedInputStream.getBufIfOpen(BufferedInputStream.java:145)
> [junit] at java.io.BufferedInputStream.read(BufferedInputStream.java:308)
> [junit] at org.codehaus.jackson.impl.ByteSourceBootstrapper.ensureLoaded(ByteSourceBootstrapper.java:338)
> [junit] at org.codehaus.jackson.impl.ByteSourceBootstrapper.detectEncoding(ByteSourceBootstrapper.java:116)
> [junit] at org.codehaus.jackson.impl.ByteSourceBootstrapper.constructParser(ByteSourceBootstrapper.java:205)
> [junit] at org.codehaus.jackson.JsonFactory._createJsonParser(JsonFactory.java:298)
> [junit] at org.codehaus.jackson.JsonFactory.createJsonParser(JsonFactory.java:251)
> [junit] at org.apache.hadoop.tools.rumen.JsonObjectMapperParser.<init>(JsonObjectMapperParser.java:72)
> [junit] at org.apache.hadoop.tools.rumen.JobTraceReader.<init>(JobTraceReader.java:49)
> [junit] at org.apache.hadoop.tools.rumen.ZombieJobProducer.<init>(ZombieJobProducer.java:94)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix.createJobFactory(Gridmix.java:212)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix.startThreads(Gridmix.java:181)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:291)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:273)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:55)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:227)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:225)
> [junit] at java.security.AccessController.doPrivileged(Native Method)
> [junit] at javax.security.auth.Subject.doAs(Subject.java:396)
> [junit] at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1021)
> [junit] at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:225)
> [junit] at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> [junit] at org.apache.hadoop.mapred.gridmix.TestGridMixDataGeneration.testGenerateDataWithREPLAYSubmission(TestGridMixDataGeneration.java:173)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> [junit] at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> [junit] at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> [junit] at java.lang.reflect.Method.invoke(Method.java:597)
> [junit] at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:44)
> [junit] at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:15)
> [junit] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:41)
> [junit] at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:20)
> [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
> [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
> [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:73)
> [junit] at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:46)
> [junit] at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:180)
> [junit] at org.junit.runners.ParentRunner.access$000(ParentRunner.java:41)
> [junit] at org.junit.runners.ParentRunner$1.evaluate(ParentRunner.java:173)
> [junit] at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:28)
> [junit] at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:31)
> [junit] at org.junit.runners.ParentRunner.run(ParentRunner.java:220)
> [junit] at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:420)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:911)
> [junit] at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:768)
> [junit] 10/08/25 07:05:13 ERROR gridmix.Gridmix: Startup failed
> [junit] java.io.IOException: java.io.IOException: Stream closed
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.