You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/07/31 01:31:40 UTC

[jira] [Resolved] (MAPREDUCE-2016) GridMix throws an ArithmeticException error when tasktracker count is zero while generating the data.

     [ https://issues.apache.org/jira/browse/MAPREDUCE-2016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer resolved MAPREDUCE-2016.
-----------------------------------------

    Resolution: Incomplete

This is likely stale.

> GridMix throws an ArithmeticException error when tasktracker count is zero while generating the data.
> -----------------------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-2016
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2016
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: contrib/gridmix
>    Affects Versions: 0.20.1
>            Reporter: Vinay Kumar Thota
>            Assignee: Amar Kamat
>
> GridMix throws an ArithmeticException error when tasktracker count is zero. In generating data, while calculating the bytes per task tracker in getSplit method, throws an exception if tasktracker count is zero. Actually bytes are calculating by dividing the number of task trackers in the cluster. So we need to build the better exception handling for these kinds of cases. Should add a condition (count should be >0) for tasktracker count before calculating the bytes per tasktracker. 
> 10/08/12 08:33:34 INFO gridmix.JobSubmitter:  Job org.apache.hadoop.mapreduce.Job@18a8ce2 submission failed 
> java.lang.ArithmeticException: / by zero
>         at org.apache.hadoop.mapred.gridmix.GenerateData$GenDataFormat.getSplits(GenerateData.java:161)
>         at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:902)
>         at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:919)
>         at org.apache.hadoop.mapred.JobClient.access$5(JobClient.java:913)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:838)
>         at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:1)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1021)
>         at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:792)
>         at org.apache.hadoop.mapreduce.Job.submit(Job.java:465)
>         at org.apache.hadoop.mapred.gridmix.GenerateData$1.run(GenerateData.java:116)
>         at org.apache.hadoop.mapred.gridmix.GenerateData$1.run(GenerateData.java:101)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:396)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1021)
>         at org.apache.hadoop.mapred.gridmix.GenerateData.call(GenerateData.java:101)
>         at org.apache.hadoop.mapred.gridmix.GenerateData.call(GenerateData.java:57)
>         at org.apache.hadoop.mapred.gridmix.JobSubmitter$SubmitTask.run(JobSubmitter.java:106)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>         at java.lang.Thread.run(Thread.java:619)



--
This message was sent by Atlassian JIRA
(v6.2#6252)