You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Harsh J (JIRA)" <ji...@apache.org> on 2013/03/01 12:27:14 UTC
[jira] [Updated] (MAPREDUCE-5039) Configuration getInt is called
From vaidya, but it actually need a float calculation(The values always be
a Floating Poin Number)
[ https://issues.apache.org/jira/browse/MAPREDUCE-5039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Harsh J updated MAPREDUCE-5039:
-------------------------------
Hadoop Flags: (was: Incompatible change)
> Configuration getInt is called From vaidya, but it actually need a float calculation(The values always be a Floating Poin Number)
> ---------------------------------------------------------------------------------------------------------------------------------
>
> Key: MAPREDUCE-5039
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5039
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: contrib/vaidya
> Affects Versions: 0.23.1
> Environment: hadoop-2.0.0-mr1-cdh4.1.2, Ubuntu 10.04
> Reporter: shobin joseph
> Original Estimate: 60h
> Remaining Estimate: 60h
>
> when we run the vaidya scrpit in hadoop-2.0.0-mr1-cdh4.1.2.
> Exception:java.lang.NumberFormatException: For input string: "0.05"java.lang.NumberFormatException: For input string: "0.05"
> at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
> at java.lang.Integer.parseInt(Integer.java:458)
> at java.lang.Integer.parseInt(Integer.java:499)
> at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:887)
> at org.apache.hadoop.vaidya.postexdiagnosis.tests.MapSideDiskSpill.getPrescription(MapSideDiskSpill.java:99)
> at org.apache.hadoop.vaidya.DiagnosticTest.getReportElement(DiagnosticTest.java:283)
> at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:254)
> In the job conf file
> the properties are like
> <property><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> <property><name>io.sort.record.percent</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> <property><name>io.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>
> all the above lines throw the exception.
> The important thing is default values for the above properties are 0.05 and 0.8
> But the getInt() Function takes only integer values, if not it takes only the integer part.
> In Hadoop io.sort.spill.percent,io.sort.record.percent,mapred.reduce.slowstart.completed.maps are expressed as Floating Point Numbers.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira