You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by ankit sharma <an...@gmail.com> on 2010/06/15 14:55:07 UTC
Jotracker java.lang.NumberFormatException
Hi All ,
I have multinode cluster with 1 master (namenode,+ jobtracker) and
2 slavers (datanode + tasktracker).
I can start namenode and datanodes,but CANT start jobtracker.The
log shows java.lang.NumberFormatException.
I will be greatfull if anybody can tell me what is the problem and
why is this java execption being thrown?
here is the complete log , all the files value are
attached.(master,slaves,core-site.xml...etc)
************************************************************/
2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker:
STARTUP_MSG:
/************************************************************
STARTUP_MSG: Starting JobTracker
STARTUP_MSG: host = centosxcat1/192.168.15.140
STARTUP_MSG: args = []
STARTUP_MSG: version = 0.20.2
STARTUP_MSG: build =
https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
************************************************************/
2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker:
java.lang.NumberFormatException: For input string: "54311
"
at
java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
at java.lang.Integer.parseInt(Integer.java:481)
at java.lang.Integer.parseInt(Integer.java:514)
at
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146)
at
org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
at
org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
at
org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)
2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker:
SHUTDOWN_MSG:
/************************************************************
SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140
************************************************************/
cat conf/master
centosxcat1
cat conf/salves
aadityaxcat3
linux-466z
cat conf/core-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. --><?xml
version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>
dfs.name.dir
</name>
<value>
/fsname
</value>
</property>
<property>
<name>
dfs.data.dir
</name>
<value>
/fsdata
</value>
</property>
<property>
<name>
dfs.replication
</name>
<value>
2
</value>
</property>
</configuration>
cat conf/mapred-site.xml
<?xml version="1.0"?>
<?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
<!-- Put site-specific property overrides in this file. -->
<configuration>
<property>
<name>
mapred.job.tracker
</name>
<value>
centosxcat1:54311
</value>
</property>
</configuration>
<configuration>
<property>
<name>fs.default.name</name>
<value>hdfs://centosxcat1</value>
</property>
</configuration>
cat conf/hdfs-site.xml
Re: Jotracker java.lang.NumberFormatException
Posted by ankit sharma <an...@gmail.com>.
Hi ,
I got the mistake, It was unwanted newline in mapred-site.xml in
mapred.job.tracker.
On Tue, Jun 15, 2010 at 6:25 PM, ankit sharma <an...@gmail.com>wrote:
> Hi All ,
> I have multinode cluster with 1 master (namenode,+ jobtracker) and
> 2 slavers (datanode + tasktracker).
> I can start namenode and datanodes,but CANT start jobtracker.The
> log shows java.lang.NumberFormatException.
>
>
>
> I will be greatfull if anybody can tell me what is the problem and
> why is this java execption being thrown?
> here is the complete log , all the files value are
> attached.(master,slaves,core-site.xml...etc)
>
>
>
> ************************************************************/
> 2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting JobTracker
> STARTUP_MSG: host = centosxcat1/192.168.15.140
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.20.2
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
> ************************************************************/
> 2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
> configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
> limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
> 2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker:
> java.lang.NumberFormatException: For input string: "54311
> "
> at
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:481)
> at java.lang.Integer.parseInt(Integer.java:514)
> at
> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146)
> at
> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
> at
> org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)
>
> 2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker:
> SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140
> ************************************************************/
>
> cat conf/master
> centosxcat1
>
> cat conf/salves
> aadityaxcat3
> linux-466z
>
> cat conf/core-site.xml
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <!-- Put site-specific property overrides in this file. --><?xml
> version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <!-- Put site-specific property overrides in this file. -->
>
> <configuration>
> <property>
> <name>
> dfs.name.dir
> </name>
> <value>
> /fsname
> </value>
> </property>
> <property>
> <name>
> dfs.data.dir
> </name>
> <value>
> /fsdata
> </value>
> </property>
> <property>
> <name>
> dfs.replication
> </name>
> <value>
> 2
> </value>
> </property>
> </configuration>
>
>
> cat conf/mapred-site.xml
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <!-- Put site-specific property overrides in this file. -->
>
> <configuration>
> <property>
> <name>
> mapred.job.tracker
> </name>
> <value>
> centosxcat1:54311
> </value>
> </property>
> </configuration>
>
>
>
> <configuration>
> <property>
> <name>fs.default.name</name>
> <value>hdfs://centosxcat1</value>
> </property>
> </configuration>
>
>
>
> cat conf/hdfs-site.xml
>
>
>
>
>
>
Re: Jotracker java.lang.NumberFormatException
Posted by Todd Lipcon <to...@cloudera.com>.
Hi Ankit,
You need to trim your configuration variables so there is no extra
whitespace. eg <value>foo</value>, not:
<value>
foo
</value>
There's a patch up for this in many of the configs, but not sure if we got
mapred.job.tracker.
-Todd
On Tue, Jun 15, 2010 at 5:55 AM, ankit sharma <an...@gmail.com>wrote:
> Hi All ,
> I have multinode cluster with 1 master (namenode,+ jobtracker) and
> 2 slavers (datanode + tasktracker).
> I can start namenode and datanodes,but CANT start jobtracker.The
> log shows java.lang.NumberFormatException.
>
>
>
> I will be greatfull if anybody can tell me what is the problem and
> why is this java execption being thrown?
> here is the complete log , all the files value are
> attached.(master,slaves,core-site.xml...etc)
>
>
>
> ************************************************************/
> 2010-06-15 17:05:12,679 INFO org.apache.hadoop.mapred.JobTracker:
> STARTUP_MSG:
> /************************************************************
> STARTUP_MSG: Starting JobTracker
> STARTUP_MSG: host = centosxcat1/192.168.15.140
> STARTUP_MSG: args = []
> STARTUP_MSG: version = 0.20.2
> STARTUP_MSG: build =
> https://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20 -r
> 911707; compiled by 'chrisdo' on Fri Feb 19 08:07:34 UTC 2010
> ************************************************************/
> 2010-06-15 17:05:12,756 INFO org.apache.hadoop.mapred.JobTracker: Scheduler
> configured with (memSizeForMapSlotOnJT, memSizeForReduceSlotOnJT,
> limitMaxMemForMapTasks, limitMaxMemForReduceTasks) (-1, -1, -1, -1)
> 2010-06-15 17:05:12,768 FATAL org.apache.hadoop.mapred.JobTracker:
> java.lang.NumberFormatException: For input string: "54311
> "
> at
>
> java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
> at java.lang.Integer.parseInt(Integer.java:481)
> at java.lang.Integer.parseInt(Integer.java:514)
> at
> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:146)
> at
> org.apache.hadoop.net.NetUtils.createSocketAddr(NetUtils.java:123)
> at
> org.apache.hadoop.mapred.JobTracker.getAddress(JobTracker.java:1807)
> at org.apache.hadoop.mapred.JobTracker.<init>(JobTracker.java:1579)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:183)
> at
> org.apache.hadoop.mapred.JobTracker.startTracker(JobTracker.java:175)
> at org.apache.hadoop.mapred.JobTracker.main(JobTracker.java:3702)
>
> 2010-06-15 17:05:12,769 INFO org.apache.hadoop.mapred.JobTracker:
> SHUTDOWN_MSG:
> /************************************************************
> SHUTDOWN_MSG: Shutting down JobTracker at centosxcat1/192.168.15.140
> ************************************************************/
>
> cat conf/master
> centosxcat1
>
> cat conf/salves
> aadityaxcat3
> linux-466z
>
> cat conf/core-site.xml
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <!-- Put site-specific property overrides in this file. --><?xml
> version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <!-- Put site-specific property overrides in this file. -->
>
> <configuration>
> <property>
> <name>
> dfs.name.dir
> </name>
> <value>
> /fsname
> </value>
> </property>
> <property>
> <name>
> dfs.data.dir
> </name>
> <value>
> /fsdata
> </value>
> </property>
> <property>
> <name>
> dfs.replication
> </name>
> <value>
> 2
> </value>
> </property>
> </configuration>
>
>
> cat conf/mapred-site.xml
> <?xml version="1.0"?>
> <?xml-stylesheet type="text/xsl" href="configuration.xsl"?>
>
> <!-- Put site-specific property overrides in this file. -->
>
> <configuration>
> <property>
> <name>
> mapred.job.tracker
> </name>
> <value>
> centosxcat1:54311
> </value>
> </property>
> </configuration>
>
>
>
> <configuration>
> <property>
> <name>fs.default.name</name>
> <value>hdfs://centosxcat1</value>
> </property>
> </configuration>
>
>
>
> cat conf/hdfs-site.xml
>
--
Todd Lipcon
Software Engineer, Cloudera