You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Billy Pearson <sa...@pearsonwholesale.com> on 2011/02/28 20:35:55 UTC
zookeeper/mapred problems
when I run a job hbase on a tasktracker that doesn ot have a local zookeeper server on it I get this
java.net.ConnectException: Connection refused
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
2011-02-28 13:22:53,692 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
2011-02-28 13:22:53,693 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
in my hbase-site.xml
I have
<property>
<name>hbase.zookeeper.quorum</name>
<value>10.0.0.30</value>
</property>
but in the job.xml it keep showing up as localhost
so I set it in the conf for the mapred job
conf.set("hbase.zookeeper.quorum", "10.0.0.30");
and it shows up right in the job.xml but the tasktrackers are still trying to connect to localhost/127.0.0.1
Any ideas on where to fix this?
i am running on 0.90.1+8-1 from cloudera
Billy
Re: zookeeper/mapred problems
Posted by Jean-Daniel Cryans <jd...@apache.org>.
I think this is https://issues.apache.org/jira/browse/HBASE-3578
You need to create a HBaseConfiguration when configuring the job.
J-D
On Mon, Feb 28, 2011 at 11:35 AM, Billy Pearson
<sa...@pearsonwholesale.com> wrote:
> when I run a job hbase on a tasktracker that doesn ot have a local zookeeper server on it I get this
>
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
> 2011-02-28 13:22:53,692 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
> 2011-02-28 13:22:53,693 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
>
> in my hbase-site.xml
> I have
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>10.0.0.30</value>
> </property>
>
> but in the job.xml it keep showing up as localhost
> so I set it in the conf for the mapred job
> conf.set("hbase.zookeeper.quorum", "10.0.0.30");
> and it shows up right in the job.xml but the tasktrackers are still trying to connect to localhost/127.0.0.1
>
> Any ideas on where to fix this?
> i am running on 0.90.1+8-1 from cloudera
>
> Billy
>
Re: zookeeper/mapred problems
Posted by Billy Pearson <sa...@pearsonwholesale.com>.
Thanks stack
It was a classpath problem
Its been a while sense I set one of these up from scratch
Billy Pearson
"Stack" <st...@duboce.net> wrote in message
news:AANLkTinM5gOryaX-Npb6gk32zv5UNz+No3k9+jH4y9S-@mail.gmail.com...
Hey Billy:
Sounds like the conf directory is not being exported out to the
cluster and/or you are not adding it to the task CLASSPATH. You've
seen:
http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description
St.Ack
On Mon, Feb 28, 2011 at 11:35 AM, Billy Pearson
<sa...@pearsonwholesale.com> wrote:
> when I run a job hbase on a tasktracker that doesn ot have a local
> zookeeper server on it I get this
>
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
> 2011-02-28 13:22:53,692 INFO org.apache.zookeeper.ClientCnxn: Opening
> socket connection to server localhost/127.0.0.1:2181
> 2011-02-28 13:22:53,693 WARN org.apache.zookeeper.ClientCnxn: Session 0x0
> for server null, unexpected error, closing socket connection and
> attempting reconnect
>
> in my hbase-site.xml
> I have
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>10.0.0.30</value>
> </property>
>
> but in the job.xml it keep showing up as localhost
> so I set it in the conf for the mapred job
> conf.set("hbase.zookeeper.quorum", "10.0.0.30");
> and it shows up right in the job.xml but the tasktrackers are still trying
> to connect to localhost/127.0.0.1
>
> Any ideas on where to fix this?
> i am running on 0.90.1+8-1 from cloudera
>
> Billy
>
Re: zookeeper/mapred problems
Posted by Stack <st...@duboce.net>.
Hey Billy:
Sounds like the conf directory is not being exported out to the
cluster and/or you are not adding it to the task CLASSPATH. You've
seen: http://hbase.apache.org/apidocs/org/apache/hadoop/hbase/mapreduce/package-summary.html#package_description
St.Ack
On Mon, Feb 28, 2011 at 11:35 AM, Billy Pearson
<sa...@pearsonwholesale.com> wrote:
> when I run a job hbase on a tasktracker that doesn ot have a local zookeeper server on it I get this
>
> java.net.ConnectException: Connection refused
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1119)
> 2011-02-28 13:22:53,692 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server localhost/127.0.0.1:2181
> 2011-02-28 13:22:53,693 WARN org.apache.zookeeper.ClientCnxn: Session 0x0 for server null, unexpected error, closing socket connection and attempting reconnect
>
> in my hbase-site.xml
> I have
> <property>
> <name>hbase.zookeeper.quorum</name>
> <value>10.0.0.30</value>
> </property>
>
> but in the job.xml it keep showing up as localhost
> so I set it in the conf for the mapred job
> conf.set("hbase.zookeeper.quorum", "10.0.0.30");
> and it shows up right in the job.xml but the tasktrackers are still trying to connect to localhost/127.0.0.1
>
> Any ideas on where to fix this?
> i am running on 0.90.1+8-1 from cloudera
>
> Billy
>