You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Chris Bates <ch...@gmail.com> on 2010/01/20 21:12:05 UTC
Config Problems with HBase and Jetty
Hi,
We're building an analytics server with HBase using Jetty. I have
experimented with the Thrift API + PHP over the past few days and got it
working, but needed the filter functionality which has not been released
yet. So I decided to switch to the Java API and run it with a Jetty server.
My Jetty server is setup on crunch2.in.escapemg.com:8888.
Hbase is setup on the same machine, with all the configuration settings
according to the "Getting Started" guide. We are using Hbase version
0.20.1.
Just doing a quick scanning test with this code:
HBaseConfiguration config = new HBaseConfiguration();
HTable table = new HTable(config, "Guts");
Scan s = new Scan();
s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
ResultScanner scanner = table.getScanner(s);
int count = 0;
int limit = 10;
try {
for (Result rr = scanner.next(); rr != null; rr =
scanner.next()) {
if (count <= limit) {
response.getOutputStream().write( rr.getRow() );
count++;
}
}
} finally {
scanner.close();
}
I get this error, which states (I think) that the HBase is throwing a
connection error:
[exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
java.io.IOException: config()
[exec] at
org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
[exec] at
org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
[exec] at
org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
[exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
[exec] at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
[exec] at org.mortbay.jetty.Server.handle(Server.java:326)
[exec] at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
[exec] at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
[exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
[exec] at
org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
[exec] at
org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
[exec] at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
[exec] at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
[exec]
[exec] 2010-01-20 14:56:14.697::WARN: /
[exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
[exec] at java.lang.ClassLoader.defineClass1(Native Method)
[exec] at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
[exec] at
java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
[exec] at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
[exec] at java.net.URLClassLoader.access$000(URLClassLoader.java:56)
[exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
[exec] at java.security.AccessController.doPrivileged(Native Method)
[exec] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[exec] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
[exec] at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
[exec] at
org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
[exec] at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
[exec] at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
[exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
[exec] at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
[exec] at org.mortbay.jetty.Server.handle(Server.java:326)
[exec] at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
[exec] at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
[exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
[exec] at
org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
[exec] at
org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
[exec] at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
[exec] at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
[exec] Caused by: java.lang.ClassNotFoundException:
org.apache.zookeeper.Watcher
[exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
[exec] at java.security.AccessController.doPrivileged(Native Method)
[exec] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[exec] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
[exec] at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
[exec] ... 35 more
After doing a mailing list search, it seemed that other configuration
problems were fixed by upgrading to 0.20.2 which I have not yet done. Is
this the problem or is there something simple I am overlooking? I have also
added my hbase-site.xml and hbase-default.xml to my lib and conf directories
to my working classpath.
I am confused because I was able to connect via thrift, and I also have a
BulkImporter MapReduce script to load the logging data into HBase that works
fine, but have been unable to locate my error in this case.
Re: Config Problems with HBase and Jetty
Posted by Chris Bates <ch...@gmail.com>.
nevermind, putting in a break seemed to work: http://pastebin.com/m834a694
thanks all to your help!
On Sat, Jan 23, 2010 at 1:25 PM, Chris Bates <
christopher.andrew.bates@gmail.com> wrote:
> Thanks for the tip. I ended up doing an "ant clean" to delete all the
> build directories because I started noticing things that were in there that
> shouldn't have been. I'm not sure why I didn't do that before.
>
> Anyways, I ended up adding the hbase-site.xml and hbase-default.xml to my
> conf directories (putting them in the lib with the binaries didn't work). I
> got the success message that I posted in a previous e-mail.
>
> My scanner still wasn't working, so just to see if it was connecting to
> HBase properly I did:
>
> HBaseAdmin admin = new HBaseAdmin(config);
> HTableDescriptor[] tables = admin.listTables();
> response.getOutputStream().write(tables[0].getName());
>
> And it worked! It properly passed the table name. So now, its got to be my
> scanner. What I'd like to do is perform this hbase shell operation:
>
> scan 'Guts', {COLUMNS=>['user:theme'], LIMIT=>10}
>
> Here is my scanner code that apparently just hangs:
> Scan s = new Scan();
> s.addColumn(Bytes.toBytes("user"),Bytes.toBytes("theme"));
> ResultScanner scanner = table.getScanner(s);
> int count = 0;
> int limit = 10;
> Result res = null;
>
>
> try {
> for (Result rr = scanner.next(); rr != null; rr =
> scanner.next()) {
> if (count <= limit) {
> response.getOutputStream().write( rr.getRow() );
> count++;
> }
> }
> } finally {
> scanner.close();
> }
>
>
> any ideas??
>
>
>
>
> On Sat, Jan 23, 2010 at 2:49 AM, Gibbon, Robert, VF-Group <
> Robert.Gibbon@vodafone.com> wrote:
>
>>
>> I got a similar problem. I got it to kick into life by putting
>> hbase-site.xml and hbase-default.xml in the same directory as the binaries.
>> Looking at HBaseConfiguration it wants them to be in the pwd - on lines 49
>> and 50:
>>
>>
>> http://github.com/apache/hbase/blob/tags/0.20.1/src/java/org/apache/hadoop/hbase/HBaseConfiguration.java
>>
>> HTH
>>
>>
>> -----Original Message-----
>> From: Chris Bates [mailto:christopher.andrew.bates@gmail.com]
>> Sent: Sat 1/23/2010 12:42 AM
>> To: hbase-user@hadoop.apache.org
>> Subject: Re: Config Problems with HBase and Jetty
>>
>> So I've been still trying to work this problem out and haven't had any
>> success. Here is another pastebin of the issues:
>>
>> http://pastebin.com/m2e19f84b
>>
>> So basically here is what I'm trying to do:
>> 1. Run HBase Java API (0.20.1) from a Jetty Webserver (setup on
>> 172.16.1.95:8888). I have handlers that are feeding objects that contain
>> the different API calls I want to make. The handlers are setup with
>> Spring.
>>
>> 2. The application is built and then runs after building. I have stared
>> at
>> my build.xml file many times and I'm sure hbase-site.xml and
>> hbase-default.xml are included in the runtime conf directories, and the
>> jars
>> that I need are all in my runtime lib directory. I can post screenshots,
>> but I'm sure they are in my classpath.
>>
>> 3. I'm running the program on 172.16.1.95. In the hbase-site.xml, my
>> zookeepers are 172.16.1.46, 172.16.1.95, 172.16.1.96. My regionservers are
>> just 172.16.1.95 and 172.16.1.96 (I sorta forget how I originally set up
>> the
>> system, so my regionserver file could possibly be another source of
>> error).
>>
>> 4. In a moment of desperation, I just decided to include ALL of Hbase's
>> conf files in my runtime conf directory. I get a different response and
>> the
>> system hangs (doesn't return anything and has a loading sign).
>>
>> Here is a thread dump for the 95 regionserver box.
>> http://pastebin.com/m1feb7a8f. Here is the output I see at the command
>> line: http://pastebin.com/ma6e7ef7
>>
>>
>> Are there any Web-server API configuration setups I can follow? Should I
>> upgrade to 0.20.2? Should I try another web server (Tomcat?).
>>
>> Thanks again for the help
>>
>>
>>
>>
>> On Wed, Jan 20, 2010 at 8:04 PM, stack <st...@duboce.net> wrote:
>>
>> > So, pardon me, I'm a little confused. The thread dump below looks like
>> a
>> > bunch of handlers waiting on something to happen. The hbase web ui
>> looks
>> > healthy. You are trying to embed hbase client inside a jetty webapp,
>> > right?
>> >
>> > Looking at this, http://pastebin.com/m3147adf1, this looks wrong:
>> >
>> >
>> > 1. [exec] 2010-01-20 16:13:00.769::INFO: Started
>> SocketConnector@
>> > 0.0.0.0:8888
>> > 2. [exec] 16:13:06,133 DEBUG [24109300@qtp-15206466-0
>> > ,Configuration]
>> > java.io.IOException<
>> >
>> http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky
>> > >:
>> > config()
>> > 3. [exec] at org.apache.hadoop.conf.Configuration.<init>(
>> > Configuration.java:210)
>> > 4. [exec] at org.apache.hadoop.conf.Configuration.<init>(
>> > Configuration.java:197)
>> > 5. [exec] at
>> org.apache.hadoop.hbase.HBaseConfiguration.<init>(
>> > HBaseConfiguration.java:33)
>> > 6. [exec] at
>> com.grooveshark.HBaseHandler.handle(HBaseHandler.
>> > java:25)
>> > 7. [exec] at org.mortbay.jetty.handler.HandlerWrapper.handle(
>> > HandlerWrapper.java:152)
>> > 8. [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
>> > 9. [exec] at org.mortbay.jetty.HttpConnection.handleRequest(
>> > HttpConnection.java:536)
>> > 10. [exec] at
>> org.mortbay.jetty.HttpConnection$RequestHandler.
>> > headerComplete(HttpConnection.java:913)
>> > 11. [exec] at
>> org.mortbay.jetty.HttpParser.parseNext(HttpParser.
>> > java:539)
>> > 12. [exec] at org.mortbay.jetty.HttpParser.parseAvailable(
>> > HttpParser.java:212)
>> > 13. [exec] at org.mortbay.jetty.HttpConnection.handle(
>> > HttpConnection.java:405)
>> > 14. [exec] at
>> org.mortbay.jetty.bio.SocketConnector$Connection.
>> > run(SocketConnector.java:228)
>> > 15. [exec] at
>> org.mortbay.thread.QueuedThreadPool$PoolThread.run
>> > (QueuedThreadPool.java:582)
>> >
>> >
>> >
>> >
>> >
>> >
>> > This is as though you still do not have hbase conf directory on the
>> jetty
>> > CLASSPATH?
>> >
>> > This is good: "Connecting to /172.16.1.96:6002"
>> >
>> > This is the right location? It got this from hbase-site.xml? Maybe its
>> > missing hbase-default.xml?
>> >
>> > Oh, I see you have DEBUG logging on for RPC. Do you have all DEBUG on
>> for
>> > all hadoop packages? It looks like stuff is working?
>> >
>> > St.Ack
>> >
>> >
>> > On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates <
>> > christopher.andrew.bates@gmail.com> wrote:
>> >
>> > > What exactly do you mean by client exceptions? Or where can I find
>> them?
>> > I
>> > > pastebin'd the exceptions I got from the command line. The web browser
>> is
>> > > blank and just has a loading sign until I kill the process. If I look
>> at
>> > > the Hbase Web UI from the crunch2 box where I ran the program,
>> everything
>> > > seems normal, but I'll paste that:
>> > >
>> > > Web UI:
>> > > http://pastebin.com/mef9a432
>> > >
>> > > Thread Dump:
>> > > http://pastebin.com/m76022dea
>> > >
>> > > On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote:
>> > >
>> > > > I was thinking hadoop perms. But if shell works, then its probably
>> > fine.
>> > > > Can you pastebin client exceptions? Thanks,
>> > > > St.Ack
>> > > >
>> > > > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
>> > > > christopher.andrew.bates@gmail.com> wrote:
>> > > >
>> > > > > Yeah, we're just using the default so no zoo.cfg. Permissions are
>> > fine
>> > > > as
>> > > > > I
>> > > > > can ssh into any other hadoop box without password. Although it
>> > looks
>> > > > like
>> > > > > permissions aren't set on the log directory. I'm currently VPN'd,
>> so
>> > > > maybe
>> > > > > its a networking issue??
>> > > > >
>> > > > > Pastebin: http://pastebin.com/m3147adf1
>> > > > >
>> > > > > Hbase shell is working:
>> > > > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'],
>> LIMIT=>5}
>> > > > > ROW COLUMN+CELL
>> > > > >
>> > > > > -10095526042667 column=user:theme,
>> > > > timestamp=-10095526042667,
>> > > > > value=Frost
>> > > > > -10095526042683 column=user:theme,
>> > > > timestamp=-10095526042683,
>> > > > > value=Frost
>> > > > > -10095526042854 column=user:theme,
>> > > > timestamp=-10095526042854,
>> > > > > value=Frost
>> > > > > -10095526042870 column=user:theme,
>> > > > timestamp=-10095526042870,
>> > > > > value=Frost
>> > > > > 5 row(s) in 0.2570 seconds
>> > > > >
>> > > > > Jetty is working:
>> > > > >
>> > > > > // Substitute HBase config for test stringbuilder
>> > > > >
>> > > > > StringBuilder builder = new StringBuilder();
>> > > > >
>> > > > > builder.append("Blah blah blah");
>> > > > >
>> > > > > response.getOutputStream().write(
>> > > > > builder.toString().getBytes());
>> > > > >
>> > > > > Outputs "Blah blah blah" to the screen.
>> > > > >
>> > > > >
>> > > > >
>> > > > > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
>> > > > >
>> > > > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
>> > > > > > Robert.Gibbon@vodafone.com> wrote:
>> > > > > >
>> > > > > > >
>> > > > > > > Try putting the directory holding zoo.cfg on the classpath -
>> you
>> > > have
>> > > > a
>> > > > > > > zoo.cfg file, right?
>> > > > > > >
>> > > > > >
>> > > > > > Default is to read zoo configuration from hbase-site.xml -- e.g.
>> > > > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll
>> read
>> > > that
>> > > > > > ahead of hbase-site.xml.
>> > > > > > St.Ack
>> > > > > >
>> > > > > >
>> > > > > >
>> > > > > > >
>> > > > > > > -----Original Message-----
>> > > > > > > From: saint.ack@gmail.com on behalf of stack
>> > > > > > > Sent: Wed 1/20/2010 9:53 PM
>> > > > > > > To: hbase-user@hadoop.apache.org
>> > > > > > > Subject: Re: Config Problems with HBase and Jetty
>> > > > > > >
>> > > > > > > Can you pastebin the below? Its hard to read in email. Maybe
>> > its
>> > > a
>> > > > > > > permissions prob? I see lots of 'from an unknown user got
>> > value'.
>> > > > Can
>> > > > > > you
>> > > > > > > get to your hbase cluster using hbase shell ok? From host
>> > running
>> > > > > > jetty?
>> > > > > > >
>> > > > > > > St.Ack
>> > > > > > >
>> > > > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
>> > > > > > > christopher.andrew.bates@gmail.com> wrote:
>> > > > > > >
>> > > > > > > > Ah. good catch...getting more errors still....
>> > > > > > > >
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
>> > > > > > > > [exec] at
>> > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > > > >
>> > > >
>> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>> > > > > > > > [exec] at
>> org.mortbay.jetty.Server.handle(Server.java:326)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > > >
>> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
>> > > > > > > > [exec] at
>> > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>> > > > > > > > [exec] at
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>> > > > > > > > [exec]
>> > > > > > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > > Client
>> > > > > > > > environment:zookeeper.version=3.2.1-808558, built on
>> 08/27/2009
>> > > > 18:48
>> > > > > > GMT
>> > > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:host.name=crunch2.local
>> > > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:java.version=1.6.0_14
>> > > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:java.vendor=Sun Microsystems Inc.
>> > > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
>> > > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
>> > > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
>> > > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:java.io.tmpdir=/tmp
>> > > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:java.compiler=<NA>
>> > > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:os.name=Linux
>> > > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:os.arch=i386
>> > > > > > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:os.version=2.6.28-11-generic
>> > > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:user.name=hadoop
>> > > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:user.home=/home/hadoop
>> > > > > > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > Client
>> > > > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
>> > > > > > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0
>> > > ,ZooKeeper]
>> > > > > > > > Initiating client connection, connectString=localhost:2181
>> > > > > > > > sessionTimeout=60000
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
>> > > > > > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0
>> > > ,ClientCnxn]
>> > > > > > > > zookeeper.disableAutoWatchReset is false
>> > > > > > > > [exec] 15:33:31,291 INFO
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Attempting connection to server
>> localhost/0:0:0:0:0:0:0:1:2181
>> > > > > > > > [exec] 15:33:31,302 INFO
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Priming connection to
>> java.nio.channels.SocketChannel[connected
>> > > > > > > > local=/0:0:0:0:0:0:0:1:41216
>> > > remote=localhost/0:0:0:0:0:0:0:1:2181]
>> > > > > > > > [exec] 15:33:31,320 INFO
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Server connection successful
>> > > > > > > > [exec] 15:33:31,379 DEBUG
>> > > > > > > > [24109300@qtp-15206466-0-EventThread
>> > > > > > ,HConnectionManager$ClientZKWatcher]
>> > > > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path:
>> > null
>> > > > > > > > [exec] 15:33:31,386 DEBUG
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
>> > > clientPath:null
>> > > > > > > > serverPath:null finished:false header:: -8,101
>> replyHeader::
>> > > > -8,80,0
>> > > > > > > > request:: 0,v{},v{},v{} response:: null
>> > > > > > > > [exec] 15:33:31,404 DEBUG
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
>> > > clientPath:null
>> > > > > > > > serverPath:null finished:false header:: 1,1 replyHeader::
>> > > > 1,81,-110
>> > > > > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
>> > > > > > > > [exec] 15:33:31,438 DEBUG
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
>> > > clientPath:null
>> > > > > > > > serverPath:null finished:false header:: 2,3 replyHeader::
>> > 2,81,0
>> > > > > > > > request::
>> > > > > > > > '/hbase/safe-mode,F response::
>> > > > > > > >
>> > > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
>> > > > > > > > [exec] 15:33:31,453 DEBUG
>> > [24109300@qtp-15206466-0-SendThread
>> > > > > > > > ,ClientCnxn]
>> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
>> > > clientPath:null
>> > > > > > > > serverPath:null finished:false header:: 3,4 replyHeader::
>> > 3,81,0
>> > > > > > > > request::
>> > > > > > > > '/hbase/root-region-server,F response::
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
>> > > > > > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
>> > > > > > ,ZooKeeperWrapper]
>> > > > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
>> > > > > > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > The
>> > > > > > > > ping interval is60000ms.
>> > > > > > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > > > Connecting to /172.16.1.96:60020
>> > > > > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user:
>> > starting,
>> > > > > > having
>> > > > > > > > connections 1
>> > > > > > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #0
>> > > > > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #0
>> > > > > > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > getProtocolVersion 139
>> > > > > > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #1
>> > > > > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #1
>> > > > > > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > getRegionInfo 28
>> > > > > > > > [exec] 15:33:31,942 DEBUG
>> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
>> > > > > > > > Found ROOT at 172.16.1.96:60020
>> > > > > > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #2
>> > > > > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #2
>> > > > > > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > getClosestRowBefore 8
>> > > > > > > > [exec] 15:33:32,004 DEBUG
>> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
>> > > > > > > > Cached location address: 172.16.1.95:60020, regioninfo:
>> REGION
>> > > =>
>> > > > > > {NAME
>> > > > > > > =>
>> > > > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED =>
>> > 1028785192,
>> > > > > TABLE
>> > > > > > > =>
>> > > > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
>> > > > '16384',
>> > > > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
>> > > > > > COMPRESSION
>> > > > > > > =>
>> > > > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY =>
>> > > 'false',
>> > > > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
>> > > > > COMPRESSION
>> > > > > > =>
>> > > > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY
>> =>
>> > > > > 'false',
>> > > > > > > > BLOCKCACHE => 'false'}]}}
>> > > > > > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > > > Connecting to /172.16.1.95:60020
>> > > > > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.95:60020 from an unknown user:
>> > starting,
>> > > > > > having
>> > > > > > > > connections 2
>> > > > > > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.95:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #3
>> > > > > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.95:60020 from an unknown user got
>> > value
>> > > #3
>> > > > > > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > getProtocolVersion 14
>> > > > > > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.95:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #4
>> > > > > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.95:60020 from an unknown user got
>> > value
>> > > #4
>> > > > > > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > getClosestRowBefore 157
>> > > > > > > > [exec] 15:33:32,179 DEBUG
>> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
>> > > > > > > > Cached location address: 172.16.1.96:60020, regioninfo:
>> REGION
>> > > =>
>> > > > > > {NAME
>> > > > > > > =>
>> > > > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY =>
>> > '1262239352230',
>> > > > > > ENCODED
>> > > > > > > > =>
>> > > > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
>> > > > 'search',
>> > > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
>> > > > > BLOCKSIZE
>> > > > > > =>
>> > > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
>> =>
>> > > > > 'user',
>> > > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
>> > > > > BLOCKSIZE
>> > > > > > =>
>> > > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
>> > > > > > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
>> > > > > > > > ,HTable$ClientScanner]
>> > > > > > > > Creating scanner over Guts starting at key ''
>> > > > > > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
>> > > > > > > > ,HTable$ClientScanner]
>> > > > > > > > Advancing internal scanner to startKey at ''
>> > > > > > > > [exec] 15:33:32,191 DEBUG
>> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
>> > > > > > > > Cache hit for row <> in tableName Guts: location server
>> > > > > > > 172.16.1.96:60020,
>> > > > > > > > location region name Guts,,1262665364102
>> > > > > > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #5
>> > > > > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #5
>> > > > > > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > openScanner 30
>> > > > > > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #6
>> > > > > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #6
>> > > > > > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > next
>> > > > > > > > 30
>> > > > > > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #7
>> > > > > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #7
>> > > > > > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > next
>> > > > > > > > 28
>> > > > > > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
>> > > > ,HBaseClient]
>> > > > > > IPC
>> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an
>> unknown
>> > > user
>> > > > > > > sending
>> > > > > > > > #8
>> > > > > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to
>> /
>> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
>> Client
>> > > > (47)
>> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
>> > value
>> > > #8
>> > > > > > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0
>> > ,HbaseRPC]
>> > > > > Call:
>> > > > > > > > next
>> > > > > > > > 27
>> > > > > > > >
>> > > > > > > > Then this scanner output seems to continue forever and it
>> just
>> > > > hangs.
>> > > > > > > I'm
>> > > > > > > > not really sure what the errors mean...
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net>
>> > wrote:
>> > > > > > > >
>> > > > > > > > > Is zookeeper jar on your CLASSPATH?
>> > > > > > > > >
>> > > > > > > > > [exec] java.lang.NoClassDefFoundError:
>> > > > > org/apache/zookeeper/Watcher
>> > > > > > > > >
>> > > > > > > > > You code looks fine.
>> > > > > > > > >
>> > > > > > > > > St.Ack
>> > > > > > > > >
>> > > > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
>> > > > > > > > > christopher.andrew.bates@gmail.com> wrote:
>> > > > > > > > >
>> > > > > > > > > > Hi,
>> > > > > > > > > >
>> > > > > > > > > > We're building an analytics server with HBase using
>> Jetty.
>> > I
>> > > > > have
>> > > > > > > > > > experimented with the Thrift API + PHP over the past few
>> > days
>> > > > and
>> > > > > > got
>> > > > > > > > it
>> > > > > > > > > > working, but needed the filter functionality which has
>> not
>> > > been
>> > > > > > > > released
>> > > > > > > > > > yet. So I decided to switch to the Java API and run it
>> > with
>> > > a
>> > > > > > Jetty
>> > > > > > > > > > server.
>> > > > > > > > > >
>> > > > > > > > > > My Jetty server is setup on
>> crunch2.in.escapemg.com:8888.
>> > > > > > > > > >
>> > > > > > > > > > Hbase is setup on the same machine, with all the
>> > > configuration
>> > > > > > > settings
>> > > > > > > > > > according to the "Getting Started" guide. We are using
>> > Hbase
>> > > > > > version
>> > > > > > > > > > 0.20.1.
>> > > > > > > > > >
>> > > > > > > > > > Just doing a quick scanning test with this code:
>> > > > > > > > > >
>> > > > > > > > > > HBaseConfiguration config = new HBaseConfiguration();
>> > > > > > > > > > HTable table = new HTable(config, "Guts");
>> > > > > > > > > > Scan s = new Scan();
>> > > > > > > > > >
>> > > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
>> > > > > > > > > > ResultScanner scanner = table.getScanner(s);
>> > > > > > > > > > int count = 0;
>> > > > > > > > > > int limit = 10;
>> > > > > > > > > > try {
>> > > > > > > > > > for (Result rr = scanner.next(); rr !=
>> null;
>> > > rr
>> > > > =
>> > > > > > > > > > scanner.next()) {
>> > > > > > > > > > if (count <= limit) {
>> > > > > > > > > > response.getOutputStream().write(
>> > > > > > rr.getRow()
>> > > > > > > );
>> > > > > > > > > > count++;
>> > > > > > > > > > }
>> > > > > > > > > > }
>> > > > > > > > > > } finally {
>> > > > > > > > > > scanner.close();
>> > > > > > > > > > }
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > I get this error, which states (I think) that the HBase
>> is
>> > > > > throwing
>> > > > > > a
>> > > > > > > > > > connection error:
>> > > > > > > > > >
>> > > > > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
>> > > > > ,Configuration]
>> > > > > > > > > > java.io.IOException: config()
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > >
>> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > >
>> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
>> > > > > > > > > > [exec] at
>> > > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > >
>> > > > > >
>> > > >
>> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>> > > > > > > > > > [exec] at
>> > > org.mortbay.jetty.Server.handle(Server.java:326)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > >
>> > > >
>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
>> > > > > > > > > > [exec] at
>> > > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>> > > > > > > > > > [exec]
>> > > > > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
>> > > > > > > > > > [exec] java.lang.NoClassDefFoundError:
>> > > > > > > org/apache/zookeeper/Watcher
>> > > > > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native
>> > > Method)
>> > > > > > > > > > [exec] at
>> > > > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > >
>> > > >
>> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
>> > > > > > > > > > [exec] at
>> > > > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
>> > > > > > > > > > [exec] at
>> > > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
>> > > > > > > > > > [exec] at
>> > > > java.security.AccessController.doPrivileged(Native
>> > > > > > > > Method)
>> > > > > > > > > > [exec] at
>> > > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> > > > > > > > > > [exec] at
>> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > > > > > > > > > [exec] at
>> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
>> > > > > > > > > > [exec] at
>> > > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > >
>> > > > > >
>> > > >
>> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>> > > > > > > > > > [exec] at
>> > > org.mortbay.jetty.Server.handle(Server.java:326)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > >
>> > > >
>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
>> > > > > > > > > > [exec] at
>> > > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>> > > > > > > > > > [exec] at
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>> > > > > > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
>> > > > > > > > > > org.apache.zookeeper.Watcher
>> > > > > > > > > > [exec] at
>> > > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
>> > > > > > > > > > [exec] at
>> > > > java.security.AccessController.doPrivileged(Native
>> > > > > > > > Method)
>> > > > > > > > > > [exec] at
>> > > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
>> > > > > > > > > > [exec] at
>> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
>> > > > > > > > > > [exec] at
>> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
>> > > > > > > > > > [exec] at
>> > > > > > > > >
>> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
>> > > > > > > > > > [exec] ... 35 more
>> > > > > > > > > >
>> > > > > > > > > >
>> > > > > > > > > > After doing a mailing list search, it seemed that other
>> > > > > > configuration
>> > > > > > > > > > problems were fixed by upgrading to 0.20.2 which I have
>> not
>> > > yet
>> > > > > > done.
>> > > > > > > > Is
>> > > > > > > > > > this the problem or is there something simple I am
>> > > overlooking?
>> > > > > I
>> > > > > > > have
>> > > > > > > > > > also
>> > > > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib
>> and
>> > > > conf
>> > > > > > > > > > directories
>> > > > > > > > > > to my working classpath.
>> > > > > > > > > >
>> > > > > > > > > > I am confused because I was able to connect via thrift,
>> and
>> > I
>> > > > > also
>> > > > > > > have
>> > > > > > > > a
>> > > > > > > > > > BulkImporter MapReduce script to load the logging data
>> into
>> > > > HBase
>> > > > > > > that
>> > > > > > > > > > works
>> > > > > > > > > > fine, but have been unable to locate my error in this
>> case.
>> > > > > > > > > >
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>>
>
Re: Config Problems with HBase and Jetty
Posted by Chris Bates <ch...@gmail.com>.
Thanks for the tip. I ended up doing an "ant clean" to delete all the build
directories because I started noticing things that were in there that
shouldn't have been. I'm not sure why I didn't do that before.
Anyways, I ended up adding the hbase-site.xml and hbase-default.xml to my
conf directories (putting them in the lib with the binaries didn't work). I
got the success message that I posted in a previous e-mail.
My scanner still wasn't working, so just to see if it was connecting to
HBase properly I did:
HBaseAdmin admin = new HBaseAdmin(config);
HTableDescriptor[] tables = admin.listTables();
response.getOutputStream().write(tables[0].getName());
And it worked! It properly passed the table name. So now, its got to be my
scanner. What I'd like to do is perform this hbase shell operation:
scan 'Guts', {COLUMNS=>['user:theme'], LIMIT=>10}
Here is my scanner code that apparently just hangs:
Scan s = new Scan();
s.addColumn(Bytes.toBytes("user"),Bytes.toBytes("theme"));
ResultScanner scanner = table.getScanner(s);
int count = 0;
int limit = 10;
Result res = null;
try {
for (Result rr = scanner.next(); rr != null; rr =
scanner.next()) {
if (count <= limit) {
response.getOutputStream().write( rr.getRow() );
count++;
}
}
} finally {
scanner.close();
}
any ideas??
On Sat, Jan 23, 2010 at 2:49 AM, Gibbon, Robert, VF-Group <
Robert.Gibbon@vodafone.com> wrote:
>
> I got a similar problem. I got it to kick into life by putting
> hbase-site.xml and hbase-default.xml in the same directory as the binaries.
> Looking at HBaseConfiguration it wants them to be in the pwd - on lines 49
> and 50:
>
>
> http://github.com/apache/hbase/blob/tags/0.20.1/src/java/org/apache/hadoop/hbase/HBaseConfiguration.java
>
> HTH
>
>
> -----Original Message-----
> From: Chris Bates [mailto:christopher.andrew.bates@gmail.com]
> Sent: Sat 1/23/2010 12:42 AM
> To: hbase-user@hadoop.apache.org
> Subject: Re: Config Problems with HBase and Jetty
>
> So I've been still trying to work this problem out and haven't had any
> success. Here is another pastebin of the issues:
>
> http://pastebin.com/m2e19f84b
>
> So basically here is what I'm trying to do:
> 1. Run HBase Java API (0.20.1) from a Jetty Webserver (setup on
> 172.16.1.95:8888). I have handlers that are feeding objects that contain
> the different API calls I want to make. The handlers are setup with
> Spring.
>
> 2. The application is built and then runs after building. I have stared at
> my build.xml file many times and I'm sure hbase-site.xml and
> hbase-default.xml are included in the runtime conf directories, and the
> jars
> that I need are all in my runtime lib directory. I can post screenshots,
> but I'm sure they are in my classpath.
>
> 3. I'm running the program on 172.16.1.95. In the hbase-site.xml, my
> zookeepers are 172.16.1.46, 172.16.1.95, 172.16.1.96. My regionservers are
> just 172.16.1.95 and 172.16.1.96 (I sorta forget how I originally set up
> the
> system, so my regionserver file could possibly be another source of error).
>
> 4. In a moment of desperation, I just decided to include ALL of Hbase's
> conf files in my runtime conf directory. I get a different response and
> the
> system hangs (doesn't return anything and has a loading sign).
>
> Here is a thread dump for the 95 regionserver box.
> http://pastebin.com/m1feb7a8f. Here is the output I see at the command
> line: http://pastebin.com/ma6e7ef7
>
>
> Are there any Web-server API configuration setups I can follow? Should I
> upgrade to 0.20.2? Should I try another web server (Tomcat?).
>
> Thanks again for the help
>
>
>
>
> On Wed, Jan 20, 2010 at 8:04 PM, stack <st...@duboce.net> wrote:
>
> > So, pardon me, I'm a little confused. The thread dump below looks like a
> > bunch of handlers waiting on something to happen. The hbase web ui looks
> > healthy. You are trying to embed hbase client inside a jetty webapp,
> > right?
> >
> > Looking at this, http://pastebin.com/m3147adf1, this looks wrong:
> >
> >
> > 1. [exec] 2010-01-20 16:13:00.769::INFO: Started SocketConnector@
> > 0.0.0.0:8888
> > 2. [exec] 16:13:06,133 DEBUG [24109300@qtp-15206466-0
> > ,Configuration]
> > java.io.IOException<
> >
> http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky
> > >:
> > config()
> > 3. [exec] at org.apache.hadoop.conf.Configuration.<init>(
> > Configuration.java:210)
> > 4. [exec] at org.apache.hadoop.conf.Configuration.<init>(
> > Configuration.java:197)
> > 5. [exec] at
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(
> > HBaseConfiguration.java:33)
> > 6. [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.
> > java:25)
> > 7. [exec] at org.mortbay.jetty.handler.HandlerWrapper.handle(
> > HandlerWrapper.java:152)
> > 8. [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > 9. [exec] at org.mortbay.jetty.HttpConnection.handleRequest(
> > HttpConnection.java:536)
> > 10. [exec] at org.mortbay.jetty.HttpConnection$RequestHandler.
> > headerComplete(HttpConnection.java:913)
> > 11. [exec] at
> org.mortbay.jetty.HttpParser.parseNext(HttpParser.
> > java:539)
> > 12. [exec] at org.mortbay.jetty.HttpParser.parseAvailable(
> > HttpParser.java:212)
> > 13. [exec] at org.mortbay.jetty.HttpConnection.handle(
> > HttpConnection.java:405)
> > 14. [exec] at
> org.mortbay.jetty.bio.SocketConnector$Connection.
> > run(SocketConnector.java:228)
> > 15. [exec] at
> org.mortbay.thread.QueuedThreadPool$PoolThread.run
> > (QueuedThreadPool.java:582)
> >
> >
> >
> >
> >
> >
> > This is as though you still do not have hbase conf directory on the jetty
> > CLASSPATH?
> >
> > This is good: "Connecting to /172.16.1.96:6002"
> >
> > This is the right location? It got this from hbase-site.xml? Maybe its
> > missing hbase-default.xml?
> >
> > Oh, I see you have DEBUG logging on for RPC. Do you have all DEBUG on
> for
> > all hadoop packages? It looks like stuff is working?
> >
> > St.Ack
> >
> >
> > On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates <
> > christopher.andrew.bates@gmail.com> wrote:
> >
> > > What exactly do you mean by client exceptions? Or where can I find
> them?
> > I
> > > pastebin'd the exceptions I got from the command line. The web browser
> is
> > > blank and just has a loading sign until I kill the process. If I look
> at
> > > the Hbase Web UI from the crunch2 box where I ran the program,
> everything
> > > seems normal, but I'll paste that:
> > >
> > > Web UI:
> > > http://pastebin.com/mef9a432
> > >
> > > Thread Dump:
> > > http://pastebin.com/m76022dea
> > >
> > > On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote:
> > >
> > > > I was thinking hadoop perms. But if shell works, then its probably
> > fine.
> > > > Can you pastebin client exceptions? Thanks,
> > > > St.Ack
> > > >
> > > > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
> > > > christopher.andrew.bates@gmail.com> wrote:
> > > >
> > > > > Yeah, we're just using the default so no zoo.cfg. Permissions are
> > fine
> > > > as
> > > > > I
> > > > > can ssh into any other hadoop box without password. Although it
> > looks
> > > > like
> > > > > permissions aren't set on the log directory. I'm currently VPN'd,
> so
> > > > maybe
> > > > > its a networking issue??
> > > > >
> > > > > Pastebin: http://pastebin.com/m3147adf1
> > > > >
> > > > > Hbase shell is working:
> > > > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'],
> LIMIT=>5}
> > > > > ROW COLUMN+CELL
> > > > >
> > > > > -10095526042667 column=user:theme,
> > > > timestamp=-10095526042667,
> > > > > value=Frost
> > > > > -10095526042683 column=user:theme,
> > > > timestamp=-10095526042683,
> > > > > value=Frost
> > > > > -10095526042854 column=user:theme,
> > > > timestamp=-10095526042854,
> > > > > value=Frost
> > > > > -10095526042870 column=user:theme,
> > > > timestamp=-10095526042870,
> > > > > value=Frost
> > > > > 5 row(s) in 0.2570 seconds
> > > > >
> > > > > Jetty is working:
> > > > >
> > > > > // Substitute HBase config for test stringbuilder
> > > > >
> > > > > StringBuilder builder = new StringBuilder();
> > > > >
> > > > > builder.append("Blah blah blah");
> > > > >
> > > > > response.getOutputStream().write(
> > > > > builder.toString().getBytes());
> > > > >
> > > > > Outputs "Blah blah blah" to the screen.
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
> > > > >
> > > > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > > > > > Robert.Gibbon@vodafone.com> wrote:
> > > > > >
> > > > > > >
> > > > > > > Try putting the directory holding zoo.cfg on the classpath -
> you
> > > have
> > > > a
> > > > > > > zoo.cfg file, right?
> > > > > > >
> > > > > >
> > > > > > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > > > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll
> read
> > > that
> > > > > > ahead of hbase-site.xml.
> > > > > > St.Ack
> > > > > >
> > > > > >
> > > > > >
> > > > > > >
> > > > > > > -----Original Message-----
> > > > > > > From: saint.ack@gmail.com on behalf of stack
> > > > > > > Sent: Wed 1/20/2010 9:53 PM
> > > > > > > To: hbase-user@hadoop.apache.org
> > > > > > > Subject: Re: Config Problems with HBase and Jetty
> > > > > > >
> > > > > > > Can you pastebin the below? Its hard to read in email. Maybe
> > its
> > > a
> > > > > > > permissions prob? I see lots of 'from an unknown user got
> > value'.
> > > > Can
> > > > > > you
> > > > > > > get to your hbase cluster using hbase shell ok? From host
> > running
> > > > > > jetty?
> > > > > > >
> > > > > > > St.Ack
> > > > > > >
> > > > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > > >
> > > > > > > > Ah. good catch...getting more errors still....
> > > > > > > >
> > > > > > > > [exec] at
> > > > > > > >
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > > [exec] at
> > > > > > > >
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > > [exec] at
> > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > [exec] at
> org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > [exec] at
> > > > > > > >
> > > > >
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > [exec] at
> > > > > > > >
> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > [exec] at
> > > > > > > >
> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > [exec]
> > > > > > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > > Client
> > > > > > > > environment:zookeeper.version=3.2.1-808558, built on
> 08/27/2009
> > > > 18:48
> > > > > > GMT
> > > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:host.name=crunch2.local
> > > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:java.version=1.6.0_14
> > > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:java.vendor=Sun Microsystems Inc.
> > > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:java.io.tmpdir=/tmp
> > > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:java.compiler=<NA>
> > > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:os.name=Linux
> > > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:os.arch=i386
> > > > > > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:os.version=2.6.28-11-generic
> > > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:user.name=hadoop
> > > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:user.home=/home/hadoop
> > > > > > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > Client
> > > > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > > > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0
> > > ,ZooKeeper]
> > > > > > > > Initiating client connection, connectString=localhost:2181
> > > > > > > > sessionTimeout=60000
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > > > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0
> > > ,ClientCnxn]
> > > > > > > > zookeeper.disableAutoWatchReset is false
> > > > > > > > [exec] 15:33:31,291 INFO
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Attempting connection to server
> localhost/0:0:0:0:0:0:0:1:2181
> > > > > > > > [exec] 15:33:31,302 INFO
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Priming connection to
> java.nio.channels.SocketChannel[connected
> > > > > > > > local=/0:0:0:0:0:0:0:1:41216
> > > remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > > > > > [exec] 15:33:31,320 INFO
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Server connection successful
> > > > > > > > [exec] 15:33:31,379 DEBUG
> > > > > > > > [24109300@qtp-15206466-0-EventThread
> > > > > > ,HConnectionManager$ClientZKWatcher]
> > > > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path:
> > null
> > > > > > > > [exec] 15:33:31,386 DEBUG
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > > clientPath:null
> > > > > > > > serverPath:null finished:false header:: -8,101 replyHeader::
> > > > -8,80,0
> > > > > > > > request:: 0,v{},v{},v{} response:: null
> > > > > > > > [exec] 15:33:31,404 DEBUG
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > > clientPath:null
> > > > > > > > serverPath:null finished:false header:: 1,1 replyHeader::
> > > > 1,81,-110
> > > > > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > > > > > > [exec] 15:33:31,438 DEBUG
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > > clientPath:null
> > > > > > > > serverPath:null finished:false header:: 2,3 replyHeader::
> > 2,81,0
> > > > > > > > request::
> > > > > > > > '/hbase/safe-mode,F response::
> > > > > > > >
> > > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > > > > > [exec] 15:33:31,453 DEBUG
> > [24109300@qtp-15206466-0-SendThread
> > > > > > > > ,ClientCnxn]
> > > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > > clientPath:null
> > > > > > > > serverPath:null finished:false header:: 3,4 replyHeader::
> > 3,81,0
> > > > > > > > request::
> > > > > > > > '/hbase/root-region-server,F response::
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > > > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > > > > > ,ZooKeeperWrapper]
> > > > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > > > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > The
> > > > > > > > ping interval is60000ms.
> > > > > > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > > > Connecting to /172.16.1.96:60020
> > > > > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user:
> > starting,
> > > > > > having
> > > > > > > > connections 1
> > > > > > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #0
> > > > > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #0
> > > > > > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > getProtocolVersion 139
> > > > > > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #1
> > > > > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #1
> > > > > > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > getRegionInfo 28
> > > > > > > > [exec] 15:33:31,942 DEBUG
> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > > Found ROOT at 172.16.1.96:60020
> > > > > > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #2
> > > > > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #2
> > > > > > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > getClosestRowBefore 8
> > > > > > > > [exec] 15:33:32,004 DEBUG
> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > > Cached location address: 172.16.1.95:60020, regioninfo:
> REGION
> > > =>
> > > > > > {NAME
> > > > > > > =>
> > > > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED =>
> > 1028785192,
> > > > > TABLE
> > > > > > > =>
> > > > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
> > > > '16384',
> > > > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > > > > > COMPRESSION
> > > > > > > =>
> > > > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY =>
> > > 'false',
> > > > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> > > > > COMPRESSION
> > > > > > =>
> > > > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY
> =>
> > > > > 'false',
> > > > > > > > BLOCKCACHE => 'false'}]}}
> > > > > > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > > > Connecting to /172.16.1.95:60020
> > > > > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.95:60020 from an unknown user:
> > starting,
> > > > > > having
> > > > > > > > connections 2
> > > > > > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #3
> > > > > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> > value
> > > #3
> > > > > > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > getProtocolVersion 14
> > > > > > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #4
> > > > > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> > value
> > > #4
> > > > > > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > getClosestRowBefore 157
> > > > > > > > [exec] 15:33:32,179 DEBUG
> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > > Cached location address: 172.16.1.96:60020, regioninfo:
> REGION
> > > =>
> > > > > > {NAME
> > > > > > > =>
> > > > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY =>
> > '1262239352230',
> > > > > > ENCODED
> > > > > > > > =>
> > > > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
> > > > 'search',
> > > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > > BLOCKSIZE
> > > > > > =>
> > > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME
> =>
> > > > > 'user',
> > > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > > BLOCKSIZE
> > > > > > =>
> > > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > > > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > > > > > ,HTable$ClientScanner]
> > > > > > > > Creating scanner over Guts starting at key ''
> > > > > > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > > > > > ,HTable$ClientScanner]
> > > > > > > > Advancing internal scanner to startKey at ''
> > > > > > > > [exec] 15:33:32,191 DEBUG
> > > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > > Cache hit for row <> in tableName Guts: location server
> > > > > > > 172.16.1.96:60020,
> > > > > > > > location region name Guts,,1262665364102
> > > > > > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #5
> > > > > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #5
> > > > > > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > openScanner 30
> > > > > > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #6
> > > > > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #6
> > > > > > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > next
> > > > > > > > 30
> > > > > > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #7
> > > > > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #7
> > > > > > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > next
> > > > > > > > 28
> > > > > > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
> > > > ,HBaseClient]
> > > > > > IPC
> > > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > > user
> > > > > > > sending
> > > > > > > > #8
> > > > > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to
> /
> > > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC
> Client
> > > > (47)
> > > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> > value
> > > #8
> > > > > > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0
> > ,HbaseRPC]
> > > > > Call:
> > > > > > > > next
> > > > > > > > 27
> > > > > > > >
> > > > > > > > Then this scanner output seems to continue forever and it
> just
> > > > hangs.
> > > > > > > I'm
> > > > > > > > not really sure what the errors mean...
> > > > > > > >
> > > > > > > >
> > > > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net>
> > wrote:
> > > > > > > >
> > > > > > > > > Is zookeeper jar on your CLASSPATH?
> > > > > > > > >
> > > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > > org/apache/zookeeper/Watcher
> > > > > > > > >
> > > > > > > > > You code looks fine.
> > > > > > > > >
> > > > > > > > > St.Ack
> > > > > > > > >
> > > > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > > > > >
> > > > > > > > > > Hi,
> > > > > > > > > >
> > > > > > > > > > We're building an analytics server with HBase using
> Jetty.
> > I
> > > > > have
> > > > > > > > > > experimented with the Thrift API + PHP over the past few
> > days
> > > > and
> > > > > > got
> > > > > > > > it
> > > > > > > > > > working, but needed the filter functionality which has
> not
> > > been
> > > > > > > > released
> > > > > > > > > > yet. So I decided to switch to the Java API and run it
> > with
> > > a
> > > > > > Jetty
> > > > > > > > > > server.
> > > > > > > > > >
> > > > > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888
> .
> > > > > > > > > >
> > > > > > > > > > Hbase is setup on the same machine, with all the
> > > configuration
> > > > > > > settings
> > > > > > > > > > according to the "Getting Started" guide. We are using
> > Hbase
> > > > > > version
> > > > > > > > > > 0.20.1.
> > > > > > > > > >
> > > > > > > > > > Just doing a quick scanning test with this code:
> > > > > > > > > >
> > > > > > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > > > > > HTable table = new HTable(config, "Guts");
> > > > > > > > > > Scan s = new Scan();
> > > > > > > > > >
> > > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > > > > > ResultScanner scanner = table.getScanner(s);
> > > > > > > > > > int count = 0;
> > > > > > > > > > int limit = 10;
> > > > > > > > > > try {
> > > > > > > > > > for (Result rr = scanner.next(); rr !=
> null;
> > > rr
> > > > =
> > > > > > > > > > scanner.next()) {
> > > > > > > > > > if (count <= limit) {
> > > > > > > > > > response.getOutputStream().write(
> > > > > > rr.getRow()
> > > > > > > );
> > > > > > > > > > count++;
> > > > > > > > > > }
> > > > > > > > > > }
> > > > > > > > > > } finally {
> > > > > > > > > > scanner.close();
> > > > > > > > > > }
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > I get this error, which states (I think) that the HBase
> is
> > > > > throwing
> > > > > > a
> > > > > > > > > > connection error:
> > > > > > > > > >
> > > > > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> > > > > ,Configuration]
> > > > > > > > > > java.io.IOException: config()
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > > > > [exec] at
> > > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > >
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > > > [exec] at
> > > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > > > [exec] at
> > > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > > > [exec]
> > > > > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > > > > org/apache/zookeeper/Watcher
> > > > > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native
> > > Method)
> > > > > > > > > > [exec] at
> > > > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > >
> > > >
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > > > > > [exec] at
> > > > > > > > >
> java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > > > > > [exec] at
> > > > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > > > > > [exec] at
> > > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > > > > > [exec] at
> > > > java.security.AccessController.doPrivileged(Native
> > > > > > > > Method)
> > > > > > > > > > [exec] at
> > > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > > > [exec] at
> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > > > [exec] at
> > > > > > > > >
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > > > [exec] at
> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > > > [exec] at
> > > > > > > > >
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > > [exec] at
> > > > > > > > >
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > > > > > [exec] at
> > > > > > > > >
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > > > > > [exec] at
> > > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > >
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > > > [exec] at
> > > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > > > [exec] at
> > > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > > > [exec] at
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > > > > > org.apache.zookeeper.Watcher
> > > > > > > > > > [exec] at
> > > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > > > > > [exec] at
> > > > java.security.AccessController.doPrivileged(Native
> > > > > > > > Method)
> > > > > > > > > > [exec] at
> > > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > > > [exec] at
> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > > > [exec] at
> > > > > > > > >
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > > > [exec] at
> > > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > > > [exec] at
> > > > > > > > >
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > > > [exec] ... 35 more
> > > > > > > > > >
> > > > > > > > > >
> > > > > > > > > > After doing a mailing list search, it seemed that other
> > > > > > configuration
> > > > > > > > > > problems were fixed by upgrading to 0.20.2 which I have
> not
> > > yet
> > > > > > done.
> > > > > > > > Is
> > > > > > > > > > this the problem or is there something simple I am
> > > overlooking?
> > > > > I
> > > > > > > have
> > > > > > > > > > also
> > > > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib
> and
> > > > conf
> > > > > > > > > > directories
> > > > > > > > > > to my working classpath.
> > > > > > > > > >
> > > > > > > > > > I am confused because I was able to connect via thrift,
> and
> > I
> > > > > also
> > > > > > > have
> > > > > > > > a
> > > > > > > > > > BulkImporter MapReduce script to load the logging data
> into
> > > > HBase
> > > > > > > that
> > > > > > > > > > works
> > > > > > > > > > fine, but have been unable to locate my error in this
> case.
> > > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
RE: Config Problems with HBase and Jetty
Posted by "Gibbon, Robert, VF-Group" <Ro...@vodafone.com>.
I got a similar problem. I got it to kick into life by putting hbase-site.xml and hbase-default.xml in the same directory as the binaries. Looking at HBaseConfiguration it wants them to be in the pwd - on lines 49 and 50:
http://github.com/apache/hbase/blob/tags/0.20.1/src/java/org/apache/hadoop/hbase/HBaseConfiguration.java
HTH
-----Original Message-----
From: Chris Bates [mailto:christopher.andrew.bates@gmail.com]
Sent: Sat 1/23/2010 12:42 AM
To: hbase-user@hadoop.apache.org
Subject: Re: Config Problems with HBase and Jetty
So I've been still trying to work this problem out and haven't had any
success. Here is another pastebin of the issues:
http://pastebin.com/m2e19f84b
So basically here is what I'm trying to do:
1. Run HBase Java API (0.20.1) from a Jetty Webserver (setup on
172.16.1.95:8888). I have handlers that are feeding objects that contain
the different API calls I want to make. The handlers are setup with Spring.
2. The application is built and then runs after building. I have stared at
my build.xml file many times and I'm sure hbase-site.xml and
hbase-default.xml are included in the runtime conf directories, and the jars
that I need are all in my runtime lib directory. I can post screenshots,
but I'm sure they are in my classpath.
3. I'm running the program on 172.16.1.95. In the hbase-site.xml, my
zookeepers are 172.16.1.46, 172.16.1.95, 172.16.1.96. My regionservers are
just 172.16.1.95 and 172.16.1.96 (I sorta forget how I originally set up the
system, so my regionserver file could possibly be another source of error).
4. In a moment of desperation, I just decided to include ALL of Hbase's
conf files in my runtime conf directory. I get a different response and the
system hangs (doesn't return anything and has a loading sign).
Here is a thread dump for the 95 regionserver box.
http://pastebin.com/m1feb7a8f. Here is the output I see at the command
line: http://pastebin.com/ma6e7ef7
Are there any Web-server API configuration setups I can follow? Should I
upgrade to 0.20.2? Should I try another web server (Tomcat?).
Thanks again for the help
On Wed, Jan 20, 2010 at 8:04 PM, stack <st...@duboce.net> wrote:
> So, pardon me, I'm a little confused. The thread dump below looks like a
> bunch of handlers waiting on something to happen. The hbase web ui looks
> healthy. You are trying to embed hbase client inside a jetty webapp,
> right?
>
> Looking at this, http://pastebin.com/m3147adf1, this looks wrong:
>
>
> 1. [exec] 2010-01-20 16:13:00.769::INFO: Started SocketConnector@
> 0.0.0.0:8888
> 2. [exec] 16:13:06,133 DEBUG [24109300@qtp-15206466-0
> ,Configuration]
> java.io.IOException<
> http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky
> >:
> config()
> 3. [exec] at org.apache.hadoop.conf.Configuration.<init>(
> Configuration.java:210)
> 4. [exec] at org.apache.hadoop.conf.Configuration.<init>(
> Configuration.java:197)
> 5. [exec] at org.apache.hadoop.hbase.HBaseConfiguration.<init>(
> HBaseConfiguration.java:33)
> 6. [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.
> java:25)
> 7. [exec] at org.mortbay.jetty.handler.HandlerWrapper.handle(
> HandlerWrapper.java:152)
> 8. [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> 9. [exec] at org.mortbay.jetty.HttpConnection.handleRequest(
> HttpConnection.java:536)
> 10. [exec] at org.mortbay.jetty.HttpConnection$RequestHandler.
> headerComplete(HttpConnection.java:913)
> 11. [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.
> java:539)
> 12. [exec] at org.mortbay.jetty.HttpParser.parseAvailable(
> HttpParser.java:212)
> 13. [exec] at org.mortbay.jetty.HttpConnection.handle(
> HttpConnection.java:405)
> 14. [exec] at org.mortbay.jetty.bio.SocketConnector$Connection.
> run(SocketConnector.java:228)
> 15. [exec] at org.mortbay.thread.QueuedThreadPool$PoolThread.run
> (QueuedThreadPool.java:582)
>
>
>
>
>
>
> This is as though you still do not have hbase conf directory on the jetty
> CLASSPATH?
>
> This is good: "Connecting to /172.16.1.96:6002"
>
> This is the right location? It got this from hbase-site.xml? Maybe its
> missing hbase-default.xml?
>
> Oh, I see you have DEBUG logging on for RPC. Do you have all DEBUG on for
> all hadoop packages? It looks like stuff is working?
>
> St.Ack
>
>
> On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > What exactly do you mean by client exceptions? Or where can I find them?
> I
> > pastebin'd the exceptions I got from the command line. The web browser is
> > blank and just has a loading sign until I kill the process. If I look at
> > the Hbase Web UI from the crunch2 box where I ran the program, everything
> > seems normal, but I'll paste that:
> >
> > Web UI:
> > http://pastebin.com/mef9a432
> >
> > Thread Dump:
> > http://pastebin.com/m76022dea
> >
> > On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote:
> >
> > > I was thinking hadoop perms. But if shell works, then its probably
> fine.
> > > Can you pastebin client exceptions? Thanks,
> > > St.Ack
> > >
> > > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
> > > christopher.andrew.bates@gmail.com> wrote:
> > >
> > > > Yeah, we're just using the default so no zoo.cfg. Permissions are
> fine
> > > as
> > > > I
> > > > can ssh into any other hadoop box without password. Although it
> looks
> > > like
> > > > permissions aren't set on the log directory. I'm currently VPN'd, so
> > > maybe
> > > > its a networking issue??
> > > >
> > > > Pastebin: http://pastebin.com/m3147adf1
> > > >
> > > > Hbase shell is working:
> > > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
> > > > ROW COLUMN+CELL
> > > >
> > > > -10095526042667 column=user:theme,
> > > timestamp=-10095526042667,
> > > > value=Frost
> > > > -10095526042683 column=user:theme,
> > > timestamp=-10095526042683,
> > > > value=Frost
> > > > -10095526042854 column=user:theme,
> > > timestamp=-10095526042854,
> > > > value=Frost
> > > > -10095526042870 column=user:theme,
> > > timestamp=-10095526042870,
> > > > value=Frost
> > > > 5 row(s) in 0.2570 seconds
> > > >
> > > > Jetty is working:
> > > >
> > > > // Substitute HBase config for test stringbuilder
> > > >
> > > > StringBuilder builder = new StringBuilder();
> > > >
> > > > builder.append("Blah blah blah");
> > > >
> > > > response.getOutputStream().write(
> > > > builder.toString().getBytes());
> > > >
> > > > Outputs "Blah blah blah" to the screen.
> > > >
> > > >
> > > >
> > > > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
> > > >
> > > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > > > > Robert.Gibbon@vodafone.com> wrote:
> > > > >
> > > > > >
> > > > > > Try putting the directory holding zoo.cfg on the classpath - you
> > have
> > > a
> > > > > > zoo.cfg file, right?
> > > > > >
> > > > >
> > > > > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll read
> > that
> > > > > ahead of hbase-site.xml.
> > > > > St.Ack
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: saint.ack@gmail.com on behalf of stack
> > > > > > Sent: Wed 1/20/2010 9:53 PM
> > > > > > To: hbase-user@hadoop.apache.org
> > > > > > Subject: Re: Config Problems with HBase and Jetty
> > > > > >
> > > > > > Can you pastebin the below? Its hard to read in email. Maybe
> its
> > a
> > > > > > permissions prob? I see lots of 'from an unknown user got
> value'.
> > > Can
> > > > > you
> > > > > > get to your hbase cluster using hbase shell ok? From host
> running
> > > > > jetty?
> > > > > >
> > > > > > St.Ack
> > > > > >
> > > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > >
> > > > > > > Ah. good catch...getting more errors still....
> > > > > > >
> > > > > > > [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > [exec] at
> > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > [exec] at
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > [exec] at
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > [exec]
> > > > > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > > Client
> > > > > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009
> > > 18:48
> > > > > GMT
> > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:host.name=crunch2.local
> > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.version=1.6.0_14
> > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.vendor=Sun Microsystems Inc.
> > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.io.tmpdir=/tmp
> > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.compiler=<NA>
> > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.name=Linux
> > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.arch=i386
> > > > > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.version=2.6.28-11-generic
> > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.name=hadoop
> > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.home=/home/hadoop
> > > > > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > > > Initiating client connection, connectString=localhost:2181
> > > > > > > sessionTimeout=60000
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0
> > ,ClientCnxn]
> > > > > > > zookeeper.disableAutoWatchReset is false
> > > > > > > [exec] 15:33:31,291 INFO
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > > > > > [exec] 15:33:31,302 INFO
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Priming connection to java.nio.channels.SocketChannel[connected
> > > > > > > local=/0:0:0:0:0:0:0:1:41216
> > remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > > > > [exec] 15:33:31,320 INFO
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Server connection successful
> > > > > > > [exec] 15:33:31,379 DEBUG
> > > > > > > [24109300@qtp-15206466-0-EventThread
> > > > > ,HConnectionManager$ClientZKWatcher]
> > > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path:
> null
> > > > > > > [exec] 15:33:31,386 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: -8,101 replyHeader::
> > > -8,80,0
> > > > > > > request:: 0,v{},v{},v{} response:: null
> > > > > > > [exec] 15:33:31,404 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 1,1 replyHeader::
> > > 1,81,-110
> > > > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > > > > > [exec] 15:33:31,438 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 2,3 replyHeader::
> 2,81,0
> > > > > > > request::
> > > > > > > '/hbase/safe-mode,F response::
> > > > > > >
> > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > > > > [exec] 15:33:31,453 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 3,4 replyHeader::
> 3,81,0
> > > > > > > request::
> > > > > > > '/hbase/root-region-server,F response::
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > > > > ,ZooKeeperWrapper]
> > > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > The
> > > > > > > ping interval is60000ms.
> > > > > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > > > Connecting to /172.16.1.96:60020
> > > > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user:
> starting,
> > > > > having
> > > > > > > connections 1
> > > > > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #0
> > > > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #0
> > > > > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getProtocolVersion 139
> > > > > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #1
> > > > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #1
> > > > > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getRegionInfo 28
> > > > > > > [exec] 15:33:31,942 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Found ROOT at 172.16.1.96:60020
> > > > > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #2
> > > > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #2
> > > > > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getClosestRowBefore 8
> > > > > > > [exec] 15:33:32,004 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION
> > =>
> > > > > {NAME
> > > > > > =>
> > > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED =>
> 1028785192,
> > > > TABLE
> > > > > > =>
> > > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
> > > '16384',
> > > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > > > > COMPRESSION
> > > > > > =>
> > > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY =>
> > 'false',
> > > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> > > > COMPRESSION
> > > > > =>
> > > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>
> > > > 'false',
> > > > > > > BLOCKCACHE => 'false'}]}}
> > > > > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > > > Connecting to /172.16.1.95:60020
> > > > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user:
> starting,
> > > > > having
> > > > > > > connections 2
> > > > > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #3
> > > > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> value
> > #3
> > > > > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getProtocolVersion 14
> > > > > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #4
> > > > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> value
> > #4
> > > > > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getClosestRowBefore 157
> > > > > > > [exec] 15:33:32,179 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION
> > =>
> > > > > {NAME
> > > > > > =>
> > > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY =>
> '1262239352230',
> > > > > ENCODED
> > > > > > > =>
> > > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
> > > 'search',
> > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > BLOCKSIZE
> > > > > =>
> > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
> > > > 'user',
> > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > BLOCKSIZE
> > > > > =>
> > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > > > > ,HTable$ClientScanner]
> > > > > > > Creating scanner over Guts starting at key ''
> > > > > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > > > > ,HTable$ClientScanner]
> > > > > > > Advancing internal scanner to startKey at ''
> > > > > > > [exec] 15:33:32,191 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cache hit for row <> in tableName Guts: location server
> > > > > > 172.16.1.96:60020,
> > > > > > > location region name Guts,,1262665364102
> > > > > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #5
> > > > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #5
> > > > > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > openScanner 30
> > > > > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #6
> > > > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #6
> > > > > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 30
> > > > > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #7
> > > > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #7
> > > > > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 28
> > > > > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #8
> > > > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #8
> > > > > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 27
> > > > > > >
> > > > > > > Then this scanner output seems to continue forever and it just
> > > hangs.
> > > > > > I'm
> > > > > > > not really sure what the errors mean...
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net>
> wrote:
> > > > > > >
> > > > > > > > Is zookeeper jar on your CLASSPATH?
> > > > > > > >
> > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > org/apache/zookeeper/Watcher
> > > > > > > >
> > > > > > > > You code looks fine.
> > > > > > > >
> > > > > > > > St.Ack
> > > > > > > >
> > > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > We're building an analytics server with HBase using Jetty.
> I
> > > > have
> > > > > > > > > experimented with the Thrift API + PHP over the past few
> days
> > > and
> > > > > got
> > > > > > > it
> > > > > > > > > working, but needed the filter functionality which has not
> > been
> > > > > > > released
> > > > > > > > > yet. So I decided to switch to the Java API and run it
> with
> > a
> > > > > Jetty
> > > > > > > > > server.
> > > > > > > > >
> > > > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > > > > > >
> > > > > > > > > Hbase is setup on the same machine, with all the
> > configuration
> > > > > > settings
> > > > > > > > > according to the "Getting Started" guide. We are using
> Hbase
> > > > > version
> > > > > > > > > 0.20.1.
> > > > > > > > >
> > > > > > > > > Just doing a quick scanning test with this code:
> > > > > > > > >
> > > > > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > > > > HTable table = new HTable(config, "Guts");
> > > > > > > > > Scan s = new Scan();
> > > > > > > > >
> > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > > > > ResultScanner scanner = table.getScanner(s);
> > > > > > > > > int count = 0;
> > > > > > > > > int limit = 10;
> > > > > > > > > try {
> > > > > > > > > for (Result rr = scanner.next(); rr != null;
> > rr
> > > =
> > > > > > > > > scanner.next()) {
> > > > > > > > > if (count <= limit) {
> > > > > > > > > response.getOutputStream().write(
> > > > > rr.getRow()
> > > > > > );
> > > > > > > > > count++;
> > > > > > > > > }
> > > > > > > > > }
> > > > > > > > > } finally {
> > > > > > > > > scanner.close();
> > > > > > > > > }
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I get this error, which states (I think) that the HBase is
> > > > throwing
> > > > > a
> > > > > > > > > connection error:
> > > > > > > > >
> > > > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> > > > ,Configuration]
> > > > > > > > > java.io.IOException: config()
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > > > [exec] at
> > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > > [exec] at
> > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > > [exec] at
> > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > > [exec]
> > > > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > > > org/apache/zookeeper/Watcher
> > > > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native
> > Method)
> > > > > > > > > [exec] at
> > > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > >
> > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > > > > [exec] at
> > > > > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > > > > [exec] at
> > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > > > > [exec] at
> > > java.security.AccessController.doPrivileged(Native
> > > > > > > Method)
> > > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > > [exec] at
> > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > > [exec] at
> > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > [exec] at
> > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > > > > [exec] at
> > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > > > > [exec] at
> > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > > [exec] at
> > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > > [exec] at
> > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > > > > org.apache.zookeeper.Watcher
> > > > > > > > > [exec] at
> > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > > > > [exec] at
> > > java.security.AccessController.doPrivileged(Native
> > > > > > > Method)
> > > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > > [exec] at
> > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > > [exec] at
> > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > > [exec] ... 35 more
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > After doing a mailing list search, it seemed that other
> > > > > configuration
> > > > > > > > > problems were fixed by upgrading to 0.20.2 which I have not
> > yet
> > > > > done.
> > > > > > > Is
> > > > > > > > > this the problem or is there something simple I am
> > overlooking?
> > > > I
> > > > > > have
> > > > > > > > > also
> > > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib and
> > > conf
> > > > > > > > > directories
> > > > > > > > > to my working classpath.
> > > > > > > > >
> > > > > > > > > I am confused because I was able to connect via thrift, and
> I
> > > > also
> > > > > > have
> > > > > > > a
> > > > > > > > > BulkImporter MapReduce script to load the logging data into
> > > HBase
> > > > > > that
> > > > > > > > > works
> > > > > > > > > fine, but have been unable to locate my error in this case.
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by Chris Bates <ch...@gmail.com>.
So I've been still trying to work this problem out and haven't had any
success. Here is another pastebin of the issues:
http://pastebin.com/m2e19f84b
So basically here is what I'm trying to do:
1. Run HBase Java API (0.20.1) from a Jetty Webserver (setup on
172.16.1.95:8888). I have handlers that are feeding objects that contain
the different API calls I want to make. The handlers are setup with Spring.
2. The application is built and then runs after building. I have stared at
my build.xml file many times and I'm sure hbase-site.xml and
hbase-default.xml are included in the runtime conf directories, and the jars
that I need are all in my runtime lib directory. I can post screenshots,
but I'm sure they are in my classpath.
3. I'm running the program on 172.16.1.95. In the hbase-site.xml, my
zookeepers are 172.16.1.46, 172.16.1.95, 172.16.1.96. My regionservers are
just 172.16.1.95 and 172.16.1.96 (I sorta forget how I originally set up the
system, so my regionserver file could possibly be another source of error).
4. In a moment of desperation, I just decided to include ALL of Hbase's
conf files in my runtime conf directory. I get a different response and the
system hangs (doesn't return anything and has a loading sign).
Here is a thread dump for the 95 regionserver box.
http://pastebin.com/m1feb7a8f. Here is the output I see at the command
line: http://pastebin.com/ma6e7ef7
Are there any Web-server API configuration setups I can follow? Should I
upgrade to 0.20.2? Should I try another web server (Tomcat?).
Thanks again for the help
On Wed, Jan 20, 2010 at 8:04 PM, stack <st...@duboce.net> wrote:
> So, pardon me, I'm a little confused. The thread dump below looks like a
> bunch of handlers waiting on something to happen. The hbase web ui looks
> healthy. You are trying to embed hbase client inside a jetty webapp,
> right?
>
> Looking at this, http://pastebin.com/m3147adf1, this looks wrong:
>
>
> 1. [exec] 2010-01-20 16:13:00.769::INFO: Started SocketConnector@
> 0.0.0.0:8888
> 2. [exec] 16:13:06,133 DEBUG [24109300@qtp-15206466-0
> ,Configuration]
> java.io.IOException<
> http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky
> >:
> config()
> 3. [exec] at org.apache.hadoop.conf.Configuration.<init>(
> Configuration.java:210)
> 4. [exec] at org.apache.hadoop.conf.Configuration.<init>(
> Configuration.java:197)
> 5. [exec] at org.apache.hadoop.hbase.HBaseConfiguration.<init>(
> HBaseConfiguration.java:33)
> 6. [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.
> java:25)
> 7. [exec] at org.mortbay.jetty.handler.HandlerWrapper.handle(
> HandlerWrapper.java:152)
> 8. [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> 9. [exec] at org.mortbay.jetty.HttpConnection.handleRequest(
> HttpConnection.java:536)
> 10. [exec] at org.mortbay.jetty.HttpConnection$RequestHandler.
> headerComplete(HttpConnection.java:913)
> 11. [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.
> java:539)
> 12. [exec] at org.mortbay.jetty.HttpParser.parseAvailable(
> HttpParser.java:212)
> 13. [exec] at org.mortbay.jetty.HttpConnection.handle(
> HttpConnection.java:405)
> 14. [exec] at org.mortbay.jetty.bio.SocketConnector$Connection.
> run(SocketConnector.java:228)
> 15. [exec] at org.mortbay.thread.QueuedThreadPool$PoolThread.run
> (QueuedThreadPool.java:582)
>
>
>
>
>
>
> This is as though you still do not have hbase conf directory on the jetty
> CLASSPATH?
>
> This is good: "Connecting to /172.16.1.96:6002"
>
> This is the right location? It got this from hbase-site.xml? Maybe its
> missing hbase-default.xml?
>
> Oh, I see you have DEBUG logging on for RPC. Do you have all DEBUG on for
> all hadoop packages? It looks like stuff is working?
>
> St.Ack
>
>
> On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > What exactly do you mean by client exceptions? Or where can I find them?
> I
> > pastebin'd the exceptions I got from the command line. The web browser is
> > blank and just has a loading sign until I kill the process. If I look at
> > the Hbase Web UI from the crunch2 box where I ran the program, everything
> > seems normal, but I'll paste that:
> >
> > Web UI:
> > http://pastebin.com/mef9a432
> >
> > Thread Dump:
> > http://pastebin.com/m76022dea
> >
> > On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote:
> >
> > > I was thinking hadoop perms. But if shell works, then its probably
> fine.
> > > Can you pastebin client exceptions? Thanks,
> > > St.Ack
> > >
> > > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
> > > christopher.andrew.bates@gmail.com> wrote:
> > >
> > > > Yeah, we're just using the default so no zoo.cfg. Permissions are
> fine
> > > as
> > > > I
> > > > can ssh into any other hadoop box without password. Although it
> looks
> > > like
> > > > permissions aren't set on the log directory. I'm currently VPN'd, so
> > > maybe
> > > > its a networking issue??
> > > >
> > > > Pastebin: http://pastebin.com/m3147adf1
> > > >
> > > > Hbase shell is working:
> > > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
> > > > ROW COLUMN+CELL
> > > >
> > > > -10095526042667 column=user:theme,
> > > timestamp=-10095526042667,
> > > > value=Frost
> > > > -10095526042683 column=user:theme,
> > > timestamp=-10095526042683,
> > > > value=Frost
> > > > -10095526042854 column=user:theme,
> > > timestamp=-10095526042854,
> > > > value=Frost
> > > > -10095526042870 column=user:theme,
> > > timestamp=-10095526042870,
> > > > value=Frost
> > > > 5 row(s) in 0.2570 seconds
> > > >
> > > > Jetty is working:
> > > >
> > > > // Substitute HBase config for test stringbuilder
> > > >
> > > > StringBuilder builder = new StringBuilder();
> > > >
> > > > builder.append("Blah blah blah");
> > > >
> > > > response.getOutputStream().write(
> > > > builder.toString().getBytes());
> > > >
> > > > Outputs "Blah blah blah" to the screen.
> > > >
> > > >
> > > >
> > > > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
> > > >
> > > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > > > > Robert.Gibbon@vodafone.com> wrote:
> > > > >
> > > > > >
> > > > > > Try putting the directory holding zoo.cfg on the classpath - you
> > have
> > > a
> > > > > > zoo.cfg file, right?
> > > > > >
> > > > >
> > > > > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll read
> > that
> > > > > ahead of hbase-site.xml.
> > > > > St.Ack
> > > > >
> > > > >
> > > > >
> > > > > >
> > > > > > -----Original Message-----
> > > > > > From: saint.ack@gmail.com on behalf of stack
> > > > > > Sent: Wed 1/20/2010 9:53 PM
> > > > > > To: hbase-user@hadoop.apache.org
> > > > > > Subject: Re: Config Problems with HBase and Jetty
> > > > > >
> > > > > > Can you pastebin the below? Its hard to read in email. Maybe
> its
> > a
> > > > > > permissions prob? I see lots of 'from an unknown user got
> value'.
> > > Can
> > > > > you
> > > > > > get to your hbase cluster using hbase shell ok? From host
> running
> > > > > jetty?
> > > > > >
> > > > > > St.Ack
> > > > > >
> > > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > >
> > > > > > > Ah. good catch...getting more errors still....
> > > > > > >
> > > > > > > [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > [exec] at
> > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > [exec] at
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > [exec] at
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > [exec]
> > > > > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > > Client
> > > > > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009
> > > 18:48
> > > > > GMT
> > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:host.name=crunch2.local
> > > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.version=1.6.0_14
> > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.vendor=Sun Microsystems Inc.
> > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.io.tmpdir=/tmp
> > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:java.compiler=<NA>
> > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.name=Linux
> > > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.arch=i386
> > > > > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:os.version=2.6.28-11-generic
> > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.name=hadoop
> > > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.home=/home/hadoop
> > > > > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > Client
> > > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0
> > ,ZooKeeper]
> > > > > > > Initiating client connection, connectString=localhost:2181
> > > > > > > sessionTimeout=60000
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0
> > ,ClientCnxn]
> > > > > > > zookeeper.disableAutoWatchReset is false
> > > > > > > [exec] 15:33:31,291 INFO
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > > > > > [exec] 15:33:31,302 INFO
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Priming connection to java.nio.channels.SocketChannel[connected
> > > > > > > local=/0:0:0:0:0:0:0:1:41216
> > remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > > > > [exec] 15:33:31,320 INFO
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Server connection successful
> > > > > > > [exec] 15:33:31,379 DEBUG
> > > > > > > [24109300@qtp-15206466-0-EventThread
> > > > > ,HConnectionManager$ClientZKWatcher]
> > > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path:
> null
> > > > > > > [exec] 15:33:31,386 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: -8,101 replyHeader::
> > > -8,80,0
> > > > > > > request:: 0,v{},v{},v{} response:: null
> > > > > > > [exec] 15:33:31,404 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 1,1 replyHeader::
> > > 1,81,-110
> > > > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > > > > > [exec] 15:33:31,438 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 2,3 replyHeader::
> 2,81,0
> > > > > > > request::
> > > > > > > '/hbase/safe-mode,F response::
> > > > > > >
> > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > > > > [exec] 15:33:31,453 DEBUG
> [24109300@qtp-15206466-0-SendThread
> > > > > > > ,ClientCnxn]
> > > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> > clientPath:null
> > > > > > > serverPath:null finished:false header:: 3,4 replyHeader::
> 3,81,0
> > > > > > > request::
> > > > > > > '/hbase/root-region-server,F response::
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > > > > ,ZooKeeperWrapper]
> > > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > The
> > > > > > > ping interval is60000ms.
> > > > > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > > > Connecting to /172.16.1.96:60020
> > > > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user:
> starting,
> > > > > having
> > > > > > > connections 1
> > > > > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #0
> > > > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #0
> > > > > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getProtocolVersion 139
> > > > > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #1
> > > > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #1
> > > > > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getRegionInfo 28
> > > > > > > [exec] 15:33:31,942 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Found ROOT at 172.16.1.96:60020
> > > > > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #2
> > > > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #2
> > > > > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getClosestRowBefore 8
> > > > > > > [exec] 15:33:32,004 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION
> > =>
> > > > > {NAME
> > > > > > =>
> > > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED =>
> 1028785192,
> > > > TABLE
> > > > > > =>
> > > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
> > > '16384',
> > > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > > > > COMPRESSION
> > > > > > =>
> > > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY =>
> > 'false',
> > > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> > > > COMPRESSION
> > > > > =>
> > > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>
> > > > 'false',
> > > > > > > BLOCKCACHE => 'false'}]}}
> > > > > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > > > Connecting to /172.16.1.95:60020
> > > > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user:
> starting,
> > > > > having
> > > > > > > connections 2
> > > > > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #3
> > > > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> value
> > #3
> > > > > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getProtocolVersion 14
> > > > > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #4
> > > > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.95:60020 from an unknown user got
> value
> > #4
> > > > > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > getClosestRowBefore 157
> > > > > > > [exec] 15:33:32,179 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION
> > =>
> > > > > {NAME
> > > > > > =>
> > > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY =>
> '1262239352230',
> > > > > ENCODED
> > > > > > > =>
> > > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
> > > 'search',
> > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > BLOCKSIZE
> > > > > =>
> > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
> > > > 'user',
> > > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > > BLOCKSIZE
> > > > > =>
> > > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > > > > ,HTable$ClientScanner]
> > > > > > > Creating scanner over Guts starting at key ''
> > > > > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > > > > ,HTable$ClientScanner]
> > > > > > > Advancing internal scanner to startKey at ''
> > > > > > > [exec] 15:33:32,191 DEBUG
> > > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > > Cache hit for row <> in tableName Guts: location server
> > > > > > 172.16.1.96:60020,
> > > > > > > location region name Guts,,1262665364102
> > > > > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #5
> > > > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #5
> > > > > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > openScanner 30
> > > > > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #6
> > > > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #6
> > > > > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 30
> > > > > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #7
> > > > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #7
> > > > > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 28
> > > > > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
> > > ,HBaseClient]
> > > > > IPC
> > > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> > user
> > > > > > sending
> > > > > > > #8
> > > > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > > (47)
> > > > > > > connection to /172.16.1.96:60020 from an unknown user got
> value
> > #8
> > > > > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0
> ,HbaseRPC]
> > > > Call:
> > > > > > > next
> > > > > > > 27
> > > > > > >
> > > > > > > Then this scanner output seems to continue forever and it just
> > > hangs.
> > > > > > I'm
> > > > > > > not really sure what the errors mean...
> > > > > > >
> > > > > > >
> > > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net>
> wrote:
> > > > > > >
> > > > > > > > Is zookeeper jar on your CLASSPATH?
> > > > > > > >
> > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > org/apache/zookeeper/Watcher
> > > > > > > >
> > > > > > > > You code looks fine.
> > > > > > > >
> > > > > > > > St.Ack
> > > > > > > >
> > > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > We're building an analytics server with HBase using Jetty.
> I
> > > > have
> > > > > > > > > experimented with the Thrift API + PHP over the past few
> days
> > > and
> > > > > got
> > > > > > > it
> > > > > > > > > working, but needed the filter functionality which has not
> > been
> > > > > > > released
> > > > > > > > > yet. So I decided to switch to the Java API and run it
> with
> > a
> > > > > Jetty
> > > > > > > > > server.
> > > > > > > > >
> > > > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > > > > > >
> > > > > > > > > Hbase is setup on the same machine, with all the
> > configuration
> > > > > > settings
> > > > > > > > > according to the "Getting Started" guide. We are using
> Hbase
> > > > > version
> > > > > > > > > 0.20.1.
> > > > > > > > >
> > > > > > > > > Just doing a quick scanning test with this code:
> > > > > > > > >
> > > > > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > > > > HTable table = new HTable(config, "Guts");
> > > > > > > > > Scan s = new Scan();
> > > > > > > > >
> > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > > > > ResultScanner scanner = table.getScanner(s);
> > > > > > > > > int count = 0;
> > > > > > > > > int limit = 10;
> > > > > > > > > try {
> > > > > > > > > for (Result rr = scanner.next(); rr != null;
> > rr
> > > =
> > > > > > > > > scanner.next()) {
> > > > > > > > > if (count <= limit) {
> > > > > > > > > response.getOutputStream().write(
> > > > > rr.getRow()
> > > > > > );
> > > > > > > > > count++;
> > > > > > > > > }
> > > > > > > > > }
> > > > > > > > > } finally {
> > > > > > > > > scanner.close();
> > > > > > > > > }
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > I get this error, which states (I think) that the HBase is
> > > > throwing
> > > > > a
> > > > > > > > > connection error:
> > > > > > > > >
> > > > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> > > > ,Configuration]
> > > > > > > > > java.io.IOException: config()
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > > > [exec] at
> > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > > [exec] at
> > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > > [exec] at
> > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > > [exec]
> > > > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > > > org/apache/zookeeper/Watcher
> > > > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native
> > Method)
> > > > > > > > > [exec] at
> > > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > >
> > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > > > > [exec] at
> > > > > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > > > > [exec] at
> > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > > > > [exec] at
> > > java.security.AccessController.doPrivileged(Native
> > > > > > > Method)
> > > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > > [exec] at
> > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > > [exec] at
> > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > > [exec] at
> > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > > > > [exec] at
> > > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > > > > [exec] at
> > > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > > [exec] at
> > org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > > [exec] at
> > > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > > [exec] at
> > > > > > > > >
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > > > > org.apache.zookeeper.Watcher
> > > > > > > > > [exec] at
> > > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > > > > [exec] at
> > > java.security.AccessController.doPrivileged(Native
> > > > > > > Method)
> > > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > > [exec] at
> > > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > > [exec] at
> > > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > > [exec] at
> > > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > > [exec] ... 35 more
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > After doing a mailing list search, it seemed that other
> > > > > configuration
> > > > > > > > > problems were fixed by upgrading to 0.20.2 which I have not
> > yet
> > > > > done.
> > > > > > > Is
> > > > > > > > > this the problem or is there something simple I am
> > overlooking?
> > > > I
> > > > > > have
> > > > > > > > > also
> > > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib and
> > > conf
> > > > > > > > > directories
> > > > > > > > > to my working classpath.
> > > > > > > > >
> > > > > > > > > I am confused because I was able to connect via thrift, and
> I
> > > > also
> > > > > > have
> > > > > > > a
> > > > > > > > > BulkImporter MapReduce script to load the logging data into
> > > HBase
> > > > > > that
> > > > > > > > > works
> > > > > > > > > fine, but have been unable to locate my error in this case.
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by stack <st...@duboce.net>.
So, pardon me, I'm a little confused. The thread dump below looks like a
bunch of handlers waiting on something to happen. The hbase web ui looks
healthy. You are trying to embed hbase client inside a jetty webapp, right?
Looking at this, http://pastebin.com/m3147adf1, this looks wrong:
1. [exec] 2010-01-20 16:13:00.769::INFO: Started SocketConnector@
0.0.0.0:8888
2. [exec] 16:13:06,133 DEBUG [24109300@qtp-15206466-0,Configuration]
java.io.IOException<http://www.google.com/search?hl=en&q=allinurl%3AIOException+java.sun.com&btnI=I%27m%20Feeling%20Lucky>:
config()
3. [exec] at org.apache.hadoop.conf.Configuration.<init>(
Configuration.java:210)
4. [exec] at org.apache.hadoop.conf.Configuration.<init>(
Configuration.java:197)
5. [exec] at org.apache.hadoop.hbase.HBaseConfiguration.<init>(
HBaseConfiguration.java:33)
6. [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.
java:25)
7. [exec] at org.mortbay.jetty.handler.HandlerWrapper.handle(
HandlerWrapper.java:152)
8. [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
9. [exec] at org.mortbay.jetty.HttpConnection.handleRequest(
HttpConnection.java:536)
10. [exec] at org.mortbay.jetty.HttpConnection$RequestHandler.
headerComplete(HttpConnection.java:913)
11. [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.
java:539)
12. [exec] at org.mortbay.jetty.HttpParser.parseAvailable(
HttpParser.java:212)
13. [exec] at org.mortbay.jetty.HttpConnection.handle(
HttpConnection.java:405)
14. [exec] at org.mortbay.jetty.bio.SocketConnector$Connection.
run(SocketConnector.java:228)
15. [exec] at org.mortbay.thread.QueuedThreadPool$PoolThread.run
(QueuedThreadPool.java:582)
This is as though you still do not have hbase conf directory on the jetty
CLASSPATH?
This is good: "Connecting to /172.16.1.96:6002"
This is the right location? It got this from hbase-site.xml? Maybe its
missing hbase-default.xml?
Oh, I see you have DEBUG logging on for RPC. Do you have all DEBUG on for
all hadoop packages? It looks like stuff is working?
St.Ack
On Wed, Jan 20, 2010 at 4:12 PM, Chris Bates <
christopher.andrew.bates@gmail.com> wrote:
> What exactly do you mean by client exceptions? Or where can I find them? I
> pastebin'd the exceptions I got from the command line. The web browser is
> blank and just has a loading sign until I kill the process. If I look at
> the Hbase Web UI from the crunch2 box where I ran the program, everything
> seems normal, but I'll paste that:
>
> Web UI:
> http://pastebin.com/mef9a432
>
> Thread Dump:
> http://pastebin.com/m76022dea
>
> On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote:
>
> > I was thinking hadoop perms. But if shell works, then its probably fine.
> > Can you pastebin client exceptions? Thanks,
> > St.Ack
> >
> > On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
> > christopher.andrew.bates@gmail.com> wrote:
> >
> > > Yeah, we're just using the default so no zoo.cfg. Permissions are fine
> > as
> > > I
> > > can ssh into any other hadoop box without password. Although it looks
> > like
> > > permissions aren't set on the log directory. I'm currently VPN'd, so
> > maybe
> > > its a networking issue??
> > >
> > > Pastebin: http://pastebin.com/m3147adf1
> > >
> > > Hbase shell is working:
> > > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
> > > ROW COLUMN+CELL
> > >
> > > -10095526042667 column=user:theme,
> > timestamp=-10095526042667,
> > > value=Frost
> > > -10095526042683 column=user:theme,
> > timestamp=-10095526042683,
> > > value=Frost
> > > -10095526042854 column=user:theme,
> > timestamp=-10095526042854,
> > > value=Frost
> > > -10095526042870 column=user:theme,
> > timestamp=-10095526042870,
> > > value=Frost
> > > 5 row(s) in 0.2570 seconds
> > >
> > > Jetty is working:
> > >
> > > // Substitute HBase config for test stringbuilder
> > >
> > > StringBuilder builder = new StringBuilder();
> > >
> > > builder.append("Blah blah blah");
> > >
> > > response.getOutputStream().write(
> > > builder.toString().getBytes());
> > >
> > > Outputs "Blah blah blah" to the screen.
> > >
> > >
> > >
> > > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
> > >
> > > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > > > Robert.Gibbon@vodafone.com> wrote:
> > > >
> > > > >
> > > > > Try putting the directory holding zoo.cfg on the classpath - you
> have
> > a
> > > > > zoo.cfg file, right?
> > > > >
> > > >
> > > > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > > > ensemble/quorum members -- but if a zoo.cfg is present, we'll read
> that
> > > > ahead of hbase-site.xml.
> > > > St.Ack
> > > >
> > > >
> > > >
> > > > >
> > > > > -----Original Message-----
> > > > > From: saint.ack@gmail.com on behalf of stack
> > > > > Sent: Wed 1/20/2010 9:53 PM
> > > > > To: hbase-user@hadoop.apache.org
> > > > > Subject: Re: Config Problems with HBase and Jetty
> > > > >
> > > > > Can you pastebin the below? Its hard to read in email. Maybe its
> a
> > > > > permissions prob? I see lots of 'from an unknown user got value'.
> > Can
> > > > you
> > > > > get to your hbase cluster using hbase shell ok? From host running
> > > > jetty?
> > > > >
> > > > > St.Ack
> > > > >
> > > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > >
> > > > > > Ah. good catch...getting more errors still....
> > > > > >
> > > > > > [exec] at
> > > > > >
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > [exec] at
> > > > > >
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > [exec] at
> > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > [exec] at
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > [exec] at
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > [exec] at
> > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > [exec]
> > > > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > > Client
> > > > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009
> > 18:48
> > > > GMT
> > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:host.name=crunch2.local
> > > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:java.version=1.6.0_14
> > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:java.vendor=Sun Microsystems Inc.
> > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:java.io.tmpdir=/tmp
> > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:java.compiler=<NA>
> > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:os.name=Linux
> > > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:os.arch=i386
> > > > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:os.version=2.6.28-11-generic
> > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:user.name=hadoop
> > > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:user.home=/home/hadoop
> > > > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > Client
> > > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0
> ,ZooKeeper]
> > > > > > Initiating client connection, connectString=localhost:2181
> > > > > > sessionTimeout=60000
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0
> ,ClientCnxn]
> > > > > > zookeeper.disableAutoWatchReset is false
> > > > > > [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > > > > [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Priming connection to java.nio.channels.SocketChannel[connected
> > > > > > local=/0:0:0:0:0:0:0:1:41216
> remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > > > [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Server connection successful
> > > > > > [exec] 15:33:31,379 DEBUG
> > > > > > [24109300@qtp-15206466-0-EventThread
> > > > ,HConnectionManager$ClientZKWatcher]
> > > > > > Got ZooKeeper event, state: SyncConnected, type: None, path: null
> > > > > > [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> clientPath:null
> > > > > > serverPath:null finished:false header:: -8,101 replyHeader::
> > -8,80,0
> > > > > > request:: 0,v{},v{},v{} response:: null
> > > > > > [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> clientPath:null
> > > > > > serverPath:null finished:false header:: 1,1 replyHeader::
> > 1,81,-110
> > > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > > > > [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> clientPath:null
> > > > > > serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> > > > > > request::
> > > > > > '/hbase/safe-mode,F response::
> > > > > >
> > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > > > [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > > ,ClientCnxn]
> > > > > > Reading reply sessionid:0x326344ba5640005, packet::
> clientPath:null
> > > > > > serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> > > > > > request::
> > > > > > '/hbase/root-region-server,F response::
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > > > ,ZooKeeperWrapper]
> > > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > The
> > > > > > ping interval is60000ms.
> > > > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > > > Connecting to /172.16.1.96:60020
> > > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user: starting,
> > > > having
> > > > > > connections 1
> > > > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #0
> > > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #0
> > > > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > getProtocolVersion 139
> > > > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #1
> > > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #1
> > > > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > getRegionInfo 28
> > > > > > [exec] 15:33:31,942 DEBUG
> > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > Found ROOT at 172.16.1.96:60020
> > > > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #2
> > > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #2
> > > > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > getClosestRowBefore 8
> > > > > > [exec] 15:33:32,004 DEBUG
> > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION
> =>
> > > > {NAME
> > > > > =>
> > > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,
> > > TABLE
> > > > > =>
> > > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
> > '16384',
> > > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > > > COMPRESSION
> > > > > =>
> > > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY =>
> 'false',
> > > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> > > COMPRESSION
> > > > =>
> > > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>
> > > 'false',
> > > > > > BLOCKCACHE => 'false'}]}}
> > > > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > > > Connecting to /172.16.1.95:60020
> > > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.95:60020 from an unknown user: starting,
> > > > having
> > > > > > connections 2
> > > > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> user
> > > > > sending
> > > > > > #3
> > > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.95:60020 from an unknown user got value
> #3
> > > > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > getProtocolVersion 14
> > > > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.95:60020 from an unknown
> user
> > > > > sending
> > > > > > #4
> > > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.95:60020 from an unknown user got value
> #4
> > > > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > getClosestRowBefore 157
> > > > > > [exec] 15:33:32,179 DEBUG
> > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION
> =>
> > > > {NAME
> > > > > =>
> > > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230',
> > > > ENCODED
> > > > > > =>
> > > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
> > 'search',
> > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > BLOCKSIZE
> > > > =>
> > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
> > > 'user',
> > > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > > BLOCKSIZE
> > > > =>
> > > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > > > ,HTable$ClientScanner]
> > > > > > Creating scanner over Guts starting at key ''
> > > > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > > > ,HTable$ClientScanner]
> > > > > > Advancing internal scanner to startKey at ''
> > > > > > [exec] 15:33:32,191 DEBUG
> > > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > > Cache hit for row <> in tableName Guts: location server
> > > > > 172.16.1.96:60020,
> > > > > > location region name Guts,,1262665364102
> > > > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #5
> > > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #5
> > > > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > openScanner 30
> > > > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #6
> > > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #6
> > > > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > next
> > > > > > 30
> > > > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #7
> > > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #7
> > > > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > next
> > > > > > 28
> > > > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
> > ,HBaseClient]
> > > > IPC
> > > > > > Client (47) connection to /172.16.1.96:60020 from an unknown
> user
> > > > > sending
> > > > > > #8
> > > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> > (47)
> > > > > > connection to /172.16.1.96:60020 from an unknown user got value
> #8
> > > > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > > Call:
> > > > > > next
> > > > > > 27
> > > > > >
> > > > > > Then this scanner output seems to continue forever and it just
> > hangs.
> > > > > I'm
> > > > > > not really sure what the errors mean...
> > > > > >
> > > > > >
> > > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
> > > > > >
> > > > > > > Is zookeeper jar on your CLASSPATH?
> > > > > > >
> > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > org/apache/zookeeper/Watcher
> > > > > > >
> > > > > > > You code looks fine.
> > > > > > >
> > > > > > > St.Ack
> > > > > > >
> > > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > We're building an analytics server with HBase using Jetty. I
> > > have
> > > > > > > > experimented with the Thrift API + PHP over the past few days
> > and
> > > > got
> > > > > > it
> > > > > > > > working, but needed the filter functionality which has not
> been
> > > > > > released
> > > > > > > > yet. So I decided to switch to the Java API and run it with
> a
> > > > Jetty
> > > > > > > > server.
> > > > > > > >
> > > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > > > > >
> > > > > > > > Hbase is setup on the same machine, with all the
> configuration
> > > > > settings
> > > > > > > > according to the "Getting Started" guide. We are using Hbase
> > > > version
> > > > > > > > 0.20.1.
> > > > > > > >
> > > > > > > > Just doing a quick scanning test with this code:
> > > > > > > >
> > > > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > > > HTable table = new HTable(config, "Guts");
> > > > > > > > Scan s = new Scan();
> > > > > > > >
> > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > > > ResultScanner scanner = table.getScanner(s);
> > > > > > > > int count = 0;
> > > > > > > > int limit = 10;
> > > > > > > > try {
> > > > > > > > for (Result rr = scanner.next(); rr != null;
> rr
> > =
> > > > > > > > scanner.next()) {
> > > > > > > > if (count <= limit) {
> > > > > > > > response.getOutputStream().write(
> > > > rr.getRow()
> > > > > );
> > > > > > > > count++;
> > > > > > > > }
> > > > > > > > }
> > > > > > > > } finally {
> > > > > > > > scanner.close();
> > > > > > > > }
> > > > > > > >
> > > > > > > >
> > > > > > > > I get this error, which states (I think) that the HBase is
> > > throwing
> > > > a
> > > > > > > > connection error:
> > > > > > > >
> > > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> > > ,Configuration]
> > > > > > > > java.io.IOException: config()
> > > > > > > > [exec] at
> > > > > > > >
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > > [exec] at
> > > > > > > >
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > > [exec] at
> > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > [exec] at
> org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > [exec] at
> > > > > > > >
> > > > >
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > [exec] at
> > > > > > > >
> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > [exec] at
> > > > > > > >
> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > [exec]
> > > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > > org/apache/zookeeper/Watcher
> > > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native
> Method)
> > > > > > > > [exec] at
> > > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > > > [exec] at
> > > > > > > >
> > > > >
> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > > > [exec] at
> > > > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > > > [exec] at
> > > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > > > [exec] at
> > > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > > > [exec] at
> > java.security.AccessController.doPrivileged(Native
> > > > > > Method)
> > > > > > > > [exec] at
> > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > [exec] at
> > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > [exec] at
> > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > [exec] at
> > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > [exec] at
> > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > > [exec] at
> > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > > > [exec] at
> > > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > > > [exec] at
> > > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > > [exec] at
> org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > > [exec] at
> > > > > > > >
> > > > >
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > > [exec] at
> > > > > > > >
> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > > [exec] at
> > > > > > > >
> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > > [exec] at
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > > > org.apache.zookeeper.Watcher
> > > > > > > > [exec] at
> > > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > > > [exec] at
> > java.security.AccessController.doPrivileged(Native
> > > > > > Method)
> > > > > > > > [exec] at
> > > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > > [exec] at
> > > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > > [exec] at
> > > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > > [exec] at
> > > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > > [exec] at
> > > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > > [exec] ... 35 more
> > > > > > > >
> > > > > > > >
> > > > > > > > After doing a mailing list search, it seemed that other
> > > > configuration
> > > > > > > > problems were fixed by upgrading to 0.20.2 which I have not
> yet
> > > > done.
> > > > > > Is
> > > > > > > > this the problem or is there something simple I am
> overlooking?
> > > I
> > > > > have
> > > > > > > > also
> > > > > > > > added my hbase-site.xml and hbase-default.xml to my lib and
> > conf
> > > > > > > > directories
> > > > > > > > to my working classpath.
> > > > > > > >
> > > > > > > > I am confused because I was able to connect via thrift, and I
> > > also
> > > > > have
> > > > > > a
> > > > > > > > BulkImporter MapReduce script to load the logging data into
> > HBase
> > > > > that
> > > > > > > > works
> > > > > > > > fine, but have been unable to locate my error in this case.
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > > >
> > > >
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by Chris Bates <ch...@gmail.com>.
What exactly do you mean by client exceptions? Or where can I find them? I
pastebin'd the exceptions I got from the command line. The web browser is
blank and just has a loading sign until I kill the process. If I look at
the Hbase Web UI from the crunch2 box where I ran the program, everything
seems normal, but I'll paste that:
Web UI:
http://pastebin.com/mef9a432
Thread Dump:
http://pastebin.com/m76022dea
On Wed, Jan 20, 2010 at 6:05 PM, stack <st...@duboce.net> wrote:
> I was thinking hadoop perms. But if shell works, then its probably fine.
> Can you pastebin client exceptions? Thanks,
> St.Ack
>
> On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > Yeah, we're just using the default so no zoo.cfg. Permissions are fine
> as
> > I
> > can ssh into any other hadoop box without password. Although it looks
> like
> > permissions aren't set on the log directory. I'm currently VPN'd, so
> maybe
> > its a networking issue??
> >
> > Pastebin: http://pastebin.com/m3147adf1
> >
> > Hbase shell is working:
> > hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
> > ROW COLUMN+CELL
> >
> > -10095526042667 column=user:theme,
> timestamp=-10095526042667,
> > value=Frost
> > -10095526042683 column=user:theme,
> timestamp=-10095526042683,
> > value=Frost
> > -10095526042854 column=user:theme,
> timestamp=-10095526042854,
> > value=Frost
> > -10095526042870 column=user:theme,
> timestamp=-10095526042870,
> > value=Frost
> > 5 row(s) in 0.2570 seconds
> >
> > Jetty is working:
> >
> > // Substitute HBase config for test stringbuilder
> >
> > StringBuilder builder = new StringBuilder();
> >
> > builder.append("Blah blah blah");
> >
> > response.getOutputStream().write(
> > builder.toString().getBytes());
> >
> > Outputs "Blah blah blah" to the screen.
> >
> >
> >
> > On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
> >
> > > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > > Robert.Gibbon@vodafone.com> wrote:
> > >
> > > >
> > > > Try putting the directory holding zoo.cfg on the classpath - you have
> a
> > > > zoo.cfg file, right?
> > > >
> > >
> > > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > > ensemble/quorum members -- but if a zoo.cfg is present, we'll read that
> > > ahead of hbase-site.xml.
> > > St.Ack
> > >
> > >
> > >
> > > >
> > > > -----Original Message-----
> > > > From: saint.ack@gmail.com on behalf of stack
> > > > Sent: Wed 1/20/2010 9:53 PM
> > > > To: hbase-user@hadoop.apache.org
> > > > Subject: Re: Config Problems with HBase and Jetty
> > > >
> > > > Can you pastebin the below? Its hard to read in email. Maybe its a
> > > > permissions prob? I see lots of 'from an unknown user got value'.
> Can
> > > you
> > > > get to your hbase cluster using hbase shell ok? From host running
> > > jetty?
> > > >
> > > > St.Ack
> > > >
> > > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > > christopher.andrew.bates@gmail.com> wrote:
> > > >
> > > > > Ah. good catch...getting more errors still....
> > > > >
> > > > > [exec] at
> > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > [exec] at
> > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > [exec] at
> > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > [exec] at
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > [exec] at
> > > > >
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > [exec] at
> > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > [exec]
> > > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > > Client
> > > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009
> 18:48
> > > GMT
> > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:host.name=crunch2.local
> > > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:java.version=1.6.0_14
> > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:java.vendor=Sun Microsystems Inc.
> > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > >
> > > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > >
> > > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:java.io.tmpdir=/tmp
> > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:java.compiler=<NA>
> > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:os.name=Linux
> > > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:os.arch=i386
> > > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:os.version=2.6.28-11-generic
> > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:user.name=hadoop
> > > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:user.home=/home/hadoop
> > > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > > > Initiating client connection, connectString=localhost:2181
> > > > > sessionTimeout=60000
> > > > >
> > > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
> > > > > zookeeper.disableAutoWatchReset is false
> > > > > [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > > > [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Priming connection to java.nio.channels.SocketChannel[connected
> > > > > local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > > [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Server connection successful
> > > > > [exec] 15:33:31,379 DEBUG
> > > > > [24109300@qtp-15206466-0-EventThread
> > > ,HConnectionManager$ClientZKWatcher]
> > > > > Got ZooKeeper event, state: SyncConnected, type: None, path: null
> > > > > [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > > serverPath:null finished:false header:: -8,101 replyHeader::
> -8,80,0
> > > > > request:: 0,v{},v{},v{} response:: null
> > > > > [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > > serverPath:null finished:false header:: 1,1 replyHeader::
> 1,81,-110
> > > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > > > [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > > serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> > > > > request::
> > > > > '/hbase/safe-mode,F response::
> > > > >
> s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > > [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > > ,ClientCnxn]
> > > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > > serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> > > > > request::
> > > > > '/hbase/root-region-server,F response::
> > > > >
> > > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > > ,ZooKeeperWrapper]
> > > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > The
> > > > > ping interval is60000ms.
> > > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > > > Connecting to /172.16.1.96:60020
> > > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user: starting,
> > > having
> > > > > connections 1
> > > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #0
> > > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #0
> > > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > getProtocolVersion 139
> > > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #1
> > > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #1
> > > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > getRegionInfo 28
> > > > > [exec] 15:33:31,942 DEBUG
> > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > Found ROOT at 172.16.1.96:60020
> > > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #2
> > > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #2
> > > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > getClosestRowBefore 8
> > > > > [exec] 15:33:32,004 DEBUG
> > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION =>
> > > {NAME
> > > > =>
> > > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,
> > TABLE
> > > > =>
> > > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE =>
> '16384',
> > > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > > COMPRESSION
> > > > =>
> > > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> > > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> > COMPRESSION
> > > =>
> > > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>
> > 'false',
> > > > > BLOCKCACHE => 'false'}]}}
> > > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > > > Connecting to /172.16.1.95:60020
> > > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.95:60020 from an unknown user: starting,
> > > having
> > > > > connections 2
> > > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.95:60020 from an unknown user
> > > > sending
> > > > > #3
> > > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.95:60020 from an unknown user got value #3
> > > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > getProtocolVersion 14
> > > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.95:60020 from an unknown user
> > > > sending
> > > > > #4
> > > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.95:60020 from an unknown user got value #4
> > > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > getClosestRowBefore 157
> > > > > [exec] 15:33:32,179 DEBUG
> > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION =>
> > > {NAME
> > > > =>
> > > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230',
> > > ENCODED
> > > > > =>
> > > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME =>
> 'search',
> > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > BLOCKSIZE
> > > =>
> > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
> > 'user',
> > > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> > BLOCKSIZE
> > > =>
> > > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > > ,HTable$ClientScanner]
> > > > > Creating scanner over Guts starting at key ''
> > > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > > ,HTable$ClientScanner]
> > > > > Advancing internal scanner to startKey at ''
> > > > > [exec] 15:33:32,191 DEBUG
> > > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > > Cache hit for row <> in tableName Guts: location server
> > > > 172.16.1.96:60020,
> > > > > location region name Guts,,1262665364102
> > > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #5
> > > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #5
> > > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > openScanner 30
> > > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #6
> > > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #6
> > > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > next
> > > > > 30
> > > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #7
> > > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #7
> > > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > next
> > > > > 28
> > > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0
> ,HBaseClient]
> > > IPC
> > > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > > sending
> > > > > #8
> > > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client
> (47)
> > > > > connection to /172.16.1.96:60020 from an unknown user got value #8
> > > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> > Call:
> > > > > next
> > > > > 27
> > > > >
> > > > > Then this scanner output seems to continue forever and it just
> hangs.
> > > > I'm
> > > > > not really sure what the errors mean...
> > > > >
> > > > >
> > > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
> > > > >
> > > > > > Is zookeeper jar on your CLASSPATH?
> > > > > >
> > > > > > [exec] java.lang.NoClassDefFoundError:
> > org/apache/zookeeper/Watcher
> > > > > >
> > > > > > You code looks fine.
> > > > > >
> > > > > > St.Ack
> > > > > >
> > > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > We're building an analytics server with HBase using Jetty. I
> > have
> > > > > > > experimented with the Thrift API + PHP over the past few days
> and
> > > got
> > > > > it
> > > > > > > working, but needed the filter functionality which has not been
> > > > > released
> > > > > > > yet. So I decided to switch to the Java API and run it with a
> > > Jetty
> > > > > > > server.
> > > > > > >
> > > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > > > >
> > > > > > > Hbase is setup on the same machine, with all the configuration
> > > > settings
> > > > > > > according to the "Getting Started" guide. We are using Hbase
> > > version
> > > > > > > 0.20.1.
> > > > > > >
> > > > > > > Just doing a quick scanning test with this code:
> > > > > > >
> > > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > > HTable table = new HTable(config, "Guts");
> > > > > > > Scan s = new Scan();
> > > > > > >
> > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > > ResultScanner scanner = table.getScanner(s);
> > > > > > > int count = 0;
> > > > > > > int limit = 10;
> > > > > > > try {
> > > > > > > for (Result rr = scanner.next(); rr != null; rr
> =
> > > > > > > scanner.next()) {
> > > > > > > if (count <= limit) {
> > > > > > > response.getOutputStream().write(
> > > rr.getRow()
> > > > );
> > > > > > > count++;
> > > > > > > }
> > > > > > > }
> > > > > > > } finally {
> > > > > > > scanner.close();
> > > > > > > }
> > > > > > >
> > > > > > >
> > > > > > > I get this error, which states (I think) that the HBase is
> > throwing
> > > a
> > > > > > > connection error:
> > > > > > >
> > > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> > ,Configuration]
> > > > > > > java.io.IOException: config()
> > > > > > > [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > > [exec] at
> > > > > > >
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > > [exec] at
> > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > > [exec] at
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > [exec] at
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > [exec]
> > > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > > > [exec] java.lang.NoClassDefFoundError:
> > > > org/apache/zookeeper/Watcher
> > > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > > > > > > [exec] at
> > > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > > [exec] at
> > > > > > >
> > > >
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > > [exec] at
> > > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > > [exec] at
> > > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > > [exec] at
> > > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > > [exec] at
> java.security.AccessController.doPrivileged(Native
> > > > > Method)
> > > > > > > [exec] at
> > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > [exec] at
> > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > [exec] at
> > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > [exec] at
> > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > [exec] at
> > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > > [exec] at
> > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > > [exec] at
> > > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > > [exec] at
> > > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > > [exec] at
> > > > > > >
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > > [exec] at
> > > > > > >
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > > [exec] at
> > > > > > >
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > > [exec] at
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > > org.apache.zookeeper.Watcher
> > > > > > > [exec] at
> > > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > > [exec] at
> java.security.AccessController.doPrivileged(Native
> > > > > Method)
> > > > > > > [exec] at
> > > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > > [exec] at
> > java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > > [exec] at
> > > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > > [exec] at
> > java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > > [exec] at
> > > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > > [exec] ... 35 more
> > > > > > >
> > > > > > >
> > > > > > > After doing a mailing list search, it seemed that other
> > > configuration
> > > > > > > problems were fixed by upgrading to 0.20.2 which I have not yet
> > > done.
> > > > > Is
> > > > > > > this the problem or is there something simple I am overlooking?
> > I
> > > > have
> > > > > > > also
> > > > > > > added my hbase-site.xml and hbase-default.xml to my lib and
> conf
> > > > > > > directories
> > > > > > > to my working classpath.
> > > > > > >
> > > > > > > I am confused because I was able to connect via thrift, and I
> > also
> > > > have
> > > > > a
> > > > > > > BulkImporter MapReduce script to load the logging data into
> HBase
> > > > that
> > > > > > > works
> > > > > > > fine, but have been unable to locate my error in this case.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > > >
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by stack <st...@duboce.net>.
I was thinking hadoop perms. But if shell works, then its probably fine.
Can you pastebin client exceptions? Thanks,
St.Ack
On Wed, Jan 20, 2010 at 1:32 PM, Chris Bates <
christopher.andrew.bates@gmail.com> wrote:
> Yeah, we're just using the default so no zoo.cfg. Permissions are fine as
> I
> can ssh into any other hadoop box without password. Although it looks like
> permissions aren't set on the log directory. I'm currently VPN'd, so maybe
> its a networking issue??
>
> Pastebin: http://pastebin.com/m3147adf1
>
> Hbase shell is working:
> hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
> ROW COLUMN+CELL
>
> -10095526042667 column=user:theme, timestamp=-10095526042667,
> value=Frost
> -10095526042683 column=user:theme, timestamp=-10095526042683,
> value=Frost
> -10095526042854 column=user:theme, timestamp=-10095526042854,
> value=Frost
> -10095526042870 column=user:theme, timestamp=-10095526042870,
> value=Frost
> 5 row(s) in 0.2570 seconds
>
> Jetty is working:
>
> // Substitute HBase config for test stringbuilder
>
> StringBuilder builder = new StringBuilder();
>
> builder.append("Blah blah blah");
>
> response.getOutputStream().write(
> builder.toString().getBytes());
>
> Outputs "Blah blah blah" to the screen.
>
>
>
> On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
>
> > On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> > Robert.Gibbon@vodafone.com> wrote:
> >
> > >
> > > Try putting the directory holding zoo.cfg on the classpath - you have a
> > > zoo.cfg file, right?
> > >
> >
> > Default is to read zoo configuration from hbase-site.xml -- e.g.
> > ensemble/quorum members -- but if a zoo.cfg is present, we'll read that
> > ahead of hbase-site.xml.
> > St.Ack
> >
> >
> >
> > >
> > > -----Original Message-----
> > > From: saint.ack@gmail.com on behalf of stack
> > > Sent: Wed 1/20/2010 9:53 PM
> > > To: hbase-user@hadoop.apache.org
> > > Subject: Re: Config Problems with HBase and Jetty
> > >
> > > Can you pastebin the below? Its hard to read in email. Maybe its a
> > > permissions prob? I see lots of 'from an unknown user got value'. Can
> > you
> > > get to your hbase cluster using hbase shell ok? From host running
> > jetty?
> > >
> > > St.Ack
> > >
> > > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > > christopher.andrew.bates@gmail.com> wrote:
> > >
> > > > Ah. good catch...getting more errors still....
> > > >
> > > > [exec] at
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > [exec] at
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > [exec] at
> com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > [exec] at
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > [exec] at
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > [exec] at
> > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > [exec] at
> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > [exec] at
> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > [exec]
> > > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Client
> > > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48
> > GMT
> > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:host.name=crunch2.local
> > > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:java.version=1.6.0_14
> > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:java.vendor=Sun Microsystems Inc.
> > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > >
> > > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > >
> > > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:java.io.tmpdir=/tmp
> > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:java.compiler=<NA>
> > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:os.name=Linux
> > > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:os.arch=i386
> > > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:os.version=2.6.28-11-generic
> > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:user.name=hadoop
> > > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:user.home=/home/hadoop
> > > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > > Initiating client connection, connectString=localhost:2181
> > > > sessionTimeout=60000
> > > >
> > > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
> > > > zookeeper.disableAutoWatchReset is false
> > > > [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > > [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Priming connection to java.nio.channels.SocketChannel[connected
> > > > local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > > [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Server connection successful
> > > > [exec] 15:33:31,379 DEBUG
> > > > [24109300@qtp-15206466-0-EventThread
> > ,HConnectionManager$ClientZKWatcher]
> > > > Got ZooKeeper event, state: SyncConnected, type: None, path: null
> > > > [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > serverPath:null finished:false header:: -8,101 replyHeader:: -8,80,0
> > > > request:: 0,v{},v{},v{} response:: null
> > > > [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > serverPath:null finished:false header:: 1,1 replyHeader:: 1,81,-110
> > > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > > [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> > > > request::
> > > > '/hbase/safe-mode,F response::
> > > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > > [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> > > > ,ClientCnxn]
> > > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > > serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> > > > request::
> > > > '/hbase/root-region-server,F response::
> > > >
> > > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> > ,ZooKeeperWrapper]
> > > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > The
> > > > ping interval is60000ms.
> > > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > > > Connecting to /172.16.1.96:60020
> > > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user: starting,
> > having
> > > > connections 1
> > > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #0
> > > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #0
> > > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > getProtocolVersion 139
> > > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #1
> > > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #1
> > > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > getRegionInfo 28
> > > > [exec] 15:33:31,942 DEBUG
> > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > Found ROOT at 172.16.1.96:60020
> > > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #2
> > > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #2
> > > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > getClosestRowBefore 8
> > > > [exec] 15:33:32,004 DEBUG
> > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > Cached location address: 172.16.1.95:60020, regioninfo: REGION =>
> > {NAME
> > > =>
> > > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192,
> TABLE
> > > =>
> > > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
> > > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> > COMPRESSION
> > > =>
> > > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> > > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10',
> COMPRESSION
> > =>
> > > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY =>
> 'false',
> > > > BLOCKCACHE => 'false'}]}}
> > > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > > > Connecting to /172.16.1.95:60020
> > > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.95:60020 from an unknown user: starting,
> > having
> > > > connections 2
> > > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.95:60020 from an unknown user
> > > sending
> > > > #3
> > > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.95:60020 from an unknown user got value #3
> > > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > getProtocolVersion 14
> > > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.95:60020 from an unknown user
> > > sending
> > > > #4
> > > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.95:60020 from an unknown user got value #4
> > > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > getClosestRowBefore 157
> > > > [exec] 15:33:32,179 DEBUG
> > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > Cached location address: 172.16.1.96:60020, regioninfo: REGION =>
> > {NAME
> > > =>
> > > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230',
> > ENCODED
> > > > =>
> > > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => 'search',
> > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> BLOCKSIZE
> > =>
> > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME =>
> 'user',
> > > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647',
> BLOCKSIZE
> > =>
> > > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > > ,HTable$ClientScanner]
> > > > Creating scanner over Guts starting at key ''
> > > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > > ,HTable$ClientScanner]
> > > > Advancing internal scanner to startKey at ''
> > > > [exec] 15:33:32,191 DEBUG
> > > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > > Cache hit for row <> in tableName Guts: location server
> > > 172.16.1.96:60020,
> > > > location region name Guts,,1262665364102
> > > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #5
> > > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #5
> > > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > openScanner 30
> > > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #6
> > > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #6
> > > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > next
> > > > 30
> > > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #7
> > > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #7
> > > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > next
> > > > 28
> > > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > IPC
> > > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > > sending
> > > > #8
> > > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > > connection to /172.16.1.96:60020 from an unknown user got value #8
> > > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC]
> Call:
> > > > next
> > > > 27
> > > >
> > > > Then this scanner output seems to continue forever and it just hangs.
> > > I'm
> > > > not really sure what the errors mean...
> > > >
> > > >
> > > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
> > > >
> > > > > Is zookeeper jar on your CLASSPATH?
> > > > >
> > > > > [exec] java.lang.NoClassDefFoundError:
> org/apache/zookeeper/Watcher
> > > > >
> > > > > You code looks fine.
> > > > >
> > > > > St.Ack
> > > > >
> > > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > > christopher.andrew.bates@gmail.com> wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > We're building an analytics server with HBase using Jetty. I
> have
> > > > > > experimented with the Thrift API + PHP over the past few days and
> > got
> > > > it
> > > > > > working, but needed the filter functionality which has not been
> > > > released
> > > > > > yet. So I decided to switch to the Java API and run it with a
> > Jetty
> > > > > > server.
> > > > > >
> > > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > > >
> > > > > > Hbase is setup on the same machine, with all the configuration
> > > settings
> > > > > > according to the "Getting Started" guide. We are using Hbase
> > version
> > > > > > 0.20.1.
> > > > > >
> > > > > > Just doing a quick scanning test with this code:
> > > > > >
> > > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > > HTable table = new HTable(config, "Guts");
> > > > > > Scan s = new Scan();
> > > > > >
> s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > > ResultScanner scanner = table.getScanner(s);
> > > > > > int count = 0;
> > > > > > int limit = 10;
> > > > > > try {
> > > > > > for (Result rr = scanner.next(); rr != null; rr =
> > > > > > scanner.next()) {
> > > > > > if (count <= limit) {
> > > > > > response.getOutputStream().write(
> > rr.getRow()
> > > );
> > > > > > count++;
> > > > > > }
> > > > > > }
> > > > > > } finally {
> > > > > > scanner.close();
> > > > > > }
> > > > > >
> > > > > >
> > > > > > I get this error, which states (I think) that the HBase is
> throwing
> > a
> > > > > > connection error:
> > > > > >
> > > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0
> ,Configuration]
> > > > > > java.io.IOException: config()
> > > > > > [exec] at
> > > > > >
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > > [exec] at
> > > > > >
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > > [exec] at
> > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > > [exec] at
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > [exec] at
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > [exec] at
> > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > [exec]
> > > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > > [exec] java.lang.NoClassDefFoundError:
> > > org/apache/zookeeper/Watcher
> > > > > > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > > > > > [exec] at
> > java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > > [exec] at
> > > > > >
> > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > > [exec] at
> > > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > > [exec] at
> > > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > > [exec] at
> > java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > > [exec] at java.security.AccessController.doPrivileged(Native
> > > > Method)
> > > > > > [exec] at
> > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > [exec] at
> java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > [exec] at
> > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > [exec] at
> java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > [exec] at
> > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > > [exec] at
> > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > > [exec] at
> > > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > > [exec] at
> > > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > > [exec] at
> > > > > >
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > > [exec] at
> > > > > >
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > > [exec] at
> > > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > > [exec] at
> > > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > > [exec] at
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > > org.apache.zookeeper.Watcher
> > > > > > [exec] at
> > java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > > [exec] at java.security.AccessController.doPrivileged(Native
> > > > Method)
> > > > > > [exec] at
> > > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > > [exec] at
> java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > > [exec] at
> > > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > > [exec] at
> java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > > [exec] at
> > > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > > [exec] ... 35 more
> > > > > >
> > > > > >
> > > > > > After doing a mailing list search, it seemed that other
> > configuration
> > > > > > problems were fixed by upgrading to 0.20.2 which I have not yet
> > done.
> > > > Is
> > > > > > this the problem or is there something simple I am overlooking?
> I
> > > have
> > > > > > also
> > > > > > added my hbase-site.xml and hbase-default.xml to my lib and conf
> > > > > > directories
> > > > > > to my working classpath.
> > > > > >
> > > > > > I am confused because I was able to connect via thrift, and I
> also
> > > have
> > > > a
> > > > > > BulkImporter MapReduce script to load the logging data into HBase
> > > that
> > > > > > works
> > > > > > fine, but have been unable to locate my error in this case.
> > > > > >
> > > > >
> > > >
> > >
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by Chris Bates <ch...@gmail.com>.
Yeah, we're just using the default so no zoo.cfg. Permissions are fine as I
can ssh into any other hadoop box without password. Although it looks like
permissions aren't set on the log directory. I'm currently VPN'd, so maybe
its a networking issue??
Pastebin: http://pastebin.com/m3147adf1
Hbase shell is working:
hbase(main):009:0> scan 'Guts', {COLUMNS => ['user:theme'], LIMIT=>5}
ROW COLUMN+CELL
-10095526042667 column=user:theme, timestamp=-10095526042667,
value=Frost
-10095526042683 column=user:theme, timestamp=-10095526042683,
value=Frost
-10095526042854 column=user:theme, timestamp=-10095526042854,
value=Frost
-10095526042870 column=user:theme, timestamp=-10095526042870,
value=Frost
5 row(s) in 0.2570 seconds
Jetty is working:
// Substitute HBase config for test stringbuilder
StringBuilder builder = new StringBuilder();
builder.append("Blah blah blah");
response.getOutputStream().write(
builder.toString().getBytes());
Outputs "Blah blah blah" to the screen.
On Wed, Jan 20, 2010 at 4:18 PM, stack <st...@duboce.net> wrote:
> On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
> Robert.Gibbon@vodafone.com> wrote:
>
> >
> > Try putting the directory holding zoo.cfg on the classpath - you have a
> > zoo.cfg file, right?
> >
>
> Default is to read zoo configuration from hbase-site.xml -- e.g.
> ensemble/quorum members -- but if a zoo.cfg is present, we'll read that
> ahead of hbase-site.xml.
> St.Ack
>
>
>
> >
> > -----Original Message-----
> > From: saint.ack@gmail.com on behalf of stack
> > Sent: Wed 1/20/2010 9:53 PM
> > To: hbase-user@hadoop.apache.org
> > Subject: Re: Config Problems with HBase and Jetty
> >
> > Can you pastebin the below? Its hard to read in email. Maybe its a
> > permissions prob? I see lots of 'from an unknown user got value'. Can
> you
> > get to your hbase cluster using hbase shell ok? From host running
> jetty?
> >
> > St.Ack
> >
> > On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> > christopher.andrew.bates@gmail.com> wrote:
> >
> > > Ah. good catch...getting more errors still....
> > >
> > > [exec] at
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > [exec] at
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > [exec] at
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > [exec] at
> org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > [exec]
> > > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Client
> > > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48
> GMT
> > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:host.name=crunch2.local
> > > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:java.version=1.6.0_14
> > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:java.vendor=Sun Microsystems Inc.
> > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > >
> > >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > >
> > >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:java.io.tmpdir=/tmp
> > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:java.compiler=<NA>
> > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:os.name=Linux
> > > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:os.arch=i386
> > > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:os.version=2.6.28-11-generic
> > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:user.name=hadoop
> > > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:user.home=/home/hadoop
> > > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > > Initiating client connection, connectString=localhost:2181
> > > sessionTimeout=60000
> > >
> > >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
> > > zookeeper.disableAutoWatchReset is false
> > > [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > > [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Priming connection to java.nio.channels.SocketChannel[connected
> > > local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
> > > [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Server connection successful
> > > [exec] 15:33:31,379 DEBUG
> > > [24109300@qtp-15206466-0-EventThread
> ,HConnectionManager$ClientZKWatcher]
> > > Got ZooKeeper event, state: SyncConnected, type: None, path: null
> > > [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > serverPath:null finished:false header:: -8,101 replyHeader:: -8,80,0
> > > request:: 0,v{},v{},v{} response:: null
> > > [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > serverPath:null finished:false header:: 1,1 replyHeader:: 1,81,-110
> > > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > > [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> > > request::
> > > '/hbase/safe-mode,F response::
> > > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > > [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> > > ,ClientCnxn]
> > > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > > serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> > > request::
> > > '/hbase/root-region-server,F response::
> > >
> > >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0
> ,ZooKeeperWrapper]
> > > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> The
> > > ping interval is60000ms.
> > > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > > Connecting to /172.16.1.96:60020
> > > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user: starting,
> having
> > > connections 1
> > > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #0
> > > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #0
> > > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > getProtocolVersion 139
> > > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #1
> > > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #1
> > > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > getRegionInfo 28
> > > [exec] 15:33:31,942 DEBUG
> > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > Found ROOT at 172.16.1.96:60020
> > > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #2
> > > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #2
> > > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > getClosestRowBefore 8
> > > [exec] 15:33:32,004 DEBUG
> > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > Cached location address: 172.16.1.95:60020, regioninfo: REGION =>
> {NAME
> > =>
> > > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE
> > =>
> > > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
> > > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647',
> COMPRESSION
> > =>
> > > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> > > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10', COMPRESSION
> =>
> > > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> > > BLOCKCACHE => 'false'}]}}
> > > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > > Connecting to /172.16.1.95:60020
> > > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.95:60020 from an unknown user: starting,
> having
> > > connections 2
> > > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.95:60020 from an unknown user
> > sending
> > > #3
> > > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.95:60020 from an unknown user got value #3
> > > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > getProtocolVersion 14
> > > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.95:60020 from an unknown user
> > sending
> > > #4
> > > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.95:60020 from an unknown user got value #4
> > > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > getClosestRowBefore 157
> > > [exec] 15:33:32,179 DEBUG
> > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > Cached location address: 172.16.1.96:60020, regioninfo: REGION =>
> {NAME
> > =>
> > > 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230',
> ENCODED
> > > =>
> > > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => 'search',
> > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE
> =>
> > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'user',
> > > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE
> =>
> > > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > > ,HTable$ClientScanner]
> > > Creating scanner over Guts starting at key ''
> > > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > > ,HTable$ClientScanner]
> > > Advancing internal scanner to startKey at ''
> > > [exec] 15:33:32,191 DEBUG
> > > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > > Cache hit for row <> in tableName Guts: location server
> > 172.16.1.96:60020,
> > > location region name Guts,,1262665364102
> > > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #5
> > > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #5
> > > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > openScanner 30
> > > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #6
> > > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #6
> > > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > next
> > > 30
> > > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #7
> > > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #7
> > > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > next
> > > 28
> > > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> IPC
> > > Client (47) connection to /172.16.1.96:60020 from an unknown user
> > sending
> > > #8
> > > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > > connection to /172.16.1.96:60020 from an unknown user got value #8
> > > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > > next
> > > 27
> > >
> > > Then this scanner output seems to continue forever and it just hangs.
> > I'm
> > > not really sure what the errors mean...
> > >
> > >
> > > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
> > >
> > > > Is zookeeper jar on your CLASSPATH?
> > > >
> > > > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> > > >
> > > > You code looks fine.
> > > >
> > > > St.Ack
> > > >
> > > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > > christopher.andrew.bates@gmail.com> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > We're building an analytics server with HBase using Jetty. I have
> > > > > experimented with the Thrift API + PHP over the past few days and
> got
> > > it
> > > > > working, but needed the filter functionality which has not been
> > > released
> > > > > yet. So I decided to switch to the Java API and run it with a
> Jetty
> > > > > server.
> > > > >
> > > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > > >
> > > > > Hbase is setup on the same machine, with all the configuration
> > settings
> > > > > according to the "Getting Started" guide. We are using Hbase
> version
> > > > > 0.20.1.
> > > > >
> > > > > Just doing a quick scanning test with this code:
> > > > >
> > > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > > HTable table = new HTable(config, "Guts");
> > > > > Scan s = new Scan();
> > > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > > ResultScanner scanner = table.getScanner(s);
> > > > > int count = 0;
> > > > > int limit = 10;
> > > > > try {
> > > > > for (Result rr = scanner.next(); rr != null; rr =
> > > > > scanner.next()) {
> > > > > if (count <= limit) {
> > > > > response.getOutputStream().write(
> rr.getRow()
> > );
> > > > > count++;
> > > > > }
> > > > > }
> > > > > } finally {
> > > > > scanner.close();
> > > > > }
> > > > >
> > > > >
> > > > > I get this error, which states (I think) that the HBase is throwing
> a
> > > > > connection error:
> > > > >
> > > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
> > > > > java.io.IOException: config()
> > > > > [exec] at
> > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > > [exec] at
> > > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > > [exec] at
> > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > > [exec] at
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > [exec] at
> > > > >
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > [exec] at
> > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > [exec]
> > > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > > [exec] java.lang.NoClassDefFoundError:
> > org/apache/zookeeper/Watcher
> > > > > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > > > > [exec] at
> java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > > [exec] at
> > > > >
> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > > [exec] at
> > > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > > [exec] at
> > > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > > [exec] at
> java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > > [exec] at java.security.AccessController.doPrivileged(Native
> > > Method)
> > > > > [exec] at
> > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > [exec] at
> > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > [exec] at
> > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > > [exec] at
> > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > > [exec] at
> > > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > > [exec] at
> > com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > > [exec] at
> > > > >
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > > [exec] at
> > > > >
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > > [exec] at
> > > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > > [exec] at
> > > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > > [exec] at
> > > > >
> > > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > > org.apache.zookeeper.Watcher
> > > > > [exec] at
> java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > > [exec] at java.security.AccessController.doPrivileged(Native
> > > Method)
> > > > > [exec] at
> > > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > > [exec] at
> > > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > > [exec] at
> > > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > > [exec] ... 35 more
> > > > >
> > > > >
> > > > > After doing a mailing list search, it seemed that other
> configuration
> > > > > problems were fixed by upgrading to 0.20.2 which I have not yet
> done.
> > > Is
> > > > > this the problem or is there something simple I am overlooking? I
> > have
> > > > > also
> > > > > added my hbase-site.xml and hbase-default.xml to my lib and conf
> > > > > directories
> > > > > to my working classpath.
> > > > >
> > > > > I am confused because I was able to connect via thrift, and I also
> > have
> > > a
> > > > > BulkImporter MapReduce script to load the logging data into HBase
> > that
> > > > > works
> > > > > fine, but have been unable to locate my error in this case.
> > > > >
> > > >
> > >
> >
> >
>
Re: Config Problems with HBase and Jetty
Posted by stack <st...@duboce.net>.
On Wed, Jan 20, 2010 at 1:10 PM, Gibbon, Robert, VF-Group <
Robert.Gibbon@vodafone.com> wrote:
>
> Try putting the directory holding zoo.cfg on the classpath - you have a
> zoo.cfg file, right?
>
Default is to read zoo configuration from hbase-site.xml -- e.g.
ensemble/quorum members -- but if a zoo.cfg is present, we'll read that
ahead of hbase-site.xml.
St.Ack
>
> -----Original Message-----
> From: saint.ack@gmail.com on behalf of stack
> Sent: Wed 1/20/2010 9:53 PM
> To: hbase-user@hadoop.apache.org
> Subject: Re: Config Problems with HBase and Jetty
>
> Can you pastebin the below? Its hard to read in email. Maybe its a
> permissions prob? I see lots of 'from an unknown user got value'. Can you
> get to your hbase cluster using hbase shell ok? From host running jetty?
>
> St.Ack
>
> On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > Ah. good catch...getting more errors still....
> >
> > [exec] at
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > [exec] at
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > [exec] at
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > [exec] at
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > [exec] at
> >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > [exec] at
> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > [exec] at
> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > [exec] at
> >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > [exec] at
> >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > [exec]
> > [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Client
> > environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48 GMT
> > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:host.name=crunch2.local
> > [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:java.version=1.6.0_14
> > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:java.vendor=Sun Microsystems Inc.
> > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> > [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> >
> >
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> >
> >
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> > [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:java.io.tmpdir=/tmp
> > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:java.compiler=<NA>
> > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:os.name=Linux
> > [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:os.arch=i386
> > [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:os.version=2.6.28-11-generic
> > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:user.name=hadoop
> > [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:user.home=/home/hadoop
> > [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> > environment:user.dir=/var/www/jetty/hbase/build/jettycab
> > [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
> > Initiating client connection, connectString=localhost:2181
> > sessionTimeout=60000
> >
> >
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> > [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
> > zookeeper.disableAutoWatchReset is false
> > [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> > [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Priming connection to java.nio.channels.SocketChannel[connected
> > local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
> > [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Server connection successful
> > [exec] 15:33:31,379 DEBUG
> > [24109300@qtp-15206466-0-EventThread,HConnectionManager$ClientZKWatcher]
> > Got ZooKeeper event, state: SyncConnected, type: None, path: null
> > [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > serverPath:null finished:false header:: -8,101 replyHeader:: -8,80,0
> > request:: 0,v{},v{},v{} response:: null
> > [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > serverPath:null finished:false header:: 1,1 replyHeader:: 1,81,-110
> > request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> > [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> > request::
> > '/hbase/safe-mode,F response::
> > s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> > [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> > ,ClientCnxn]
> > Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> > serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> > request::
> > '/hbase/root-region-server,F response::
> >
> >
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> > [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0,ZooKeeperWrapper]
> > Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> > [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0,HBaseClient] The
> > ping interval is60000ms.
> > [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > Connecting to /172.16.1.96:60020
> > [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user: starting, having
> > connections 1
> > [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #0
> > [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #0
> > [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > getProtocolVersion 139
> > [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #1
> > [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #1
> > [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > getRegionInfo 28
> > [exec] 15:33:31,942 DEBUG
> > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > Found ROOT at 172.16.1.96:60020
> > [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #2
> > [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #2
> > [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > getClosestRowBefore 8
> > [exec] 15:33:32,004 DEBUG
> > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > Cached location address: 172.16.1.95:60020, regioninfo: REGION => {NAME
> =>
> > '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE
> =>
> > {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
> > FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647', COMPRESSION
> =>
> > 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> > BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10', COMPRESSION =>
> > 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> > BLOCKCACHE => 'false'}]}}
> > [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> > Connecting to /172.16.1.95:60020
> > [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.95:60020 from an unknown user: starting, having
> > connections 2
> > [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.95:60020 from an unknown user
> sending
> > #3
> > [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.95:60020 from an unknown user got value #3
> > [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > getProtocolVersion 14
> > [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.95:60020 from an unknown user
> sending
> > #4
> > [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> > 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.95:60020 from an unknown user got value #4
> > [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > getClosestRowBefore 157
> > [exec] 15:33:32,179 DEBUG
> > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > Cached location address: 172.16.1.96:60020, regioninfo: REGION => {NAME
> =>
> > 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230', ENCODED
> > =>
> > 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => 'search',
> > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
> > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'user',
> > VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
> > '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> > [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> > ,HTable$ClientScanner]
> > Creating scanner over Guts starting at key ''
> > [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> > ,HTable$ClientScanner]
> > Advancing internal scanner to startKey at ''
> > [exec] 15:33:32,191 DEBUG
> > [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> > Cache hit for row <> in tableName Guts: location server
> 172.16.1.96:60020,
> > location region name Guts,,1262665364102
> > [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #5
> > [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #5
> > [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > openScanner 30
> > [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #6
> > [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #6
> > [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > next
> > 30
> > [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #7
> > [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #7
> > [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > next
> > 28
> > [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> > Client (47) connection to /172.16.1.96:60020 from an unknown user
> sending
> > #8
> > [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> > 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> > connection to /172.16.1.96:60020 from an unknown user got value #8
> > [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> > next
> > 27
> >
> > Then this scanner output seems to continue forever and it just hangs.
> I'm
> > not really sure what the errors mean...
> >
> >
> > On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
> >
> > > Is zookeeper jar on your CLASSPATH?
> > >
> > > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> > >
> > > You code looks fine.
> > >
> > > St.Ack
> > >
> > > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > > christopher.andrew.bates@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > We're building an analytics server with HBase using Jetty. I have
> > > > experimented with the Thrift API + PHP over the past few days and got
> > it
> > > > working, but needed the filter functionality which has not been
> > released
> > > > yet. So I decided to switch to the Java API and run it with a Jetty
> > > > server.
> > > >
> > > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > > >
> > > > Hbase is setup on the same machine, with all the configuration
> settings
> > > > according to the "Getting Started" guide. We are using Hbase version
> > > > 0.20.1.
> > > >
> > > > Just doing a quick scanning test with this code:
> > > >
> > > > HBaseConfiguration config = new HBaseConfiguration();
> > > > HTable table = new HTable(config, "Guts");
> > > > Scan s = new Scan();
> > > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > > ResultScanner scanner = table.getScanner(s);
> > > > int count = 0;
> > > > int limit = 10;
> > > > try {
> > > > for (Result rr = scanner.next(); rr != null; rr =
> > > > scanner.next()) {
> > > > if (count <= limit) {
> > > > response.getOutputStream().write( rr.getRow()
> );
> > > > count++;
> > > > }
> > > > }
> > > > } finally {
> > > > scanner.close();
> > > > }
> > > >
> > > >
> > > > I get this error, which states (I think) that the HBase is throwing a
> > > > connection error:
> > > >
> > > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
> > > > java.io.IOException: config()
> > > > [exec] at
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > > [exec] at
> > > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > > [exec] at
> com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > > [exec] at
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > [exec] at
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > [exec] at
> > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > [exec] at
> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > [exec] at
> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > [exec]
> > > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > > [exec] java.lang.NoClassDefFoundError:
> org/apache/zookeeper/Watcher
> > > > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > > > [exec] at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > > [exec] at
> > > >
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > > [exec] at
> > > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > > [exec] at
> > java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > > [exec] at java.security.AccessController.doPrivileged(Native
> > Method)
> > > > [exec] at
> > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > [exec] at
> > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > [exec] at
> > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > > [exec] at
> > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > > [exec] at
> > > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > > [exec] at
> com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > > [exec] at
> > > >
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > > [exec] at
> > > >
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > > [exec] at
> > org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > > [exec] at
> > > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > > [exec] at
> > > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > > [exec] at
> > > >
> > > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > > org.apache.zookeeper.Watcher
> > > > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > > [exec] at java.security.AccessController.doPrivileged(Native
> > Method)
> > > > [exec] at
> > java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > > [exec] at
> > > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > > [exec] at
> > > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > > [exec] ... 35 more
> > > >
> > > >
> > > > After doing a mailing list search, it seemed that other configuration
> > > > problems were fixed by upgrading to 0.20.2 which I have not yet done.
> > Is
> > > > this the problem or is there something simple I am overlooking? I
> have
> > > > also
> > > > added my hbase-site.xml and hbase-default.xml to my lib and conf
> > > > directories
> > > > to my working classpath.
> > > >
> > > > I am confused because I was able to connect via thrift, and I also
> have
> > a
> > > > BulkImporter MapReduce script to load the logging data into HBase
> that
> > > > works
> > > > fine, but have been unable to locate my error in this case.
> > > >
> > >
> >
>
>
RE: Config Problems with HBase and Jetty
Posted by "Gibbon, Robert, VF-Group" <Ro...@vodafone.com>.
Try putting the directory holding zoo.cfg on the classpath - you have a zoo.cfg file, right?
-----Original Message-----
From: saint.ack@gmail.com on behalf of stack
Sent: Wed 1/20/2010 9:53 PM
To: hbase-user@hadoop.apache.org
Subject: Re: Config Problems with HBase and Jetty
Can you pastebin the below? Its hard to read in email. Maybe its a
permissions prob? I see lots of 'from an unknown user got value'. Can you
get to your hbase cluster using hbase shell ok? From host running jetty?
St.Ack
On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
christopher.andrew.bates@gmail.com> wrote:
> Ah. good catch...getting more errors still....
>
> [exec] at
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> [exec] at
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> [exec] at
>
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> [exec] at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> [exec] at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> [exec] at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> [exec] at
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> [exec] at
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> [exec] at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> [exec] at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> [exec]
> [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48 GMT
> [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:host.name=crunch2.local
> [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.version=1.6.0_14
> [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.vendor=Sun Microsystems Inc.
> [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
>
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
>
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.io.tmpdir=/tmp
> [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.compiler=<NA>
> [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:os.name=Linux
> [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:os.arch=i386
> [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:os.version=2.6.28-11-generic
> [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:user.name=hadoop
> [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:user.home=/home/hadoop
> [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:user.dir=/var/www/jetty/hbase/build/jettycab
> [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Initiating client connection, connectString=localhost:2181
> sessionTimeout=60000
>
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
> zookeeper.disableAutoWatchReset is false
> [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Priming connection to java.nio.channels.SocketChannel[connected
> local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
> [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Server connection successful
> [exec] 15:33:31,379 DEBUG
> [24109300@qtp-15206466-0-EventThread,HConnectionManager$ClientZKWatcher]
> Got ZooKeeper event, state: SyncConnected, type: None, path: null
> [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: -8,101 replyHeader:: -8,80,0
> request:: 0,v{},v{},v{} response:: null
> [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: 1,1 replyHeader:: 1,81,-110
> request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> request::
> '/hbase/safe-mode,F response::
> s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> request::
> '/hbase/root-region-server,F response::
>
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0,ZooKeeperWrapper]
> Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0,HBaseClient] The
> ping interval is60000ms.
> [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> Connecting to /172.16.1.96:60020
> [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user: starting, having
> connections 1
> [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #0
> [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #0
> [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getProtocolVersion 139
> [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #1
> [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #1
> [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getRegionInfo 28
> [exec] 15:33:31,942 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Found ROOT at 172.16.1.96:60020
> [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #2
> [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #2
> [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getClosestRowBefore 8
> [exec] 15:33:32,004 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Cached location address: 172.16.1.95:60020, regioninfo: REGION => {NAME =>
> '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE =>
> {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
> FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647', COMPRESSION =>
> 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10', COMPRESSION =>
> 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> BLOCKCACHE => 'false'}]}}
> [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> Connecting to /172.16.1.95:60020
> [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.95:60020 from an unknown user: starting, having
> connections 2
> [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.95:60020 from an unknown user sending
> #3
> [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.95:60020 from an unknown user got value #3
> [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getProtocolVersion 14
> [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.95:60020 from an unknown user sending
> #4
> [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.95:60020 from an unknown user got value #4
> [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getClosestRowBefore 157
> [exec] 15:33:32,179 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Cached location address: 172.16.1.96:60020, regioninfo: REGION => {NAME =>
> 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230', ENCODED
> =>
> 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => 'search',
> VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'user',
> VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> ,HTable$ClientScanner]
> Creating scanner over Guts starting at key ''
> [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> ,HTable$ClientScanner]
> Advancing internal scanner to startKey at ''
> [exec] 15:33:32,191 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Cache hit for row <> in tableName Guts: location server 172.16.1.96:60020,
> location region name Guts,,1262665364102
> [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #5
> [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #5
> [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> openScanner 30
> [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #6
> [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #6
> [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> next
> 30
> [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #7
> [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #7
> [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> next
> 28
> [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #8
> [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #8
> [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> next
> 27
>
> Then this scanner output seems to continue forever and it just hangs. I'm
> not really sure what the errors mean...
>
>
> On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
>
> > Is zookeeper jar on your CLASSPATH?
> >
> > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> >
> > You code looks fine.
> >
> > St.Ack
> >
> > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > christopher.andrew.bates@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > We're building an analytics server with HBase using Jetty. I have
> > > experimented with the Thrift API + PHP over the past few days and got
> it
> > > working, but needed the filter functionality which has not been
> released
> > > yet. So I decided to switch to the Java API and run it with a Jetty
> > > server.
> > >
> > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > >
> > > Hbase is setup on the same machine, with all the configuration settings
> > > according to the "Getting Started" guide. We are using Hbase version
> > > 0.20.1.
> > >
> > > Just doing a quick scanning test with this code:
> > >
> > > HBaseConfiguration config = new HBaseConfiguration();
> > > HTable table = new HTable(config, "Guts");
> > > Scan s = new Scan();
> > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > ResultScanner scanner = table.getScanner(s);
> > > int count = 0;
> > > int limit = 10;
> > > try {
> > > for (Result rr = scanner.next(); rr != null; rr =
> > > scanner.next()) {
> > > if (count <= limit) {
> > > response.getOutputStream().write( rr.getRow() );
> > > count++;
> > > }
> > > }
> > > } finally {
> > > scanner.close();
> > > }
> > >
> > >
> > > I get this error, which states (I think) that the HBase is throwing a
> > > connection error:
> > >
> > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
> > > java.io.IOException: config()
> > > [exec] at
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > [exec] at
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > [exec] at
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > [exec] at
> org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > [exec]
> > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> > > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > > [exec] at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > [exec] at
> > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > [exec] at
> > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > [exec] at
> java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > [exec] at java.security.AccessController.doPrivileged(Native
> Method)
> > > [exec] at
> java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > [exec] at
> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > [exec] at
> > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > [exec] at
> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > [exec] at
> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > [exec] at
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > [exec] at
> org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > org.apache.zookeeper.Watcher
> > > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > [exec] at java.security.AccessController.doPrivileged(Native
> Method)
> > > [exec] at
> java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > [exec] at
> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > [exec] at
> > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > [exec] ... 35 more
> > >
> > >
> > > After doing a mailing list search, it seemed that other configuration
> > > problems were fixed by upgrading to 0.20.2 which I have not yet done.
> Is
> > > this the problem or is there something simple I am overlooking? I have
> > > also
> > > added my hbase-site.xml and hbase-default.xml to my lib and conf
> > > directories
> > > to my working classpath.
> > >
> > > I am confused because I was able to connect via thrift, and I also have
> a
> > > BulkImporter MapReduce script to load the logging data into HBase that
> > > works
> > > fine, but have been unable to locate my error in this case.
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by stack <st...@duboce.net>.
Can you pastebin the below? Its hard to read in email. Maybe its a
permissions prob? I see lots of 'from an unknown user got value'. Can you
get to your hbase cluster using hbase shell ok? From host running jetty?
St.Ack
On Wed, Jan 20, 2010 at 12:38 PM, Chris Bates <
christopher.andrew.bates@gmail.com> wrote:
> Ah. good catch...getting more errors still....
>
> [exec] at
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> [exec] at
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> [exec] at
>
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> [exec] at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> [exec] at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> [exec] at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> [exec] at
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> [exec] at
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> [exec] at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> [exec] at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> [exec]
> [exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48 GMT
> [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:host.name=crunch2.local
> [exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.version=1.6.0_14
> [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.vendor=Sun Microsystems Inc.
> [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
> [exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
>
> environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
> [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
>
> environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
> [exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.io.tmpdir=/tmp
> [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:java.compiler=<NA>
> [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:os.name=Linux
> [exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:os.arch=i386
> [exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:os.version=2.6.28-11-generic
> [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:user.name=hadoop
> [exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:user.home=/home/hadoop
> [exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
> environment:user.dir=/var/www/jetty/hbase/build/jettycab
> [exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
> Initiating client connection, connectString=localhost:2181
> sessionTimeout=60000
>
> watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
> [exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
> zookeeper.disableAutoWatchReset is false
> [exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
> [exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Priming connection to java.nio.channels.SocketChannel[connected
> local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
> [exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Server connection successful
> [exec] 15:33:31,379 DEBUG
> [24109300@qtp-15206466-0-EventThread,HConnectionManager$ClientZKWatcher]
> Got ZooKeeper event, state: SyncConnected, type: None, path: null
> [exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: -8,101 replyHeader:: -8,80,0
> request:: 0,v{},v{},v{} response:: null
> [exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: 1,1 replyHeader:: 1,81,-110
> request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
> [exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0
> request::
> '/hbase/safe-mode,F response::
> s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
> [exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread
> ,ClientCnxn]
> Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
> serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0
> request::
> '/hbase/root-region-server,F response::
>
> #3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
> [exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0,ZooKeeperWrapper]
> Read ZNode /hbase/root-region-server got 172.16.1.96:60020
> [exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0,HBaseClient] The
> ping interval is60000ms.
> [exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> Connecting to /172.16.1.96:60020
> [exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user: starting, having
> connections 1
> [exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #0
> [exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #0
> [exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getProtocolVersion 139
> [exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #1
> [exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #1
> [exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getRegionInfo 28
> [exec] 15:33:31,942 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Found ROOT at 172.16.1.96:60020
> [exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #2
> [exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #2
> [exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getClosestRowBefore 8
> [exec] 15:33:32,004 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Cached location address: 172.16.1.95:60020, regioninfo: REGION => {NAME =>
> '.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE =>
> {{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
> FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647', COMPRESSION =>
> 'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10', COMPRESSION =>
> 'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY => 'false',
> BLOCKCACHE => 'false'}]}}
> [exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0,HBaseClient]
> Connecting to /172.16.1.95:60020
> [exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
> 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.95:60020 from an unknown user: starting, having
> connections 2
> [exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.95:60020 from an unknown user sending
> #3
> [exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
> 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.95:60020 from an unknown user got value #3
> [exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getProtocolVersion 14
> [exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.95:60020 from an unknown user sending
> #4
> [exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
> 172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.95:60020 from an unknown user got value #4
> [exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> getClosestRowBefore 157
> [exec] 15:33:32,179 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Cached location address: 172.16.1.96:60020, regioninfo: REGION => {NAME =>
> 'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230', ENCODED
> =>
> 413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => 'search',
> VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'user',
> VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
> '65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
> [exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0
> ,HTable$ClientScanner]
> Creating scanner over Guts starting at key ''
> [exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0
> ,HTable$ClientScanner]
> Advancing internal scanner to startKey at ''
> [exec] 15:33:32,191 DEBUG
> [24109300@qtp-15206466-0,HConnectionManager$TableServers]
> Cache hit for row <> in tableName Guts: location server 172.16.1.96:60020,
> location region name Guts,,1262665364102
> [exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #5
> [exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #5
> [exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> openScanner 30
> [exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #6
> [exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #6
> [exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> next
> 30
> [exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #7
> [exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #7
> [exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> next
> 28
> [exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
> Client (47) connection to /172.16.1.96:60020 from an unknown user sending
> #8
> [exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
> 172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
> connection to /172.16.1.96:60020 from an unknown user got value #8
> [exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
> next
> 27
>
> Then this scanner output seems to continue forever and it just hangs. I'm
> not really sure what the errors mean...
>
>
> On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
>
> > Is zookeeper jar on your CLASSPATH?
> >
> > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> >
> > You code looks fine.
> >
> > St.Ack
> >
> > On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> > christopher.andrew.bates@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > We're building an analytics server with HBase using Jetty. I have
> > > experimented with the Thrift API + PHP over the past few days and got
> it
> > > working, but needed the filter functionality which has not been
> released
> > > yet. So I decided to switch to the Java API and run it with a Jetty
> > > server.
> > >
> > > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> > >
> > > Hbase is setup on the same machine, with all the configuration settings
> > > according to the "Getting Started" guide. We are using Hbase version
> > > 0.20.1.
> > >
> > > Just doing a quick scanning test with this code:
> > >
> > > HBaseConfiguration config = new HBaseConfiguration();
> > > HTable table = new HTable(config, "Guts");
> > > Scan s = new Scan();
> > > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > > ResultScanner scanner = table.getScanner(s);
> > > int count = 0;
> > > int limit = 10;
> > > try {
> > > for (Result rr = scanner.next(); rr != null; rr =
> > > scanner.next()) {
> > > if (count <= limit) {
> > > response.getOutputStream().write( rr.getRow() );
> > > count++;
> > > }
> > > }
> > > } finally {
> > > scanner.close();
> > > }
> > >
> > >
> > > I get this error, which states (I think) that the HBase is throwing a
> > > connection error:
> > >
> > > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
> > > java.io.IOException: config()
> > > [exec] at
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > > [exec] at
> > > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > > [exec] at
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > [exec] at
> org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > [exec]
> > > [exec] 2010-01-20 14:56:14.697::WARN: /
> > > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> > > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > > [exec] at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > > [exec] at
> > > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > > [exec] at
> > java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > > [exec] at
> java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > > [exec] at java.security.AccessController.doPrivileged(Native
> Method)
> > > [exec] at
> java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > [exec] at
> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > [exec] at
> > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > > [exec] at
> > >
> > >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > > [exec] at
> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > > [exec] at
> > org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > > [exec] at
> > >
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > > [exec] at
> org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > > [exec] at
> > > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > > [exec] at
> > > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > > [exec] at
> > >
> > >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > > [exec] Caused by: java.lang.ClassNotFoundException:
> > > org.apache.zookeeper.Watcher
> > > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > > [exec] at java.security.AccessController.doPrivileged(Native
> Method)
> > > [exec] at
> java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > > [exec] at
> > sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > > [exec] at
> > java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > > [exec] ... 35 more
> > >
> > >
> > > After doing a mailing list search, it seemed that other configuration
> > > problems were fixed by upgrading to 0.20.2 which I have not yet done.
> Is
> > > this the problem or is there something simple I am overlooking? I have
> > > also
> > > added my hbase-site.xml and hbase-default.xml to my lib and conf
> > > directories
> > > to my working classpath.
> > >
> > > I am confused because I was able to connect via thrift, and I also have
> a
> > > BulkImporter MapReduce script to load the logging data into HBase that
> > > works
> > > fine, but have been unable to locate my error in this case.
> > >
> >
>
Re: Config Problems with HBase and Jetty
Posted by Chris Bates <ch...@gmail.com>.
Ah. good catch...getting more errors still....
[exec] at
org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
[exec] at
org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
[exec] at
org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
[exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
[exec] at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
[exec] at org.mortbay.jetty.Server.handle(Server.java:326)
[exec] at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
[exec] at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
[exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
[exec] at
org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
[exec] at
org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
[exec] at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
[exec] at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
[exec]
[exec] 15:33:31,226 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:zookeeper.version=3.2.1-808558, built on 08/27/2009 18:48 GMT
[exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:host.name=crunch2.local
[exec] 15:33:31,227 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.version=1.6.0_14
[exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.vendor=Sun Microsystems Inc.
[exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.home=/usr/lib/jvm/java-6-sun-1.6.0.14/jre
[exec] 15:33:31,228 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.class.path=:/var/www/jetty/hbase/build/jettycab/lib/commons-logging-1.1.1.jar:/var/www/jetty/hbase/build/jettycab/lib/fast-md5.jar:/var/www/jetty/hbase/build/jettycab/lib/hadoop-0.20.0-core.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-0.20.1.jar:/var/www/jetty/hbase/build/jettycab/lib/hbase-default.xml:/var/www/jetty/hbase/build/jettycab/lib/hbase-site.xml:/var/www/jetty/hbase/build/jettycab/lib/jetty-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/jettycab-0.1.0.jar:/var/www/jetty/hbase/build/jettycab/lib/jetty-util-6.1.20.jar:/var/www/jetty/hbase/build/jettycab/lib/log4j-1.2.14.jar:/var/www/jetty/hbase/build/jettycab/lib/mysql-connector-java-5.0.4-bin.jar:/var/www/jetty/hbase/build/jettycab/lib/servlet-api.jar:/var/www/jetty/hbase/build/jettycab/lib/spring-2.5.1.jar:/var/www/jetty/hbase/build/jettycab/lib/zookeeper-3.2.1.jar
[exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.library.path=/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386/client:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/lib/i386:/usr/lib/jvm/java-6-sun-1.6.0.14/jre/../lib/i386:/usr/java/packages/lib/i386:/lib:/usr/lib
[exec] 15:33:31,229 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.io.tmpdir=/tmp
[exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:java.compiler=<NA>
[exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:os.name=Linux
[exec] 15:33:31,230 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:os.arch=i386
[exec] 15:33:31,231 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:os.version=2.6.28-11-generic
[exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:user.name=hadoop
[exec] 15:33:31,232 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:user.home=/home/hadoop
[exec] 15:33:31,233 INFO [24109300@qtp-15206466-0,ZooKeeper] Client
environment:user.dir=/var/www/jetty/hbase/build/jettycab
[exec] 15:33:31,236 INFO [24109300@qtp-15206466-0,ZooKeeper]
Initiating client connection, connectString=localhost:2181
sessionTimeout=60000
watcher=org.apache.hadoop.hbase.client.HConnectionManager$ClientZKWatcher@5fcf29
[exec] 15:33:31,241 INFO [24109300@qtp-15206466-0,ClientCnxn]
zookeeper.disableAutoWatchReset is false
[exec] 15:33:31,291 INFO [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Attempting connection to server localhost/0:0:0:0:0:0:0:1:2181
[exec] 15:33:31,302 INFO [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Priming connection to java.nio.channels.SocketChannel[connected
local=/0:0:0:0:0:0:0:1:41216 remote=localhost/0:0:0:0:0:0:0:1:2181]
[exec] 15:33:31,320 INFO [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Server connection successful
[exec] 15:33:31,379 DEBUG
[24109300@qtp-15206466-0-EventThread,HConnectionManager$ClientZKWatcher]
Got ZooKeeper event, state: SyncConnected, type: None, path: null
[exec] 15:33:31,386 DEBUG [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
serverPath:null finished:false header:: -8,101 replyHeader:: -8,80,0
request:: 0,v{},v{},v{} response:: null
[exec] 15:33:31,404 DEBUG [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
serverPath:null finished:false header:: 1,1 replyHeader:: 1,81,-110
request:: '/hbase,,v{s{31,s{'world,'anyone}}},0 response::
[exec] 15:33:31,438 DEBUG [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
serverPath:null finished:false header:: 2,3 replyHeader:: 2,81,0 request::
'/hbase/safe-mode,F response::
s{24,24,1263597776438,1263597776438,0,0,0,154868729443319808,0,0,24}
[exec] 15:33:31,453 DEBUG [24109300@qtp-15206466-0-SendThread,ClientCnxn]
Reading reply sessionid:0x326344ba5640005, packet:: clientPath:null
serverPath:null finished:false header:: 3,4 replyHeader:: 3,81,0 request::
'/hbase/root-region-server,F response::
#3137322e31362e312e39363a3630303230,s{26,76,1263597776621,1264006609781,1,0,0,0,17,0,26}
[exec] 15:33:31,454 DEBUG [24109300@qtp-15206466-0,ZooKeeperWrapper]
Read ZNode /hbase/root-region-server got 172.16.1.96:60020
[exec] 15:33:31,677 DEBUG [24109300@qtp-15206466-0,HBaseClient] The
ping interval is60000ms.
[exec] 15:33:31,792 DEBUG [24109300@qtp-15206466-0,HBaseClient]
Connecting to /172.16.1.96:60020
[exec] 15:33:31,839 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user: starting, having
connections 1
[exec] 15:33:31,843 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #0
[exec] 15:33:31,911 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #0
[exec] 15:33:31,913 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
getProtocolVersion 139
[exec] 15:33:31,914 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #1
[exec] 15:33:31,933 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #1
[exec] 15:33:31,941 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
getRegionInfo 28
[exec] 15:33:31,942 DEBUG
[24109300@qtp-15206466-0,HConnectionManager$TableServers]
Found ROOT at 172.16.1.96:60020
[exec] 15:33:31,944 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #2
[exec] 15:33:31,948 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #2
[exec] 15:33:31,951 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
getClosestRowBefore 8
[exec] 15:33:32,004 DEBUG
[24109300@qtp-15206466-0,HConnectionManager$TableServers]
Cached location address: 172.16.1.95:60020, regioninfo: REGION => {NAME =>
'.META.,,1', STARTKEY => '', ENDKEY => '', ENCODED => 1028785192, TABLE =>
{{NAME => '.META.', IS_META => 'true', MEMSTORE_FLUSHSIZE => '16384',
FAMILIES => [{NAME => 'historian', VERSIONS => '2147483647', COMPRESSION =>
'NONE', TTL => '604800', BLOCKSIZE => '8192', IN_MEMORY => 'false',
BLOCKCACHE => 'false'}, {NAME => 'info', VERSIONS => '10', COMPRESSION =>
'NONE', TTL => '2147483647', BLOCKSIZE => '8192', IN_MEMORY => 'false',
BLOCKCACHE => 'false'}]}}
[exec] 15:33:32,006 DEBUG [24109300@qtp-15206466-0,HBaseClient]
Connecting to /172.16.1.95:60020
[exec] 15:33:32,013 DEBUG [IPC Client (47) connection to /
172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.95:60020 from an unknown user: starting, having
connections 2
[exec] 15:33:32,016 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.95:60020 from an unknown user sending #3
[exec] 15:33:32,018 DEBUG [IPC Client (47) connection to /
172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.95:60020 from an unknown user got value #3
[exec] 15:33:32,020 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
getProtocolVersion 14
[exec] 15:33:32,021 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.95:60020 from an unknown user sending #4
[exec] 15:33:32,176 DEBUG [IPC Client (47) connection to /
172.16.1.95:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.95:60020 from an unknown user got value #4
[exec] 15:33:32,177 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
getClosestRowBefore 157
[exec] 15:33:32,179 DEBUG
[24109300@qtp-15206466-0,HConnectionManager$TableServers]
Cached location address: 172.16.1.96:60020, regioninfo: REGION => {NAME =>
'Guts,,1262665364102', STARTKEY => '', ENDKEY => '1262239352230', ENCODED =>
413700531, TABLE => {{NAME => 'Guts', FAMILIES => [{NAME => 'search',
VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}, {NAME => 'user',
VERSIONS => '3', COMPRESSION => 'NONE', TTL => '2147483647', BLOCKSIZE =>
'65536', IN_MEMORY => 'false', BLOCKCACHE => 'true'}]}}
[exec] 15:33:32,189 DEBUG [24109300@qtp-15206466-0,HTable$ClientScanner]
Creating scanner over Guts starting at key ''
[exec] 15:33:32,190 DEBUG [24109300@qtp-15206466-0,HTable$ClientScanner]
Advancing internal scanner to startKey at ''
[exec] 15:33:32,191 DEBUG
[24109300@qtp-15206466-0,HConnectionManager$TableServers]
Cache hit for row <> in tableName Guts: location server 172.16.1.96:60020,
location region name Guts,,1262665364102
[exec] 15:33:32,192 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #5
[exec] 15:33:32,221 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #5
[exec] 15:33:32,222 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call:
openScanner 30
[exec] 15:33:32,224 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #6
[exec] 15:33:32,250 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #6
[exec] 15:33:32,253 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call: next
30
[exec] 15:33:32,260 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #7
[exec] 15:33:32,286 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #7
[exec] 15:33:32,287 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call: next
28
[exec] 15:33:32,288 DEBUG [24109300@qtp-15206466-0,HBaseClient] IPC
Client (47) connection to /172.16.1.96:60020 from an unknown user sending #8
[exec] 15:33:32,315 DEBUG [IPC Client (47) connection to /
172.16.1.96:60020 from an unknown user,HBaseClient] IPC Client (47)
connection to /172.16.1.96:60020 from an unknown user got value #8
[exec] 15:33:32,315 DEBUG [24109300@qtp-15206466-0,HbaseRPC] Call: next
27
Then this scanner output seems to continue forever and it just hangs. I'm
not really sure what the errors mean...
On Wed, Jan 20, 2010 at 3:21 PM, stack <st...@duboce.net> wrote:
> Is zookeeper jar on your CLASSPATH?
>
> [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
>
> You code looks fine.
>
> St.Ack
>
> On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
> christopher.andrew.bates@gmail.com> wrote:
>
> > Hi,
> >
> > We're building an analytics server with HBase using Jetty. I have
> > experimented with the Thrift API + PHP over the past few days and got it
> > working, but needed the filter functionality which has not been released
> > yet. So I decided to switch to the Java API and run it with a Jetty
> > server.
> >
> > My Jetty server is setup on crunch2.in.escapemg.com:8888.
> >
> > Hbase is setup on the same machine, with all the configuration settings
> > according to the "Getting Started" guide. We are using Hbase version
> > 0.20.1.
> >
> > Just doing a quick scanning test with this code:
> >
> > HBaseConfiguration config = new HBaseConfiguration();
> > HTable table = new HTable(config, "Guts");
> > Scan s = new Scan();
> > s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> > ResultScanner scanner = table.getScanner(s);
> > int count = 0;
> > int limit = 10;
> > try {
> > for (Result rr = scanner.next(); rr != null; rr =
> > scanner.next()) {
> > if (count <= limit) {
> > response.getOutputStream().write( rr.getRow() );
> > count++;
> > }
> > }
> > } finally {
> > scanner.close();
> > }
> >
> >
> > I get this error, which states (I think) that the HBase is throwing a
> > connection error:
> >
> > [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
> > java.io.IOException: config()
> > [exec] at
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> > [exec] at
> > org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> > [exec] at
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > [exec] at
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > [exec] at
> >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > [exec] at
> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > [exec] at
> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > [exec] at
> >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > [exec] at
> >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > [exec]
> > [exec] 2010-01-20 14:56:14.697::WARN: /
> > [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> > [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> > [exec] at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> > [exec] at
> > java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> > [exec] at
> java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> > [exec] at java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> > [exec] at java.security.AccessController.doPrivileged(Native Method)
> > [exec] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > [exec] at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > [exec] at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> > [exec] at
> >
> >
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> > [exec] at
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> > [exec] at
> org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> > [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> > [exec] at
> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> > [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> > [exec] at
> > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> > [exec] at
> >
> >
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> > [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> > [exec] at
> > org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> > [exec] at
> > org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> > [exec] at
> >
> >
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> > [exec] at
> >
> >
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> > [exec] Caused by: java.lang.ClassNotFoundException:
> > org.apache.zookeeper.Watcher
> > [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> > [exec] at java.security.AccessController.doPrivileged(Native Method)
> > [exec] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> > [exec] at
> sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> > [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> > [exec] at
> java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> > [exec] ... 35 more
> >
> >
> > After doing a mailing list search, it seemed that other configuration
> > problems were fixed by upgrading to 0.20.2 which I have not yet done. Is
> > this the problem or is there something simple I am overlooking? I have
> > also
> > added my hbase-site.xml and hbase-default.xml to my lib and conf
> > directories
> > to my working classpath.
> >
> > I am confused because I was able to connect via thrift, and I also have a
> > BulkImporter MapReduce script to load the logging data into HBase that
> > works
> > fine, but have been unable to locate my error in this case.
> >
>
Re: Config Problems with HBase and Jetty
Posted by stack <st...@duboce.net>.
Is zookeeper jar on your CLASSPATH?
[exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
You code looks fine.
St.Ack
On Wed, Jan 20, 2010 at 12:12 PM, Chris Bates <
christopher.andrew.bates@gmail.com> wrote:
> Hi,
>
> We're building an analytics server with HBase using Jetty. I have
> experimented with the Thrift API + PHP over the past few days and got it
> working, but needed the filter functionality which has not been released
> yet. So I decided to switch to the Java API and run it with a Jetty
> server.
>
> My Jetty server is setup on crunch2.in.escapemg.com:8888.
>
> Hbase is setup on the same machine, with all the configuration settings
> according to the "Getting Started" guide. We are using Hbase version
> 0.20.1.
>
> Just doing a quick scanning test with this code:
>
> HBaseConfiguration config = new HBaseConfiguration();
> HTable table = new HTable(config, "Guts");
> Scan s = new Scan();
> s.addColumn(Bytes.toBytes("user:"),Bytes.toBytes("theme"));
> ResultScanner scanner = table.getScanner(s);
> int count = 0;
> int limit = 10;
> try {
> for (Result rr = scanner.next(); rr != null; rr =
> scanner.next()) {
> if (count <= limit) {
> response.getOutputStream().write( rr.getRow() );
> count++;
> }
> }
> } finally {
> scanner.close();
> }
>
>
> I get this error, which states (I think) that the HBase is throwing a
> connection error:
>
> [exec] 14:56:14,197 DEBUG [24109300@qtp-15206466-0,Configuration]
> java.io.IOException: config()
> [exec] at
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:210)
> [exec] at
> org.apache.hadoop.conf.Configuration.<init>(Configuration.java:197)
> [exec] at
>
> org.apache.hadoop.hbase.HBaseConfiguration.<init>(HBaseConfiguration.java:33)
> [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:25)
> [exec] at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> [exec] at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> [exec] at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> [exec] at
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> [exec] at
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> [exec] at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> [exec] at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> [exec]
> [exec] 2010-01-20 14:56:14.697::WARN: /
> [exec] java.lang.NoClassDefFoundError: org/apache/zookeeper/Watcher
> [exec] at java.lang.ClassLoader.defineClass1(Native Method)
> [exec] at java.lang.ClassLoader.defineClass(ClassLoader.java:621)
> [exec] at
> java.security.SecureClassLoader.defineClass(SecureClassLoader.java:124)
> [exec] at java.net.URLClassLoader.defineClass(URLClassLoader.java:260)
> [exec] at java.net.URLClassLoader.access$000(URLClassLoader.java:56)
> [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:195)
> [exec] at java.security.AccessController.doPrivileged(Native Method)
> [exec] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> [exec] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> [exec] at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager.getClientZooKeeperWatcher(HConnectionManager.java:151)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getZooKeeperWrapper(HConnectionManager.java:885)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRootRegion(HConnectionManager.java:901)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:580)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:589)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegionInMeta(HConnectionManager.java:630)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:593)
> [exec] at
>
> org.apache.hadoop.hbase.client.HConnectionManager$TableServers.locateRegion(HConnectionManager.java:556)
> [exec] at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:127)
> [exec] at org.apache.hadoop.hbase.client.HTable.<init>(HTable.java:105)
> [exec] at com.grooveshark.HBaseHandler.handle(HBaseHandler.java:27)
> [exec] at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
> [exec] at org.mortbay.jetty.Server.handle(Server.java:326)
> [exec] at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:536)
> [exec] at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:913)
> [exec] at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:539)
> [exec] at
> org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
> [exec] at
> org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:405)
> [exec] at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
> [exec] at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
> [exec] Caused by: java.lang.ClassNotFoundException:
> org.apache.zookeeper.Watcher
> [exec] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> [exec] at java.security.AccessController.doPrivileged(Native Method)
> [exec] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> [exec] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> [exec] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> [exec] at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> [exec] ... 35 more
>
>
> After doing a mailing list search, it seemed that other configuration
> problems were fixed by upgrading to 0.20.2 which I have not yet done. Is
> this the problem or is there something simple I am overlooking? I have
> also
> added my hbase-site.xml and hbase-default.xml to my lib and conf
> directories
> to my working classpath.
>
> I am confused because I was able to connect via thrift, and I also have a
> BulkImporter MapReduce script to load the logging data into HBase that
> works
> fine, but have been unable to locate my error in this case.
>