You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by George Pang <p0...@gmail.com> on 2013/11/01 22:14:37 UTC
Re: Send data to a remote Hbase server
Hi Ashish,
Does it mean I have to install zookeeper too in the HBase box, in order to
talk to Hbase from a remote Flume?
Thank you,
George
On Thu, Oct 31, 2013 at 12:36 AM, Ashish <pa...@gmail.com> wrote:
> Have a look at http://flume.apache.org/FlumeUserGuide.html#hbasesinks
>
> It says "This sink writes data to HBase. The Hbase configuration is
> picked up from the first hbase-site.xml encountered in the classpath."
>
> It will be able to talk to your Remote Server.
>
>
> On Thu, Oct 31, 2013 at 12:10 PM, George Pang <p0...@gmail.com> wrote:
>
>> Hi,
>>
>> I set up Flume to get Apache server log and send it over to Hbase, my
>> experiment works in a single machine (Apache, Flume and Hbase all in local
>> machine)
>>
>> If I want Flume to send to Hbase located in a remote server, what should
>> I do? I don't see in flume.conf example a place for remote Hbase address.
>>
>> Thank you,
>>
>> George
>>
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>
Re: Send data to a remote Hbase server
Posted by George Pang <p0...@gmail.com>.
Thank you for response, I run zookeeper, and when I run the client which is
Flume AsyncHbaseSinc, it connected to the right host and port of Zookeeper,
but then
can not find root region. The error message is like this:
Opening socket connection to server MyHost/MyIP:2181
2013-11-04 18:21:19,373 (lifecycleSupervisor-1-1) [INFO -
org.hbase.async.HBaseClient$ZKClient.getDeferredRoot(HBaseClient.java:2695)]
*Need to find the -ROOT- region*
2013-11-04 18:21:19,424 (lifecycleSupervisor-1-1-SendThread(MyHost:2181))
[INFO -
org.apache.zookeeper.ClientCnxn$SendThread.primeConnection(ClientCnxn.java:947)]
*Socket connection established to MyHost/MyIP:2181, initiating session
*2013-11-04
18:21:19,427 (lifecycleSupervisor-1-1-SendThread(MyHost:2181)) [DEBUG -
org.apache.zookeeper.ClientCnxn$SendThread.primeConnection(ClientCnxn.java:996)]
Session establishment request sent on MyHost/MyIP:2181
2013-11-04 18:21:19,481 (lifecycleSupervisor-1-1-SendThread(MyHost:2181))
[INFO -
org.apache.zookeeper.ClientCnxn$SendThread.readConnectResult(ClientCnxn.java:736)]
Session establishment complete on server MyHost/MyIP 2181, sessionid =
0x1422451bbfd000e, negotiated timeout = 6000
2013-11-04 18:21:19,493 (lifecycleSupervisor-1-1-EventThread) [DEBUG -
org.hbase.async.HBaseClient$ZKClient.process(HBaseClient.java:2750)] Got
ZooKeeper event: WatchedEvent state:SyncConnected type:None path:null
2013-11-04 18:21:19,495 (lifecycleSupervisor-1-1-EventThread) [DEBUG -
org.hbase.async.HBaseClient$ZKClient.getRootRegion(HBaseClient.java:2969)]
Finding the -ROOT- region in ZooKeeper
2013-11-04 18:21:19,500 (lifecycleSupervisor-1-1-EventThread) [DEBUG -
org.hbase.async.HBaseClient$ZKClient.process(HBaseClient.java:2771)] Done
handling ZooKeeper event: WatchedEvent state:SyncConnected type:None
path:null
2013-11-04 18:21:19,550 (lifecycleSupervisor-1-1-SendThread(MyHost:2181))
[DEBUG -
org.apache.zookeeper.ClientCnxn$SendThread.readResponse(ClientCnxn.java:836)]
Reading reply sessionid:0x1422451bbfd000e, packet::
clientPath:/hbase/root-region-server serverPath:/hbase/root-region-server
finished:false header:: 1,4 replyHeader:: 1,989,-101 request::
'/hbase/root-region-server,T response::
2013-11-04 18:21:19,555 (lifecycleSupervisor-1-1-EventThread) [ERROR -
org.hbase.async.HBaseClient$ZKClient$2.processResult(HBaseClient.java:2860)]
*The znode for the -ROOT- region doesn't exist!*
My ps aux | grep Hbase:
.....logger=INFO,RFAS org.apache.hadoop.*hbase.regionserver.HRegionServer
start*
Thank you for any idea!
George
On Mon, Nov 4, 2013 at 8:33 AM, Jeff Lord <jl...@cloudera.com> wrote:
> Zookeeper should already be running on the hbase server.
> If you are using standalone mode it is run within the same jvm as hbase.
>
>
>
> On Fri, Nov 1, 2013 at 2:14 PM, George Pang <p0...@gmail.com> wrote:
>
>> Hi Ashish,
>>
>> Does it mean I have to install zookeeper too in the HBase box, in order
>> to talk to Hbase from a remote Flume?
>>
>> Thank you,
>>
>> George
>>
>>
>> On Thu, Oct 31, 2013 at 12:36 AM, Ashish <pa...@gmail.com> wrote:
>>
>>> Have a look at http://flume.apache.org/FlumeUserGuide.html#hbasesinks
>>>
>>> It says "This sink writes data to HBase. The Hbase configuration is
>>> picked up from the first hbase-site.xml encountered in the classpath."
>>>
>>> It will be able to talk to your Remote Server.
>>>
>>>
>>> On Thu, Oct 31, 2013 at 12:10 PM, George Pang <p0...@gmail.com> wrote:
>>>
>>>> Hi,
>>>>
>>>> I set up Flume to get Apache server log and send it over to Hbase, my
>>>> experiment works in a single machine (Apache, Flume and Hbase all in local
>>>> machine)
>>>>
>>>> If I want Flume to send to Hbase located in a remote server, what
>>>> should I do? I don't see in flume.conf example a place for remote Hbase
>>>> address.
>>>>
>>>> Thank you,
>>>>
>>>> George
>>>>
>>>
>>>
>>>
>>> --
>>> thanks
>>> ashish
>>>
>>> Blog: http://www.ashishpaliwal.com/blog
>>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>>>
>>
>>
>
Re: Send data to a remote Hbase server
Posted by Jeff Lord <jl...@cloudera.com>.
Zookeeper should already be running on the hbase server.
If you are using standalone mode it is run within the same jvm as hbase.
On Fri, Nov 1, 2013 at 2:14 PM, George Pang <p0...@gmail.com> wrote:
> Hi Ashish,
>
> Does it mean I have to install zookeeper too in the HBase box, in order to
> talk to Hbase from a remote Flume?
>
> Thank you,
>
> George
>
>
> On Thu, Oct 31, 2013 at 12:36 AM, Ashish <pa...@gmail.com> wrote:
>
>> Have a look at http://flume.apache.org/FlumeUserGuide.html#hbasesinks
>>
>> It says "This sink writes data to HBase. The Hbase configuration is
>> picked up from the first hbase-site.xml encountered in the classpath."
>>
>> It will be able to talk to your Remote Server.
>>
>>
>> On Thu, Oct 31, 2013 at 12:10 PM, George Pang <p0...@gmail.com> wrote:
>>
>>> Hi,
>>>
>>> I set up Flume to get Apache server log and send it over to Hbase, my
>>> experiment works in a single machine (Apache, Flume and Hbase all in local
>>> machine)
>>>
>>> If I want Flume to send to Hbase located in a remote server, what should
>>> I do? I don't see in flume.conf example a place for remote Hbase address.
>>>
>>> Thank you,
>>>
>>> George
>>>
>>
>>
>>
>> --
>> thanks
>> ashish
>>
>> Blog: http://www.ashishpaliwal.com/blog
>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>>
>
>