You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Hilmi Yildirim <hi...@neofonie.de> on 2015/05/26 14:05:05 UTC
HBase Connection in cluster
Hi,
I implemented a job which reads data from HBASE with following code (I
replaced the real address by m1.example.com)
protected Scan getScanner() {
Scan scan = new Scan();
Configuration conf = HBaseConfiguration.create();
conf.set("hbase.zookeeper.quorum", "m1.example.com");
conf.set("hbase.zookeeper.property.clientPort", "2181");
try {
table = new HTable(conf, "table");
table.getScanner(scan);
} catch (IOException e) {
// TODO Auto-generated catch block
e.printStackTrace();
}
return scan;
}
My code works well when I execute it local but when I execute deploy it
on the cluster then I get following exceptions:
14:00:30,610 INFO
org.apache.zookeeper.ClientCnxn - Opening
socket connection to server localhost/127.0.0.1:2181. Will not attempt
to authenticate using SASL (unknown error)
14:00:30,610 WARN
org.apache.zookeeper.ClientCnxn - Session
0x0 for server null, unexpected error, closing socket connection and
attempting reconnect
java.net.ConnectException: Verbindungsaufbau abgelehnt
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
14:00:31,089 INFO
org.apache.zookeeper.ClientCnxn - Opening
socket connection to server localhost/127.0.0.1:2181. Will not attempt
to authenticate using SASL (unknown error)
14:00:31,089 WARN
org.apache.zookeeper.ClientCnxn - Session
0x0 for server null, unexpected error, closing socket connection and
attempting reconnect
java.net.ConnectException: Verbindungsaufbau abgelehnt
at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
at
sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
at
org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
at
org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
Does anyone know what I make wrong?
Best Regards,
Hilmi
--
--
Hilmi Yildirim
Software Developer R&D
http://www.neofonie.de
Besuchen Sie den Neo Tech Blog für Anwender:
http://blog.neofonie.de/
Folgen Sie uns:
https://plus.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
https://www.xing.com/companies/neofoniegmbh
Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Geschäftsführung: Thomas Kitlitschko
Re: HBase Connection in cluster
Posted by Flavio Pompermaier <po...@okkam.it>.
In the src/main/resources folder of the project
On Tue, May 26, 2015 at 2:42 PM, Hilmi Yildirim <hi...@neofonie.de>
wrote:
> Where do you put the hbase-site.xml? In the resource folder of the
> project or on the cluster?
>
>
> Am 26.05.2015 um 14:12 schrieb Flavio Pompermaier:
>
> I usually put those connection params inside the hbase-site.xml that will
> be included in the generated jar..
>
> On Tue, May 26, 2015 at 2:07 PM, Hilmi Yildirim <
> hilmi.yildirim@neofonie.de> wrote:
>
>> I want to add that it is strange that the client wants to establish a
>> connection to localhost but I have defined another machine.
>>
>>
>>
>>
>> Am 26.05.2015 um 14:05 schrieb Hilmi Yildirim:
>>
>>> Hi,
>>> I implemented a job which reads data from HBASE with following code (I
>>> replaced the real address by m1.example.com)
>>>
>>> protected Scan getScanner() {
>>> Scan scan = new Scan();
>>> Configuration conf = HBaseConfiguration.create();
>>> conf.set("hbase.zookeeper.quorum", "m1.example.com");
>>> conf.set("hbase.zookeeper.property.clientPort", "2181");
>>>
>>> try {
>>> table = new HTable(conf, "table");
>>> table.getScanner(scan);
>>> } catch (IOException e) {
>>> // TODO Auto-generated catch block
>>> e.printStackTrace();
>>> }
>>> return scan;
>>> }
>>>
>>>
>>> My code works well when I execute it local but when I execute deploy it
>>> on the cluster then I get following exceptions:
>>>
>>> 14:00:30,610 INFO org.apache.zookeeper.ClientCnxn
>>> - Opening socket connection to server localhost/127.0.0.1:2181.
>>> Will not attempt to authenticate using SASL (unknown error)
>>> 14:00:30,610 WARN org.apache.zookeeper.ClientCnxn
>>> - Session 0x0 for server null, unexpected error, closing socket
>>> connection and attempting reconnect
>>> java.net.ConnectException: Verbindungsaufbau abgelehnt
>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>> at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>>> at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>>> at
>>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>>> 14:00:31,089 INFO org.apache.zookeeper.ClientCnxn
>>> - Opening socket connection to server localhost/127.0.0.1:2181.
>>> Will not attempt to authenticate using SASL (unknown error)
>>> 14:00:31,089 WARN org.apache.zookeeper.ClientCnxn
>>> - Session 0x0 for server null, unexpected error, closing socket
>>> connection and attempting reconnect
>>> java.net.ConnectException: Verbindungsaufbau abgelehnt
>>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>>> at
>>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>>> at
>>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>>> at
>>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>>>
>>>
>>> Does anyone know what I make wrong?
>>>
>>> Best Regards,
>>> Hilmi
>>>
>>>
>> --
>> --
>> Hilmi Yildirim
>> Software Developer R&D
>>
>> T: +49 30 24627-281
>> Hilmi.Yildirim@neofonie.de
>>
>>
>> http://www.neofonie.de
>>
>> Besuchen Sie den Neo Tech Blog für Anwender:
>> http://blog.neofonie.de/
>>
>> Folgen Sie uns:
>> https://plus.google.com/+neofonie
>> http://www.linkedin.com/company/neofonie-gmbh
>> https://www.xing.com/companies/neofoniegmbh
>>
>> Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
>> Handelsregister Berlin-Charlottenburg: HRB 67460
>> Geschäftsführung: Thomas Kitlitschko
>>
>>
>
>
> --
> --
> Hilmi Yildirim
> Software Developer R&D
>
> T: +49 30 24627-281Hilmi.Yildirim@neofonie.de
> http://www.neofonie.de
>
> Besuchen Sie den Neo Tech Blog für Anwender:http://blog.neofonie.de/
>
> Folgen Sie uns:https://plus.google.com/+neofoniehttp://www.linkedin.com/company/neofonie-gmbhhttps://www.xing.com/companies/neofoniegmbh
>
> Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
> Handelsregister Berlin-Charlottenburg: HRB 67460
> Geschäftsführung: Thomas Kitlitschko
>
>
Re: HBase Connection in cluster
Posted by Hilmi Yildirim <hi...@neofonie.de>.
Where do you put the hbase-site.xml? In the resource folder of the
project or on the cluster?
Am 26.05.2015 um 14:12 schrieb Flavio Pompermaier:
> I usually put those connection params inside the hbase-site.xml that
> will be included in the generated jar..
>
> On Tue, May 26, 2015 at 2:07 PM, Hilmi Yildirim
> <hilmi.yildirim@neofonie.de <ma...@neofonie.de>> wrote:
>
> I want to add that it is strange that the client wants to
> establish a connection to localhost but I have defined another
> machine.
>
>
>
>
> Am 26.05.2015 um 14:05 schrieb Hilmi Yildirim:
>
> Hi,
> I implemented a job which reads data from HBASE with following
> code (I replaced the real address by m1.example.com
> <http://m1.example.com>)
>
> protected Scan getScanner() {
> Scan scan = new Scan();
> Configuration conf = HBaseConfiguration.create();
> conf.set("hbase.zookeeper.quorum", "m1.example.com
> <http://m1.example.com>");
> conf.set("hbase.zookeeper.property.clientPort", "2181");
>
> try {
> table = new HTable(conf, "table");
> table.getScanner(scan);
> } catch (IOException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> }
> return scan;
> }
>
>
> My code works well when I execute it local but when I execute
> deploy it on the cluster then I get following exceptions:
>
> 14:00:30,610 INFO org.apache.zookeeper.ClientCnxn
> - Opening socket connection to server
> localhost/127.0.0.1:2181 <http://127.0.0.1:2181>. Will not
> attempt to authenticate using SASL (unknown error)
> 14:00:30,610 WARN org.apache.zookeeper.ClientCnxn
> - Session 0x0 for server null, unexpected
> error, closing socket connection and attempting reconnect
> java.net.ConnectException: Verbindungsaufbau abgelehnt
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native
> Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 14:00:31,089 INFO org.apache.zookeeper.ClientCnxn
> - Opening socket connection to server
> localhost/127.0.0.1:2181 <http://127.0.0.1:2181>. Will not
> attempt to authenticate using SASL (unknown error)
> 14:00:31,089 WARN org.apache.zookeeper.ClientCnxn
> - Session 0x0 for server null, unexpected
> error, closing socket connection and attempting reconnect
> java.net.ConnectException: Verbindungsaufbau abgelehnt
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native
> Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>
>
> Does anyone know what I make wrong?
>
> Best Regards,
> Hilmi
>
>
> --
> --
> Hilmi Yildirim
> Software Developer R&D
>
> T: +49 30 24627-281 <tel:%2B49%2030%2024627-281>
> Hilmi.Yildirim@neofonie.de <ma...@neofonie.de>
>
>
> http://www.neofonie.de
>
> Besuchen Sie den Neo Tech Blog für Anwender:
> http://blog.neofonie.de/
>
> Folgen Sie uns:
> https://plus.google.com/+neofonie
> http://www.linkedin.com/company/neofonie-gmbh
> https://www.xing.com/companies/neofoniegmbh
>
> Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
> Handelsregister Berlin-Charlottenburg: HRB 67460
> Geschäftsführung: Thomas Kitlitschko
>
>
>
--
--
Hilmi Yildirim
Software Developer R&D
T: +49 30 24627-281
Hilmi.Yildirim@neofonie.de
http://www.neofonie.de
Besuchen Sie den Neo Tech Blog für Anwender:
http://blog.neofonie.de/
Folgen Sie uns:
https://plus.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
https://www.xing.com/companies/neofoniegmbh
Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Geschäftsführung: Thomas Kitlitschko
Re: HBase Connection in cluster
Posted by Flavio Pompermaier <po...@okkam.it>.
I usually put those connection params inside the hbase-site.xml that will
be included in the generated jar..
On Tue, May 26, 2015 at 2:07 PM, Hilmi Yildirim <hi...@neofonie.de>
wrote:
> I want to add that it is strange that the client wants to establish a
> connection to localhost but I have defined another machine.
>
>
>
>
> Am 26.05.2015 um 14:05 schrieb Hilmi Yildirim:
>
>> Hi,
>> I implemented a job which reads data from HBASE with following code (I
>> replaced the real address by m1.example.com)
>>
>> protected Scan getScanner() {
>> Scan scan = new Scan();
>> Configuration conf = HBaseConfiguration.create();
>> conf.set("hbase.zookeeper.quorum", "m1.example.com");
>> conf.set("hbase.zookeeper.property.clientPort", "2181");
>>
>> try {
>> table = new HTable(conf, "table");
>> table.getScanner(scan);
>> } catch (IOException e) {
>> // TODO Auto-generated catch block
>> e.printStackTrace();
>> }
>> return scan;
>> }
>>
>>
>> My code works well when I execute it local but when I execute deploy it
>> on the cluster then I get following exceptions:
>>
>> 14:00:30,610 INFO org.apache.zookeeper.ClientCnxn
>> - Opening socket connection to server localhost/127.0.0.1:2181.
>> Will not attempt to authenticate using SASL (unknown error)
>> 14:00:30,610 WARN org.apache.zookeeper.ClientCnxn
>> - Session 0x0 for server null, unexpected error, closing socket
>> connection and attempting reconnect
>> java.net.ConnectException: Verbindungsaufbau abgelehnt
>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>> at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>> at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>> 14:00:31,089 INFO org.apache.zookeeper.ClientCnxn
>> - Opening socket connection to server localhost/127.0.0.1:2181.
>> Will not attempt to authenticate using SASL (unknown error)
>> 14:00:31,089 WARN org.apache.zookeeper.ClientCnxn
>> - Session 0x0 for server null, unexpected error, closing socket
>> connection and attempting reconnect
>> java.net.ConnectException: Verbindungsaufbau abgelehnt
>> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>> at
>> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
>> at
>> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
>> at
>> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>>
>>
>> Does anyone know what I make wrong?
>>
>> Best Regards,
>> Hilmi
>>
>>
> --
> --
> Hilmi Yildirim
> Software Developer R&D
>
> T: +49 30 24627-281
> Hilmi.Yildirim@neofonie.de
>
>
> http://www.neofonie.de
>
> Besuchen Sie den Neo Tech Blog für Anwender:
> http://blog.neofonie.de/
>
> Folgen Sie uns:
> https://plus.google.com/+neofonie
> http://www.linkedin.com/company/neofonie-gmbh
> https://www.xing.com/companies/neofoniegmbh
>
> Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
> Handelsregister Berlin-Charlottenburg: HRB 67460
> Geschäftsführung: Thomas Kitlitschko
>
>
Re: HBase Connection in cluster
Posted by Hilmi Yildirim <hi...@neofonie.de>.
I want to add that it is strange that the client wants to establish a
connection to localhost but I have defined another machine.
Am 26.05.2015 um 14:05 schrieb Hilmi Yildirim:
> Hi,
> I implemented a job which reads data from HBASE with following code (I
> replaced the real address by m1.example.com)
>
> protected Scan getScanner() {
> Scan scan = new Scan();
> Configuration conf = HBaseConfiguration.create();
> conf.set("hbase.zookeeper.quorum", "m1.example.com");
> conf.set("hbase.zookeeper.property.clientPort", "2181");
>
> try {
> table = new HTable(conf, "table");
> table.getScanner(scan);
> } catch (IOException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> }
> return scan;
> }
>
>
> My code works well when I execute it local but when I execute deploy
> it on the cluster then I get following exceptions:
>
> 14:00:30,610 INFO
> org.apache.zookeeper.ClientCnxn -
> Opening socket connection to server localhost/127.0.0.1:2181. Will not
> attempt to authenticate using SASL (unknown error)
> 14:00:30,610 WARN
> org.apache.zookeeper.ClientCnxn -
> Session 0x0 for server null, unexpected error, closing socket
> connection and attempting reconnect
> java.net.ConnectException: Verbindungsaufbau abgelehnt
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
> 14:00:31,089 INFO
> org.apache.zookeeper.ClientCnxn -
> Opening socket connection to server localhost/127.0.0.1:2181. Will not
> attempt to authenticate using SASL (unknown error)
> 14:00:31,089 WARN
> org.apache.zookeeper.ClientCnxn -
> Session 0x0 for server null, unexpected error, closing socket
> connection and attempting reconnect
> java.net.ConnectException: Verbindungsaufbau abgelehnt
> at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
> at
> sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:739)
> at
> org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350)
> at
> org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1068)
>
>
> Does anyone know what I make wrong?
>
> Best Regards,
> Hilmi
>
--
--
Hilmi Yildirim
Software Developer R&D
T: +49 30 24627-281
Hilmi.Yildirim@neofonie.de
http://www.neofonie.de
Besuchen Sie den Neo Tech Blog für Anwender:
http://blog.neofonie.de/
Folgen Sie uns:
https://plus.google.com/+neofonie
http://www.linkedin.com/company/neofonie-gmbh
https://www.xing.com/companies/neofoniegmbh
Neofonie GmbH | Robert-Koch-Platz 4 | 10115 Berlin
Handelsregister Berlin-Charlottenburg: HRB 67460
Geschäftsführung: Thomas Kitlitschko