You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@knox.apache.org by prateek arora <pr...@gmail.com> on 2015/05/23 01:01:11 UTC
some times my curl command hang ( Added More Information )
Hi
I am trying to create a table in hbase using knox gateway :
curl -v -ik -u guest:guest-password -H "Accept: text/xml" -H
"Content-Type: text/xml" -d '<?xml version="1.0"
encoding="UTF-8"?><TableSchema name="table1"><ColumnSchema
name="family1"/><ColumnSchema name="family2"/></TableSchema>' -X PUT '
https://localhost:8443/gateway/sandbox/hbase/table1/schema'
always 2 tables was created successfully but when I try to create third
table its hang and restart of gateway service is required.
This scenario only occur during creation of table in hbase.
output of curl ( when hang occur)
* Hostname was NOT found in DNS cache
* Trying 192.168.44.98...
* Connected to master (192.168.44.98) port 8443 (#0)
* successfully set certificate verify locations:
* CAfile: none
CApath: /etc/ssl/certs
* SSLv3, TLS handshake, Client hello (1):
* SSLv3, TLS handshake, Server hello (2):
* SSLv3, TLS handshake, CERT (11):
* SSLv3, TLS handshake, Server key exchange (12):
* SSLv3, TLS handshake, Server finished (14):
* SSLv3, TLS handshake, Client key exchange (16):
* SSLv3, TLS change cipher, Client hello (1):
* SSLv3, TLS handshake, Finished (20):
* SSLv3, TLS change cipher, Client hello (1):
* SSLv3, TLS handshake, Finished (20):
* SSL connection using ECDHE-RSA-AES256-SHA384
* Server certificate:
* subject: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
* start date: 2015-05-21 23:50:29 GMT
* expire date: 2016-05-20 23:50:29 GMT
* issuer: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
* SSL certificate verify result: self signed certificate (18),
continuing anyway.
* Server auth using Basic with user 'admin'
> PUT /gateway/sandbox/hbase/table10/schema HTTP/1.1
> Authorization: Basic YWRtaW46YWRtaW4tcGFzc3dvcmQ=
> User-Agent: curl/7.35.0
> Host: master:8443
> Accept: application/json
> Content-Type: application/json
> Content-Length: 52
>
* upload completely sent off: 52 out of 52 bytes
Gateway log:
2015-05-22 15:46:51,589 INFO realm.AuthorizingRealm
(AuthorizingRealm.java:getAuthorizationCacheLazy(248)) - No cache or
cacheManager properties have been set. Authorization cache cannot be
obtained.
2015-05-22 15:46:51,592 DEBUG hadoop.gateway
(UrlRewriteProcessor.java:rewrite(155)) - Rewrote URL:
https://localhost:8443/gateway/sandbox/hbase/table15/schema, direction: IN
via implicit rule: WEBHBASE/webhbase/path/inbound to URL:
http://192.168.44.98:20550/table15/schema
2015-05-22 15:46:51,593 DEBUG hadoop.gateway
(DefaultDispatch.java:executeOutboundRequest(109)) - Dispatch request: PUT
http://192.168.44.98:20550/table15/schema?user.name=guest
2015-05-22 15:46:51,594 DEBUG protocol.RequestAddCookies
(RequestAddCookies.java:process(122)) - CookieSpec selected: best-match
2015-05-22 15:46:51,595 DEBUG protocol.RequestAuthCache
(RequestAuthCache.java:process(75)) - Auth cache not set in the context
2015-05-22 15:46:51,595 DEBUG conn.PoolingHttpClientConnectionManager
(PoolingHttpClientConnectionManager.java:requestConnection(219)) -
Connection request: [route: {}->http://192.168.44.98:20550][total kept
alive: 0; route allocated: 2 of 2; total allocated: 2 of 20]
*I think gateway tries to establish connection with Hadoop service but
number of route allocation reach to max limit “route allocated: 2 of 2 “so
its hang. So may be previous hbase commands not releasing there
connection.*
Please help me to solve this problem.
Regards
Prateek
Re: some times my curl command hang ( Added More Information )
Posted by larry mccay <lm...@apache.org>.
Hi Prateek -
This sounds like a bug.
Can you file a jira for this, please.
We will need to reproduce and determine the root cause and hopefully
provide a fix for you.
thank!
--larry
On Fri, May 22, 2015 at 7:01 PM, prateek arora <pr...@gmail.com>
wrote:
> Hi
>
>
>
>
>
> I am trying to create a table in hbase using knox gateway :
>
>
>
> curl -v -ik -u guest:guest-password -H "Accept: text/xml" -H
> "Content-Type: text/xml" -d '<?xml version="1.0"
> encoding="UTF-8"?><TableSchema name="table1"><ColumnSchema
> name="family1"/><ColumnSchema name="family2"/></TableSchema>' -X PUT '
> https://localhost:8443/gateway/sandbox/hbase/table1/schema'
>
>
>
> always 2 tables was created successfully but when I try to create third
> table its hang and restart of gateway service is required.
>
> This scenario only occur during creation of table in hbase.
>
>
>
>
>
> output of curl ( when hang occur)
>
>
>
> * Hostname was NOT found in DNS cache
>
> * Trying 192.168.44.98...
>
> * Connected to master (192.168.44.98) port 8443 (#0)
>
> * successfully set certificate verify locations:
>
> * CAfile: none
>
> CApath: /etc/ssl/certs
>
> * SSLv3, TLS handshake, Client hello (1):
>
> * SSLv3, TLS handshake, Server hello (2):
>
> * SSLv3, TLS handshake, CERT (11):
>
> * SSLv3, TLS handshake, Server key exchange (12):
>
> * SSLv3, TLS handshake, Server finished (14):
>
> * SSLv3, TLS handshake, Client key exchange (16):
>
> * SSLv3, TLS change cipher, Client hello (1):
>
> * SSLv3, TLS handshake, Finished (20):
>
> * SSLv3, TLS change cipher, Client hello (1):
>
> * SSLv3, TLS handshake, Finished (20):
>
> * SSL connection using ECDHE-RSA-AES256-SHA384
>
> * Server certificate:
>
> * subject: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
>
> * start date: 2015-05-21 23:50:29 GMT
>
> * expire date: 2016-05-20 23:50:29 GMT
>
> * issuer: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
>
> * SSL certificate verify result: self signed certificate (18),
> continuing anyway.
>
> * Server auth using Basic with user 'admin'
>
> > PUT /gateway/sandbox/hbase/table10/schema HTTP/1.1
>
> > Authorization: Basic YWRtaW46YWRtaW4tcGFzc3dvcmQ=
>
> > User-Agent: curl/7.35.0
>
> > Host: master:8443
>
> > Accept: application/json
>
> > Content-Type: application/json
>
> > Content-Length: 52
>
> >
>
> * upload completely sent off: 52 out of 52 bytes
>
>
>
>
>
> Gateway log:
>
>
>
> 2015-05-22 15:46:51,589 INFO realm.AuthorizingRealm
> (AuthorizingRealm.java:getAuthorizationCacheLazy(248)) - No cache or
> cacheManager properties have been set. Authorization cache cannot be
> obtained.
>
> 2015-05-22 15:46:51,592 DEBUG hadoop.gateway
> (UrlRewriteProcessor.java:rewrite(155)) - Rewrote URL:
> https://localhost:8443/gateway/sandbox/hbase/table15/schema, direction:
> IN via implicit rule: WEBHBASE/webhbase/path/inbound to URL:
> http://192.168.44.98:20550/table15/schema
>
> 2015-05-22 15:46:51,593 DEBUG hadoop.gateway
> (DefaultDispatch.java:executeOutboundRequest(109)) - Dispatch request: PUT
> http://192.168.44.98:20550/table15/schema?user.name=guest
>
> 2015-05-22 15:46:51,594 DEBUG protocol.RequestAddCookies
> (RequestAddCookies.java:process(122)) - CookieSpec selected: best-match
>
> 2015-05-22 15:46:51,595 DEBUG protocol.RequestAuthCache
> (RequestAuthCache.java:process(75)) - Auth cache not set in the context
>
> 2015-05-22 15:46:51,595 DEBUG conn.PoolingHttpClientConnectionManager
> (PoolingHttpClientConnectionManager.java:requestConnection(219)) -
> Connection request: [route: {}->http://192.168.44.98:20550][total kept
> alive: 0; route allocated: 2 of 2; total allocated: 2 of 20]
>
>
>
>
>
>
>
> *I think gateway tries to establish connection with Hadoop service but
> number of route allocation reach to max limit “route allocated: 2 of 2 “so
> its hang. So may be previous hbase commands not releasing there
> connection.*
>
>
>
>
>
>
>
> Please help me to solve this problem.
>
>
>
> Regards
>
> Prateek
>
>
>
Re: some times my curl command hang ( Added More Information )
Posted by prateek arora <pr...@gmail.com>.
Hi
I am using knox 0.6.0.
As per https://issues.apache.org/jira/browse/KNOX-546 "this scenario is
only true in a secure cluster setup."
I am not using secure cluster setup. so not sure this will solved my
scenario or not.
I observed one more thing hang will happen during creation of hbase table
and putting a data inside that.
same functionality is working fine with older knox version 0.5.1.
can i report this as a bug?
if yes then please let me know the steps to report as a bug.
Regards
prateek
On Fri, May 22, 2015 at 4:55 PM, Sumit Gupta <su...@hortonworks.com>
wrote:
> Hi Prateek,
>
> I didn’t catch which version of Knox you are using. Assuming you are
> using 0.6.0 please take a look at
> https://issues.apache.org/jira/browse/KNOX-546 as it may resolve your
> issue. This fix is not yet in a release but if you want to try it out you
> can build from the 0.6.0 branch source or master.
>
> HTH,
> Sumit.
>
>
> From: prateek arora <pr...@gmail.com>
> Reply-To: "user@knox.apache.org" <us...@knox.apache.org>
> Date: Friday, May 22, 2015 at 7:01 PM
> To: "user@knox.apache.org" <us...@knox.apache.org>, "
> user-help@knox.apache.org" <us...@knox.apache.org>
> Subject: some times my curl command hang ( Added More Information )
>
> Hi
>
>
>
>
>
> I am trying to create a table in hbase using knox gateway :
>
>
>
> curl -v -ik -u guest:guest-password -H "Accept: text/xml" -H
> "Content-Type: text/xml" -d '<?xml version="1.0"
> encoding="UTF-8"?><TableSchema name="table1"><ColumnSchema
> name="family1"/><ColumnSchema name="family2"/></TableSchema>' -X PUT '
> https://localhost:8443/gateway/sandbox/hbase/table1/schema'
>
>
>
> always 2 tables was created successfully but when I try to create third
> table its hang and restart of gateway service is required.
>
> This scenario only occur during creation of table in hbase.
>
>
>
>
>
> output of curl ( when hang occur)
>
>
>
> * Hostname was NOT found in DNS cache
>
> * Trying 192.168.44.98...
>
> * Connected to master (192.168.44.98) port 8443 (#0)
>
> * successfully set certificate verify locations:
>
> * CAfile: none
>
> CApath: /etc/ssl/certs
>
> * SSLv3, TLS handshake, Client hello (1):
>
> * SSLv3, TLS handshake, Server hello (2):
>
> * SSLv3, TLS handshake, CERT (11):
>
> * SSLv3, TLS handshake, Server key exchange (12):
>
> * SSLv3, TLS handshake, Server finished (14):
>
> * SSLv3, TLS handshake, Client key exchange (16):
>
> * SSLv3, TLS change cipher, Client hello (1):
>
> * SSLv3, TLS handshake, Finished (20):
>
> * SSLv3, TLS change cipher, Client hello (1):
>
> * SSLv3, TLS handshake, Finished (20):
>
> * SSL connection using ECDHE-RSA-AES256-SHA384
>
> * Server certificate:
>
> * subject: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
>
> * start date: 2015-05-21 23:50:29 GMT
>
> * expire date: 2016-05-20 23:50:29 GMT
>
> * issuer: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
>
> * SSL certificate verify result: self signed certificate (18),
> continuing anyway.
>
> * Server auth using Basic with user 'admin'
>
> > PUT /gateway/sandbox/hbase/table10/schema HTTP/1.1
>
> > Authorization: Basic YWRtaW46YWRtaW4tcGFzc3dvcmQ=
>
> > User-Agent: curl/7.35.0
>
> > Host: master:8443
>
> > Accept: application/json
>
> > Content-Type: application/json
>
> > Content-Length: 52
>
> >
>
> * upload completely sent off: 52 out of 52 bytes
>
>
>
>
>
> Gateway log:
>
>
>
> 2015-05-22 15:46:51,589 INFO realm.AuthorizingRealm
> (AuthorizingRealm.java:getAuthorizationCacheLazy(248)) - No cache or
> cacheManager properties have been set. Authorization cache cannot be
> obtained.
>
> 2015-05-22 15:46:51,592 DEBUG hadoop.gateway
> (UrlRewriteProcessor.java:rewrite(155)) - Rewrote URL:
> https://localhost:8443/gateway/sandbox/hbase/table15/schema, direction:
> IN via implicit rule: WEBHBASE/webhbase/path/inbound to URL:
> http://192.168.44.98:20550/table15/schema
>
> 2015-05-22 15:46:51,593 DEBUG hadoop.gateway
> (DefaultDispatch.java:executeOutboundRequest(109)) - Dispatch request: PUT
> http://192.168.44.98:20550/table15/schema?user.name=guest
>
> 2015-05-22 15:46:51,594 DEBUG protocol.RequestAddCookies
> (RequestAddCookies.java:process(122)) - CookieSpec selected: best-match
>
> 2015-05-22 15:46:51,595 DEBUG protocol.RequestAuthCache
> (RequestAuthCache.java:process(75)) - Auth cache not set in the context
>
> 2015-05-22 15:46:51,595 DEBUG conn.PoolingHttpClientConnectionManager
> (PoolingHttpClientConnectionManager.java:requestConnection(219)) -
> Connection request: [route: {}->http://192.168.44.98:20550][total kept
> alive: 0; route allocated: 2 of 2; total allocated: 2 of 20]
>
>
>
>
>
>
>
> *I think gateway tries to establish connection with Hadoop service but
> number of route allocation reach to max limit “route allocated: 2 of 2 “so
> its hang. So may be previous hbase commands not releasing there
> connection.*
>
>
>
>
>
>
>
> Please help me to solve this problem.
>
>
>
> Regards
>
> Prateek
>
>
>
Re: some times my curl command hang ( Added More Information )
Posted by Sumit Gupta <su...@hortonworks.com>.
Hi Prateek,
I didn't catch which version of Knox you are using. Assuming you are using 0.6.0 please take a look at https://issues.apache.org/jira/browse/KNOX-546 as it may resolve your issue. This fix is not yet in a release but if you want to try it out you can build from the 0.6.0 branch source or master.
HTH,
Sumit.
From: prateek arora <pr...@gmail.com>>
Reply-To: "user@knox.apache.org<ma...@knox.apache.org>" <us...@knox.apache.org>>
Date: Friday, May 22, 2015 at 7:01 PM
To: "user@knox.apache.org<ma...@knox.apache.org>" <us...@knox.apache.org>>, "user-help@knox.apache.org<ma...@knox.apache.org>" <us...@knox.apache.org>>
Subject: some times my curl command hang ( Added More Information )
Hi
I am trying to create a table in hbase using knox gateway :
curl -v -ik -u guest:guest-password -H "Accept: text/xml" -H "Content-Type: text/xml" -d '<?xml version="1.0" encoding="UTF-8"?><TableSchema name="table1"><ColumnSchema name="family1"/><ColumnSchema name="family2"/></TableSchema>' -X PUT 'https://localhost:8443/gateway/sandbox/hbase/table1/schema'
always 2 tables was created successfully but when I try to create third table its hang and restart of gateway service is required.
This scenario only occur during creation of table in hbase.
output of curl ( when hang occur)
* Hostname was NOT found in DNS cache
* Trying 192.168.44.98...
* Connected to master (192.168.44.98) port 8443 (#0)
* successfully set certificate verify locations:
* CAfile: none
CApath: /etc/ssl/certs
* SSLv3, TLS handshake, Client hello (1):
* SSLv3, TLS handshake, Server hello (2):
* SSLv3, TLS handshake, CERT (11):
* SSLv3, TLS handshake, Server key exchange (12):
* SSLv3, TLS handshake, Server finished (14):
* SSLv3, TLS handshake, Client key exchange (16):
* SSLv3, TLS change cipher, Client hello (1):
* SSLv3, TLS handshake, Finished (20):
* SSLv3, TLS change cipher, Client hello (1):
* SSLv3, TLS handshake, Finished (20):
* SSL connection using ECDHE-RSA-AES256-SHA384
* Server certificate:
* subject: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
* start date: 2015-05-21 23:50:29 GMT
* expire date: 2016-05-20 23:50:29 GMT
* issuer: C=US; ST=Test; L=Test; O=Hadoop; OU=Test; CN=localhost
* SSL certificate verify result: self signed certificate (18), continuing anyway.
* Server auth using Basic with user 'admin'
> PUT /gateway/sandbox/hbase/table10/schema HTTP/1.1
> Authorization: Basic YWRtaW46YWRtaW4tcGFzc3dvcmQ=
> User-Agent: curl/7.35.0
> Host: master:8443
> Accept: application/json
> Content-Type: application/json
> Content-Length: 52
>
* upload completely sent off: 52 out of 52 bytes
Gateway log:
2015-05-22 15:46:51,589 INFO realm.AuthorizingRealm (AuthorizingRealm.java:getAuthorizationCacheLazy(248)) - No cache or cacheManager properties have been set. Authorization cache cannot be obtained.
2015-05-22 15:46:51,592 DEBUG hadoop.gateway (UrlRewriteProcessor.java:rewrite(155)) - Rewrote URL: https://localhost:8443/gateway/sandbox/hbase/table15/schema, direction: IN via implicit rule: WEBHBASE/webhbase/path/inbound to URL: http://192.168.44.98:20550/table15/schema
2015-05-22 15:46:51,593 DEBUG hadoop.gateway (DefaultDispatch.java:executeOutboundRequest(109)) - Dispatch request: PUT http://192.168.44.98:20550/table15/schema?user.name=guest
2015-05-22 15:46:51,594 DEBUG protocol.RequestAddCookies (RequestAddCookies.java:process(122)) - CookieSpec selected: best-match
2015-05-22 15:46:51,595 DEBUG protocol.RequestAuthCache (RequestAuthCache.java:process(75)) - Auth cache not set in the context
2015-05-22 15:46:51,595 DEBUG conn.PoolingHttpClientConnectionManager (PoolingHttpClientConnectionManager.java:requestConnection(219)) - Connection request: [route: {}->http://192.168.44.98:20550][total kept alive: 0; route allocated: 2 of 2; total allocated: 2 of 20]
I think gateway tries to establish connection with Hadoop service but number of route allocation reach to max limit "route allocated: 2 of 2 "so its hang. So may be previous hbase commands not releasing there connection.
Please help me to solve this problem.
Regards
Prateek