You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Tom White (Created) (JIRA)" <ji...@apache.org> on 2012/02/22 22:55:48 UTC
[jira] [Created] (WHIRR-525) Upgrade to HBase 0.92.0
Upgrade to HBase 0.92.0
-----------------------
Key: WHIRR-525
URL: https://issues.apache.org/jira/browse/WHIRR-525
Project: Whirr
Issue Type: Improvement
Components: service/hbase
Reporter: Tom White
We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13221375#comment-13221375 ]
Tom White commented on WHIRR-525:
---------------------------------
That's odd, it worked when I ran it. I'll try it again.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431975#comment-13431975 ]
Andrew Bayer commented on WHIRR-525:
------------------------------------
That is true. I think Tom needs to handle that, though.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225572#comment-13225572 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
Re-testing now on a better connection.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430591#comment-13430591 ]
Andrew Bayer commented on WHIRR-525:
------------------------------------
I just saw the timing issue with the CDH HBase test as well, due to ZK not being up yet in this case.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432833#comment-13432833 ]
Andrew Bayer commented on WHIRR-525:
------------------------------------
Verified that all tests pass with the old (June 1) 0.92.2 RC, so I think we're best just committing this, doc'ing the issue, and bumping to 0.92.2 as soon as it's out.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Assignee: Andrew Bayer
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225884#comment-13225884 ]
Tom White commented on WHIRR-525:
---------------------------------
I opened WHIRR-552 and attached the logs from a failed attempt there. HBase experts feel free to take a look!
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216953#comment-13216953 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
Looks good but I don't think it's a good idea to remove the integration tests for 0.89 and 0.90 as long as those version are still relevant. What if we create a subproject just with the old tests? (to be able to use the previous thrift API)
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13433487#comment-13433487 ]
Tom White commented on WHIRR-525:
---------------------------------
> we're best just committing this, doc'ing the issue, and bumping to 0.92.2 as soon as it's out.
I agree. It could be a while before 0.92.2 comes out. So +1 to committing now. Do you want to add a sentence to src/site/xdoc/known-limitations.xml?
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Assignee: Andrew Bayer
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-525:
----------------------------
Attachment: WHIRR-525.patch
This patch upgrades HBase to 0.92.0. Tests for 0.89 and 0.90 have been removed since the Thrift API changed, however these versions will still work since the HBase service code is unchanged.
I ran HBase and CDH HBase integration tests successfully.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-525:
------------------------------
Fix Version/s: (was: 0.7.2)
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Bayer updated WHIRR-525:
-------------------------------
Attachment: WHIRR-525.patch
Latest patch removes some defunct test properties files from services/hbase.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Assignee: Andrew Bayer
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217644#comment-13217644 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
+1
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Bayer updated WHIRR-525:
-------------------------------
Attachment: WHIRR-525-zk-retry.patch
New version of ZK retry patch that also re-enables the CDH HBase live test.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-525:
----------------------------
Attachment: WHIRR-525.patch
Thanks for the review Andrei. Here's a new patch which includes integration tests for 0.90.5 in a separate Maven module. I didn't include 0.89 since it isn't available from the mirrors any more (http://www.apache.org/dyn/closer.cgi/hbase/).
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225881#comment-13225881 ]
Tom White commented on WHIRR-525:
---------------------------------
I managed to reproduce this once, and looking at the logs it appears that the region server failed to start:
{noformat}
2012-03-09 05:17:47,116 INFO org.apache.hadoop.hbase.util.RetryCounter: The 3 times to retry after sleeping 8000 ms
2012-03-09 05:17:48,126 INFO org.apache.zookeeper.ClientCnxn: Opening socket connection to server domU-12-31-39-02-BC-72.compute-1.internal/10.248.195.128:2181
2012-03-09 05:17:48,127 INFO org.apache.zookeeper.ClientCnxn: Socket connection established to domU-12-31-39-02-BC-72.compute-1.internal/10.248.195.128:2181, initiating
session
2012-03-09 05:17:48,133 WARN org.apache.zookeeper.ClientCnxnSocket: Connected to an old server; r-o mode will be unavailable
2012-03-09 05:17:48,133 INFO org.apache.zookeeper.ClientCnxn: Session establishment complete on server domU-12-31-39-02-BC-72.compute-1.internal/10.248.195.128:2181, se
ssionid = 0x135f5e431c50002, negotiated timeout = 40000
2012-03-09 05:17:58,136 INFO org.apache.hadoop.ipc.HBaseServer: Stopping server on 60020
2012-03-09 05:17:58,140 FATAL org.apache.hadoop.hbase.regionserver.HRegionServer: ABORTING region server domU-12-31-39-03-B9-B2.compute-1.internal,60020,1331270241403:
Initialization of RS failed. Hence aborting RS.
java.io.IOException: Received the shutdown message while waiting.
at org.apache.hadoop.hbase.regionserver.HRegionServer.blockAndCheckIfStopped(HRegionServer.java:587)
at org.apache.hadoop.hbase.regionserver.HRegionServer.initializeZooKeeper(HRegionServer.java:556)
at org.apache.hadoop.hbase.regionserver.HRegionServer.preRegistrationInitialization(HRegionServer.java:524)
at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:625)
at java.lang.Thread.run(Thread.java:636)
{noformat}
The odd thing is that I can't issue an {{ruok}} to the ZK node from within the cluster (it connects but returns nothing), whereas I get {{imok}} from outside.
This is a sporadic failure which seems to be 0.92 related, so I'm inclined to commit this and have a follow up JIRA to fix it. What do you think? (Having this in will help progress WHIRR-391 since there is overlap in some of the cdh refactoring I'm doing there.)
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225240#comment-13225240 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
I have change form 0.92.0-SNAPSHOT to 0.92.0 (as available on Maven Central) and seems to be working as expected.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-525:
----------------------------
Attachment: WHIRR-525.patch
On retrying I had the same problem, so I updated the patch so as to not use the Apache archive, and the integration test passed.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225124#comment-13225124 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
Now I'm getting:
{noformat}
[ERROR] Failed to execute goal on project whirr-hbase: Could not resolve dependencies for project org.apache.whirr:whirr-hbase:bundle:0.8.0-SNAPSHOT: Failed to collect dependencies for [org.apache.whirr:whirr-core:jar:0.8.0-SNAPSHOT (compile), org.apache.whirr:whirr-core:jar:tests:0.8.0-SNAPSHOT (test), org.apache.whirr:whirr-hadoop:jar:0.8.0-SNAPSHOT (compile), org.apache.whirr:whirr-zookeeper:jar:0.8.0-SNAPSHOT (compile), junit:junit:jar:4.8.1 (test), org.hamcrest:hamcrest-all:jar:1.1 (test), commons-configuration:commons-configuration:jar:1.7 (compile), org.slf4j:slf4j-api:jar:1.6.3 (compile), org.slf4j:slf4j-log4j12:jar:1.6.3 (test), com.jcraft:jsch:jar:0.1.44-1 (compile), log4j:log4j:jar:1.2.16 (test), org.apache.zookeeper:zookeeper:jar:3.3.1 (test), dnsjava:dnsjava:jar:2.1.1 (compile), org.apache.hadoop:hadoop-core:jar:0.20.205.0 (test), org.apache.hbase:hbase:jar:0.92.0-SNAPSHOT (test), org.apache.hbase:hbase:jar:tests:0.92.0-SNAPSHOT (test)]: Failed to read artifact descriptor for org.apache.hbase:hbase:jar:0.92.0-SNAPSHOT: Could not transfer artifact org.apache.hbase:hbase:pom:0.92.0-SNAPSHOT from/to cloudera (https://repository.cloudera.com/content/repositories/releases/): Error transferring file: Server returned HTTP response code: 409 for URL: https://repository.cloudera.com/content/repositories/releases/org/apache/hbase/hbase/0.92.0-SNAPSHOT/hbase-0.92.0-SNAPSHOT.pom -> [Help 1]
{noformat}
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Adrian Cole (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13431962#comment-13431962 ]
Adrian Cole commented on WHIRR-525:
-----------------------------------
The original patch needs to be recut.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Bayer updated WHIRR-525:
-------------------------------
Attachment: WHIRR-525-zk-retry.patch
This patch is to be added alongside the existing WHIRR-525.patch - even if WHIRR-525.patch isn't added, we need this one for CDH4 HBase to actually work properly, and it shouldn't have any compatibility issues with <0.92 versions of HBase.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525-zk-retry.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Tom White (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tom White updated WHIRR-525:
----------------------------
Attachment: WHIRR-525.patch
I've updated the patch to HBase 0.92.0 (from SNAPSHOT) and it compiles and passes the integration test for me. Andrei, are you OK with this going in now?
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13430603#comment-13430603 ]
Andrew Bayer commented on WHIRR-525:
------------------------------------
Looks like the ZK issue is that "hbase.zookeeper.recoverable.waittime" is no longer used in HBase 0.92. Instead, we need to set and bump "zookeeper.recovery.retry" to greater than the default 3. I'm trying with 20 now, but will probably boost that further.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280407#comment-13280407 ]
Karel Vervaeke commented on WHIRR-525:
--------------------------------------
The top 3 most likely culprits are (IMO):
- DNS issue
- firewall issue
- Timing issue.
My money's on timing issue.
What instance-templates are you using? Does occur in single-node cluster or also when using multiple nodes?
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218691#comment-13218691 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
I've tried a few times to run this but always seems to get stuck after the following log lines:
{noformat}
2012-02-29 01:19:06,150 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for master...
.Warning: Permanently added 'ec2-107-21-87-208.compute-1.amazonaws.com,107.21.87.208' (RSA) to the list of known hosts.
..2012-02-29 01:19:09,749 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Connected to thrift server.
2012-02-29 01:19:09,749 INFO [org.apache.whirr.service.hbase.integration.HBaseServiceController] (main) Waiting for .META. table...
{noformat}
Any ideas?
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-525:
------------------------------
Fix Version/s: 0.7.2
0.8.0
Adding on the roadmap for 0.8.0 & 0.7.2 - we need to find a way to make the deployment reliable.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0, 0.7.2
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Bayer resolved WHIRR-525.
--------------------------------
Resolution: Fixed
Committed, with note in known_limitations.xml.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Assignee: Andrew Bayer
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrew Bayer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13432829#comment-13432829 ]
Andrew Bayer commented on WHIRR-525:
------------------------------------
0.94 would require yet more code-changes, so I'm trying an old RC of 0.92.2 to see if that works.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Assignee: Andrew Bayer
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525-zk-retry.patch, WHIRR-525-zk-retry.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218413#comment-13218413 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
I'm going to commit this now.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Amandeep Khurana (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280414#comment-13280414 ]
Amandeep Khurana commented on WHIRR-525:
----------------------------------------
It's a timing issue. I looked at the RS logs. They died because the master wasn't up. Started them manually and HBase came up fine.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Fix For: 0.8.0
>
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225240#comment-13225240 ]
Andrei Savu edited comment on WHIRR-525 at 3/8/12 5:13 PM:
-----------------------------------------------------------
I have changed from 0.92.0-SNAPSHOT to 0.92.0 (as available on Maven Central) and seems to be building as expected. I still have some issues with running integration tests on aws-ec2 but I guess this is happening because I'm on a slow connection.
was (Author: savu.andrei):
I have change form 0.92.0-SNAPSHOT to 0.92.0 (as available on Maven Central) and seems to be working as expected.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-525) Upgrade to HBase 0.92.0
Posted by "Andrei Savu (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13225633#comment-13225633 ]
Andrei Savu commented on WHIRR-525:
-----------------------------------
Still stuck for me at "Waiting for .META. table..." - Can someone else test this patch? I will check the logs tomorrow.
> Upgrade to HBase 0.92.0
> -----------------------
>
> Key: WHIRR-525
> URL: https://issues.apache.org/jira/browse/WHIRR-525
> Project: Whirr
> Issue Type: Improvement
> Components: service/hbase
> Reporter: Tom White
> Attachments: WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch, WHIRR-525.patch
>
>
> We should support HBase 0.92. The integration test will need changing since the Thrift inteface has changed between HBase 0.90 and 0.92.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira