You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Henry JunYoung KIM <he...@gmail.com> on 2012/09/05 13:35:25 UTC

cannot create a table having a snappy compression algorithm in mac os x.

Hi, hbase users.

I have a problem to create a table with a snappy algorithm in Mac OS X (lion).

I am sure that there is a snappy jar file in $HBASE_HOME/lib, but, it couldn't create it without errors.

environment : 
	hbase vesion : 0.92.1
	distribution mode : pseudo-distributed (1 master, 1 region-server)

region server log : 
	2012-09-05 20:28:11,882 ERROR org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler: Failed open of region=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.
	java.io.IOException: Compression algorithm 'snappy' previously failed test.
		at org.apache.hadoop.hbase.util.CompressionTest.testCompression(CompressionTest.java:78)
		at org.apache.hadoop.hbase.regionserver.HRegion.checkCompressionCodecs(HRegion.java:3237)
		at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3226)
		at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:3176)
		at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.openRegion(OpenRegionHandler.java:331)
		at org.apache.hadoop.hbase.regionserver.handler.OpenRegionHandler.process(OpenRegionHandler.java:107)
		at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
		at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
		at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
		at java.lang.Thread.run(Thread.java:680)

master log : 
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Found an existing plan for STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. destination server is 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing plan for region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.; plan=hri=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783., src=, dest=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Assigning region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,569 DEBUG org.apache.hadoop.hbase.master.ServerManager: New connection to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,570 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_OPENING, server=192.168.162.80,60020,1346843417187, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=RS_ZK_REGION_FAILED_OPEN, server=192.168.162.80,60020,1346843417187, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.handler.ClosedRegionHandler: Handling CLOSED event for 1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Forcing OFFLINE; was=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. state=CLOSED, ts=1346844678571, server=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,571 DEBUG org.apache.hadoop.hbase.zookeeper.ZKAssign: master:60000-0x139961fb9f00000 Creating (or updating) unassigned node for 1fa032ecf18ef9d194cc619f0205f783 with OFFLINE state
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Handling transition=M_ZK_REGION_OFFLINE, server=192.168.162.80,60000,1346843415199, region=1fa032ecf18ef9d194cc619f0205f783
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Found an existing plan for STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. destination server is 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Using pre-existing plan for region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783.; plan=hri=STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783., src=, dest=192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.AssignmentManager: Assigning region STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,572 DEBUG org.apache.hadoop.hbase.master.ServerManager: New connection to 192.168.162.80,60020,1346843417187
2012-09-05 20:31:18,575 ERROR org.apache.hadoop.hbase.master.AssignmentManager: Failed assignment in: 192.168.162.80,60020,1346843417187 due to org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. ,which we are already trying to OPEN.
org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. ,which we are already trying to OPEN.
	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
	at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
	at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
	at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1624)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1329)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1304)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1299)
	at org.apache.hadoop.hbase.master.handler.ClosedRegionHandler.process(ClosedRegionHandler.java:102)
	at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:169)
	at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
	at java.lang.Thread.run(Thread.java:680)
Caused by: org.apache.hadoop.ipc.RemoteException: org.apache.hadoop.hbase.regionserver.RegionAlreadyInTransitionException: Received:OPEN for the region:STORAGE_TEST,,1346844467727.1fa032ecf18ef9d194cc619f0205f783. ,which we are already trying to OPEN.
	at org.apache.hadoop.hbase.regionserver.HRegionServer.checkIfRegionInTransition(HRegionServer.java:2479)
	at org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:2437)
	at sun.reflect.GeneratedMethodAccessor20.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
	at java.lang.reflect.Method.invoke(Method.java:597)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Server.call(WritableRpcEngine.java:364)
	at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1326)

	at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:918)
	at org.apache.hadoop.hbase.ipc.WritableRpcEngine$Invoker.invoke(WritableRpcEngine.java:150)
	at $Proxy10.openRegion(Unknown Source)
	at org.apache.hadoop.hbase.master.ServerManager.sendRegionOpen(ServerManager.java:435)
	at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1592)
	... 8 more


Would you share your experiences with this situation ?