You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Mubarak Seyed (Created) (JIRA)" <ji...@apache.org> on 2012/03/29 20:06:22 UTC
[jira] [Created] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Create table fails if we keep refreshing master's UI for task monitor status
----------------------------------------------------------------------------
Key: HBASE-5675
URL: https://issues.apache.org/jira/browse/HBASE-5675
Project: HBase
Issue Type: Bug
Components: master
Affects Versions: 0.90.4
Reporter: Mubarak Seyed
I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
{code}
table_ACreating table table_A
java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
at com.test.tools.hbase.schema.main(schema.java:627)
Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
at java.util.SubList.checkForComodification(AbstractList.java:752)
at java.util.SubList.add(AbstractList.java:632)
at java.util.SubList.add(AbstractList.java:633)
at java.util.SubList.add(AbstractList.java:633)
..
..
at java.util.SubList.add(AbstractList.java:633)
at java.util.AbstractList.add(AbstractList.java:91)
at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
at $Proxy5.createTable(Unknown Source)
at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Mubarak Seyed (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mubarak Seyed updated HBASE-5675:
---------------------------------
Affects Version/s: 0.94.0
0.92.0
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0, 0.94.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Jonathan Hsieh (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh updated HBASE-5675:
----------------------------------
Affects Version/s: (was: 0.94.0)
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241866#comment-13241866 ]
Jonathan Hsieh commented on HBASE-5675:
---------------------------------------
The fix was in HBASE-5535 and in the 0.94 branch and above. I'll mark this issue as duplicate, and get it added into the issues to fix in CDH.
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0, 0.94.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Mubarak Seyed (Assigned) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mubarak Seyed reassigned HBASE-5675:
------------------------------------
Assignee: Mubarak Seyed
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241938#comment-13241938 ]
Jonathan Hsieh commented on HBASE-5675:
---------------------------------------
I took a closer look and HBASE-5535 doesn't seem to really add any new synchronization help on the tasks list. Another related patch is a part of HBASE-4057; investigating further.
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Jonathan Hsieh (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jonathan Hsieh resolved HBASE-5675.
-----------------------------------
Resolution: Duplicate
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "stack (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241518#comment-13241518 ]
stack commented on HBASE-5675:
------------------------------
This is still an issue then?
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0, 0.94.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Jonathan Hsieh (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241955#comment-13241955 ]
Jonathan Hsieh commented on HBASE-5675:
---------------------------------------
Mubarak, found it -- the fix is actually HBASE-4386, fixed in 0.92/0.94/trunk (and CDH3u3).
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Mubarak Seyed (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241877#comment-13241877 ]
Mubarak Seyed commented on HBASE-5675:
--------------------------------------
Thanks Jon.
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Lars Hofhansl (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241477#comment-13241477 ]
Lars Hofhansl commented on HBASE-5675:
--------------------------------------
TaskMonitor does not seem exist in 0.90.x.
In 0.92.x it is properly synchronized - although the synchronization was changed in 0.94+ (unnecessarily IMHO).
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Mubarak Seyed (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241513#comment-13241513 ]
Mubarak Seyed commented on HBASE-5675:
--------------------------------------
@Lars
CDH3u2 backports distributed log splitting to 0.90.x branch and task monitor stuff as well. I have verified the code
{code}
public List<StoreFile> close(final boolean abort) throws IOException {
// Only allow one thread to close at a time. Serialize them so dual
// threads attempting to close will run up against each other.
MonitoredTask status = TaskMonitor.get().createStatus(
"Closing region " + this +
(abort ? " due to abort" : ""));
status.setStatus("Waiting for close lock");
try {
synchronized (closeLock) {
return doClose(abort, status);
}
} finally {
status.cleanup();
}
}
{code}
It is affected in 0.92 and above i believe. Thanks.
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0, 0.94.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Andrew Purtell (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241531#comment-13241531 ]
Andrew Purtell commented on HBASE-5675:
---------------------------------------
We saw this CME in our internal distro but solved it by bringing forward TaskMonitor to the latest in 0.92.
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4, 0.92.0, 0.94.0
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5675) Create table fails if we keep
refreshing master's UI for task monitor status
Posted by "Mubarak Seyed (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5675?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13241471#comment-13241471 ]
Mubarak Seyed commented on HBASE-5675:
--------------------------------------
I could create a table using workarounds
# Increase the RPC timeout value to 10 minutes
# Create one table at a time
# No refresh of master's web UI
> Create table fails if we keep refreshing master's UI for task monitor status
> ----------------------------------------------------------------------------
>
> Key: HBASE-5675
> URL: https://issues.apache.org/jira/browse/HBASE-5675
> Project: HBase
> Issue Type: Bug
> Components: master
> Affects Versions: 0.90.4
> Reporter: Mubarak Seyed
> Assignee: Mubarak Seyed
> Labels: noob
>
> I tried to create a table with 2K pre-split regions, region assignment was in middle and i was keep refreshing master's web UI to find the status of the task using task monitor, table creation was failed and {{META}} was showing 2K regions with server location value is {{null}} and regions weren't deployed onto region-servers.
> {code}
> table_ACreating table table_A
> java.io.IOException: java.io.IOException: java.util.ConcurrentModificationException
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
> at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:39)
> at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:95)
> at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:79)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:384)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTable(HBaseAdmin.java:294)
> at com.test.tools.hbase.schema.createIfNotExists(schema.java:520)
> at com.test.tools.hbase.schema.main(schema.java:627)
> Caused by: org.apache.hadoop.ipc.RemoteException: java.io.IOException: java.util.ConcurrentModificationException
> at java.util.SubList.checkForComodification(AbstractList.java:752)
> at java.util.SubList.add(AbstractList.java:632)
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.SubList.add(AbstractList.java:633)
> ..
> ..
> at java.util.SubList.add(AbstractList.java:633)
> at java.util.AbstractList.add(AbstractList.java:91)
> at org.apache.hadoop.hbase.monitoring.TaskMonitor.createStatus(TaskMonitor.java:76)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:510)
> at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:490)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:853)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:813)
> at org.apache.hadoop.hbase.master.HMaster.createTable(HMaster.java:780)
> at sun.reflect.GeneratedMethodAccessor27.invoke(Unknown Source)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Server.call(HBaseRPC.java:570)
> at org.apache.hadoop.hbase.ipc.HBaseServer$Handler.run(HBaseServer.java:1039)
> at org.apache.hadoop.hbase.ipc.HBaseClient.call(HBaseClient.java:771)
> at org.apache.hadoop.hbase.ipc.HBaseRPC$Invoker.invoke(HBaseRPC.java:257)
> at $Proxy5.createTable(Unknown Source)
> at org.apache.hadoop.hbase.client.HBaseAdmin.createTableAsync(HBaseAdmin.java:382)
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira