You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Chao Wang (Jira)" <ji...@apache.org> on 2020/09/11 06:12:00 UTC

[jira] [Updated] (HBASE-25011) Swallow Throwable if catch throw other exception

     [ https://issues.apache.org/jira/browse/HBASE-25011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chao Wang updated HBASE-25011:
------------------------------
    Description: 
if this.close() throw exception,  will not explain "throw t", we will not seem actual error.As shown in the figure below. this is code in hbase master branch.

!image-2020-09-11-09-45-06-952.png!

this is log in my production environment, actual error is not printing:

2020-09-10 16:38:17,249 | INFO  | RS_OPEN_REGION-regionserve | Open aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:135)2020-09-10 16:38:17,249 | INFO  | RS_OPEN_REGION-regionserve | Open aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:135)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.hindex.server.regionserver.HIndexRegionCoprocessor loaded, priority=536870911. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870912. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor com.huawei.hadoop.hbase.backup.services.RecoveryCoprocessor loaded, priority=536870913. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | WARN  | RS_OPEN_REGION-regionserver | HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! | org.apache.ranger.authorization.hbase.HbaseUserUtilsImpl.initiailize(HbaseUserUtilsImpl.java:48)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870914. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | WARN  | RS_OPEN_REGION-regionserver | SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. | org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint.start(SecureBulkLoadEndpoint.java:75)2020-09-10 16:38:17,255 | WARN  | RS_OPEN_REGION-regionserver | Secure bulk load has been integrated into HBase core. | org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint.start(SecureBulkLoadEndpoint.java:76)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870915. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.security.access.ReadOnlyClusterEnabler loaded, priority=536870916. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.coprocessor.MetaTableMetrics loaded, priority=536870917. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | Unable to get remote Address | org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.getRemoteAddress(RangerAuthorizationCoprocessor.java:210)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | Waiting for flushes and compactions to finish for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1812)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | Total wait time for flushes and compaction for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. is: 0ms | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1848)2020-09-10 16:38:17,256 | INFO  | RS_OPEN_REGION-regionserver | Closing region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1676)2020-09-10 16:38:17,337 | WARN  | RS_OPEN_REGION-regionserver | Failed to open region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d., will report to master | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.cleanUpAndReportFailure(AssignRegionHandler.java:89)java.io.IOException: The new max sequence id 1 is less than the old max sequence id 10 at org.apache.hadoop.hbase.wal.WALSplitUtil.writeRegionSequenceIdFile(WALSplitUtil.java:413) at org.apache.hadoop.hbase.regionserver.HRegion.writeRegionCloseMarker(HRegion.java:1241) at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1781) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1594) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1540) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7484) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7429) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7401) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7359) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7310) at org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:145) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)

  was:
if this.close() throw exception,  will not explain "throw t", we will not seem actual error.As shown in the figure below. this is code in hbase master branch.

!image-2020-09-11-09-45-06-952.png!

this is log in my production environment, actual error is not printing:

2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver/node-group-1wKzN0003:16020-11 | Waiting for flushes and compactions to finish for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1812)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver/node-group-1wKzN0003:16020-11 | Waiting for flushes and compactions to finish for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1812)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver/node-group-1wKzN0003:16020-11 | Total wait time for flushes and compaction for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. is: 0ms | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1848)2020-09-10 16:38:17,256 | INFO  | RS_OPEN_REGION-regionserver/node-group-1wKzN0003:16020-11 | Closing region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1676)2020-09-10 16:38:17,337 | WARN  | RS_OPEN_REGION-regionserver/node-group-1wKzN0003:16020-11 | Failed to open region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d., will report to master | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.cleanUpAndReportFailure(AssignRegionHandler.java:89)java.io.IOException: The new max sequence id 1 is less than the old max sequence id 10 at org.apache.hadoop.hbase.wal.WALSplitUtil.writeRegionSequenceIdFile(WALSplitUtil.java:413) at org.apache.hadoop.hbase.regionserver.HRegion.writeRegionCloseMarker(HRegion.java:1241) at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1781) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1594) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1540) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7484) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7429) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7401) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7359) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7310) at org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:145) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)


> Swallow Throwable if catch throw other exception
> ------------------------------------------------
>
>                 Key: HBASE-25011
>                 URL: https://issues.apache.org/jira/browse/HBASE-25011
>             Project: HBase
>          Issue Type: Bug
>          Components: Region Assignment
>    Affects Versions: 2.2.3
>            Reporter: Chao Wang
>            Assignee: Chao Wang
>            Priority: Minor
>         Attachments: image-2020-09-11-09-45-06-952.png
>
>
> if this.close() throw exception,  will not explain "throw t", we will not seem actual error.As shown in the figure below. this is code in hbase master branch.
> !image-2020-09-11-09-45-06-952.png!
> this is log in my production environment, actual error is not printing:
> 2020-09-10 16:38:17,249 | INFO  | RS_OPEN_REGION-regionserve | Open aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:135)2020-09-10 16:38:17,249 | INFO  | RS_OPEN_REGION-regionserve | Open aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:135)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.hindex.server.regionserver.HIndexRegionCoprocessor loaded, priority=536870911. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.security.token.TokenProvider loaded, priority=536870912. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor com.huawei.hadoop.hbase.backup.services.RecoveryCoprocessor loaded, priority=536870913. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | WARN  | RS_OPEN_REGION-regionserver | HbaseUserUtilsImpl.initialize: Unexpected: initialization called more than once! | org.apache.ranger.authorization.hbase.HbaseUserUtilsImpl.initiailize(HbaseUserUtilsImpl.java:48)2020-09-10 16:38:17,254 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor loaded, priority=536870914. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,254 | WARN  | RS_OPEN_REGION-regionserver | SecureBulkLoadEndpoint is deprecated. It will be removed in future releases. | org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint.start(SecureBulkLoadEndpoint.java:75)2020-09-10 16:38:17,255 | WARN  | RS_OPEN_REGION-regionserver | Secure bulk load has been integrated into HBase core. | org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint.start(SecureBulkLoadEndpoint.java:76)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.security.access.SecureBulkLoadEndpoint loaded, priority=536870915. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.security.access.ReadOnlyClusterEnabler loaded, priority=536870916. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | System coprocessor org.apache.hadoop.hbase.coprocessor.MetaTableMetrics loaded, priority=536870917. | org.apache.hadoop.hbase.coprocessor.CoprocessorHost.loadSystemCoprocessors(CoprocessorHost.java:165)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | Unable to get remote Address | org.apache.ranger.authorization.hbase.RangerAuthorizationCoprocessor.getRemoteAddress(RangerAuthorizationCoprocessor.java:210)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | Waiting for flushes and compactions to finish for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1812)2020-09-10 16:38:17,255 | INFO  | RS_OPEN_REGION-regionserver | Total wait time for flushes and compaction for the region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. is: 0ms | org.apache.hadoop.hbase.regionserver.HRegion.waitForFlushesAndCompactions(HRegion.java:1848)2020-09-10 16:38:17,256 | INFO  | RS_OPEN_REGION-regionserver | Closing region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d. | org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1676)2020-09-10 16:38:17,337 | WARN  | RS_OPEN_REGION-regionserver | Failed to open region aes_table,,1599722342956.c05438c8c2e3ec250e8fcbf35b49694d., will report to master | org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.cleanUpAndReportFailure(AssignRegionHandler.java:89)java.io.IOException: The new max sequence id 1 is less than the old max sequence id 10 at org.apache.hadoop.hbase.wal.WALSplitUtil.writeRegionSequenceIdFile(WALSplitUtil.java:413) at org.apache.hadoop.hbase.regionserver.HRegion.writeRegionCloseMarker(HRegion.java:1241) at org.apache.hadoop.hbase.regionserver.HRegion.doClose(HRegion.java:1781) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1594) at org.apache.hadoop.hbase.regionserver.HRegion.close(HRegion.java:1540) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7484) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7429) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7401) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7359) at org.apache.hadoop.hbase.regionserver.HRegion.openHRegion(HRegion.java:7310) at org.apache.hadoop.hbase.regionserver.handler.AssignRegionHandler.process(AssignRegionHandler.java:145) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:104) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748)



--
This message was sent by Atlassian Jira
(v8.3.4#803005)