You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Hudson (JIRA)" <ji...@apache.org> on 2018/08/14 03:29:00 UTC

[jira] [Commented] (HBASE-18633) Add more info to understand the source/scenario of large batch requests exceeding threshold

    [ https://issues.apache.org/jira/browse/HBASE-18633?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16579202#comment-16579202 ] 

Hudson commented on HBASE-18633:
--------------------------------

SUCCESS: Integrated in Jenkins build HBase-1.3-IT #450 (See [https://builds.apache.org/job/HBase-1.3-IT/450/])
HBASE-21028 Backport HBASE-18633 to branch-1.3 (vikasv: rev fe55991b8ea242bc9a460f83602753d63c8e33df)
* (edit) hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
* (edit) hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMultiLogThreshold.java


> Add more info to understand the source/scenario of large batch requests exceeding threshold
> -------------------------------------------------------------------------------------------
>
>                 Key: HBASE-18633
>                 URL: https://issues.apache.org/jira/browse/HBASE-18633
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 3.0.0, 1.4.0, 1.3.1, 2.0.0-alpha-3
>            Reporter: Vikas Vishwakarma
>            Assignee: Vikas Vishwakarma
>            Priority: Major
>             Fix For: 1.4.0, 2.0.0-alpha-3, 2.0.0
>
>         Attachments: HBASE-18633.branch-1.001.patch, HBASE-18633.master.001.patch, HBASE-18633.master.001.patch
>
>
> In our controlled test env, we are seeing frequent Large batch operation detected warnings (as implemented in HBASE-18023). 
> We are not running any client with large batch sizes on this test env, but we start seeing these warnings after some runtime. Maybe it is caused due to some error / retry scenario. Could also be related to Phoenix index updates based on surrounding activity in the logs. Need to add more info like table/region name and anything else that will enable debugging the source or the scenario in which these warnings occur. 
> 2017-08-12 03:40:33,919 WARN  [7,queue=0,port=16020] regionserver.RSRpcServices - Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7108 Client: xxx
> 2017-08-12 03:40:34,476 WARN  [7,queue=0,port=16020] regionserver.RSRpcServices - Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7096 Client: xxx
> 2017-08-12 03:40:34,483 WARN  [4,queue=0,port=16020] regionserver.RSRpcServices - Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7091 Client: xxx
> 2017-08-12 03:40:35,728 WARN  [3,queue=0,port=16020] regionserver.RSRpcServices - Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 7102 Client: xxx



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)