You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ambari.apache.org by "Mohammad Arshad (Jira)" <ji...@apache.org> on 2023/07/24 16:41:00 UTC

[jira] [Commented] (AMBARI-25945) Sync batch size in ambari metrics collector and ams hbase

    [ https://issues.apache.org/jira/browse/AMBARI-25945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17746530#comment-17746530 ] 

Mohammad Arshad commented on AMBARI-25945:
------------------------------------------

Thanks [~vjasani] for reviewing and merging this PR

> Sync batch size in ambari metrics collector and ams hbase
> ---------------------------------------------------------
>
>                 Key: AMBARI-25945
>                 URL: https://issues.apache.org/jira/browse/AMBARI-25945
>             Project: Ambari
>          Issue Type: Bug
>          Components: ambari-metrics
>    Affects Versions: metrics-3.0.0
>            Reporter: Mohammad Arshad
>            Assignee: Mohammad Arshad
>            Priority: Major
>             Fix For: 3.0.0
>
>         Attachments: image-2023-06-20-18-36-37-450.png
>
>          Time Spent: 20m
>  Remaining Estimate: 0h
>
> In metrics collector phoenix batch size is 10000, but in ams hbase batch size is 5000. Because of this following warning message is constantly getting logged
> {noformat}
> 2023-05-19 05:49:04,899 WARN  [RpcServer.default.FPBQ.Fifo.handler=28,queue=1,port=61320] regionserver.RSRpcServices: Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 5690 Client: ams//IP first region in multi=METRIC_RECORD_MINUTE_UUID,,1684154511984.1a0cc25ec53f3475ff282a47dc9d03b7.
> 2023-05-19 05:50:05,136 WARN  [RpcServer.default.FPBQ.Fifo.handler=21,queue=0,port=61320] regionserver.RSRpcServices: Large batch operation detected (greater than 5000) (HBASE-18023). Requested Number of Rows: 10000 Client: ams//IP first region in multi=METRIC_AGGREGATE_UUID,,1684154515075.77371e2960a2ce70bb15d223338ba893.
> {noformat}
> To fix this problem, either we should decrease phoenix batch size in collector or increase batch size in ams hbase.
> I propose to increase the batch size in ams hbase



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@ambari.apache.org
For additional commands, e-mail: issues-help@ambari.apache.org