You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Michael Stack (Jira)" <ji...@apache.org> on 2020/09/30 16:46:00 UTC
[jira] [Resolved] (HBASE-25109) Add MR Counters to WALPlayer;
currently hard to tell if it is doing anything
[ https://issues.apache.org/jira/browse/HBASE-25109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Stack resolved HBASE-25109.
-----------------------------------
Fix Version/s: 2.4.0
2.3.3
3.0.0-alpha-1
Hadoop Flags: Reviewed
Assignee: Michael Stack
Resolution: Fixed
Pushed to branch-2.3+. Thanks for review [~huaxiangsun]
> Add MR Counters to WALPlayer; currently hard to tell if it is doing anything
> ----------------------------------------------------------------------------
>
> Key: HBASE-25109
> URL: https://issues.apache.org/jira/browse/HBASE-25109
> Project: HBase
> Issue Type: Improvement
> Reporter: Michael Stack
> Assignee: Michael Stack
> Priority: Major
> Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0
>
>
> For example, when WALPlayer runs, it emits this:
> {code:java}
> 020-09-28 11:16:05,489 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1916643172_0001_m_000000_0: Counters: 20
> File System Counters
> FILE: Number of bytes read=268891453
> FILE: Number of bytes written=1018719
> FILE: Number of read operations=0
> FILE: Number of large read operations=0
> FILE: Number of write operations=0
> Map-Reduce Framework
> Map input records=4375
> Map output records=5369
> Input split bytes=245
> Spilled Records=0
> Failed Shuffles=0
> Merged Map outputs=0
> GC time elapsed (ms)=59
> Total committed heap usage (bytes)=518979584
> File Input Format Counters
> Bytes Read=0
> File Output Format Counters
> Bytes Written=0 {code}
> Change it so it does this:
> {code:java}
> 020-09-28 11:16:05,489 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1916643172_0001_m_000000_0: Counters: 20
> File System Counters
> FILE: Number of bytes read=268891453
> FILE: Number of bytes written=1018719
> FILE: Number of read operations=0
> FILE: Number of large read operations=0
> FILE: Number of write operations=0
> Map-Reduce Framework
> Map input records=4375
> Map output records=5369
> Input split bytes=245
> Spilled Records=0
> Failed Shuffles=0
> Merged Map outputs=0
> GC time elapsed (ms)=59
> Total committed heap usage (bytes)=518979584
> org.apache.hadoop.hbase.mapreduce.WALPlayer$Counter
> CELLS_READ=89574
> CELLS_WRITTEN=89572
> DELETES=64
> PUTS=5305
> WALEDITS=4375
> File Input Format Counters
> Bytes Read=0
> File Output Format Counters
> Bytes Written=0 {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)