You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Michael Stack (Jira)" <ji...@apache.org> on 2020/09/28 18:19:00 UTC
[jira] [Updated] (HBASE-25109) Add MR Counters to WALPlayer;
currently hard to tell if it is doing anything
[ https://issues.apache.org/jira/browse/HBASE-25109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Michael Stack updated HBASE-25109:
----------------------------------
Description:
For example, when WALPlayer runs, it emits this:
{code:java}
020-09-28 11:16:05,489 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1916643172_0001_m_000000_0: Counters: 20
File System Counters
FILE: Number of bytes read=268891453
FILE: Number of bytes written=1018719
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=4375
Map output records=5369
Input split bytes=245
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=59
Total committed heap usage (bytes)=518979584
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0 {code}
Change it so it does this:
{code:java}
020-09-28 11:16:05,489 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1916643172_0001_m_000000_0: Counters: 20
File System Counters
FILE: Number of bytes read=268891453
FILE: Number of bytes written=1018719
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
Map-Reduce Framework
Map input records=4375
Map output records=5369
Input split bytes=245
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=59
Total committed heap usage (bytes)=518979584
org.apache.hadoop.hbase.mapreduce.WALPlayer$Counter
CELLS_READ=89574
CELLS_WRITTEN=89572
DELETES=64
PUTS=5305
WALEDITS=4375
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0 {code}
> Add MR Counters to WALPlayer; currently hard to tell if it is doing anything
> ----------------------------------------------------------------------------
>
> Key: HBASE-25109
> URL: https://issues.apache.org/jira/browse/HBASE-25109
> Project: HBase
> Issue Type: Improvement
> Reporter: Michael Stack
> Priority: Major
>
> For example, when WALPlayer runs, it emits this:
> {code:java}
> 020-09-28 11:16:05,489 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1916643172_0001_m_000000_0: Counters: 20
> File System Counters
> FILE: Number of bytes read=268891453
> FILE: Number of bytes written=1018719
> FILE: Number of read operations=0
> FILE: Number of large read operations=0
> FILE: Number of write operations=0
> Map-Reduce Framework
> Map input records=4375
> Map output records=5369
> Input split bytes=245
> Spilled Records=0
> Failed Shuffles=0
> Merged Map outputs=0
> GC time elapsed (ms)=59
> Total committed heap usage (bytes)=518979584
> File Input Format Counters
> Bytes Read=0
> File Output Format Counters
> Bytes Written=0 {code}
> Change it so it does this:
> {code:java}
> 020-09-28 11:16:05,489 INFO [LocalJobRunner Map Task Executor #0] mapred.Task: Final Counters for attempt_local1916643172_0001_m_000000_0: Counters: 20
> File System Counters
> FILE: Number of bytes read=268891453
> FILE: Number of bytes written=1018719
> FILE: Number of read operations=0
> FILE: Number of large read operations=0
> FILE: Number of write operations=0
> Map-Reduce Framework
> Map input records=4375
> Map output records=5369
> Input split bytes=245
> Spilled Records=0
> Failed Shuffles=0
> Merged Map outputs=0
> GC time elapsed (ms)=59
> Total committed heap usage (bytes)=518979584
> org.apache.hadoop.hbase.mapreduce.WALPlayer$Counter
> CELLS_READ=89574
> CELLS_WRITTEN=89572
> DELETES=64
> PUTS=5305
> WALEDITS=4375
> File Input Format Counters
> Bytes Read=0
> File Output Format Counters
> Bytes Written=0 {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)