You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Joe Crobak (JIRA)" <ji...@apache.org> on 2012/09/18 22:19:07 UTC
[jira] [Created] (HIVE-3482) Add support for S3 FileSystemCounters
to MapRedStats
Joe Crobak created HIVE-3482:
--------------------------------
Summary: Add support for S3 FileSystemCounters to MapRedStats
Key: HIVE-3482
URL: https://issues.apache.org/jira/browse/HIVE-3482
Project: Hive
Issue Type: Improvement
Components: CLI
Affects Versions: 0.9.0
Reporter: Joe Crobak
Priority: Minor
When I run a Hive query on data in S3, it'd be nice if the output included filesystem counters for S3, too. e.g., I'm envisioning a few more columns:
{noformat}
Job 0: Map: 14 Reduce: 1 Cumulative CPU: 491.7 sec HDFS Read: 3714 S3N Read: 1051000000 HDFS Write: 29 SUCCESS
{noformat}
rather than
{noformat}
Job 0: Map: 14 Reduce: 1 Cumulative CPU: 491.7 sec HDFS Read: 3714 HDFS Write: 29 SUCCESS
{noformat}
This shouldn't require a new setting -- but rather a would only output the counters for which there was a non-null value. And it wouldn't report on FILES_BYTES_READ/WRITTEN.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira