You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@pig.apache.org by "liyunzhang_intel (JIRA)" <ji...@apache.org> on 2016/02/15 02:30:18 UTC
[jira] [Created] (PIG-4809) Implement to collect metric data like
getSMMSpillCount() in SparkJobStats
liyunzhang_intel created PIG-4809:
-------------------------------------
Summary: Implement to collect metric data like getSMMSpillCount() in SparkJobStats
Key: PIG-4809
URL: https://issues.apache.org/jira/browse/PIG-4809
Project: Pig
Issue Type: Sub-task
Components: spark
Reporter: liyunzhang_intel
In current code, we don't implement to collect metric data in SparkJobStats like:
SparkJobStats#getSMMSpillCount:
{code}
@Override
public long getSMMSpillCount() {
throw new UnsupportedOperationException();
}
{code}
We just throw UnsupportedOperationException when this function is called.
We need implement following functions in SparkJobStats if the metric data can be collected in spark mode:
{code}
@Override
public int getNumberMaps() {
throw new UnsupportedOperationException();
}
@Override
public int getNumberReduces() {
throw new UnsupportedOperationException();
}
@Override
public long getMaxMapTime() {
throw new UnsupportedOperationException();
}
@Override
public long getMinMapTime() {
throw new UnsupportedOperationException();
}
@Override
public long getAvgMapTime() {
throw new UnsupportedOperationException();
}
@Override
public long getMaxReduceTime() {
throw new UnsupportedOperationException();
}
@Override
public long getMinReduceTime() {
throw new UnsupportedOperationException();
}
@Override
public long getAvgREduceTime() {
throw new UnsupportedOperationException();
}
@Override
public long getMapInputRecords() {
throw new UnsupportedOperationException();
}
@Override
public long getMapOutputRecords() {
throw new UnsupportedOperationException();
}
@Override
public long getReduceInputRecords() {
throw new UnsupportedOperationException();
}
@Override
public long getReduceOutputRecords() {
throw new UnsupportedOperationException();
}
@Override
public long getSMMSpillCount() {
throw new UnsupportedOperationException();
}
@Override
public long getProactiveSpillCountObjects() {
throw new UnsupportedOperationException();
}
@Override
public long getProactiveSpillCountRecs() {
throw new UnsupportedOperationException();
}
@Override
public Map<String, Long> getMultiStoreCounters() {
throw new UnsupportedOperationException();
}
@Override
public Map<String, Long> getMultiInputCounters() {
throw new UnsupportedOperationException();
}
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)