You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Rahul Singhal <Ra...@guavus.com> on 2014/06/08 01:08:09 UTC

Dumping Metics on HDFS

Hi All,

I am running spark applications in yarn-cluster mode and need to read the spark application metrics even after the application is over. I was planning to use the csv sink, but it seems that codehale's CsvReporter only supports dumping metrics to local filesystem.

Any suggestions to navigate around this limitation would be helpful.

Thanks,
Rahul Singhal