[GitHub] [hudi] nsivabalan commented on issue #6984: [SUPPORT] hudi metrics with flink so little

[GitBox <gi...@apache.org>]

nsivabalan commented on issue #6984:
URL: https://github.com/apache/hudi/issues/6984#issuecomment-1286433720

   we do expose lot of metrics. not sure, what exactly are you looking for. For instance, you see should below set of metrics. 
   for regular commits:
   ```
         Metrics.registerGauge(getMetricsName(actionType, "totalPartitionsWritten"), totalPartitionsWritten);
         Metrics.registerGauge(getMetricsName(actionType, "totalFilesInsert"), totalFilesInsert);
         Metrics.registerGauge(getMetricsName(actionType, "totalFilesUpdate"), totalFilesUpdate);
         Metrics.registerGauge(getMetricsName(actionType, "totalRecordsWritten"), totalRecordsWritten);
         Metrics.registerGauge(getMetricsName(actionType, "totalUpdateRecordsWritten"), totalUpdateRecordsWritten);
         Metrics.registerGauge(getMetricsName(actionType, "totalInsertRecordsWritten"), totalInsertRecordsWritten);
         Metrics.registerGauge(getMetricsName(actionType, "totalBytesWritten"), totalBytesWritten);
         Metrics.registerGauge(getMetricsName(actionType, "totalScanTime"), totalTimeTakenByScanner);
         Metrics.registerGauge(getMetricsName(actionType, "totalCreateTime"), totalTimeTakenForInsert);
         Metrics.registerGauge(getMetricsName(actionType, "totalUpsertTime"), totalTimeTakenForUpsert);
         Metrics.registerGauge(getMetricsName(actionType, "totalCompactedRecordsUpdated"), totalCompactedRecordsUpdated);
         Metrics.registerGauge(getMetricsName(actionType, "totalLogFilesCompacted"), totalLogFilesCompacted);
         Metrics.registerGauge(getMetricsName(actionType, "totalLogFilesSize"), totalLogFilesSize);
   ```
   commitTime, duration, commitLatencyInMs. 
   Just that these are not categorized based on operation type. 
   
   @bhasudha : we should add a new page listing out all metrics exposed by hudi. 
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org