[GitHub] [hudi] yihua commented on a diff in pull request #6350: [HUDI-4610] Document list of metrics emitted by Hudi

[GitBox <gi...@apache.org>]

yihua commented on code in PR #6350:
URL: https://github.com/apache/hudi/pull/6350#discussion_r964197328


##########
website/docs/metrics.md:
##########
@@ -201,3 +201,32 @@ These `HoodieMetrics` can then be plotted on a standard tool like grafana. Below
 <figure>
     <img className="docimage" src={require("/assets/images/hudi_commit_duration.png").default} alt="hudi_commit_duration.png"  />
 </figure>
+
+## List of metrics:
+
+The below metrics are available in all timeline operations that involves a commit such as deltacommit, compaction, clustering and rollback.
+
+Name  |  Description
+--- | ---
+commitFreshnessInMs | Milliseconds from the commit end time and the maximum event time of the incoming records
+commitLatencyInMs | Milliseconds from the commit end time and the minimum event time of incoming records
+commitTime  | Time of commit in epoch milliseconds
+duration  | Total time taken for the commit/rollback in milliseconds
+numFilesDeleted | Number of files deleted during a clean/rollback
+numFilesFinalized | Number of files finalized in a write
+totalBytesWritten | Bytes written in a HoodieCommit
+totalCompactedRecordsUpdated  | Number of records updated in a compaction operation
+totalCreateTime | Time taken for file creation during a Hoodie Insert operation
+totalFilesInsert  | Number of newly written files in a HoodieCommit
+totalFilesUpdate  | Number of files updated in a HoodieCommit
+totalInsertRecordsWritten | Number of records inserted or converted to updates(for small file handling) in a HoodieCommit

Review Comment:
   @yesemsanthoshkumar could you clarify what this means: `converted to updates(for small file handling)`?  I assume the small file handling of parquet files only considers inserts.



-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org