[GitHub] [spark] yijiacui-db edited a comment on pull request #31944: [SPARK-34297][SQL] Expose source metrics API and Add Kafka metrics to report delay.

[GitBox <gi...@apache.org>]

yijiacui-db edited a comment on pull request #31944:
URL: https://github.com/apache/spark/pull/31944#issuecomment-805278090


   > hi @yijiacui-db, thanks for working on this. I'm still working on this and related API. The community has an agreement ([SPARK-34366](https://issues.apache.org/jira/browse/SPARK-34366), PR #31476) on metric API for data source. Next step I will implement the API at data source including kafka data source. If you are interested in this work, welcome to help review the work later. Thanks.
   
   Hi @viirya, this pull request exposes the backlog metrics to end-user through streaming query progress, not the metrics in the Spark UI.  I think it makes sense to combine both of them to expose metrics at different levels. Sorry I used your jira number because I thought that's the jira number I should use. I can make another jira to track this work if you perfer.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org