You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Apache Spark (Jira)" <ji...@apache.org> on 2021/08/31 10:12:00 UTC

[jira] [Commented] (SPARK-35624) Support reading inputbytes and inputrecords of the stage int spark context interface

    [ https://issues.apache.org/jira/browse/SPARK-35624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17407213#comment-17407213 ] 

Apache Spark commented on SPARK-35624:
--------------------------------------

User 'allendang001' has created a pull request for this issue:
https://github.com/apache/spark/pull/33874

> Support reading inputbytes and inputrecords of the stage int spark context interface 
> -------------------------------------------------------------------------------------
>
>                 Key: SPARK-35624
>                 URL: https://issues.apache.org/jira/browse/SPARK-35624
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.2.0
>            Reporter: allendang
>            Priority: Major
>
> One of our projects needs to count the amount of data scanned and the number of scanned data rows during the execution of sparksql statements, but the current version of spark does not provide an interface to view these data, so I want to obtain this type of data through the spark context interface



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org