You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Itsuki Toyota (Jira)" <ji...@apache.org> on 2020/07/24 12:04:00 UTC

[jira] [Created] (SPARK-32428) [EXAMPLES] Make BinaryClassificationMetricsExample consistently print the metrics on driver's stdout

Itsuki Toyota created SPARK-32428:
-------------------------------------

             Summary: [EXAMPLES] Make BinaryClassificationMetricsExample consistently print the metrics on driver's stdout
                 Key: SPARK-32428
                 URL: https://issues.apache.org/jira/browse/SPARK-32428
             Project: Spark
          Issue Type: Improvement
          Components: Examples
    Affects Versions: 3.0.0, 2.4.6
            Reporter: Itsuki Toyota


Some RDDs in this example (e.g., precision, recall) call println without calling collect.
If the job is under local mode, it sends the data to the driver node and prints the metrics on the driver's stdout.
However if the job is under cluster mode, the job prints the metrics on the executor's stdout.
It seems inconsistent compared to the other metrics nothing to do with RDD (e.g., auPRC, auROC) since these metrics always output the result on the driver's stdout.
All of the metrics should output its result on the driver's stdout.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org