You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Itsuki Toyota (Jira)" <ji...@apache.org> on 2020/07/24 12:04:00 UTC
[jira] [Created] (SPARK-32428) [EXAMPLES] Make
BinaryClassificationMetricsExample consistently print the metrics on
driver's stdout
Itsuki Toyota created SPARK-32428:
-------------------------------------
Summary: [EXAMPLES] Make BinaryClassificationMetricsExample consistently print the metrics on driver's stdout
Key: SPARK-32428
URL: https://issues.apache.org/jira/browse/SPARK-32428
Project: Spark
Issue Type: Improvement
Components: Examples
Affects Versions: 3.0.0, 2.4.6
Reporter: Itsuki Toyota
Some RDDs in this example (e.g., precision, recall) call println without calling collect.
If the job is under local mode, it sends the data to the driver node and prints the metrics on the driver's stdout.
However if the job is under cluster mode, the job prints the metrics on the executor's stdout.
It seems inconsistent compared to the other metrics nothing to do with RDD (e.g., auPRC, auROC) since these metrics always output the result on the driver's stdout.
All of the metrics should output its result on the driver's stdout.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org