You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@livy.apache.org by "Yiheng Wang (Jira)" <ji...@apache.org> on 2019/10/30 10:06:00 UTC
[jira] [Comment Edited] (LIVY-569) BinaryClassificationMetrics give
AttributeError
[ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16962882#comment-16962882 ]
Yiheng Wang edited comment on LIVY-569 at 10/30/19 10:05 AM:
-------------------------------------------------------------
Hi, which version of spark/livy are you using. I cannot reproduce this error.
was (Author: yihengw):
Hi, which version of spark/livy are you using. I cannot reproduce this error. Please check the attachment.
!屏幕快照 2019-10-30 下午6.03.04.png!
> BinaryClassificationMetrics give AttributeError
> -----------------------------------------------
>
> Key: LIVY-569
> URL: https://issues.apache.org/jira/browse/LIVY-569
> Project: Livy
> Issue Type: Bug
> Reporter: Fred de Gier
> Priority: Major
>
> When using the BinaryClassificationMetrics there is an error, possible related to conversion of data types. This only occurs when using Sparkmagic and Livy.
> *Input:*
> {code:java}
> from pyspark import SparkContext
> from pyspark.sql import SparkSession
> import pyspark
> from pyspark.mllib.evaluation import BinaryClassificationMetrics
> a = sc.parallelize([
> (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
> (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0),
> (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
> (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0),
> (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
> ])
> metrics = BinaryClassificationMetrics(a)
> {code}
>
> *Output:*
> {code:java}
> 'StructField' object has no attribute '_get_object_id' {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)