[jira] [Commented] (LIVY-569) BinaryClassificationMetrics give AttributeError

["Yiheng Wang (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LIVY-569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16964538#comment-16964538 ] 

Yiheng Wang commented on LIVY-569:
----------------------------------


From the comments of the stack overflow question, it looks like it's related with AWS EMR Livy. Are you also using the AWS EMR livy?

> BinaryClassificationMetrics give AttributeError
> -----------------------------------------------
>
>                 Key: LIVY-569
>                 URL: https://issues.apache.org/jira/browse/LIVY-569
>             Project: Livy
>          Issue Type: Bug
>            Reporter: Fred de Gier
>            Priority: Major
>
> When using the BinaryClassificationMetrics there is an error, possible related to conversion of data types. This only occurs when using Sparkmagic and Livy.
> *Input:*
> {code:java}
> from pyspark import SparkContext 
>  from pyspark.sql import SparkSession 
>  import pyspark
>  from pyspark.mllib.evaluation import BinaryClassificationMetrics
> a = sc.parallelize([
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), (0.0, 1.0), 
>  (0.0, 1.0), (0.0, 1.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), 
>  (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0), (0.0, 0.0)
>  ])
> metrics = BinaryClassificationMetrics(a)
> {code}
>  
> *Output:*
> {code:java}
> 'StructField' object has no attribute '_get_object_id' {code}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)