[jira] [Commented] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

["Apache Spark (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-12346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15059710#comment-15059710 ] 

Apache Spark commented on SPARK-12346:
--------------------------------------

User 'ericl' has created a pull request for this issue:
https://github.com/apache/spark/pull/10323

> GLM summary crashes with NoSuchElementException if attributes are missing names
> -------------------------------------------------------------------------------
>
>                 Key: SPARK-12346
>                 URL: https://issues.apache.org/jira/browse/SPARK-12346
>             Project: Spark
>          Issue Type: Bug
>            Reporter: Eric Liang
>
> In getModelFeatures() of SparkRWrappers.scala, we call _.name.get on all the feature column attributes. This fails when the attribute name is not defined.
> One way of reproducing this is to perform glm() in R with a vector-type input feature that lacks ML attrs, then trying to call summary() on it, for example:
> {code}
> df <- sql(sqlContext, "SELECT * FROM testData")
> df2 <- withColumnRenamed(df, "f1", "f2") // This drops the ML attrs from f1
> lrModel <- glm(hours_per_week ~ f2, data = df2, family = "gaussian")
> summary(lrModel) // NoSuchElementException
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org