[jira] [Created] (SPARK-12346) GLM summary crashes with NoSuchElementException if attributes are missing names

["Eric Liang (JIRA)" <ji...@apache.org>]

Eric Liang created SPARK-12346:
----------------------------------

             Summary: GLM summary crashes with NoSuchElementException if attributes are missing names
                 Key: SPARK-12346
                 URL: https://issues.apache.org/jira/browse/SPARK-12346
             Project: Spark
          Issue Type: Bug
            Reporter: Eric Liang


In getModelFeatures() of SparkRWrappers.scala, we call _.name.get on all the feature column attributes. This fails when the attribute name is not defined.

One way of reproducing this is to perform glm() in R with a vector-type input feature that lacks ML attrs, then trying to call summary() on it, for example:

{code}
df <- sql(sqlContext, "SELECT * FROM testData")
df2 <- withColumnRenamed(df, "f1", "f2") // This drops the ML attrs from f1

lrModel <- glm(hours_per_week ~ f2, data = df2, family = "gaussian")
summary(lrModel) // NoSuchElementException
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org