You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Evgeny SInelnikov (JIRA)" <ji...@apache.org> on 2015/07/06 14:46:04 UTC

[jira] [Created] (SPARK-8840) Float type coercion with hiveContext

Evgeny SInelnikov created SPARK-8840:
----------------------------------------

             Summary: Float type coercion with hiveContext
                 Key: SPARK-8840
                 URL: https://issues.apache.org/jira/browse/SPARK-8840
             Project: Spark
          Issue Type: Bug
          Components: SparkR
    Affects Versions: 1.4.0
            Reporter: Evgeny SInelnikov


Problem with +float+ type coercion on SparkR with hiveContext.

{code}
> result <- sql(hiveContext, "SELECT offset, percentage from data limit 100")
> show(result)
DataFrame[offset:float, percentage:float]
> head(result)
Error in as.data.frame.default(x[[i]], optional = TRUE) :
    cannot coerce class ""jobj"" to a data.frame
{code}

This trouble looks like already exists (SPARK-2863 - Emulate Hive type
coercion in native reimplementations of Hive functions) with same
reason - not completed "native reimplementations of Hive..." not
"...functions" only.

I used spark 1.4.0 binaries from official site:
http://spark.apache.org/downloads.html
And running it on:
* Hortonworks HDP 2.2.0.0-2041
* with Hive 0.14
* with disabled hooks for Application Timeline Servers (ATSHook) in hive-site.xml, commented:
** hive.exec.failure.hooks,
** hive.exec.post.hooks,
** hive.exec.pre.hooks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org