You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Evgeny SInelnikov (JIRA)" <ji...@apache.org> on 2015/07/07 13:12:04 UTC
[jira] [Comment Edited] (SPARK-8840) Float type coercion with
hiveContext
[ https://issues.apache.org/jira/browse/SPARK-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14616528#comment-14616528 ]
Evgeny SInelnikov edited comment on SPARK-8840 at 7/7/15 11:11 AM:
-------------------------------------------------------------------
No, this work in R (sparkR shell from spark distribution):
https://spark.apache.org/docs/latest/sparkr.html
{code}
# spark/bin/sparkR
R version 3.1.3 (2015-03-09) -- "Smooth Sidewalk"
Copyright (C) 2015 The R Foundation for Statistical Computing
Platform: x86_64-redhat-linux-gnu (64-bit)
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
Natural language support but running in an English locale
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
{code}
was (Author: esinelnikov):
No, this work in R (sparkR shell from spark distribution):
{code}
# spark/bin/sparkR
R version 3.1.3 (2015-03-09) -- "Smooth Sidewalk"
Copyright (C) 2015 The R Foundation for Statistical Computing
Platform: x86_64-redhat-linux-gnu (64-bit)
R is free software and comes with ABSOLUTELY NO WARRANTY.
You are welcome to redistribute it under certain conditions.
Type 'license()' or 'licence()' for distribution details.
Natural language support but running in an English locale
R is a collaborative project with many contributors.
Type 'contributors()' for more information and
'citation()' on how to cite R or R packages in publications.
Type 'demo()' for some demos, 'help()' for on-line help, or
'help.start()' for an HTML browser interface to help.
Type 'q()' to quit R.
{code}
> Float type coercion with hiveContext
> ------------------------------------
>
> Key: SPARK-8840
> URL: https://issues.apache.org/jira/browse/SPARK-8840
> Project: Spark
> Issue Type: Bug
> Components: SparkR
> Affects Versions: 1.4.0
> Reporter: Evgeny SInelnikov
>
> Problem with +float+ type coercion on SparkR with hiveContext.
> {code}
> > result <- sql(hiveContext, "SELECT offset, percentage from data limit 100")
> > show(result)
> DataFrame[offset:float, percentage:float]
> > head(result)
> Error in as.data.frame.default(x[[i]], optional = TRUE) :
> cannot coerce class ""jobj"" to a data.frame
> {code}
> This trouble looks like already exists (SPARK-2863 - Emulate Hive type
> coercion in native reimplementations of Hive functions) with same
> reason - not completed "native reimplementations of Hive..." not
> "...functions" only.
> I used spark 1.4.0 binaries from official site:
> http://spark.apache.org/downloads.html
> And running it on:
> * Hortonworks HDP 2.2.0.0-2041
> * with Hive 0.14
> * with disabled hooks for Application Timeline Servers (ATSHook) in hive-site.xml, commented:
> ** hive.exec.failure.hooks,
> ** hive.exec.post.hooks,
> ** hive.exec.pre.hooks.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org