You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Weiqiang Zhuang (JIRA)" <ji...@apache.org> on 2018/09/11 22:57:00 UTC
[jira] [Commented] (SPARK-24572) "eager execution" for R shell, IDE
[ https://issues.apache.org/jira/browse/SPARK-24572?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16611357#comment-16611357 ]
Weiqiang Zhuang commented on SPARK-24572:
-----------------------------------------
[~felixcheung] are you thinking of using the same config introduced by the SPARK-24215 and doing something like below in red?
{code:java}
setMethod("show", "SparkDataFrame",
function(object) {
if (identical(sparkR.conf("spark.sql.repl.eagerEval.enabled", "false")[[1]], "true")) {
return(showDF(object))
}
cols <- lapply(dtypes(object), function(l) {
paste(l, collapse = ":")
})
s <- paste(cols, collapse = ", ")
cat(paste(class(object), "[", s, "]\n", sep = ""))
})
{code}
> "eager execution" for R shell, IDE
> ----------------------------------
>
> Key: SPARK-24572
> URL: https://issues.apache.org/jira/browse/SPARK-24572
> Project: Spark
> Issue Type: Bug
> Components: SparkR
> Affects Versions: 2.4.0
> Reporter: Felix Cheung
> Priority: Major
>
> like python in SPARK-24215
> we could also have eager execution when SparkDataFrame is returned to the R shell
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org