You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Yu Ishikawa (JIRA)" <ji...@apache.org> on 2015/06/19 02:45:00 UTC
[jira] [Comment Edited] (SPARK-8431) Add in operator to DataFrame
Column in SparkR
[ https://issues.apache.org/jira/browse/SPARK-8431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592803#comment-14592803 ]
Yu Ishikawa edited comment on SPARK-8431 at 6/19/15 12:44 AM:
--------------------------------------------------------------
Hi [~shivaram] and [~davies], thank you for your comment.
In {{sql/core/src/main/scala/org/apache/spark/sql/Column.scala}}, I implemented the {{in}} operation in Scala like below. However I don't know What Java class the parameter {{Any*}} is.
https://github.com/apache/spark/pull/6824/files#diff-ac415c903887e49486ba542a65eec980R624
{noformat}
def in(list: Any*): Column = In(expr, list.map(lit(_).expr))
{noformat}
Umm, should we add a wrapper method like below to call by SparkR?
{noformat}
def in(list: List[Any]): Column = in(list:_*)
{noformat}
was (Author: yuu.ishikawa@gmail.com):
Hi [~shivaram] and [~davies], thank you for your comment.
In {{sql/core/src/main/scala/org/apache/spark/sql/Column.scala}}, I implemented the {{in}} operation like below. However I don't know What Java class the parameter {{Any*}} is.
https://github.com/apache/spark/pull/6824/files#diff-ac415c903887e49486ba542a65eec980R624
{noformat}
def in(list: Any*): Column = In(expr, list.map(lit(_).expr))
{noformat}
Umm, should we add a wrapper method like below to call by SparkR?
{noformat}
def in(list: List[Any]): Column = in(list:_*)
{noformat}
> Add in operator to DataFrame Column in SparkR
> ---------------------------------------------
>
> Key: SPARK-8431
> URL: https://issues.apache.org/jira/browse/SPARK-8431
> Project: Spark
> Issue Type: New Feature
> Components: SparkR, SQL
> Reporter: Yu Ishikawa
>
> To filter values in a set, we should add {{%in%}} operation into SparkR.
> {noformat}
> df$a %in% c(1, 2, 3)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org