[jira] [Resolved] (SPARK-27408) functions.coalesce working on csv but not on Mongospark

["Hyukjin Kwon (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-27408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hyukjin Kwon resolved SPARK-27408.
----------------------------------
    Resolution: Invalid

Sounds like the issue is specific to mongo-spark 

> functions.coalesce working on csv but not on Mongospark
> -------------------------------------------------------
>
>                 Key: SPARK-27408
>                 URL: https://issues.apache.org/jira/browse/SPARK-27408
>             Project: Spark
>          Issue Type: Bug
>          Components: Java API
>    Affects Versions: 2.2.0
>            Reporter: yashwanth
>            Priority: Minor
>
> e1.csv
>  
> id,code,type
> 1,,A
> 2,,
> 3,123,I
>  
> e2.csv
> id,code,type
> 1,456,A
> 2,789,A1
> 3,,C
>  Dataset<Row> goldenCopy = e1.as("a").join(e2.as("b")).where("a.id == b.id");
> 	    goldenCopy.select(functions.coalesce(e1.col("code"),e2.col("code"))).show();
> I can't able to run the above code on dataset got from mongo-spark, I had imported same csv files into mongodb using mongoimport .
>  
> refer stackoverflow 
> https://stackoverflow.com/questions/55570984/spark-functions-coalesce-not-working-on-mongodb-collections-but-works-on-csvs



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org