You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "yashwanth (JIRA)" <ji...@apache.org> on 2019/04/08 15:32:00 UTC

[jira] [Created] (SPARK-27408) functions.coalesce working on csv but not on Mongospark

yashwanth created SPARK-27408:
---------------------------------

             Summary: functions.coalesce working on csv but not on Mongospark
                 Key: SPARK-27408
                 URL: https://issues.apache.org/jira/browse/SPARK-27408
             Project: Spark
          Issue Type: Bug
          Components: Java API
    Affects Versions: 2.2.0
            Reporter: yashwanth


e1.csv
 
id,code,type
1,,A
2,,
3,123,I
 

e2.csv

id,code,type
1,456,A
2,789,A1
3,,C


 Dataset<Row> goldenCopy = e1.as("a").join(e2.as("b")).where("a.id == b.id");
	    goldenCopy.select(functions.coalesce(e1.col("code"),e2.col("code"))).show();

I can't able to run the above code on dataset got from mongo-spark, I had imported same csv files into mongodb using mongoimport .
 
refer stackoverflow 
https://stackoverflow.com/questions/55570984/spark-functions-coalesce-not-working-on-mongodb-collections-but-works-on-csvs




--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org