You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "yashwanth (JIRA)" <ji...@apache.org> on 2019/04/08 15:32:00 UTC
[jira] [Created] (SPARK-27408) functions.coalesce working on csv
but not on Mongospark
yashwanth created SPARK-27408:
---------------------------------
Summary: functions.coalesce working on csv but not on Mongospark
Key: SPARK-27408
URL: https://issues.apache.org/jira/browse/SPARK-27408
Project: Spark
Issue Type: Bug
Components: Java API
Affects Versions: 2.2.0
Reporter: yashwanth
e1.csv
id,code,type
1,,A
2,,
3,123,I
e2.csv
id,code,type
1,456,A
2,789,A1
3,,C
Dataset<Row> goldenCopy = e1.as("a").join(e2.as("b")).where("a.id == b.id");
goldenCopy.select(functions.coalesce(e1.col("code"),e2.col("code"))).show();
I can't able to run the above code on dataset got from mongo-spark, I had imported same csv files into mongodb using mongoimport .
refer stackoverflow
https://stackoverflow.com/questions/55570984/spark-functions-coalesce-not-working-on-mongodb-collections-but-works-on-csvs
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org