You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by klrmowse <kl...@gmail.com> on 2018/03/16 15:12:11 UTC
Spark 2.x Core: .setMaster(local[*]) output is different from
spark-submit
when i run a job with .setMaster(local[*]), the output is as expected...
but when i run it using YARN (single node, pseudo-distributed hdfs) via
spark-submit, the output is fudged - instead of key-value pairs, it only
shows one value preceded by a comma, and the rest are blank
what am i missing?
thanks in advance
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org
Re: Spark 2.x Core: .setMaster(local[*]) output is different from
spark-submit
Posted by klrmowse <kl...@gmail.com>.
for clarification...
.saveAsTextFile(rdd) writes to local fs, but not hdfs
anyone?
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org