You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Bonsen <he...@126.com> on 2015/12/21 14:09:39 UTC
get parameters of spark-submit
1.I code my scala class and pack.(not input the hdfs files' paths,just use
the paths from "spark-submit"'s parameters)
2.Then,If I input like this:
${SPARK_HOME/bin}/spark-submit \
--master <master > \
<jar file path> \
hdfs://<xxxxxxxxx> \
hdfs://<uyyyyyyyy> \
what should I do to get the two hdfs files' paths in my scala class's
code(before pack the jar file)?
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/get-parameters-of-spark-submit-tp25749.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: get parameters of spark-submit
Posted by Jeff Zhang <zj...@gmail.com>.
don't understand your question. These parameter are passed to your program
as args of the main function.
On Mon, Dec 21, 2015 at 9:09 PM, Bonsen <he...@126.com> wrote:
> 1.I code my scala class and pack.(not input the hdfs files' paths,just use
> the paths from "spark-submit"'s parameters)
> 2.Then,If I input like this:
> ${SPARK_HOME/bin}/spark-submit \
> --master <master > \
> <jar file path> \
> hdfs://<xxxxxxxxx> \
> hdfs://<uyyyyyyyy> \
>
> what should I do to get the two hdfs files' paths in my scala class's
> code(before pack the jar file)?
>
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/get-parameters-of-spark-submit-tp25749.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>
--
Best Regards
Jeff Zhang