You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bahir.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2016/07/12 23:00:24 UTC
[jira] [Commented] (BAHIR-22) Add script to run examples
[ https://issues.apache.org/jira/browse/BAHIR-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373880#comment-15373880 ]
ASF subversion and git services commented on BAHIR-22:
------------------------------------------------------
Commit 61f5592e4bd334a6c4c39cae2229dce53ee66535 in bahir's branch refs/heads/master from [~ckadner]
[ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=61f5592 ]
[BAHIR-22] add shell script to run examples
Apache Spark has a convenience script ./bin/run-example to allow users to
quickly run the pre-packaged examples without having to compose a long(ish)
spark-submit command.
The JavaDoc of most examples refers to that ./bin/run-example script
in their description of how to run that example.
This adds a similar convenience script to the Apache Bahir project in order
to keep consistent with existing (Apache Spark) documentation and to
(at least initially) hide additional complexities of the spark-submit command.
Example:
./bin/run-example \
org.apache.spark.examples.streaming.akka.ActorWordCount localhost 9999
...translates to this spark-submit command:
${SPARK_HOME}/bin/spark-submit \
--packages org.apache.bahir:spark-streaming-akka_2.11:2.0.0-SNAPSHOT \
--class org.apache.spark.examples.streaming.akka.ActorWordCount \
streaming-akka/target/spark-streaming-akka_2.11-2.0.0-SNAPSHOT-tests.jar \
localhost 9999
Closes #4
> Add script to run examples
> --------------------------
>
> Key: BAHIR-22
> URL: https://issues.apache.org/jira/browse/BAHIR-22
> Project: Bahir
> Issue Type: Task
> Components: Spark Streaming Connectors
> Affects Versions: 2.0.0
> Reporter: Christian Kadner
> Assignee: Christian Kadner
> Fix For: 2.0.0
>
> Original Estimate: 8h
> Remaining Estimate: 8h
>
> Apache Spark has a convenience script {{./bin/run-example}} to allow users to quickly run the pre-packaged examples without having to compose a long(ish) spark-submit command. The JavaDoc of most examples refers to that {{./bin/run-example}} script in their description of how to run that example.
> The Apache Bahir project should have a similar convenience script to be consistent with Apache Spark, existing documentation and to (at least initially) hide additional complexities of the spark-submit command.
> Example:
> {code}
> ./bin/run-example \
> org.apache.spark.examples.streaming.akka.ActorWordCount localhost 9999
> {code}
> ...translates to this {{spark-submit}} command:
> {code}
> ${SPARK_HOME}/bin/spark-submit \
> --packages org.apache.bahir:spark-streaming-akka_2.11:2.0.0-SNAPSHOT \
> --class org.apache.spark.examples.streaming.akka.ActorWordCount \
> streaming-akka/target/spark-streaming-akka_2.11-2.0.0-SNAPSHOT-tests.jar \
> localhost 9999
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)