You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@bahir.apache.org by "ASF subversion and git services (JIRA)" <ji...@apache.org> on 2016/07/12 23:00:24 UTC

[jira] [Commented] (BAHIR-22) Add script to run examples

    [ https://issues.apache.org/jira/browse/BAHIR-22?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15373880#comment-15373880 ] 

ASF subversion and git services commented on BAHIR-22:
------------------------------------------------------

Commit 61f5592e4bd334a6c4c39cae2229dce53ee66535 in bahir's branch refs/heads/master from [~ckadner]
[ https://git-wip-us.apache.org/repos/asf?p=bahir.git;h=61f5592 ]

[BAHIR-22] add shell script to run examples

Apache Spark has a convenience script ./bin/run-example to allow users to
quickly run the pre-packaged examples without having to compose a long(ish)
spark-submit command.
The JavaDoc of most examples refers to that ./bin/run-example script
in their description of how to run that example.

This adds a similar convenience script to the Apache Bahir project in order
to keep consistent with existing (Apache Spark) documentation and to
(at least initially) hide additional complexities of the spark-submit command.

Example:

./bin/run-example \
  org.apache.spark.examples.streaming.akka.ActorWordCount localhost 9999

...translates to this spark-submit command:

${SPARK_HOME}/bin/spark-submit \
  --packages org.apache.bahir:spark-streaming-akka_2.11:2.0.0-SNAPSHOT \
  --class org.apache.spark.examples.streaming.akka.ActorWordCount \
    streaming-akka/target/spark-streaming-akka_2.11-2.0.0-SNAPSHOT-tests.jar \
  localhost 9999

Closes #4


> Add script to run examples
> --------------------------
>
>                 Key: BAHIR-22
>                 URL: https://issues.apache.org/jira/browse/BAHIR-22
>             Project: Bahir
>          Issue Type: Task
>          Components: Spark Streaming Connectors
>    Affects Versions: 2.0.0
>            Reporter: Christian Kadner
>            Assignee: Christian Kadner
>             Fix For: 2.0.0
>
>   Original Estimate: 8h
>  Remaining Estimate: 8h
>
> Apache Spark has a convenience script {{./bin/run-example}} to allow users to quickly run the pre-packaged examples without having to compose a long(ish) spark-submit command. The JavaDoc of most examples refers to that  {{./bin/run-example}} script in their description of how to run that example.
> The Apache Bahir project should have a similar convenience script to be consistent with Apache Spark, existing documentation and to (at least initially) hide additional complexities of the spark-submit command.
> Example:
> {code}
> ./bin/run-example \
>   org.apache.spark.examples.streaming.akka.ActorWordCount localhost 9999
> {code}
> ...translates to this {{spark-submit}} command:
> {code}
> ${SPARK_HOME}/bin/spark-submit \
>   --packages org.apache.bahir:spark-streaming-akka_2.11:2.0.0-SNAPSHOT \
>   --class org.apache.spark.examples.streaming.akka.ActorWordCount \
>     streaming-akka/target/spark-streaming-akka_2.11-2.0.0-SNAPSHOT-tests.jar \
>   localhost 9999
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)