You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@beam.apache.org by "bvolpato (via GitHub)" <gi...@apache.org> on 2023/11/16 04:10:32 UTC

[PR] Add Maven archetype for examples with Dataflow Runner only [beam]

bvolpato opened a new pull request, #29447:
URL: https://github.com/apache/beam/pull/29447

   Generates POM following https://beam.apache.org/blog/managing-beam-dependencies-in-java/
   
   This will allow more runner-specific project so profiles don't have to be used. It allows a user to get started on Dataflow with 2 commands:
   
   ```
   mvn archetype:generate \
       -DarchetypeGroupId=org.apache.beam \
       -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-dataflow-examples \
       -DarchetypeVersion=2.53.0-SNAPSHOT \
       -DtargetPlatform=11 \
       -DgroupId=org.example \
       -DartifactId=word-count-beam \
       -Dversion="0.1" \
       -Dpackage=org.apache.beam.dataflow.examples \
       -DinteractiveMode=false
   ```
   
   And
   
   ```
   mvn clean package exec:java -Dexec.mainClass="org.apache.beam.dataflow.examples.WordCount" -Dexec.args='--runner=DataflowRunner --project={PROJECT} --output=gs://{BUCKET}/output'
   ```
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] Add Maven archetype for examples with Dataflow Runner only [beam]

Posted by "bvolpato (via GitHub)" <gi...@apache.org>.

bvolpato closed pull request #29447: Add Maven archetype for examples with Dataflow Runner only
URL: https://github.com/apache/beam/pull/29447


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [PR] Add Maven archetype for examples with Dataflow Runner only [beam]

Posted by "bvolpato (via GitHub)" <gi...@apache.org>.

bvolpato commented on PR #29447:
URL: https://github.com/apache/beam/pull/29447#issuecomment-1815014735

   > iiuc the src code are the same as current examples maven-artifact, and only the pom.xml is different (most dependency arragement). And it simplifies the need of `-Pdataflow-runner` comparing to https://beam.apache.org/get-started/quickstart-java/
   > 
   > If there are problem or anything making it inconvenient using existing examples maven-artifact for Dataflow runner we should fix there, personally I am -1 to create a new dataflow only artifact, as Beam acts/markets as it runs on different runners.
   
   Thanks!
   I helped someone trying to use the examples to start a Dataflow project and it wasn't the user friendly. But I agree that maybe the archetype here isn't the best venue.
   
   The main concern is that there's a bloat and version properties for all runners which make it confusing. I'll see if there's a way to add profiles conditionally to the archetype. 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org