You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@wayang.apache.org by al...@apache.org on 2024/09/12 13:35:35 UTC
(incubator-wayang) branch main updated (a2f5ed71 -> 886938e6)
This is an automated email from the ASF dual-hosted git repository.
aloalt pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/incubator-wayang.git
from a2f5ed71 Merge pull request #467 from juripetersen/fix-flink-versioning
add a7afeee4 renamed examples to applications
add dfe309ac finished WordCount with KafkaSource and KafkaSink
add 00bc4225 fixed license issue
add a7397892 changes scope and systempath in dependency on wayang-api-scala-java_2.12 in wayang-applications so that it can be build in cloud env. MIGHT BRING BACK THE VISIBILITY ISSUE ! -> must be checked
add ad39d7fe fixed version conflict with 2.12 versions of Wayang-packages.
add 79ad6958 deactivated the tests, which break the cloud build.
add 9f4ee35f fixed review issues
add 6f21676c added license note.
add c73578a8 clean files
add bc507955 removed debugging line from wayang-submit
add 953873e7 added another test application to support debugging.
add 9d9d7755 cleaned the bootstrap and clean scripts in wayang-applications.
add df588e2b configuration for kafka cluster has been parametrized using env.sh file
add b2fee627 fixed license header.
add a0e260a5 added Readme and removed brew related comments.
add e7b268a4 clean env_template.sh
add 6353814a make version in env_template.sh configurable
add 3caf1bb5 removed OSX specific paths
add d86eeb3d Rename env_template.sh to env_template_osx.sh
add d245a36b Update README.md
add b95e18c7 Merge branch 'kamir-patch-2' of https://github.com/apache/incubator-wayang into kamir-patch-2
add 886938e6 Merge pull request #468 from apache/kamir-patch-2
No new revisions were added by this update.
Summary of changes:
bin/wayang-submit | 3 +-
.../pywayang_config.ini => env_template_osx.sh | 39 +++---
pom.xml | 7 +-
.../scala/org/apache/wayang/api/DataQuanta.scala | 4 +-
wayang-applications/README.md | 60 +++++++++
.../bin/bootstrap_ccloud_kafka_topics.sh | 35 ++++++
.../bin/cleanup_ccloud_kafka_topics.sh | 17 +--
.../bin/env.demo1.sh | 11 +-
.../bin/env_template.sh | 36 +++---
.../bin/run_wordcount.sh | 28 ++---
.../bin/run_wordcount_kafka.sh | 29 ++---
.../data/case-study/DATA_REPO_001/README.md | 0
wayang-applications/pom.xml | 134 +++++++++++++++++++++
.../wayang/applications/OutputSerializer.java | 22 ++--
.../java/org/apache/wayang/applications/Util.java | 11 +-
.../org/apache/wayang/applications}/WordCount.java | 52 ++++----
.../wayang/applications/WordCountOnKafkaTopic.java | 126 +++++++++++++++++++
wayang-assembly/dependency-reduced-pom.xml | 2 +-
.../wayang/basic/operators/KafkaTopicSink.java | 1 +
.../wayang/java/operators/JavaKafkaTopicSink.java | 23 ++--
...leSinkTest.java => JavaKafkaTopicSinkTest.java} | 108 ++++++++++++-----
.../java/operators/JavaKafkaTopicSourceTest.java | 9 +-
.../java/operators/JavaTextFileSinkTest.java | 9 +-
.../spark/operators/SparkKafkaTopicSource.java | 2 +-
24 files changed, 592 insertions(+), 176 deletions(-)
copy python/old_code/pywayang/src/pywy/config/pywayang_config.ini => env_template_osx.sh (55%)
mode change 100644 => 100755
create mode 100644 wayang-applications/README.md
create mode 100755 wayang-applications/bin/bootstrap_ccloud_kafka_topics.sh
copy python/src/pywy/execution/util.py => wayang-applications/bin/cleanup_ccloud_kafka_topics.sh (63%)
mode change 100644 => 100755
copy python/old_code/pywayang/src/pywy/config/__init__.py => wayang-applications/bin/env.demo1.sh (77%)
copy python/old_code/pywayang/src/pywy/config/pywayang_config.ini => wayang-applications/bin/env_template.sh (59%)
copy python/old_code/pywayang/src/pywy/config/pywayang_config.ini => wayang-applications/bin/run_wordcount.sh (65%)
mode change 100644 => 100755
copy python/old_code/pywayang/src/pywy/config/pywayang_config.ini => wayang-applications/bin/run_wordcount_kafka.sh (67%)
mode change 100644 => 100755
copy README.md => wayang-applications/data/case-study/DATA_REPO_001/README.md (100%)
create mode 100644 wayang-applications/pom.xml
copy wayang-benchmark/src/main/scala/org/apache/wayang/apps/simwords/AddIdFunction.scala => wayang-applications/src/main/java/org/apache/wayang/applications/OutputSerializer.java (72%)
copy wayang-commons/wayang-basic/src/main/java/org/apache/wayang/basic/model/Model.java => wayang-applications/src/main/java/org/apache/wayang/applications/Util.java (80%)
copy {wayang-benchmark/src/main/java/org/apache/wayang/apps/wordcount => wayang-applications/src/main/java/org/apache/wayang/applications}/WordCount.java (62%)
create mode 100644 wayang-applications/src/main/java/org/apache/wayang/applications/WordCountOnKafkaTopic.java
copy wayang-platforms/wayang-java/src/test/java/org/apache/wayang/java/operators/{JavaTextFileSinkTest.java => JavaKafkaTopicSinkTest.java} (51%)