You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@wayang.apache.org by Biao Geng <bi...@gmail.com> on 2023/04/13 15:55:22 UTC

What's the proper way to run Wayang's WordCount Example?

Dear community,

Thanks for your efforts for creating this project! I am new to Wayang and want to follow instructions to run a quick demo. I finally managed to do that and could see outputs like the following(I wrote some notes about the process in this issue’s comment<https://github.com/apache/incubator-wayang/issues/282#issuecomment-1507208045>):
```
Found 689 words:
91x the
87x wayang
68x apache
```
But in the process, I had to figure out some installation/running problems, which makes me wondering if I am on the right direction: should I use wayang-submit or consider Wayang as a library(i.e. write java program and build a fat jar)? Which one is recommended?

Best,
Biao Geng

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

 I ran the Wordcount example successfully too! 
Thanks a lot @Biao :)I also modifed the script to not print the jars file names.
Maybe we should create a new thread to discuss the next release. @Alex what do you think?
Best
--
Zoi

    Στις Πέμπτη 20 Απριλίου 2023 - 10:57:40 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:  
 
 No worries, good points said. We are looking forward to more contributions from you :)

Cheers, have a great day,
 —Alex 

> On 19. Apr 2023, at 18:45, Biao Geng <bi...@gmail.com> wrote:
> 
> Got it. And just a correction for my previous email: I am *not* quite familiar with the release regulations of Apache. Sorry for the possible confusion.
> Best,
> Biao Geng
> 
> From: Alexander Alten <alo@databloom.ai <ma...@databloom.ai>>
> Date: Wednesday, April 19, 2023 at 11:44 PM
> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
> Subject: Re: What's the proper way to run Wayang's WordCount Example?
> Hey Biao,
> 
> Fully agree :) It’s a community decision at the end, and when a bindery release makes more sense for users, we should consider this!
> 
> Cheers,
> --Alex
> 
>> On 19. Apr 2023, at 17:09, Biao Geng <bi...@gmail.com> wrote:
>> 
>> Hi there,
>> Thanks for the information! I am quite familiar with the release regulations of Apache, but as a normal user of Flink and Spark, from their download page(Spark<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://spark.apache.org/downloads.html%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw044JGX5jCe0UTsfrEKeIqn&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3gwSZh-RIeNS00RdfoAKPH>, Flink<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://flink.apache.org/downloads/%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3jzvw3N6IpB00syY3jeCFV&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2rvZiapOIgh1HZpFoPzAQ_>), these Apache projects will produce both source release(the tar that contains source code only) and binary release(the tar that contains binary files and jars). Hope it can help.
>> 
>> Best,
>> Biao Geng
>> From: Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>>
>> Date: Wednesday, April 19, 2023 at 5:12 PM
>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>> Ya, thats a good point, and thank you for pointing this out. Generally spoken, a binary release can be problematic, since the code can contain unwanted licenses, add-ons etc. From my point, I’d vote in favor of a code release and with a -1 for a binary one. But thats a decision the community has to take.
>> 
>> Nevertheless, it is possible to offer a binary release, albeit I think when the build instructions are clear and functional, we should stick with that and avoid a pre-built one. But again, just my opinion :)
>> 
>> Best,
>> —Alex
>> 
>>> On 19. Apr 2023, at 11:04, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> wrote:
>>> 
>>> Hi all,
>>> I agree that the main branch should not contain any binaries.
>>> 
>>> Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
>>> @Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)
>>> 
>>> Best
>>> --
>>> Zoi
>>> 
>>>  Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>> 
>>> Hey Biao,
>>> 
>>> Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz.
>>> 
>>> What you think?
>>> 
>>> Cheers,
>>> —Alex
>>> 
>>> Sent from my iPhone
>>> 
>>>> On 19. Apr 2023, at 08:39, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> wrote:
>>>> 
>>>> Hi Alexander,
>>>> Great to hear from you that the codes can work! And thanks for the hinting
>>>> about Apache license. I would fix it.
>>>> But for the PR, I add jars in my branch to facilitate the verification but
>>>> I think we should not add jars directly to the main branch, right? From my
>>>> experience, it may be better to create a tar.gz including all necessary
>>>> jars and put it on the apache wayang's website or somewhere else provided
>>>> by Apache.
>>>> I did not add the tar.gz in my wordcount_fix branch because its size is
>>>> larger than 100mb, which cannot be uploaded directly to Github. But I think
>>>> all of us can build the tar.gz using wayang-assembly module(thanks to the
>>>> previous work from other people) following my tutorial and maybe our
>>>> release manager can publish the tar.gz so everyone of us can validate the
>>>> release candidate.
>>>> 
>>>> Best,
>>>> Biao Geng
>>>> 
>>>> 
>>>> 
>>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>> 于2023年4月19日周三 03:02写道：
>>>> 
>>>>> Hey,
>>>>> 
>>>>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>>>>> u please review?
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/pull/300%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0tTMAVXLDtf1nrrGef1Gi6%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3ja1w_beU8bYPm-KwMQYYz%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2xk1w9inp92ypqOzLmtrZX&source=gmail-imap&ust=1682527562000000&usg=AOvVaw10hJj8NPXUJEFhU6Xg26lU
>>>>> 
>>>>> @Biao, please add the valid Apache Software License 2 headers,  see
>>>>> Wordcount fix · apache/incubator-wayang@4431aed (github.com <http://github.com/> <https://www.google.com/url?q=http://github.com/&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0v4c-GwAAKef8-hthIAo0g> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttp://github.com/%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw1tdHyBoZ0zW2UpIcmIg8nK&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2UzBCL1CfiRG2RX-CJHAzS>) <
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3UcUEjJ2epl9ajaSCaCFoL&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2NHRCL9y4LAxFjzyrOl3iB><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0Ms5rOlvvg-43el5WUpTFM&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0VIGyccvfT25KQic48J0ko><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3UcUEjJ2epl9ajaSCaCFoL%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0Ms5rOlvvg-43el5WUpTFM%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0bcL-ViaBeKGIsq0YtzUpW>
>>>>> ff
>>>>> 
>>>>> Cheers,
>>>>> —Alex
>>>>> 
>>>>>>> On 18. Apr 2023, at 19:52, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> wrote:
>>>>>> 
>>>>>> Hi folks,
>>>>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>>>>> zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>>.
>>>>>> So, you can find the built binary files hers:
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw1oHka8SFQc3UKYAHxgjP7W%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0p7wEfxyYvYyF5rDPhpchB%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw0-tp1DqT5sMfYLAzVjF8mx%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3Li-i9pxYZrECZ0FdLx5JE&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0tb-IivtSwIJYVbc9uxcG6
>>>>>> I also wrote a simple tutorial<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0xyQx5E99qbJSEzupD3Zjt&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2fYOolZR-q6--1Mt1lQ8Rd><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2qcr8CRct8OqOKTUdl5HRE&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1TPRuqo0xJkJrIAuu2-MLG><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0xyQx5E99qbJSEzupD3Zjt%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2qcr8CRct8OqOKTUdl5HRE%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3SEq3iU2JpoaWCfH_TFokX>
>>>>> based on README in the project. It would be great if anyone else can follow
>>>>> the instructions in the doc to verify the word count example. If there are
>>>>> any problems, please let me know.
>>>>>> 
>>>>>> Besides, there are some interesting discoveries:
>>>>>> 
>>>>>> 1.  We already have the wayang-assembly module, which would help us
>>>>> build the binary easily. In fact, I directly used it in my wordcount_fix
>>>>> branch instead of pushing my previous jars.
>>>>>> 2.  Though the built binary files can work, it would still output some
>>>>> annoying information, which I have mentioned in the issue<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3bJ5xGRhGWIwPR-PxBoboB&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1NoC4wRsNOYOH2en6k7N7a><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0BphWKa6_9HYUZuxLAwHs0&source=gmail-imap&ust=1682527562000000&usg=AOvVaw07by-nHcCHfBeCHlP8kDG4><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3bJ5xGRhGWIwPR-PxBoboB%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0BphWKa6_9HYUZuxLAwHs0%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0c3m-G2vCuqQuZEzF4hXBd>.
>>>>> I will spend some time later to figure out if we can avoid it.
>>>>>> 
>>>>>> Best,
>>>>>> Biao Geng
>>>>>> 
>>>>>> 
>>>>>> From: Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>>
>>>>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>>> Hi there,
>>>>>> 
>>>>>> Thanks a lot for your response and the discussion.
>>>>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>>>>> file with the binaries for the new release. I will also add a doc for that
>>>>> so you can verify it at least by running the word count example.
>>>>>> I may take following steps:
>>>>>> 
>>>>>> 1.  I will create a fork based on current main branch(commitId is
>>>>> d46f3c3<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw29uK8aTb7VpaDqFmTEwVUA&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0WvweUxoZrHjLht1OunrVC>)<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0YWaqDfLMQCRQjr-1oz2m-&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2jjd1DMcIf30O8xgJOlPr-)><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw29uK8aTb7VpaDqFmTEwVUA%253e)%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0YWaqDfLMQCRQjr-1oz2m- <http://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0YWaqDfLMQCRQjr-1oz2m->)%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1zrPs5TjQ-62vWPtKZz6Uh>
>>>>> with workable jars for running the wordcount example.
>>>>>> 2.  I will write a simple tutorial to show how to run the example
>>>>> locally.
>>>>>> I also create a jira<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2J_WU-NDecUVuDP69MX3It&source=gmail-imap&ust=1682527562000000&usg=AOvVaw37xur-VwNVO9A0g-TNuDIw><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3tDd4NhzwsJhDBnHd8XgHq&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3ygxMfYkEuV0zgR3I3gvWg><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2J_WU-NDecUVuDP69MX3It%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3tDd4NhzwsJhDBnHd8XgHq%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1mjjRC9-H37X2dJbzsVZwE>
>>>>> to track the work. Once I am ready, I will update in this thread.
>>>>>> 
>>>>>> Best,
>>>>>> Biao Geng
>>>>>> 
>>>>>> 
>>>>>> From: Jorge Arnulfo Quiané Ruiz <quianeufo@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>>
>>>>>> Date: Monday, April 17, 2023 at 11:51 PM
>>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>>> Welcome on board Biao and thanks a lot for your help to the project,
>>>>> pretty much appreciated!!!
>>>>>> 
>>>>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>>>>> will also perform point 2) we will start point 3.
>>>>>> 
>>>>>> Best,
>>>>>> Jorge
>>>>>> 
>>>>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>> wrote:
>>>>>>> 
>>>>>>> Great!
>>>>>>> So, I propose to do the following:
>>>>>>> 
>>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>>> release
>>>>>>> 2. I get the file and test it in my machine
>>>>>>> 
>>>>>>> 3. Alex initiates the release process
>>>>>>> How does this sound?
>>>>>>> 
>>>>>>> Best--
>>>>>>> Zoi
>>>>>>> 
>>>>>>> Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>>>>> Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>> έγραψε:
>>>>>>> 
>>>>>>> Great!
>>>>>>> So, I propose to do the following:
>>>>>>> 
>>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>>> release2. I get the file and test it in my machine
>>>>>>> 3. Alex initiates the release process
>>>>>>> How does this sound?
>>>>>>> Best
>>>>>>> --
>>>>>>> Zoi
>>>>>>> 
>>>>>>> Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>>>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>>>>>> 
>>>>>>> Good point.
>>>>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>>> wrote:
>>>>>>>> 
>>>>>>>> I think we should do a binary release first without changing anything
>>>>> so that the installation problem is fixed asap. This won’t be a new release
>>>>> but complementary to the current one. Isn’t that possible? Or is it
>>>>> possible to just replace the current file we have with a new one?
>>>>>>> 
>>>>>>> Yes, we need a new release.
>>>>>>> 
>>>>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>>>>> But this requires more time.
>>>>>>> 
>>>>>>> +1
>>>>>>> 
>>>>>>>> Best—Zoi
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Sent from Yahoo Mail for iPhone
>>>>>>>> 
>>>>>>>> 
>>>>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai> <ma...@databloom.ai>
>>>>> <ma...@databloom.ai>> wrote:
>>>>>>>> 
>>>>>>>> Hi, and welcome Biao :)
>>>>>>>> 
>>>>>>>> Yes, we should certainly plan a new release as soon as we have
>>>>> finished the cleanup process. From my point of view we should eliminate
>>>>> Java 8 support due security concerns. I’m also in for to end support for
>>>>> GraphChi, since this project is dead since 8 years. To end support for J8
>>>>> and GraphChi I think we need to clarify the reasons in the release notes.
>>>>> Maybe it’s a good idea to start a new thread which contains the content of
>>>>> the next release? Just to make sure that we have a clear path.
>>>>>>>> 
>>>>>>>> Objections and comments are welcome, @community!
>>>>>>>> 
>>>>>>>> —Alex
>>>>>>>> 
>>>>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>>> wrote:
>>>>>>>>> 
>>>>>>>>> Yes, I totally agree that we need to correct the current release and
>>>>> provide the binaries and not the source code.
>>>>>>>>> I am also not very familiar with the release process but I think Alex
>>>>> and/or Chris could help with that.@Alex, what do you think?
>>>>>>>>> In the meantime, maybe you could add/modify the README instructions
>>>>> for someone that wants to clone and build wayang and run the wordcount
>>>>> locally? For example, I could also build it successfully in my laptop but
>>>>> then it's not clear what I have to do to be able to run the main class.
>>>>>>>>> 
>>>>>>>>> Best
>>>>>>>>> --
>>>>>>>>> Zoi
>>>>>>>>> 
>>>>>>>>> Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>>>>> Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>> 
>>>>>>>>> Hi Zoi,
>>>>>>>>> Thanks for the response! I see the point that the command-line tool
>>>>> is for
>>>>>>>>> production and the library is for development. That's consistent with
>>>>> my
>>>>>>>>> use experience of big data engines like spark and flink.
>>>>>>>>> As for the issue <
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://github.com/apache/incubator-wayang/issues/282%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2ZkiU8-ZBYEdPPRJF78DV9&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3loQuzp_aGUvTgCAorE8Iw><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://github.com/apache/incubator-wayang/issues/282%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3CHvahymuTqYTrwc52ebjD&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3e9Wmp6xz9vq6jNG8CUD-z><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2ZkiU8-ZBYEdPPRJF78DV9%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3CHvahymuTqYTrwc52ebjD%3e>,
>>>>> I
>>>>>>>>> found the discussion
>>>>>>>>> <
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw1m4D4wACfxT02JUaM_xkvi%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3TzmdxiF_9es899NcxN8d5%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw0uMQT8ihnPENWa8gNqzcL6%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2VYbRRTjzDEwdu1XVuEaHd&source=gmail-imap&ust=1682527562000000&usg=AOvVaw36HnsmuuzNy-GRVxUfTcu1><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw1m4D4wACfxT02JUaM_xkvi%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3TzmdxiF_9es899NcxN8d5%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw0uMQT8ihnPENWa8gNqzcL6%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2KoXmmMzDqA3V7pgdD7Sf4&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0u_A65dAGT-CJmZm5utvWb><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2VYbRRTjzDEwdu1XVuEaHd%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2KoXmmMzDqA3V7pgdD7Sf4%3e>
>>>>> and
>>>>>>>>> sure, I can help to solve the problem. But I believe my current
>>>>> solution is
>>>>>>>>> not what we really want in the long run, right? The key part is to
>>>>> correct
>>>>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>>>>> themselves to add missing jars. While I am not quite familiar with
>>>>> Wayand's
>>>>>>>>> release process, will there be someone else with more experience to
>>>>> figure
>>>>>>>>> it out?
>>>>>>>>> Then I can take care of the other parts like validating the new
>>>>> zip/tar
>>>>>>>>> file, improving the README or solving some other problems in the
>>>>> process.
>>>>>>>>> What do you think?
>>>>>>>>> 
>>>>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>>>>> 
>>>>>>>>> Best,
>>>>>>>>> Biao Geng
>>>>>>>>> 
>>>>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>>> 于2023年4月14日周五 03:32写道：
>>>>>>>>> 
>>>>>>>>>> Dear Biao,
>>>>>>>>>> welcome to the Wayang community :)
>>>>>>>>>> It's great you could run Wayang and yes you are in the right
>>>>> direction.
>>>>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>>>>> suggested to have two different ways in the documentation. One is
>>>>> using the
>>>>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>>>>> production. The other is as you said like a library that you can use
>>>>> in
>>>>>>>>>> your java application when developing.
>>>>>>>>>> 
>>>>>>>>>> As you already made it run, do you think you could take care of that
>>>>> issue
>>>>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>>>>> Best
>>>>>>>>>> --Zoi
>>>>>>>>>> 
>>>>>>>>>> Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>>>>> Geng
>>>>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>>> 
>>>>>>>>>> Dear community,
>>>>>>>>>> 
>>>>>>>>>> Thanks for your efforts for creating this project! I am new to
>>>>> Wayang and
>>>>>>>>>> want to follow instructions to run a quick demo. I finally managed
>>>>> to do
>>>>>>>>>> that and could see outputs like the following(I wrote some notes
>>>>> about the
>>>>>>>>>> process in this issue’s comment<
>>>>>>>>>> 
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252525252523issuecomment-1507208045%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw06CRhhCuIpDwEbMTgY2TgF%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw2Rsab148FhEj8AKQI7B4oV%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Z87e-vU2VJmxBDthG1W_F%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2e91aUSVSR-CkOGm4EPzca&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0a0Pn3iir9Ggx6hdBaJEp2
>>>>>>>>>>> ):
>>>>>>>>>> ```
>>>>>>>>>> Found 689 words:
>>>>>>>>>> 91x the
>>>>>>>>>> 87x wayang
>>>>>>>>>> 68x apache
>>>>>>>>>> ```
>>>>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>>>>> problems, which makes me wondering if I am on the right direction:
>>>>> should I
>>>>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>>>>> program
>>>>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>>>>> 
>>>>>>>>>> Best,
>>>>>>>>>> Biao Geng
>>>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> --
>>>>>>>> databloom AI, Inc.
>>>>>>>> 
>>>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>>>> 33127 Miami, Florida
>>>>>>>> United States
>>>>>>>> 
>>>>>>>> 
>>>>>>>> --  Please consider the environment before printing this
>>>>>>>> email --
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Disclaimer:
>>>>>>>> The content of this message is confidential. If you
>>>>>>>> have received it by mistake, please inform us by an email reply and
>>>>> then
>>>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>>> reveal
>>>>>>>> the contents of this message to anyone. The integrity and security of
>>>>> this
>>>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>>>>> will
>>>>>>>> not be held liable for any damage caused by the message.
>>>>>>> 
>>>>>>> 
>>>>>>> --
>>>>>>> databloom AI, Inc.
>>>>>>> 
>>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>>> 33127 Miami, Florida
>>>>>>> United States
>>>>>>> 
>>>>>>> 
>>>>>>> --  Please consider the environment before printing this
>>>>>>> email --
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> Disclaimer:
>>>>>>> The content of this message is confidential. If you
>>>>>>> have received it by mistake, please inform us by an email reply and then
>>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>>> reveal
>>>>>>> the contents of this message to anyone. The integrity and security of
>>>>> this
>>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>>>> not be held liable for any damage caused by the message.
>>>>>>> 
>>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> databloom AI, Inc.
>>>>> 
>>>>> 3401 N. MIAMI AVE. STE 230
>>>>> 33127 Miami, Florida
>>>>> United States
>>>>> 
>>>>> 
>>>>> --  Please consider the environment before printing this
>>>>> email --
>>>>> 
>>>>> 
>>>>> 
>>>>> Disclaimer:
>>>>> The content of this message is confidential. If you
>>>>> have received it by mistake, please inform us by an email reply and then
>>>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>>>> the contents of this message to anyone. The integrity and security of this
>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>> not be held liable for any damage caused by the message.
>>>>> 
>>>>> 
>>> 
>>> --
>>> databloom AI, Inc.
>>> 
>>> 3401 N. MIAMI AVE. STE 230
>>> 33127 Miami, Florida
>>> United States
>>> 
>>> 
>>> --  Please consider the environment before printing this
>>> email --
>>> 
>>> 
>>> 
>>> Disclaimer:
>>> The content of this message is confidential. If you
>>> have received it by mistake, please inform us by an email reply and then
>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>> the contents of this message to anyone. The integrity and security of this
>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>> not be held liable for any damage caused by the message.
>> 
>> 
>> --
>> databloom AI, Inc.
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>> 
>> 
>> --  Please consider the environment before printing this
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
> 
> 
> --
> databloom AI, Inc.
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
> 
> 
> --  Please consider the environment before printing this
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten <al...@databloom.ai>.

No worries, good points said. We are looking forward to more contributions from you :)

Cheers, have a great day,
 —Alex 

> On 19. Apr 2023, at 18:45, Biao Geng <bi...@gmail.com> wrote:
> 
> Got it. And just a correction for my previous email: I am *not* quite familiar with the release regulations of Apache. Sorry for the possible confusion.
> Best,
> Biao Geng
> 
> From: Alexander Alten <alo@databloom.ai <ma...@databloom.ai>>
> Date: Wednesday, April 19, 2023 at 11:44 PM
> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
> Subject: Re: What's the proper way to run Wayang's WordCount Example?
> Hey Biao,
> 
> Fully agree :) It’s a community decision at the end, and when a bindery release makes more sense for users, we should consider this!
> 
> Cheers,
> --Alex
> 
>> On 19. Apr 2023, at 17:09, Biao Geng <bi...@gmail.com> wrote:
>> 
>> Hi there,
>> Thanks for the information! I am quite familiar with the release regulations of Apache, but as a normal user of Flink and Spark, from their download page(Spark<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://spark.apache.org/downloads.html%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw044JGX5jCe0UTsfrEKeIqn&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3gwSZh-RIeNS00RdfoAKPH>, Flink<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://flink.apache.org/downloads/%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3jzvw3N6IpB00syY3jeCFV&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2rvZiapOIgh1HZpFoPzAQ_>), these Apache projects will produce both source release(the tar that contains source code only) and binary release(the tar that contains binary files and jars). Hope it can help.
>> 
>> Best,
>> Biao Geng
>> From: Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>>
>> Date: Wednesday, April 19, 2023 at 5:12 PM
>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>> Ya, thats a good point, and thank you for pointing this out. Generally spoken, a binary release can be problematic, since the code can contain unwanted licenses, add-ons etc. From my point, I’d vote in favor of a code release and with a -1 for a binary one. But thats a decision the community has to take.
>> 
>> Nevertheless, it is possible to offer a binary release, albeit I think when the build instructions are clear and functional, we should stick with that and avoid a pre-built one. But again, just my opinion :)
>> 
>> Best,
>> —Alex
>> 
>>> On 19. Apr 2023, at 11:04, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> wrote:
>>> 
>>> Hi all,
>>> I agree that the main branch should not contain any binaries.
>>> 
>>> Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
>>> @Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)
>>> 
>>> Best
>>> --
>>> Zoi
>>> 
>>>  Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>> 
>>> Hey Biao,
>>> 
>>> Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz.
>>> 
>>> What you think?
>>> 
>>> Cheers,
>>> —Alex
>>> 
>>> Sent from my iPhone
>>> 
>>>> On 19. Apr 2023, at 08:39, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> wrote:
>>>> 
>>>> Hi Alexander,
>>>> Great to hear from you that the codes can work! And thanks for the hinting
>>>> about Apache license. I would fix it.
>>>> But for the PR, I add jars in my branch to facilitate the verification but
>>>> I think we should not add jars directly to the main branch, right? From my
>>>> experience, it may be better to create a tar.gz including all necessary
>>>> jars and put it on the apache wayang's website or somewhere else provided
>>>> by Apache.
>>>> I did not add the tar.gz in my wordcount_fix branch because its size is
>>>> larger than 100mb, which cannot be uploaded directly to Github. But I think
>>>> all of us can build the tar.gz using wayang-assembly module(thanks to the
>>>> previous work from other people) following my tutorial and maybe our
>>>> release manager can publish the tar.gz so everyone of us can validate the
>>>> release candidate.
>>>> 
>>>> Best,
>>>> Biao Geng
>>>> 
>>>> 
>>>> 
>>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>> 于2023年4月19日周三 03:02写道：
>>>> 
>>>>> Hey,
>>>>> 
>>>>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>>>>> u please review?
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/pull/300%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0tTMAVXLDtf1nrrGef1Gi6%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3ja1w_beU8bYPm-KwMQYYz%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2xk1w9inp92ypqOzLmtrZX&source=gmail-imap&ust=1682527562000000&usg=AOvVaw10hJj8NPXUJEFhU6Xg26lU
>>>>> 
>>>>> @Biao, please add the valid Apache Software License 2 headers,  see
>>>>> Wordcount fix · apache/incubator-wayang@4431aed (github.com <http://github.com/> <https://www.google.com/url?q=http://github.com/&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0v4c-GwAAKef8-hthIAo0g> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttp://github.com/%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw1tdHyBoZ0zW2UpIcmIg8nK&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2UzBCL1CfiRG2RX-CJHAzS>) <
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3UcUEjJ2epl9ajaSCaCFoL&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2NHRCL9y4LAxFjzyrOl3iB><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0Ms5rOlvvg-43el5WUpTFM&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0VIGyccvfT25KQic48J0ko><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3UcUEjJ2epl9ajaSCaCFoL%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%2525253D300%25252523step:6:141%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0Ms5rOlvvg-43el5WUpTFM%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0bcL-ViaBeKGIsq0YtzUpW>
>>>>> ff
>>>>> 
>>>>> Cheers,
>>>>> —Alex
>>>>> 
>>>>>>> On 18. Apr 2023, at 19:52, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> wrote:
>>>>>> 
>>>>>> Hi folks,
>>>>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>>>>> zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>>.
>>>>>> So, you can find the built binary files hers:
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw1oHka8SFQc3UKYAHxgjP7W%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0p7wEfxyYvYyF5rDPhpchB%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw0-tp1DqT5sMfYLAzVjF8mx%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3Li-i9pxYZrECZ0FdLx5JE&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0tb-IivtSwIJYVbc9uxcG6
>>>>>> I also wrote a simple tutorial<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0xyQx5E99qbJSEzupD3Zjt&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2fYOolZR-q6--1Mt1lQ8Rd><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2qcr8CRct8OqOKTUdl5HRE&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1TPRuqo0xJkJrIAuu2-MLG><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0xyQx5E99qbJSEzupD3Zjt%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3juTbTSf5K_pccH_BmgU_P%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2qcr8CRct8OqOKTUdl5HRE%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3SEq3iU2JpoaWCfH_TFokX>
>>>>> based on README in the project. It would be great if anyone else can follow
>>>>> the instructions in the doc to verify the word count example. If there are
>>>>> any problems, please let me know.
>>>>>> 
>>>>>> Besides, there are some interesting discoveries:
>>>>>> 
>>>>>> 1.  We already have the wayang-assembly module, which would help us
>>>>> build the binary easily. In fact, I directly used it in my wordcount_fix
>>>>> branch instead of pushing my previous jars.
>>>>>> 2.  Though the built binary files can work, it would still output some
>>>>> annoying information, which I have mentioned in the issue<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3bJ5xGRhGWIwPR-PxBoboB&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1NoC4wRsNOYOH2en6k7N7a><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0BphWKa6_9HYUZuxLAwHs0&source=gmail-imap&ust=1682527562000000&usg=AOvVaw07by-nHcCHfBeCHlP8kDG4><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3bJ5xGRhGWIwPR-PxBoboB%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw374wnAzaTdF9LIHsRJDsZt%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0BphWKa6_9HYUZuxLAwHs0%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0c3m-G2vCuqQuZEzF4hXBd>.
>>>>> I will spend some time later to figure out if we can avoid it.
>>>>>> 
>>>>>> Best,
>>>>>> Biao Geng
>>>>>> 
>>>>>> 
>>>>>> From: Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>>
>>>>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>>> Hi there,
>>>>>> 
>>>>>> Thanks a lot for your response and the discussion.
>>>>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>>>>> file with the binaries for the new release. I will also add a doc for that
>>>>> so you can verify it at least by running the word count example.
>>>>>> I may take following steps:
>>>>>> 
>>>>>> 1.  I will create a fork based on current main branch(commitId is
>>>>> d46f3c3<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw29uK8aTb7VpaDqFmTEwVUA&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0WvweUxoZrHjLht1OunrVC>)<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0YWaqDfLMQCRQjr-1oz2m-&source=gmail-imap&ust=1682527562000000&usg=AOvVaw2jjd1DMcIf30O8xgJOlPr-)><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw29uK8aTb7VpaDqFmTEwVUA%253e)%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0YWaqDfLMQCRQjr-1oz2m- <http://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0KR103oRbBWOAn_lLoacih%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2TW3xv-kgnBDwpswdEVbgN%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw0YWaqDfLMQCRQjr-1oz2m->)%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1zrPs5TjQ-62vWPtKZz6Uh>
>>>>> with workable jars for running the wordcount example.
>>>>>> 2.  I will write a simple tutorial to show how to run the example
>>>>> locally.
>>>>>> I also create a jira<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2J_WU-NDecUVuDP69MX3It&source=gmail-imap&ust=1682527562000000&usg=AOvVaw37xur-VwNVO9A0g-TNuDIw><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3tDd4NhzwsJhDBnHd8XgHq&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3ygxMfYkEuV0zgR3I3gvWg><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2J_WU-NDecUVuDP69MX3It%253e%253chttps://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://issues.apache.org/jira/browse/WAYANG-48%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3tDd4NhzwsJhDBnHd8XgHq%253e&source=gmail-imap&ust=1682527562000000&usg=AOvVaw1mjjRC9-H37X2dJbzsVZwE>
>>>>> to track the work. Once I am ready, I will update in this thread.
>>>>>> 
>>>>>> Best,
>>>>>> Biao Geng
>>>>>> 
>>>>>> 
>>>>>> From: Jorge Arnulfo Quiané Ruiz <quianeufo@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>>
>>>>>> Date: Monday, April 17, 2023 at 11:51 PM
>>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>>> Welcome on board Biao and thanks a lot for your help to the project,
>>>>> pretty much appreciated!!!
>>>>>> 
>>>>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>>>>> will also perform point 2) we will start point 3.
>>>>>> 
>>>>>> Best,
>>>>>> Jorge
>>>>>> 
>>>>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>> wrote:
>>>>>>> 
>>>>>>> Great!
>>>>>>> So, I propose to do the following:
>>>>>>> 
>>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>>> release
>>>>>>> 2. I get the file and test it in my machine
>>>>>>> 
>>>>>>> 3. Alex initiates the release process
>>>>>>> How does this sound?
>>>>>>> 
>>>>>>> Best--
>>>>>>> Zoi
>>>>>>> 
>>>>>>> Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>>>>> Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>> έγραψε:
>>>>>>> 
>>>>>>> Great!
>>>>>>> So, I propose to do the following:
>>>>>>> 
>>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>>> release2. I get the file and test it in my machine
>>>>>>> 3. Alex initiates the release process
>>>>>>> How does this sound?
>>>>>>> Best
>>>>>>> --
>>>>>>> Zoi
>>>>>>> 
>>>>>>> Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>>>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>>>>>> 
>>>>>>> Good point.
>>>>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>>> wrote:
>>>>>>>> 
>>>>>>>> I think we should do a binary release first without changing anything
>>>>> so that the installation problem is fixed asap. This won’t be a new release
>>>>> but complementary to the current one. Isn’t that possible? Or is it
>>>>> possible to just replace the current file we have with a new one?
>>>>>>> 
>>>>>>> Yes, we need a new release.
>>>>>>> 
>>>>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>>>>> But this requires more time.
>>>>>>> 
>>>>>>> +1
>>>>>>> 
>>>>>>>> Best—Zoi
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Sent from Yahoo Mail for iPhone
>>>>>>>> 
>>>>>>>> 
>>>>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai> <ma...@databloom.ai>
>>>>> <ma...@databloom.ai>> wrote:
>>>>>>>> 
>>>>>>>> Hi, and welcome Biao :)
>>>>>>>> 
>>>>>>>> Yes, we should certainly plan a new release as soon as we have
>>>>> finished the cleanup process. From my point of view we should eliminate
>>>>> Java 8 support due security concerns. I’m also in for to end support for
>>>>> GraphChi, since this project is dead since 8 years. To end support for J8
>>>>> and GraphChi I think we need to clarify the reasons in the release notes.
>>>>> Maybe it’s a good idea to start a new thread which contains the content of
>>>>> the next release? Just to make sure that we have a clear path.
>>>>>>>> 
>>>>>>>> Objections and comments are welcome, @community!
>>>>>>>> 
>>>>>>>> —Alex
>>>>>>>> 
>>>>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>>> wrote:
>>>>>>>>> 
>>>>>>>>> Yes, I totally agree that we need to correct the current release and
>>>>> provide the binaries and not the source code.
>>>>>>>>> I am also not very familiar with the release process but I think Alex
>>>>> and/or Chris could help with that.@Alex, what do you think?
>>>>>>>>> In the meantime, maybe you could add/modify the README instructions
>>>>> for someone that wants to clone and build wayang and run the wordcount
>>>>> locally? For example, I could also build it successfully in my laptop but
>>>>> then it's not clear what I have to do to be able to run the main class.
>>>>>>>>> 
>>>>>>>>> Best
>>>>>>>>> --
>>>>>>>>> Zoi
>>>>>>>>> 
>>>>>>>>> Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>>>>> Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>> 
>>>>>>>>> Hi Zoi,
>>>>>>>>> Thanks for the response! I see the point that the command-line tool
>>>>> is for
>>>>>>>>> production and the library is for development. That's consistent with
>>>>> my
>>>>>>>>> use experience of big data engines like spark and flink.
>>>>>>>>> As for the issue <
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://github.com/apache/incubator-wayang/issues/282%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2ZkiU8-ZBYEdPPRJF78DV9&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3loQuzp_aGUvTgCAorE8Iw><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://github.com/apache/incubator-wayang/issues/282%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw3CHvahymuTqYTrwc52ebjD&source=gmail-imap&ust=1682527562000000&usg=AOvVaw3e9Wmp6xz9vq6jNG8CUD-z><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2ZkiU8-ZBYEdPPRJF78DV9%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3CHvahymuTqYTrwc52ebjD%3e>,
>>>>> I
>>>>>>>>> found the discussion
>>>>>>>>> <
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw1m4D4wACfxT02JUaM_xkvi%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3TzmdxiF_9es899NcxN8d5%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw0uMQT8ihnPENWa8gNqzcL6%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2VYbRRTjzDEwdu1XVuEaHd&source=gmail-imap&ust=1682527562000000&usg=AOvVaw36HnsmuuzNy-GRVxUfTcu1><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw1m4D4wACfxT02JUaM_xkvi%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw3TzmdxiF_9es899NcxN8d5%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw0uMQT8ihnPENWa8gNqzcL6%25253e%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2KoXmmMzDqA3V7pgdD7Sf4&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0u_A65dAGT-CJmZm5utvWb><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2VYbRRTjzDEwdu1XVuEaHd%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2KoXmmMzDqA3V7pgdD7Sf4%3e>
>>>>> and
>>>>>>>>> sure, I can help to solve the problem. But I believe my current
>>>>> solution is
>>>>>>>>> not what we really want in the long run, right? The key part is to
>>>>> correct
>>>>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>>>>> themselves to add missing jars. While I am not quite familiar with
>>>>> Wayand's
>>>>>>>>> release process, will there be someone else with more experience to
>>>>> figure
>>>>>>>>> it out?
>>>>>>>>> Then I can take care of the other parts like validating the new
>>>>> zip/tar
>>>>>>>>> file, improving the README or solving some other problems in the
>>>>> process.
>>>>>>>>> What do you think?
>>>>>>>>> 
>>>>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>>>>> 
>>>>>>>>> Best,
>>>>>>>>> Biao Geng
>>>>>>>>> 
>>>>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>>> 于2023年4月14日周五 03:32写道：
>>>>>>>>> 
>>>>>>>>>> Dear Biao,
>>>>>>>>>> welcome to the Wayang community :)
>>>>>>>>>> It's great you could run Wayang and yes you are in the right
>>>>> direction.
>>>>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>>>>> suggested to have two different ways in the documentation. One is
>>>>> using the
>>>>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>>>>> production. The other is as you said like a library that you can use
>>>>> in
>>>>>>>>>> your java application when developing.
>>>>>>>>>> 
>>>>>>>>>> As you already made it run, do you think you could take care of that
>>>>> issue
>>>>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>>>>> Best
>>>>>>>>>> --Zoi
>>>>>>>>>> 
>>>>>>>>>> Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>>>>> Geng
>>>>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>>> 
>>>>>>>>>> Dear community,
>>>>>>>>>> 
>>>>>>>>>> Thanks for your efforts for creating this project! I am new to
>>>>> Wayang and
>>>>>>>>>> want to follow instructions to run a quick demo. I finally managed
>>>>> to do
>>>>>>>>>> that and could see outputs like the following(I wrote some notes
>>>>> about the
>>>>>>>>>> process in this issue’s comment<
>>>>>>>>>> 
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://www.google.com/url?q%25252525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252525252523issuecomment-1507208045%252525252526source%25252525253Dgmail-imap%252525252526ust%25252525253D1682062845000000%252525252526usg%25252525253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682067936000000%2525252526usg%252525253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682445157000000%25252526usg%2525253DAOvVaw06CRhhCuIpDwEbMTgY2TgF%252526source%25253Dgmail-imap%252526ust%25253D1682491142000000%252526usg%25253DAOvVaw2Rsab148FhEj8AKQI7B4oV%2526source%253Dgmail-imap%2526ust%253D1682499883000000%2526usg%253DAOvVaw3Z87e-vU2VJmxBDthG1W_F%26source%3Dgmail-imap%26ust%3D1682521801000000%26usg%3DAOvVaw2e91aUSVSR-CkOGm4EPzca&source=gmail-imap&ust=1682527562000000&usg=AOvVaw0a0Pn3iir9Ggx6hdBaJEp2
>>>>>>>>>>> ):
>>>>>>>>>> ```
>>>>>>>>>> Found 689 words:
>>>>>>>>>> 91x the
>>>>>>>>>> 87x wayang
>>>>>>>>>> 68x apache
>>>>>>>>>> ```
>>>>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>>>>> problems, which makes me wondering if I am on the right direction:
>>>>> should I
>>>>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>>>>> program
>>>>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>>>>> 
>>>>>>>>>> Best,
>>>>>>>>>> Biao Geng
>>>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> --
>>>>>>>> databloom AI, Inc.
>>>>>>>> 
>>>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>>>> 33127 Miami, Florida
>>>>>>>> United States
>>>>>>>> 
>>>>>>>> 
>>>>>>>> --  Please consider the environment before printing this
>>>>>>>> email --
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> Disclaimer:
>>>>>>>> The content of this message is confidential. If you
>>>>>>>> have received it by mistake, please inform us by an email reply and
>>>>> then
>>>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>>> reveal
>>>>>>>> the contents of this message to anyone. The integrity and security of
>>>>> this
>>>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>>>>> will
>>>>>>>> not be held liable for any damage caused by the message.
>>>>>>> 
>>>>>>> 
>>>>>>> --
>>>>>>> databloom AI, Inc.
>>>>>>> 
>>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>>> 33127 Miami, Florida
>>>>>>> United States
>>>>>>> 
>>>>>>> 
>>>>>>> --  Please consider the environment before printing this
>>>>>>> email --
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> Disclaimer:
>>>>>>> The content of this message is confidential. If you
>>>>>>> have received it by mistake, please inform us by an email reply and then
>>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>>> reveal
>>>>>>> the contents of this message to anyone. The integrity and security of
>>>>> this
>>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>>>> not be held liable for any damage caused by the message.
>>>>>>> 
>>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> databloom AI, Inc.
>>>>> 
>>>>> 3401 N. MIAMI AVE. STE 230
>>>>> 33127 Miami, Florida
>>>>> United States
>>>>> 
>>>>> 
>>>>> --  Please consider the environment before printing this
>>>>> email --
>>>>> 
>>>>> 
>>>>> 
>>>>> Disclaimer:
>>>>> The content of this message is confidential. If you
>>>>> have received it by mistake, please inform us by an email reply and then
>>>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>>>> the contents of this message to anyone. The integrity and security of this
>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>> not be held liable for any damage caused by the message.
>>>>> 
>>>>> 
>>> 
>>> --
>>> databloom AI, Inc.
>>> 
>>> 3401 N. MIAMI AVE. STE 230
>>> 33127 Miami, Florida
>>> United States
>>> 
>>> 
>>> --  Please consider the environment before printing this
>>> email --
>>> 
>>> 
>>> 
>>> Disclaimer:
>>> The content of this message is confidential. If you
>>> have received it by mistake, please inform us by an email reply and then
>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>> the contents of this message to anyone. The integrity and security of this
>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>> not be held liable for any damage caused by the message.
>> 
>> 
>> --
>> databloom AI, Inc.
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>> 
>> 
>> --  Please consider the environment before printing this
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
> 
> 
> --
> databloom AI, Inc.
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
> 
> 
> --  Please consider the environment before printing this
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Biao Geng <bi...@gmail.com>.

Got it. And just a correction for my previous email: I am *not* quite familiar with the release regulations of Apache. Sorry for the possible confusion.
Best,
Biao Geng

From: Alexander Alten <al...@databloom.ai>
Date: Wednesday, April 19, 2023 at 11:44 PM
To: dev@wayang.apache.org <de...@wayang.apache.org>
Subject: Re: What's the proper way to run Wayang's WordCount Example?
Hey Biao,

Fully agree :) It’s a community decision at the end, and when a bindery release makes more sense for users, we should consider this!

Cheers,
--Alex

> On 19. Apr 2023, at 17:09, Biao Geng <bi...@gmail.com> wrote:
>
> Hi there,
> Thanks for the information! I am quite familiar with the release regulations of Apache, but as a normal user of Flink and Spark, from their download page(Spark<https://www.google.com/url?q=https://spark.apache.org/downloads.html&source=gmail-imap&ust=1682521801000000&usg=AOvVaw044JGX5jCe0UTsfrEKeIqn>, Flink<https://www.google.com/url?q=https://flink.apache.org/downloads/&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3jzvw3N6IpB00syY3jeCFV>), these Apache projects will produce both source release(the tar that contains source code only) and binary release(the tar that contains binary files and jars). Hope it can help.
>
> Best,
> Biao Geng
> From: Alexander Alten <alo@databloom.ai <ma...@databloom.ai>>
> Date: Wednesday, April 19, 2023 at 5:12 PM
> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
> Subject: Re: What's the proper way to run Wayang's WordCount Example?
> Ya, thats a good point, and thank you for pointing this out. Generally spoken, a binary release can be problematic, since the code can contain unwanted licenses, add-ons etc. From my point, I’d vote in favor of a code release and with a -1 for a binary one. But thats a decision the community has to take.
>
> Nevertheless, it is possible to offer a binary release, albeit I think when the build instructions are clear and functional, we should stick with that and avoid a pre-built one. But again, just my opinion :)
>
> Best,
> —Alex
>
>> On 19. Apr 2023, at 11:04, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>
>> Hi all,
>> I agree that the main branch should not contain any binaries.
>>
>> Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
>> @Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)
>>
>> Best
>> --
>> Zoi
>>
>>   Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>
>> Hey Biao,
>>
>> Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz.
>>
>> What you think?
>>
>> Cheers,
>> —Alex
>>
>> Sent from my iPhone
>>
>>> On 19. Apr 2023, at 08:39, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>> wrote:
>>>
>>> Hi Alexander,
>>> Great to hear from you that the codes can work! And thanks for the hinting
>>> about Apache license. I would fix it.
>>> But for the PR, I add jars in my branch to facilitate the verification but
>>> I think we should not add jars directly to the main branch, right? From my
>>> experience, it may be better to create a tar.gz including all necessary
>>> jars and put it on the apache wayang's website or somewhere else provided
>>> by Apache.
>>> I did not add the tar.gz in my wordcount_fix branch because its size is
>>> larger than 100mb, which cannot be uploaded directly to Github. But I think
>>> all of us can build the tar.gz using wayang-assembly module(thanks to the
>>> previous work from other people) following my tutorial and maybe our
>>> release manager can publish the tar.gz so everyone of us can validate the
>>> release candidate.
>>>
>>> Best,
>>> Biao Geng
>>>
>>>
>>>
>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> 于2023年4月19日周三 03:02写道：
>>>
>>>> Hey,
>>>>
>>>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>>>> u please review?
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/pull/300%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0tTMAVXLDtf1nrrGef1Gi6%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3ja1w_beU8bYPm-KwMQYYz&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2xk1w9inp92ypqOzLmtrZX
>>>>
>>>> @Biao, please add the valid Apache Software License 2 headers,  see
>>>> Wordcount fix · apache/incubator-wayang@4431aed (github.com <http://github.com/> <https://www.google.com/url?q=http://github.com/&source=gmail-imap&ust=1682521801000000&usg=AOvVaw1tdHyBoZ0zW2UpIcmIg8nK>) <
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%25253D300%252523step:6:141%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw1-oOp0hFMC5rgdUdBsEuGt&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3UcUEjJ2epl9ajaSCaCFoL><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%25253D300%252523step:6:141%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0Ms5rOlvvg-43el5WUpTFM><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%25253D300%252523step:6:141%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw1-oOp0hFMC5rgdUdBsEuGt&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3UcUEjJ2epl9ajaSCaCFoL%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%25253D300%252523step:6:141%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0Ms5rOlvvg-43el5WUpTFM%3e>
>>>> ff
>>>>
>>>> Cheers,
>>>> —Alex
>>>>
>>>>>> On 18. Apr 2023, at 19:52, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> wrote:
>>>>>
>>>>> Hi folks,
>>>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>>>> zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>>.
>>>>> So, you can find the built binary files hers:
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1oHka8SFQc3UKYAHxgjP7W%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0p7wEfxyYvYyF5rDPhpchB%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0-tp1DqT5sMfYLAzVjF8mx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3Li-i9pxYZrECZ0FdLx5JE
>>>>> I also wrote a simple tutorial<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3juTbTSf5K_pccH_BmgU_P&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0xyQx5E99qbJSEzupD3Zjt><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3juTbTSf5K_pccH_BmgU_P%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2qcr8CRct8OqOKTUdl5HRE><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3juTbTSf5K_pccH_BmgU_P&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0xyQx5E99qbJSEzupD3Zjt%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3juTbTSf5K_pccH_BmgU_P%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2qcr8CRct8OqOKTUdl5HRE%3e>
>>>> based on README in the project. It would be great if anyone else can follow
>>>> the instructions in the doc to verify the word count example. If there are
>>>> any problems, please let me know.
>>>>>
>>>>> Besides, there are some interesting discoveries:
>>>>>
>>>>> 1.  We already have the wayang-assembly module, which would help us
>>>> build the binary easily. In fact, I directly used it in my wordcount_fix
>>>> branch instead of pushing my previous jars.
>>>>> 2.  Though the built binary files can work, it would still output some
>>>> annoying information, which I have mentioned in the issue<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw374wnAzaTdF9LIHsRJDsZt%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3bJ5xGRhGWIwPR-PxBoboB><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw374wnAzaTdF9LIHsRJDsZt%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0BphWKa6_9HYUZuxLAwHs0><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw374wnAzaTdF9LIHsRJDsZt%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3bJ5xGRhGWIwPR-PxBoboB%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw374wnAzaTdF9LIHsRJDsZt%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0BphWKa6_9HYUZuxLAwHs0%3e>.
>>>> I will spend some time later to figure out if we can avoid it.
>>>>>
>>>>> Best,
>>>>> Biao Geng
>>>>>
>>>>>
>>>>> From: Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>>
>>>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>> Hi there,
>>>>>
>>>>> Thanks a lot for your response and the discussion.
>>>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>>>> file with the binaries for the new release. I will also add a doc for that
>>>> so you can verify it at least by running the word count example.
>>>>> I may take following steps:
>>>>>
>>>>> 1.  I will create a fork based on current main branch(commitId is
>>>> d46f3c3<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0KR103oRbBWOAn_lLoacih%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2TW3xv-kgnBDwpswdEVbgN&source=gmail-imap&ust=1682521801000000&usg=AOvVaw29uK8aTb7VpaDqFmTEwVUA>)<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0KR103oRbBWOAn_lLoacih%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2TW3xv-kgnBDwpswdEVbgN%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0YWaqDfLMQCRQjr-1oz2m-)><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0KR103oRbBWOAn_lLoacih%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2TW3xv-kgnBDwpswdEVbgN&source=gmail-imap&ust=1682521801000000&usg=AOvVaw29uK8aTb7VpaDqFmTEwVUA%3e)%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0KR103oRbBWOAn_lLoacih%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2TW3xv-kgnBDwpswdEVbgN%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0YWaqDfLMQCRQjr-1oz2m-)%3e>
>>>> with workable jars for running the wordcount example.
>>>>> 2.  I will write a simple tutorial to show how to run the example
>>>> locally.
>>>>> I also create a jira<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://issues.apache.org/jira/browse/WAYANG-48%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Ct4RY6-4KvMMdPME2TaeA&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2J_WU-NDecUVuDP69MX3It><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://issues.apache.org/jira/browse/WAYANG-48%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3tDd4NhzwsJhDBnHd8XgHq><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://issues.apache.org/jira/browse/WAYANG-48%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Ct4RY6-4KvMMdPME2TaeA&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2J_WU-NDecUVuDP69MX3It%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://issues.apache.org/jira/browse/WAYANG-48%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3tDd4NhzwsJhDBnHd8XgHq%3e>
>>>> to track the work. Once I am ready, I will update in this thread.
>>>>>
>>>>> Best,
>>>>> Biao Geng
>>>>>
>>>>>
>>>>> From: Jorge Arnulfo Quiané Ruiz <quianeufo@gmail.com <ma...@gmail.com> <ma...@gmail.com>>
>>>>> Date: Monday, April 17, 2023 at 11:51 PM
>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>> Welcome on board Biao and thanks a lot for your help to the project,
>>>> pretty much appreciated!!!
>>>>>
>>>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>>>> will also perform point 2) we will start point 3.
>>>>>
>>>>> Best,
>>>>> Jorge
>>>>>
>>>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>> wrote:
>>>>>>
>>>>>> Great!
>>>>>> So, I propose to do the following:
>>>>>>
>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>> release
>>>>>> 2. I get the file and test it in my machine
>>>>>>
>>>>>> 3. Alex initiates the release process
>>>>>> How does this sound?
>>>>>>
>>>>>> Best--
>>>>>> Zoi
>>>>>>
>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>>>> Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>> έγραψε:
>>>>>>
>>>>>> Great!
>>>>>> So, I propose to do the following:
>>>>>>
>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>> release2. I get the file and test it in my machine
>>>>>> 3. Alex initiates the release process
>>>>>> How does this sound?
>>>>>> Best
>>>>>> --
>>>>>> Zoi
>>>>>>
>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>>>>>
>>>>>> Good point.
>>>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>> wrote:
>>>>>>>
>>>>>>> I think we should do a binary release first without changing anything
>>>> so that the installation problem is fixed asap. This won’t be a new release
>>>> but complementary to the current one. Isn’t that possible? Or is it
>>>> possible to just replace the current file we have with a new one?
>>>>>>
>>>>>> Yes, we need a new release.
>>>>>>
>>>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>>>> But this requires more time.
>>>>>>
>>>>>> +1
>>>>>>
>>>>>>> Best—Zoi
>>>>>>>
>>>>>>>
>>>>>>> Sent from Yahoo Mail for iPhone
>>>>>>>
>>>>>>>
>>>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>
>>>> <ma...@databloom.ai>> wrote:
>>>>>>>
>>>>>>> Hi, and welcome Biao :)
>>>>>>>
>>>>>>> Yes, we should certainly plan a new release as soon as we have
>>>> finished the cleanup process. From my point of view we should eliminate
>>>> Java 8 support due security concerns. I’m also in for to end support for
>>>> GraphChi, since this project is dead since 8 years. To end support for J8
>>>> and GraphChi I think we need to clarify the reasons in the release notes.
>>>> Maybe it’s a good idea to start a new thread which contains the content of
>>>> the next release? Just to make sure that we have a clear path.
>>>>>>>
>>>>>>> Objections and comments are welcome, @community!
>>>>>>>
>>>>>>> —Alex
>>>>>>>
>>>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>> wrote:
>>>>>>>>
>>>>>>>> Yes, I totally agree that we need to correct the current release and
>>>> provide the binaries and not the source code.
>>>>>>>> I am also not very familiar with the release process but I think Alex
>>>> and/or Chris could help with that.@Alex, what do you think?
>>>>>>>> In the meantime, maybe you could add/modify the README instructions
>>>> for someone that wants to clone and build wayang and run the wordcount
>>>> locally? For example, I could also build it successfully in my laptop but
>>>> then it's not clear what I have to do to be able to run the main class.
>>>>>>>>
>>>>>>>> Best
>>>>>>>> --
>>>>>>>> Zoi
>>>>>>>>
>>>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>>>> Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>
>>>>>>>> Hi Zoi,
>>>>>>>> Thanks for the response! I see the point that the command-line tool
>>>> is for
>>>>>>>> production and the library is for development. That's consistent with
>>>> my
>>>>>>>> use experience of big data engines like spark and flink.
>>>>>>>> As for the issue <
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2ZkiU8-ZBYEdPPRJF78DV9><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3CHvahymuTqYTrwc52ebjD><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2ZkiU8-ZBYEdPPRJF78DV9%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3CHvahymuTqYTrwc52ebjD%3e>,
>>>> I
>>>>>>>> found the discussion
>>>>>>>> <
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2VYbRRTjzDEwdu1XVuEaHd><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2KoXmmMzDqA3V7pgdD7Sf4><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2VYbRRTjzDEwdu1XVuEaHd%3e%3chttps://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2KoXmmMzDqA3V7pgdD7Sf4%3e>
>>>> and
>>>>>>>> sure, I can help to solve the problem. But I believe my current
>>>> solution is
>>>>>>>> not what we really want in the long run, right? The key part is to
>>>> correct
>>>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>>>> themselves to add missing jars. While I am not quite familiar with
>>>> Wayand's
>>>>>>>> release process, will there be someone else with more experience to
>>>> figure
>>>>>>>> it out?
>>>>>>>> Then I can take care of the other parts like validating the new
>>>> zip/tar
>>>>>>>> file, improving the README or solving some other problems in the
>>>> process.
>>>>>>>> What do you think?
>>>>>>>>
>>>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>>>>
>>>>>>>> Best,
>>>>>>>> Biao Geng
>>>>>>>>
>>>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>> 于2023年4月14日周五 03:32写道：
>>>>>>>>
>>>>>>>>> Dear Biao,
>>>>>>>>> welcome to the Wayang community :)
>>>>>>>>> It's great you could run Wayang and yes you are in the right
>>>> direction.
>>>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>>>> suggested to have two different ways in the documentation. One is
>>>> using the
>>>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>>>> production. The other is as you said like a library that you can use
>>>> in
>>>>>>>>> your java application when developing.
>>>>>>>>>
>>>>>>>>> As you already made it run, do you think you could take care of that
>>>> issue
>>>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>>>> Best
>>>>>>>>> --Zoi
>>>>>>>>>
>>>>>>>>>  Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>>>> Geng
>>>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>>
>>>>>>>>> Dear community,
>>>>>>>>>
>>>>>>>>> Thanks for your efforts for creating this project! I am new to
>>>> Wayang and
>>>>>>>>> want to follow instructions to run a quick demo. I finally managed
>>>> to do
>>>>>>>>> that and could see outputs like the following(I wrote some notes
>>>> about the
>>>>>>>>> process in this issue’s comment<
>>>>>>>>>
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%252525252523issuecomment-1507208045%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw06CRhhCuIpDwEbMTgY2TgF%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw2Rsab148FhEj8AKQI7B4oV%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Z87e-vU2VJmxBDthG1W_F&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2e91aUSVSR-CkOGm4EPzca
>>>>>>>>>> ):
>>>>>>>>> ```
>>>>>>>>> Found 689 words:
>>>>>>>>> 91x the
>>>>>>>>> 87x wayang
>>>>>>>>> 68x apache
>>>>>>>>> ```
>>>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>>>> problems, which makes me wondering if I am on the right direction:
>>>> should I
>>>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>>>> program
>>>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>>>>
>>>>>>>>> Best,
>>>>>>>>> Biao Geng
>>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> databloom AI, Inc.
>>>>>>>
>>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>>> 33127 Miami, Florida
>>>>>>> United States
>>>>>>>
>>>>>>>
>>>>>>> --  Please consider the environment before printing this
>>>>>>> email --
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> Disclaimer:
>>>>>>> The content of this message is confidential. If you
>>>>>>> have received it by mistake, please inform us by an email reply and
>>>> then
>>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>> reveal
>>>>>>> the contents of this message to anyone. The integrity and security of
>>>> this
>>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>>>> will
>>>>>>> not be held liable for any damage caused by the message.
>>>>>>
>>>>>>
>>>>>> --
>>>>>> databloom AI, Inc.
>>>>>>
>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>> 33127 Miami, Florida
>>>>>> United States
>>>>>>
>>>>>>
>>>>>> --  Please consider the environment before printing this
>>>>>> email --
>>>>>>
>>>>>>
>>>>>>
>>>>>> Disclaimer:
>>>>>> The content of this message is confidential. If you
>>>>>> have received it by mistake, please inform us by an email reply and then
>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>> reveal
>>>>>> the contents of this message to anyone. The integrity and security of
>>>> this
>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>>> not be held liable for any damage caused by the message.
>>>>>>
>>>>>>
>>>>
>>>>
>>>> --
>>>> databloom AI, Inc.
>>>>
>>>> 3401 N. MIAMI AVE. STE 230
>>>> 33127 Miami, Florida
>>>> United States
>>>>
>>>>
>>>> --  Please consider the environment before printing this
>>>> email --
>>>>
>>>>
>>>>
>>>> Disclaimer:
>>>> The content of this message is confidential. If you
>>>> have received it by mistake, please inform us by an email reply and then
>>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>>> the contents of this message to anyone. The integrity and security of this
>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>> not be held liable for any damage caused by the message.
>>>>
>>>>
>>
>> --
>> databloom AI, Inc.
>>
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>>
>>
>> --  Please consider the environment before printing this
>> email --
>>
>>
>>
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
>
>
> --
> databloom AI, Inc.
>
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
>
>
> --  Please consider the environment before printing this
> email --
>
>
>
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.


--
databloom AI, Inc.

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida
United States


--  Please consider the environment before printing this
email --



Disclaimer:
The content of this message is confidential. If you
have received it by mistake, please inform us by an email reply and then
delete the message. It is forbidden to copy, forward, or in any way reveal
the contents of this message to anyone. The integrity and security of this
email cannot be guaranteed over the Internet. Therefore, the sender will
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten <al...@databloom.ai>.

Hey Biao,

Fully agree :) It’s a community decision at the end, and when a bindery release makes more sense for users, we should consider this! 

Cheers, 
--Alex 

> On 19. Apr 2023, at 17:09, Biao Geng <bi...@gmail.com> wrote:
> 
> Hi there,
> Thanks for the information! I am quite familiar with the release regulations of Apache, but as a normal user of Flink and Spark, from their download page(Spark<https://www.google.com/url?q=https://spark.apache.org/downloads.html&source=gmail-imap&ust=1682521801000000&usg=AOvVaw044JGX5jCe0UTsfrEKeIqn>, Flink<https://www.google.com/url?q=https://flink.apache.org/downloads/&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3jzvw3N6IpB00syY3jeCFV>), these Apache projects will produce both source release(the tar that contains source code only) and binary release(the tar that contains binary files and jars). Hope it can help.
> 
> Best,
> Biao Geng
> From: Alexander Alten <alo@databloom.ai <ma...@databloom.ai>>
> Date: Wednesday, April 19, 2023 at 5:12 PM
> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
> Subject: Re: What's the proper way to run Wayang's WordCount Example?
> Ya, thats a good point, and thank you for pointing this out. Generally spoken, a binary release can be problematic, since the code can contain unwanted licenses, add-ons etc. From my point, I’d vote in favor of a code release and with a -1 for a binary one. But thats a decision the community has to take.
> 
> Nevertheless, it is possible to offer a binary release, albeit I think when the build instructions are clear and functional, we should stick with that and avoid a pre-built one. But again, just my opinion :)
> 
> Best,
> —Alex
> 
>> On 19. Apr 2023, at 11:04, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>> 
>> Hi all,
>> I agree that the main branch should not contain any binaries.
>> 
>> Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
>> @Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)
>> 
>> Best
>> --
>> Zoi
>> 
>>   Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>> 
>> Hey Biao,
>> 
>> Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz.
>> 
>> What you think?
>> 
>> Cheers,
>> —Alex
>> 
>> Sent from my iPhone
>> 
>>> On 19. Apr 2023, at 08:39, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>> wrote:
>>> 
>>> Hi Alexander,
>>> Great to hear from you that the codes can work! And thanks for the hinting
>>> about Apache license. I would fix it.
>>> But for the PR, I add jars in my branch to facilitate the verification but
>>> I think we should not add jars directly to the main branch, right? From my
>>> experience, it may be better to create a tar.gz including all necessary
>>> jars and put it on the apache wayang's website or somewhere else provided
>>> by Apache.
>>> I did not add the tar.gz in my wordcount_fix branch because its size is
>>> larger than 100mb, which cannot be uploaded directly to Github. But I think
>>> all of us can build the tar.gz using wayang-assembly module(thanks to the
>>> previous work from other people) following my tutorial and maybe our
>>> release manager can publish the tar.gz so everyone of us can validate the
>>> release candidate.
>>> 
>>> Best,
>>> Biao Geng
>>> 
>>> 
>>> 
>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> 于2023年4月19日周三 03:02写道：
>>> 
>>>> Hey,
>>>> 
>>>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>>>> u please review?
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/pull/300%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0tTMAVXLDtf1nrrGef1Gi6%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3ja1w_beU8bYPm-KwMQYYz&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2xk1w9inp92ypqOzLmtrZX
>>>> 
>>>> @Biao, please add the valid Apache Software License 2 headers,  see
>>>> Wordcount fix · apache/incubator-wayang@4431aed (github.com <http://github.com/> <https://www.google.com/url?q=http://github.com/&source=gmail-imap&ust=1682521801000000&usg=AOvVaw1tdHyBoZ0zW2UpIcmIg8nK>) <
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%25253D300%252523step:6:141%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw1-oOp0hFMC5rgdUdBsEuGt&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3UcUEjJ2epl9ajaSCaCFoL><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%25253D300%252523step:6:141%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0PTqlEt48VuUq8L-MSH4xJ%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw1-oOp0hFMC5rgdUdBsEuGt%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0Ms5rOlvvg-43el5WUpTFM>
>>>> ff
>>>> 
>>>> Cheers,
>>>> —Alex
>>>> 
>>>>>> On 18. Apr 2023, at 19:52, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> wrote:
>>>>> 
>>>>> Hi folks,
>>>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>>>> zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>>.
>>>>> So, you can find the built binary files hers:
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1oHka8SFQc3UKYAHxgjP7W%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0p7wEfxyYvYyF5rDPhpchB%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0-tp1DqT5sMfYLAzVjF8mx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3Li-i9pxYZrECZ0FdLx5JE
>>>>> I also wrote a simple tutorial<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3juTbTSf5K_pccH_BmgU_P&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0xyQx5E99qbJSEzupD3Zjt><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3n-a2AHlEcvAcHwqqZFXnm%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3juTbTSf5K_pccH_BmgU_P%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2qcr8CRct8OqOKTUdl5HRE>
>>>> based on README in the project. It would be great if anyone else can follow
>>>> the instructions in the doc to verify the word count example. If there are
>>>> any problems, please let me know.
>>>>> 
>>>>> Besides, there are some interesting discoveries:
>>>>> 
>>>>> 1.  We already have the wayang-assembly module, which would help us
>>>> build the binary easily. In fact, I directly used it in my wordcount_fix
>>>> branch instead of pushing my previous jars.
>>>>> 2.  Though the built binary files can work, it would still output some
>>>> annoying information, which I have mentioned in the issue<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw374wnAzaTdF9LIHsRJDsZt%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3bJ5xGRhGWIwPR-PxBoboB><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw374wnAzaTdF9LIHsRJDsZt%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2Zmy_B6UXWVriy6_gJ2_UI%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0BphWKa6_9HYUZuxLAwHs0>.
>>>> I will spend some time later to figure out if we can avoid it.
>>>>> 
>>>>> Best,
>>>>> Biao Geng
>>>>> 
>>>>> 
>>>>> From: Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>>
>>>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>> Hi there,
>>>>> 
>>>>> Thanks a lot for your response and the discussion.
>>>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>>>> file with the binaries for the new release. I will also add a doc for that
>>>> so you can verify it at least by running the word count example.
>>>>> I may take following steps:
>>>>> 
>>>>> 1.  I will create a fork based on current main branch(commitId is
>>>> d46f3c3<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0KR103oRbBWOAn_lLoacih%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2TW3xv-kgnBDwpswdEVbgN&source=gmail-imap&ust=1682521801000000&usg=AOvVaw29uK8aTb7VpaDqFmTEwVUA>)<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0KR103oRbBWOAn_lLoacih%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1Z0reT6hP3FdL0xT0AG6eR%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2TW3xv-kgnBDwpswdEVbgN%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw0YWaqDfLMQCRQjr-1oz2m-)>
>>>> with workable jars for running the wordcount example.
>>>>> 2.  I will write a simple tutorial to show how to run the example
>>>> locally.
>>>>> I also create a jira<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://issues.apache.org/jira/browse/WAYANG-48%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Ct4RY6-4KvMMdPME2TaeA&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2J_WU-NDecUVuDP69MX3It><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://issues.apache.org/jira/browse/WAYANG-48%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw1bbjMe4Na9GBayFrhHdfNF%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Ct4RY6-4KvMMdPME2TaeA%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3tDd4NhzwsJhDBnHd8XgHq>
>>>> to track the work. Once I am ready, I will update in this thread.
>>>>> 
>>>>> Best,
>>>>> Biao Geng
>>>>> 
>>>>> 
>>>>> From: Jorge Arnulfo Quiané Ruiz <quianeufo@gmail.com <ma...@gmail.com> <ma...@gmail.com>>
>>>>> Date: Monday, April 17, 2023 at 11:51 PM
>>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org> <ma...@wayang.apache.org>>
>>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>>> Welcome on board Biao and thanks a lot for your help to the project,
>>>> pretty much appreciated!!!
>>>>> 
>>>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>>>> will also perform point 2) we will start point 3.
>>>>> 
>>>>> Best,
>>>>> Jorge
>>>>> 
>>>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID> <ma...@yahoo.gr.INVALID>> wrote:
>>>>>> 
>>>>>> Great!
>>>>>> So, I propose to do the following:
>>>>>> 
>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>> release
>>>>>> 2. I get the file and test it in my machine
>>>>>> 
>>>>>> 3. Alex initiates the release process
>>>>>> How does this sound?
>>>>>> 
>>>>>> Best--
>>>>>> Zoi
>>>>>> 
>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>>>> Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>> έγραψε:
>>>>>> 
>>>>>> Great!
>>>>>> So, I propose to do the following:
>>>>>> 
>>>>>> 1. Biao creates the compressed file with the binaries for the new
>>>> release2. I get the file and test it in my machine
>>>>>> 3. Alex initiates the release process
>>>>>> How does this sound?
>>>>>> Best
>>>>>> --
>>>>>> Zoi
>>>>>> 
>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>> έγραψε:
>>>>>> 
>>>>>> Good point.
>>>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>> wrote:
>>>>>>> 
>>>>>>> I think we should do a binary release first without changing anything
>>>> so that the installation problem is fixed asap. This won’t be a new release
>>>> but complementary to the current one. Isn’t that possible? Or is it
>>>> possible to just replace the current file we have with a new one?
>>>>>> 
>>>>>> Yes, we need a new release.
>>>>>> 
>>>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>>>> But this requires more time.
>>>>>> 
>>>>>> +1
>>>>>> 
>>>>>>> Best—Zoi
>>>>>>> 
>>>>>>> 
>>>>>>> Sent from Yahoo Mail for iPhone
>>>>>>> 
>>>>>>> 
>>>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai> <ma...@databloom.ai>
>>>> <ma...@databloom.ai>> wrote:
>>>>>>> 
>>>>>>> Hi, and welcome Biao :)
>>>>>>> 
>>>>>>> Yes, we should certainly plan a new release as soon as we have
>>>> finished the cleanup process. From my point of view we should eliminate
>>>> Java 8 support due security concerns. I’m also in for to end support for
>>>> GraphChi, since this project is dead since 8 years. To end support for J8
>>>> and GraphChi I think we need to clarify the reasons in the release notes.
>>>> Maybe it’s a good idea to start a new thread which contains the content of
>>>> the next release? Just to make sure that we have a clear path.
>>>>>>> 
>>>>>>> Objections and comments are welcome, @community!
>>>>>>> 
>>>>>>> —Alex
>>>>>>> 
>>>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>> wrote:
>>>>>>>> 
>>>>>>>> Yes, I totally agree that we need to correct the current release and
>>>> provide the binaries and not the source code.
>>>>>>>> I am also not very familiar with the release process but I think Alex
>>>> and/or Chris could help with that.@Alex, what do you think?
>>>>>>>> In the meantime, maybe you could add/modify the README instructions
>>>> for someone that wants to clone and build wayang and run the wordcount
>>>> locally? For example, I could also build it successfully in my laptop but
>>>> then it's not clear what I have to do to be able to run the main class.
>>>>>>>> 
>>>>>>>> Best
>>>>>>>> --
>>>>>>>> Zoi
>>>>>>>> 
>>>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>>>> Biao Geng <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>> 
>>>>>>>> Hi Zoi,
>>>>>>>> Thanks for the response! I see the point that the command-line tool
>>>> is for
>>>>>>>> production and the library is for development. That's consistent with
>>>> my
>>>>>>>> use experience of big data engines like spark and flink.
>>>>>>>> As for the issue <
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2ZkiU8-ZBYEdPPRJF78DV9><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw2C3gfz-iK_Hqm2mntfDbwx%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw3CHvahymuTqYTrwc52ebjD>,
>>>> I
>>>>>>>> found the discussion
>>>>>>>> <
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2VYbRRTjzDEwdu1XVuEaHd><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw1m4D4wACfxT02JUaM_xkvi%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw3TzmdxiF_9es899NcxN8d5%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw0uMQT8ihnPENWa8gNqzcL6%253e&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2KoXmmMzDqA3V7pgdD7Sf4>
>>>> and
>>>>>>>> sure, I can help to solve the problem. But I believe my current
>>>> solution is
>>>>>>>> not what we really want in the long run, right? The key part is to
>>>> correct
>>>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>>>> themselves to add missing jars. While I am not quite familiar with
>>>> Wayand's
>>>>>>>> release process, will there be someone else with more experience to
>>>> figure
>>>>>>>> it out?
>>>>>>>> Then I can take care of the other parts like validating the new
>>>> zip/tar
>>>>>>>> file, improving the README or solving some other problems in the
>>>> process.
>>>>>>>> What do you think?
>>>>>>>> 
>>>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>>>> 
>>>>>>>> Best,
>>>>>>>> Biao Geng
>>>>>>>> 
>>>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>>> 于2023年4月14日周五 03:32写道：
>>>>>>>> 
>>>>>>>>> Dear Biao,
>>>>>>>>> welcome to the Wayang community :)
>>>>>>>>> It's great you could run Wayang and yes you are in the right
>>>> direction.
>>>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>>>> suggested to have two different ways in the documentation. One is
>>>> using the
>>>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>>>> production. The other is as you said like a library that you can use
>>>> in
>>>>>>>>> your java application when developing.
>>>>>>>>> 
>>>>>>>>> As you already made it run, do you think you could take care of that
>>>> issue
>>>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>>>> Best
>>>>>>>>> --Zoi
>>>>>>>>> 
>>>>>>>>>  Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>>>> Geng
>>>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>> 
>>>>>>>>> Dear community,
>>>>>>>>> 
>>>>>>>>> Thanks for your efforts for creating this project! I am new to
>>>> Wayang and
>>>>>>>>> want to follow instructions to run a quick demo. I finally managed
>>>> to do
>>>>>>>>> that and could see outputs like the following(I wrote some notes
>>>> about the
>>>>>>>>> process in this issue’s comment<
>>>>>>>>> 
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://www.google.com/url?q%252525253Dhttps://github.com/apache/incubator-wayang/issues/282%252525252523issuecomment-1507208045%2525252526source%252525253Dgmail-imap%2525252526ust%252525253D1682062845000000%2525252526usg%252525253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682067936000000%25252526usg%2525253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%252526source%25253Dgmail-imap%252526ust%25253D1682445157000000%252526usg%25253DAOvVaw06CRhhCuIpDwEbMTgY2TgF%2526source%253Dgmail-imap%2526ust%253D1682491142000000%2526usg%253DAOvVaw2Rsab148FhEj8AKQI7B4oV%26source%3Dgmail-imap%26ust%3D1682499883000000%26usg%3DAOvVaw3Z87e-vU2VJmxBDthG1W_F&source=gmail-imap&ust=1682521801000000&usg=AOvVaw2e91aUSVSR-CkOGm4EPzca
>>>>>>>>>> ):
>>>>>>>>> ```
>>>>>>>>> Found 689 words:
>>>>>>>>> 91x the
>>>>>>>>> 87x wayang
>>>>>>>>> 68x apache
>>>>>>>>> ```
>>>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>>>> problems, which makes me wondering if I am on the right direction:
>>>> should I
>>>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>>>> program
>>>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>>>> 
>>>>>>>>> Best,
>>>>>>>>> Biao Geng
>>>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> --
>>>>>>> databloom AI, Inc.
>>>>>>> 
>>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>>> 33127 Miami, Florida
>>>>>>> United States
>>>>>>> 
>>>>>>> 
>>>>>>> --  Please consider the environment before printing this
>>>>>>> email --
>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> Disclaimer:
>>>>>>> The content of this message is confidential. If you
>>>>>>> have received it by mistake, please inform us by an email reply and
>>>> then
>>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>> reveal
>>>>>>> the contents of this message to anyone. The integrity and security of
>>>> this
>>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>>>> will
>>>>>>> not be held liable for any damage caused by the message.
>>>>>> 
>>>>>> 
>>>>>> --
>>>>>> databloom AI, Inc.
>>>>>> 
>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>> 33127 Miami, Florida
>>>>>> United States
>>>>>> 
>>>>>> 
>>>>>> --  Please consider the environment before printing this
>>>>>> email --
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> Disclaimer:
>>>>>> The content of this message is confidential. If you
>>>>>> have received it by mistake, please inform us by an email reply and then
>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>>> reveal
>>>>>> the contents of this message to anyone. The integrity and security of
>>>> this
>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>>> not be held liable for any damage caused by the message.
>>>>>> 
>>>>>> 
>>>> 
>>>> 
>>>> --
>>>> databloom AI, Inc.
>>>> 
>>>> 3401 N. MIAMI AVE. STE 230
>>>> 33127 Miami, Florida
>>>> United States
>>>> 
>>>> 
>>>> --  Please consider the environment before printing this
>>>> email --
>>>> 
>>>> 
>>>> 
>>>> Disclaimer:
>>>> The content of this message is confidential. If you
>>>> have received it by mistake, please inform us by an email reply and then
>>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>>> the contents of this message to anyone. The integrity and security of this
>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>> not be held liable for any damage caused by the message.
>>>> 
>>>> 
>> 
>> --
>> databloom AI, Inc.
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>> 
>> 
>> --  Please consider the environment before printing this
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
> 
> 
> --
> databloom AI, Inc.
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
> 
> 
> --  Please consider the environment before printing this
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Biao Geng <bi...@gmail.com>.

Hi there,
Thanks for the information! I am quite familiar with the release regulations of Apache, but as a normal user of Flink and Spark, from their download page(Spark<https://spark.apache.org/downloads.html>, Flink<https://flink.apache.org/downloads/>), these Apache projects will produce both source release(the tar that contains source code only) and binary release(the tar that contains binary files and jars). Hope it can help.

Best,
Biao Geng
From: Alexander Alten <al...@databloom.ai>
Date: Wednesday, April 19, 2023 at 5:12 PM
To: dev@wayang.apache.org <de...@wayang.apache.org>
Subject: Re: What's the proper way to run Wayang's WordCount Example?
Ya, thats a good point, and thank you for pointing this out. Generally spoken, a binary release can be problematic, since the code can contain unwanted licenses, add-ons etc. From my point, I’d vote in favor of a code release and with a -1 for a binary one. But thats a decision the community has to take.

Nevertheless, it is possible to offer a binary release, albeit I think when the build instructions are clear and functional, we should stick with that and avoid a pre-built one. But again, just my opinion :)

Best,
—Alex

> On 19. Apr 2023, at 11:04, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>
> Hi all,
> I agree that the main branch should not contain any binaries.
>
> Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
> @Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)
>
> Best
> --
> Zoi
>
>    Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <alo@databloom.ai <ma...@databloom.ai>> έγραψε:
>
> Hey Biao,
>
> Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz.
>
> What you think?
>
> Cheers,
> —Alex
>
> Sent from my iPhone
>
>> On 19. Apr 2023, at 08:39, Biao Geng <bi...@gmail.com> wrote:
>>
>> Hi Alexander,
>> Great to hear from you that the codes can work! And thanks for the hinting
>> about Apache license. I would fix it.
>> But for the PR, I add jars in my branch to facilitate the verification but
>> I think we should not add jars directly to the main branch, right? From my
>> experience, it may be better to create a tar.gz including all necessary
>> jars and put it on the apache wayang's website or somewhere else provided
>> by Apache.
>> I did not add the tar.gz in my wordcount_fix branch because its size is
>> larger than 100mb, which cannot be uploaded directly to Github. But I think
>> all of us can build the tar.gz using wayang-assembly module(thanks to the
>> previous work from other people) following my tutorial and maybe our
>> release manager can publish the tar.gz so everyone of us can validate the
>> release candidate.
>>
>> Best,
>> Biao Geng
>>
>>
>>
>> Alexander Alten <al...@databloom.ai> 于2023年4月19日周三 03:02写道：
>>
>>> Hey,
>>>
>>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>>> u please review?
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/pull/300%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0tTMAVXLDtf1nrrGef1Gi6&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3ja1w_beU8bYPm-KwMQYYz
>>>
>>> @Biao, please add the valid Apache Software License 2 headers,  see
>>> Wordcount fix · apache/incubator-wayang@4431aed (github.com <http://github.com/>) <
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%253D300%2523step:6:141%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0PTqlEt48VuUq8L-MSH4xJ&source=gmail-imap&ust=1682499883000000&usg=AOvVaw1-oOp0hFMC5rgdUdBsEuGt><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%253D300%2523step:6:141%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0PTqlEt48VuUq8L-MSH4xJ&source=gmail-imap&ust=1682499883000000&usg=AOvVaw1-oOp0hFMC5rgdUdBsEuGt%3e>
>>> ff
>>>
>>> Cheers,
>>> —Alex
>>>
>>>>> On 18. Apr 2023, at 19:52, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>> wrote:
>>>>
>>>> Hi folks,
>>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>>> zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID>>.
>>>> So, you can find the built binary files hers:
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw1oHka8SFQc3UKYAHxgjP7W%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0p7wEfxyYvYyF5rDPhpchB&source=gmail-imap&ust=1682499883000000&usg=AOvVaw0-tp1DqT5sMfYLAzVjF8mx
>>>> I also wrote a simple tutorial<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw3n-a2AHlEcvAcHwqqZFXnm&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3juTbTSf5K_pccH_BmgU_P><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw3n-a2AHlEcvAcHwqqZFXnm&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3juTbTSf5K_pccH_BmgU_P%3e>
>>> based on README in the project. It would be great if anyone else can follow
>>> the instructions in the doc to verify the word count example. If there are
>>> any problems, please let me know.
>>>>
>>>> Besides, there are some interesting discoveries:
>>>>
>>>> 1.  We already have the wayang-assembly module, which would help us
>>> build the binary easily. In fact, I directly used it in my wordcount_fix
>>> branch instead of pushing my previous jars.
>>>> 2.  Though the built binary files can work, it would still output some
>>> annoying information, which I have mentioned in the issue<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw374wnAzaTdF9LIHsRJDsZt&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2Zmy_B6UXWVriy6_gJ2_UI><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw374wnAzaTdF9LIHsRJDsZt&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2Zmy_B6UXWVriy6_gJ2_UI%3e>.
>>> I will spend some time later to figure out if we can avoid it.
>>>>
>>>> Best,
>>>> Biao Geng
>>>>
>>>>
>>>> From: Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>>
>>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>> Hi there,
>>>>
>>>> Thanks a lot for your response and the discussion.
>>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>>> file with the binaries for the new release. I will also add a doc for that
>>> so you can verify it at least by running the word count example.
>>>> I may take following steps:
>>>>
>>>> 1.  I will create a fork based on current main branch(commitId is
>>> d46f3c3<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0KR103oRbBWOAn_lLoacih%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw1Z0reT6hP3FdL0xT0AG6eR&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2TW3xv-kgnBDwpswdEVbgN>)<https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0KR103oRbBWOAn_lLoacih%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw1Z0reT6hP3FdL0xT0AG6eR&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2TW3xv-kgnBDwpswdEVbgN%3e)>
>>> with workable jars for running the wordcount example.
>>>> 2.  I will write a simple tutorial to show how to run the example
>>> locally.
>>>> I also create a jira<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://issues.apache.org/jira/browse/WAYANG-48%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw1bbjMe4Na9GBayFrhHdfNF&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3Ct4RY6-4KvMMdPME2TaeA><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://issues.apache.org/jira/browse/WAYANG-48%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw1bbjMe4Na9GBayFrhHdfNF&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3Ct4RY6-4KvMMdPME2TaeA%3e>
>>> to track the work. Once I am ready, I will update in this thread.
>>>>
>>>> Best,
>>>> Biao Geng
>>>>
>>>>
>>>> From: Jorge Arnulfo Quiané Ruiz <quianeufo@gmail.com <ma...@gmail.com>>
>>>> Date: Monday, April 17, 2023 at 11:51 PM
>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>> Welcome on board Biao and thanks a lot for your help to the project,
>>> pretty much appreciated!!!
>>>>
>>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>>> will also perform point 2) we will start point 3.
>>>>
>>>> Best,
>>>> Jorge
>>>>
>>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID>> wrote:
>>>>>
>>>>> Great!
>>>>> So, I propose to do the following:
>>>>>
>>>>> 1. Biao creates the compressed file with the binaries for the new
>>> release
>>>>> 2. I get the file and test it in my machine
>>>>>
>>>>> 3. Alex initiates the release process
>>>>> How does this sound?
>>>>>
>>>>> Best--
>>>>> Zoi
>>>>>
>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>>> Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> έγραψε:
>>>>>
>>>>> Great!
>>>>> So, I propose to do the following:
>>>>>
>>>>> 1. Biao creates the compressed file with the binaries for the new
>>> release2. I get the file and test it in my machine
>>>>> 3. Alex initiates the release process
>>>>> How does this sound?
>>>>> Best
>>>>> --
>>>>> Zoi
>>>>>
>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> έγραψε:
>>>>>
>>>>> Good point.
>>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
>>> wrote:
>>>>>>
>>>>>> I think we should do a binary release first without changing anything
>>> so that the installation problem is fixed asap. This won’t be a new release
>>> but complementary to the current one. Isn’t that possible? Or is it
>>> possible to just replace the current file we have with a new one?
>>>>>
>>>>> Yes, we need a new release.
>>>>>
>>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>>> But this requires more time.
>>>>>
>>>>> +1
>>>>>
>>>>>> Best—Zoi
>>>>>>
>>>>>>
>>>>>> Sent from Yahoo Mail for iPhone
>>>>>>
>>>>>>
>>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>
>>> <ma...@databloom.ai>> wrote:
>>>>>>
>>>>>> Hi, and welcome Biao :)
>>>>>>
>>>>>> Yes, we should certainly plan a new release as soon as we have
>>> finished the cleanup process. From my point of view we should eliminate
>>> Java 8 support due security concerns. I’m also in for to end support for
>>> GraphChi, since this project is dead since 8 years. To end support for J8
>>> and GraphChi I think we need to clarify the reasons in the release notes.
>>> Maybe it’s a good idea to start a new thread which contains the content of
>>> the next release? Just to make sure that we have a clear path.
>>>>>>
>>>>>> Objections and comments are welcome, @community!
>>>>>>
>>>>>> —Alex
>>>>>>
>>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
>>> wrote:
>>>>>>>
>>>>>>> Yes, I totally agree that we need to correct the current release and
>>> provide the binaries and not the source code.
>>>>>>> I am also not very familiar with the release process but I think Alex
>>> and/or Chris could help with that.@Alex, what do you think?
>>>>>>> In the meantime, maybe you could add/modify the README instructions
>>> for someone that wants to clone and build wayang and run the wordcount
>>> locally? For example, I could also build it successfully in my laptop but
>>> then it's not clear what I have to do to be able to run the main class.
>>>>>>>
>>>>>>> Best
>>>>>>> --
>>>>>>> Zoi
>>>>>>>
>>>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>>> Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>>>>
>>>>>>> Hi Zoi,
>>>>>>> Thanks for the response! I see the point that the command-line tool
>>> is for
>>>>>>> production and the library is for development. That's consistent with
>>> my
>>>>>>> use experience of big data engines like spark and flink.
>>>>>>> As for the issue <
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2C3gfz-iK_Hqm2mntfDbwx><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2C3gfz-iK_Hqm2mntfDbwx%3e>,
>>> I
>>>>>>> found the discussion
>>>>>>> <
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw1m4D4wACfxT02JUaM_xkvi%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw3TzmdxiF_9es899NcxN8d5&source=gmail-imap&ust=1682499883000000&usg=AOvVaw0uMQT8ihnPENWa8gNqzcL6><https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw1m4D4wACfxT02JUaM_xkvi%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw3TzmdxiF_9es899NcxN8d5&source=gmail-imap&ust=1682499883000000&usg=AOvVaw0uMQT8ihnPENWa8gNqzcL6%3e>
>>> and
>>>>>>> sure, I can help to solve the problem. But I believe my current
>>> solution is
>>>>>>> not what we really want in the long run, right? The key part is to
>>> correct
>>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>>> themselves to add missing jars. While I am not quite familiar with
>>> Wayand's
>>>>>>> release process, will there be someone else with more experience to
>>> figure
>>>>>>> it out?
>>>>>>> Then I can take care of the other parts like validating the new
>>> zip/tar
>>>>>>> file, improving the README or solving some other problems in the
>>> process.
>>>>>>> What do you think?
>>>>>>>
>>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>>>
>>>>>>> Best,
>>>>>>> Biao Geng
>>>>>>>
>>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>> 于2023年4月14日周五 03:32写道：
>>>>>>>
>>>>>>>> Dear Biao,
>>>>>>>> welcome to the Wayang community :)
>>>>>>>> It's great you could run Wayang and yes you are in the right
>>> direction.
>>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>>> suggested to have two different ways in the documentation. One is
>>> using the
>>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>>> production. The other is as you said like a library that you can use
>>> in
>>>>>>>> your java application when developing.
>>>>>>>>
>>>>>>>> As you already made it run, do you think you could take care of that
>>> issue
>>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>>> Best
>>>>>>>> --Zoi
>>>>>>>>
>>>>>>>>   Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>>> Geng
>>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>>
>>>>>>>> Dear community,
>>>>>>>>
>>>>>>>> Thanks for your efforts for creating this project! I am new to
>>> Wayang and
>>>>>>>> want to follow instructions to run a quick demo. I finally managed
>>> to do
>>>>>>>> that and could see outputs like the following(I wrote some notes
>>> about the
>>>>>>>> process in this issue’s comment<
>>>>>>>>
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252523issuecomment-1507208045%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw06CRhhCuIpDwEbMTgY2TgF%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw2Rsab148FhEj8AKQI7B4oV&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3Z87e-vU2VJmxBDthG1W_F
>>>>>>>>> ):
>>>>>>>> ```
>>>>>>>> Found 689 words:
>>>>>>>> 91x the
>>>>>>>> 87x wayang
>>>>>>>> 68x apache
>>>>>>>> ```
>>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>>> problems, which makes me wondering if I am on the right direction:
>>> should I
>>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>>> program
>>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>>>
>>>>>>>> Best,
>>>>>>>> Biao Geng
>>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> databloom AI, Inc.
>>>>>>
>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>> 33127 Miami, Florida
>>>>>> United States
>>>>>>
>>>>>>
>>>>>> --  Please consider the environment before printing this
>>>>>> email --
>>>>>>
>>>>>>
>>>>>>
>>>>>> Disclaimer:
>>>>>> The content of this message is confidential. If you
>>>>>> have received it by mistake, please inform us by an email reply and
>>> then
>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>> reveal
>>>>>> the contents of this message to anyone. The integrity and security of
>>> this
>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>>> will
>>>>>> not be held liable for any damage caused by the message.
>>>>>
>>>>>
>>>>> --
>>>>> databloom AI, Inc.
>>>>>
>>>>> 3401 N. MIAMI AVE. STE 230
>>>>> 33127 Miami, Florida
>>>>> United States
>>>>>
>>>>>
>>>>> --  Please consider the environment before printing this
>>>>> email --
>>>>>
>>>>>
>>>>>
>>>>> Disclaimer:
>>>>> The content of this message is confidential. If you
>>>>> have received it by mistake, please inform us by an email reply and then
>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>> reveal
>>>>> the contents of this message to anyone. The integrity and security of
>>> this
>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>> not be held liable for any damage caused by the message.
>>>>>
>>>>>
>>>
>>>
>>> --
>>> databloom AI, Inc.
>>>
>>> 3401 N. MIAMI AVE. STE 230
>>> 33127 Miami, Florida
>>> United States
>>>
>>>
>>> --  Please consider the environment before printing this
>>> email --
>>>
>>>
>>>
>>> Disclaimer:
>>> The content of this message is confidential. If you
>>> have received it by mistake, please inform us by an email reply and then
>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>> the contents of this message to anyone. The integrity and security of this
>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>> not be held liable for any damage caused by the message.
>>>
>>>
>
> --
> databloom AI, Inc.
>
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
>
>
> --  Please consider the environment before printing this
> email --
>
>
>
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.


--
databloom AI, Inc.

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida
United States


--  Please consider the environment before printing this
email --



Disclaimer:
The content of this message is confidential. If you
have received it by mistake, please inform us by an email reply and then
delete the message. It is forbidden to copy, forward, or in any way reveal
the contents of this message to anyone. The integrity and security of this
email cannot be guaranteed over the Internet. Therefore, the sender will
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten <al...@databloom.ai>.

Ya, thats a good point, and thank you for pointing this out. Generally spoken, a binary release can be problematic, since the code can contain unwanted licenses, add-ons etc. From my point, I’d vote in favor of a code release and with a -1 for a binary one. But thats a decision the community has to take. 

Nevertheless, it is possible to offer a binary release, albeit I think when the build instructions are clear and functional, we should stick with that and avoid a pre-built one. But again, just my opinion :) 

Best,
—Alex 

> On 19. Apr 2023, at 11:04, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
> 
> Hi all,
> I agree that the main branch should not contain any binaries. 
> 
> Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
> @Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)
> 
> Best
> --
> Zoi
> 
>    Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <alo@databloom.ai <ma...@databloom.ai>> έγραψε:  
> 
> Hey Biao,
> 
> Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz. 
> 
> What you think?
> 
> Cheers,
> —Alex 
> 
> Sent from my iPhone
> 
>> On 19. Apr 2023, at 08:39, Biao Geng <bi...@gmail.com> wrote:
>> 
>> Hi Alexander,
>> Great to hear from you that the codes can work! And thanks for the hinting
>> about Apache license. I would fix it.
>> But for the PR, I add jars in my branch to facilitate the verification but
>> I think we should not add jars directly to the main branch, right? From my
>> experience, it may be better to create a tar.gz including all necessary
>> jars and put it on the apache wayang's website or somewhere else provided
>> by Apache.
>> I did not add the tar.gz in my wordcount_fix branch because its size is
>> larger than 100mb, which cannot be uploaded directly to Github. But I think
>> all of us can build the tar.gz using wayang-assembly module(thanks to the
>> previous work from other people) following my tutorial and maybe our
>> release manager can publish the tar.gz so everyone of us can validate the
>> release candidate.
>> 
>> Best,
>> Biao Geng
>> 
>> 
>> 
>> Alexander Alten <al...@databloom.ai> 于2023年4月19日周三 03:02写道：
>> 
>>> Hey,
>>> 
>>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>>> u please review?
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/pull/300%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0tTMAVXLDtf1nrrGef1Gi6&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3ja1w_beU8bYPm-KwMQYYz
>>> 
>>> @Biao, please add the valid Apache Software License 2 headers,  see
>>> Wordcount fix · apache/incubator-wayang@4431aed (github.com <http://github.com/>) <
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%253D300%2523step:6:141%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0PTqlEt48VuUq8L-MSH4xJ&source=gmail-imap&ust=1682499883000000&usg=AOvVaw1-oOp0hFMC5rgdUdBsEuGt>
>>> ff
>>> 
>>> Cheers,
>>> —Alex
>>> 
>>>>> On 18. Apr 2023, at 19:52, Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>> wrote:
>>>> 
>>>> Hi folks,
>>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>>> zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID>>.
>>>> So, you can find the built binary files hers:
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw1oHka8SFQc3UKYAHxgjP7W%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0p7wEfxyYvYyF5rDPhpchB&source=gmail-imap&ust=1682499883000000&usg=AOvVaw0-tp1DqT5sMfYLAzVjF8mx
>>>> I also wrote a simple tutorial<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw3n-a2AHlEcvAcHwqqZFXnm&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3juTbTSf5K_pccH_BmgU_P>
>>> based on README in the project. It would be great if anyone else can follow
>>> the instructions in the doc to verify the word count example. If there are
>>> any problems, please let me know.
>>>> 
>>>> Besides, there are some interesting discoveries:
>>>> 
>>>> 1.  We already have the wayang-assembly module, which would help us
>>> build the binary easily. In fact, I directly used it in my wordcount_fix
>>> branch instead of pushing my previous jars.
>>>> 2.  Though the built binary files can work, it would still output some
>>> annoying information, which I have mentioned in the issue<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw34LIeGiMvoHFNEp2lwHUt7%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw374wnAzaTdF9LIHsRJDsZt&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2Zmy_B6UXWVriy6_gJ2_UI>.
>>> I will spend some time later to figure out if we can avoid it.
>>>> 
>>>> Best,
>>>> Biao Geng
>>>> 
>>>> 
>>>> From: Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>>
>>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>> Hi there,
>>>> 
>>>> Thanks a lot for your response and the discussion.
>>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>>> file with the binaries for the new release. I will also add a doc for that
>>> so you can verify it at least by running the word count example.
>>>> I may take following steps:
>>>> 
>>>> 1.  I will create a fork based on current main branch(commitId is
>>> d46f3c3<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0KR103oRbBWOAn_lLoacih%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw1Z0reT6hP3FdL0xT0AG6eR&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2TW3xv-kgnBDwpswdEVbgN>)
>>> with workable jars for running the wordcount example.
>>>> 2.  I will write a simple tutorial to show how to run the example
>>> locally.
>>>> I also create a jira<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://issues.apache.org/jira/browse/WAYANG-48%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0tJGfl2UkGmF1cW_PZWDrn%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw1bbjMe4Na9GBayFrhHdfNF&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3Ct4RY6-4KvMMdPME2TaeA>
>>> to track the work. Once I am ready, I will update in this thread.
>>>> 
>>>> Best,
>>>> Biao Geng
>>>> 
>>>> 
>>>> From: Jorge Arnulfo Quiané Ruiz <quianeufo@gmail.com <ma...@gmail.com>>
>>>> Date: Monday, April 17, 2023 at 11:51 PM
>>>> To: dev@wayang.apache.org <ma...@wayang.apache.org> <dev@wayang.apache.org <ma...@wayang.apache.org>>
>>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>>> Welcome on board Biao and thanks a lot for your help to the project,
>>> pretty much appreciated!!!
>>>> 
>>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>>> will also perform point 2) we will start point 3.
>>>> 
>>>> Best,
>>>> Jorge
>>>> 
>>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zkaoudi@yahoo.gr.INVALID <ma...@yahoo.gr.INVALID>> wrote:
>>>>> 
>>>>> Great!
>>>>> So, I propose to do the following:
>>>>> 
>>>>> 1. Biao creates the compressed file with the binaries for the new
>>> release
>>>>> 2. I get the file and test it in my machine
>>>>> 
>>>>> 3. Alex initiates the release process
>>>>> How does this sound?
>>>>> 
>>>>> Best--
>>>>> Zoi
>>>>> 
>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>>> Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> έγραψε:
>>>>> 
>>>>> Great!
>>>>> So, I propose to do the following:
>>>>> 
>>>>> 1. Biao creates the compressed file with the binaries for the new
>>> release2. I get the file and test it in my machine
>>>>> 3. Alex initiates the release process
>>>>> How does this sound?
>>>>> Best
>>>>> --
>>>>> Zoi
>>>>> 
>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>>> Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> έγραψε:
>>>>> 
>>>>> Good point.
>>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
>>> wrote:
>>>>>> 
>>>>>> I think we should do a binary release first without changing anything
>>> so that the installation problem is fixed asap. This won’t be a new release
>>> but complementary to the current one. Isn’t that possible? Or is it
>>> possible to just replace the current file we have with a new one?
>>>>> 
>>>>> Yes, we need a new release.
>>>>> 
>>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>>> But this requires more time.
>>>>> 
>>>>> +1
>>>>> 
>>>>>> Best—Zoi
>>>>>> 
>>>>>> 
>>>>>> Sent from Yahoo Mail for iPhone
>>>>>> 
>>>>>> 
>>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>
>>> <ma...@databloom.ai>> wrote:
>>>>>> 
>>>>>> Hi, and welcome Biao :)
>>>>>> 
>>>>>> Yes, we should certainly plan a new release as soon as we have
>>> finished the cleanup process. From my point of view we should eliminate
>>> Java 8 support due security concerns. I’m also in for to end support for
>>> GraphChi, since this project is dead since 8 years. To end support for J8
>>> and GraphChi I think we need to clarify the reasons in the release notes.
>>> Maybe it’s a good idea to start a new thread which contains the content of
>>> the next release? Just to make sure that we have a clear path.
>>>>>> 
>>>>>> Objections and comments are welcome, @community!
>>>>>> 
>>>>>> —Alex
>>>>>> 
>>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
>>> wrote:
>>>>>>> 
>>>>>>> Yes, I totally agree that we need to correct the current release and
>>> provide the binaries and not the source code.
>>>>>>> I am also not very familiar with the release process but I think Alex
>>> and/or Chris could help with that.@Alex, what do you think?
>>>>>>> In the meantime, maybe you could add/modify the README instructions
>>> for someone that wants to clone and build wayang and run the wordcount
>>> locally? For example, I could also build it successfully in my laptop but
>>> then it's not clear what I have to do to be able to run the main class.
>>>>>>> 
>>>>>>> Best
>>>>>>> --
>>>>>>> Zoi
>>>>>>> 
>>>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>>> Biao Geng <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>>>> 
>>>>>>> Hi Zoi,
>>>>>>> Thanks for the response! I see the point that the command-line tool
>>> is for
>>>>>>> production and the library is for development. That's consistent with
>>> my
>>>>>>> use experience of big data engines like spark and flink.
>>>>>>> As for the issue <
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw0gWUoplrSdBvFQbB_Ei6Dj&source=gmail-imap&ust=1682499883000000&usg=AOvVaw2C3gfz-iK_Hqm2mntfDbwx>,
>>> I
>>>>>>> found the discussion
>>>>>>> <
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw1m4D4wACfxT02JUaM_xkvi%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw3TzmdxiF_9es899NcxN8d5&source=gmail-imap&ust=1682499883000000&usg=AOvVaw0uMQT8ihnPENWa8gNqzcL6>
>>> and
>>>>>>> sure, I can help to solve the problem. But I believe my current
>>> solution is
>>>>>>> not what we really want in the long run, right? The key part is to
>>> correct
>>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>>> themselves to add missing jars. While I am not quite familiar with
>>> Wayand's
>>>>>>> release process, will there be someone else with more experience to
>>> figure
>>>>>>> it out?
>>>>>>> Then I can take care of the other parts like validating the new
>>> zip/tar
>>>>>>> file, improving the README or solving some other problems in the
>>> process.
>>>>>>> What do you think?
>>>>>>> 
>>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>>> 
>>>>>>> Best,
>>>>>>> Biao Geng
>>>>>>> 
>>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid> <ma...@yahoo.gr.invalid>>
>>> 于2023年4月14日周五 03:32写道：
>>>>>>> 
>>>>>>>> Dear Biao,
>>>>>>>> welcome to the Wayang community :)
>>>>>>>> It's great you could run Wayang and yes you are in the right
>>> direction.
>>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>>> suggested to have two different ways in the documentation. One is
>>> using the
>>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>>> production. The other is as you said like a library that you can use
>>> in
>>>>>>>> your java application when developing.
>>>>>>>> 
>>>>>>>> As you already made it run, do you think you could take care of that
>>> issue
>>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>>> Best
>>>>>>>> --Zoi
>>>>>>>> 
>>>>>>>>   Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>>> Geng
>>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com> <ma...@gmail.com>> έγραψε:
>>>>>>>> 
>>>>>>>> Dear community,
>>>>>>>> 
>>>>>>>> Thanks for your efforts for creating this project! I am new to
>>> Wayang and
>>>>>>>> want to follow instructions to run a quick demo. I finally managed
>>> to do
>>>>>>>> that and could see outputs like the following(I wrote some notes
>>> about the
>>>>>>>> process in this issue’s comment<
>>>>>>>> 
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://www.google.com/url?q%2525253Dhttps://github.com/apache/incubator-wayang/issues/282%2525252523issuecomment-1507208045%25252526source%2525253Dgmail-imap%25252526ust%2525253D1682062845000000%25252526usg%2525253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%252526source%25253Dgmail-imap%252526ust%25253D1682067936000000%252526usg%25253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%2526source%253Dgmail-imap%2526ust%253D1682445157000000%2526usg%253DAOvVaw06CRhhCuIpDwEbMTgY2TgF%26source%3Dgmail-imap%26ust%3D1682491142000000%26usg%3DAOvVaw2Rsab148FhEj8AKQI7B4oV&source=gmail-imap&ust=1682499883000000&usg=AOvVaw3Z87e-vU2VJmxBDthG1W_F
>>>>>>>>> ):
>>>>>>>> ```
>>>>>>>> Found 689 words:
>>>>>>>> 91x the
>>>>>>>> 87x wayang
>>>>>>>> 68x apache
>>>>>>>> ```
>>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>>> problems, which makes me wondering if I am on the right direction:
>>> should I
>>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>>> program
>>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>>> 
>>>>>>>> Best,
>>>>>>>> Biao Geng
>>>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> --
>>>>>> databloom AI, Inc.
>>>>>> 
>>>>>> 3401 N. MIAMI AVE. STE 230
>>>>>> 33127 Miami, Florida
>>>>>> United States
>>>>>> 
>>>>>> 
>>>>>> --  Please consider the environment before printing this
>>>>>> email --
>>>>>> 
>>>>>> 
>>>>>> 
>>>>>> Disclaimer:
>>>>>> The content of this message is confidential. If you
>>>>>> have received it by mistake, please inform us by an email reply and
>>> then
>>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>> reveal
>>>>>> the contents of this message to anyone. The integrity and security of
>>> this
>>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>>> will
>>>>>> not be held liable for any damage caused by the message.
>>>>> 
>>>>> 
>>>>> --
>>>>> databloom AI, Inc.
>>>>> 
>>>>> 3401 N. MIAMI AVE. STE 230
>>>>> 33127 Miami, Florida
>>>>> United States
>>>>> 
>>>>> 
>>>>> --  Please consider the environment before printing this
>>>>> email --
>>>>> 
>>>>> 
>>>>> 
>>>>> Disclaimer:
>>>>> The content of this message is confidential. If you
>>>>> have received it by mistake, please inform us by an email reply and then
>>>>> delete the message. It is forbidden to copy, forward, or in any way
>>> reveal
>>>>> the contents of this message to anyone. The integrity and security of
>>> this
>>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>>> not be held liable for any damage caused by the message.
>>>>> 
>>>>> 
>>> 
>>> 
>>> --
>>> databloom AI, Inc.
>>> 
>>> 3401 N. MIAMI AVE. STE 230
>>> 33127 Miami, Florida
>>> United States
>>> 
>>> 
>>> --  Please consider the environment before printing this
>>> email --
>>> 
>>> 
>>> 
>>> Disclaimer:
>>> The content of this message is confidential. If you
>>> have received it by mistake, please inform us by an email reply and then
>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>> the contents of this message to anyone. The integrity and security of this
>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>> not be held liable for any damage caused by the message.
>>> 
>>> 
> 
> -- 
> databloom AI, Inc.  
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida 
> United States
> 
> 
> --  Please consider the environment before printing this 
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you 
> have received it by mistake, please inform us by an email reply and then 
> delete the message. It is forbidden to copy, forward, or in any way reveal 
> the contents of this message to anyone. The integrity and security of this 
> email cannot be guaranteed over the Internet. Therefore, the sender will 
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

 Hi all,
I agree that the main branch should not contain any binaries. 

Regarding the release, I read yesterday from the links of Apache that a release MUST contain the source code. Binaries are optional and should be a different file. Of course, we do want the binaries in the next release but this does not mean that we need to have them in the main branch and together with the source code.
@Biao: I will test the binaries and tutorial that you sent sometime today or tomorrow and let you know. Thanks a lot for that :)

Best
--
Zoi

    Στις Τετάρτη 19 Απριλίου 2023 - 08:42:50 π.μ. CEST, ο χρήστης Alexander Alten-Lorenz <al...@databloom.ai> έγραψε:  
 
 Hey Biao,

Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz. 

What you think?

Cheers,
—Alex 

Sent from my iPhone

> On 19. Apr 2023, at 08:39, Biao Geng <bi...@gmail.com> wrote:
> 
> Hi Alexander,
> Great to hear from you that the codes can work! And thanks for the hinting
> about Apache license. I would fix it.
> But for the PR, I add jars in my branch to facilitate the verification but
> I think we should not add jars directly to the main branch, right? From my
> experience, it may be better to create a tar.gz including all necessary
> jars and put it on the apache wayang's website or somewhere else provided
> by Apache.
> I did not add the tar.gz in my wordcount_fix branch because its size is
> larger than 100mb, which cannot be uploaded directly to Github. But I think
> all of us can build the tar.gz using wayang-assembly module(thanks to the
> previous work from other people) following my tutorial and maybe our
> release manager can publish the tar.gz so everyone of us can validate the
> release candidate.
> 
> Best,
> Biao Geng
> 
> 
> 
> Alexander Alten <al...@databloom.ai> 于2023年4月19日周三 03:02写道：
> 
>> Hey,
>> 
>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>> u please review?
>> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/pull/300&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0tTMAVXLDtf1nrrGef1Gi6
>> 
>> @Biao, please add the valid Apache Software License 2 headers,  see
>> Wordcount fix · apache/incubator-wayang@4431aed (github.com) <
>> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%3D300%23step:6:141&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0PTqlEt48VuUq8L-MSH4xJ>
>> ff
>> 
>> Cheers,
>> —Alex
>> 
>>>> On 18. Apr 2023, at 19:52, Biao Geng <bi...@gmail.com> wrote:
>>> 
>>> Hi folks,
>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>> zkaoudi@yahoo.gr.INVALID>.
>>> So, you can find the built binary files hers:
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw1oHka8SFQc3UKYAHxgjP7W&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0p7wEfxyYvYyF5rDPhpchB
>>> I also wrote a simple tutorial<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh&source=gmail-imap&ust=1682491142000000&usg=AOvVaw3n-a2AHlEcvAcHwqqZFXnm>
>> based on README in the project. It would be great if anyone else can follow
>> the instructions in the doc to verify the word count example. If there are
>> any problems, please let me know.
>>> 
>>> Besides, there are some interesting discoveries:
>>> 
>>> 1.  We already have the wayang-assembly module, which would help us
>> build the binary easily. In fact, I directly used it in my wordcount_fix
>> branch instead of pushing my previous jars.
>>> 2.  Though the built binary files can work, it would still output some
>> annoying information, which I have mentioned in the issue<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw34LIeGiMvoHFNEp2lwHUt7&source=gmail-imap&ust=1682491142000000&usg=AOvVaw374wnAzaTdF9LIHsRJDsZt>.
>> I will spend some time later to figure out if we can avoid it.
>>> 
>>> Best,
>>> Biao Geng
>>> 
>>> 
>>> From: Biao Geng <bi...@gmail.com>
>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>> To: dev@wayang.apache.org <de...@wayang.apache.org>
>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>> Hi there,
>>> 
>>> Thanks a lot for your response and the discussion.
>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>> file with the binaries for the new release. I will also add a doc for that
>> so you can verify it at least by running the word count example.
>>> I may take following steps:
>>> 
>>> 1.  I will create a fork based on current main branch(commitId is
>> d46f3c3<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw0KR103oRbBWOAn_lLoacih&source=gmail-imap&ust=1682491142000000&usg=AOvVaw1Z0reT6hP3FdL0xT0AG6eR>)
>> with workable jars for running the wordcount example.
>>> 2.  I will write a simple tutorial to show how to run the example
>> locally.
>>> I also create a jira<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://issues.apache.org/jira/browse/WAYANG-48%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw0tJGfl2UkGmF1cW_PZWDrn&source=gmail-imap&ust=1682491142000000&usg=AOvVaw1bbjMe4Na9GBayFrhHdfNF>
>> to track the work. Once I am ready, I will update in this thread.
>>> 
>>> Best,
>>> Biao Geng
>>> 
>>> 
>>> From: Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>
>>> Date: Monday, April 17, 2023 at 11:51 PM
>>> To: dev@wayang.apache.org <de...@wayang.apache.org>
>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>> Welcome on board Biao and thanks a lot for your help to the project,
>> pretty much appreciated!!!
>>> 
>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>> will also perform point 2) we will start point 3.
>>> 
>>> Best,
>>> Jorge
>>> 
>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
>>>> 
>>>> Great!
>>>> So, I propose to do the following:
>>>> 
>>>> 1. Biao creates the compressed file with the binaries for the new
>> release
>>>> 2. I get the file and test it in my machine
>>>> 
>>>> 3. Alex initiates the release process
>>>> How does this sound?
>>>> 
>>>> Best--
>>>> Zoi
>>>> 
>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>> Kaoudi <zk...@yahoo.gr.invalid> έγραψε:
>>>> 
>>>> Great!
>>>> So, I propose to do the following:
>>>> 
>>>> 1. Biao creates the compressed file with the binaries for the new
>> release2. I get the file and test it in my machine
>>>> 3. Alex initiates the release process
>>>> How does this sound?
>>>> Best
>>>> --
>>>> Zoi
>>>> 
>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>> Alexander Alten <al...@databloom.ai> έγραψε:
>>>> 
>>>> Good point.
>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid>
>> wrote:
>>>>> 
>>>>> I think we should do a binary release first without changing anything
>> so that the installation problem is fixed asap. This won’t be a new release
>> but complementary to the current one. Isn’t that possible? Or is it
>> possible to just replace the current file we have with a new one?
>>>> 
>>>> Yes, we need a new release.
>>>> 
>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>> But this requires more time.
>>>> 
>>>> +1
>>>> 
>>>>> Best—Zoi
>>>>> 
>>>>> 
>>>>> Sent from Yahoo Mail for iPhone
>>>>> 
>>>>> 
>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai
>> <ma...@databloom.ai>> wrote:
>>>>> 
>>>>> Hi, and welcome Biao :)
>>>>> 
>>>>> Yes, we should certainly plan a new release as soon as we have
>> finished the cleanup process. From my point of view we should eliminate
>> Java 8 support due security concerns. I’m also in for to end support for
>> GraphChi, since this project is dead since 8 years. To end support for J8
>> and GraphChi I think we need to clarify the reasons in the release notes.
>> Maybe it’s a good idea to start a new thread which contains the content of
>> the next release? Just to make sure that we have a clear path.
>>>>> 
>>>>> Objections and comments are welcome, @community!
>>>>> 
>>>>> —Alex
>>>>> 
>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid>
>> wrote:
>>>>>> 
>>>>>> Yes, I totally agree that we need to correct the current release and
>> provide the binaries and not the source code.
>>>>>> I am also not very familiar with the release process but I think Alex
>> and/or Chris could help with that.@Alex, what do you think?
>>>>>> In the meantime, maybe you could add/modify the README instructions
>> for someone that wants to clone and build wayang and run the wordcount
>> locally? For example, I could also build it successfully in my laptop but
>> then it's not clear what I have to do to be able to run the main class.
>>>>>> 
>>>>>> Best
>>>>>> --
>>>>>> Zoi
>>>>>> 
>>>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>> Biao Geng <bi...@gmail.com> έγραψε:
>>>>>> 
>>>>>> Hi Zoi,
>>>>>> Thanks for the response! I see the point that the command-line tool
>> is for
>>>>>> production and the library is for development. That's consistent with
>> my
>>>>>> use experience of big data engines like spark and flink.
>>>>>> As for the issue <
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682062845000000%252526usg%25253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%2526source%253Dgmail-imap%2526ust%253D1682067936000000%2526usg%253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0gWUoplrSdBvFQbB_Ei6Dj>,
>> I
>>>>>> found the discussion
>>>>>> <
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%252526source%25253Dgmail-imap%252526ust%25253D1682062845000000%252526usg%25253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%2526source%253Dgmail-imap%2526ust%253D1682067936000000%2526usg%253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw1m4D4wACfxT02JUaM_xkvi&source=gmail-imap&ust=1682491142000000&usg=AOvVaw3TzmdxiF_9es899NcxN8d5>
>> and
>>>>>> sure, I can help to solve the problem. But I believe my current
>> solution is
>>>>>> not what we really want in the long run, right? The key part is to
>> correct
>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>> themselves to add missing jars. While I am not quite familiar with
>> Wayand's
>>>>>> release process, will there be someone else with more experience to
>> figure
>>>>>> it out?
>>>>>> Then I can take care of the other parts like validating the new
>> zip/tar
>>>>>> file, improving the README or solving some other problems in the
>> process.
>>>>>> What do you think?
>>>>>> 
>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>> 
>>>>>> Best,
>>>>>> Biao Geng
>>>>>> 
>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
>> 于2023年4月14日周五 03:32写道：
>>>>>> 
>>>>>>> Dear Biao,
>>>>>>> welcome to the Wayang community :)
>>>>>>> It's great you could run Wayang and yes you are in the right
>> direction.
>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>> suggested to have two different ways in the documentation. One is
>> using the
>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>> production. The other is as you said like a library that you can use
>> in
>>>>>>> your java application when developing.
>>>>>>> 
>>>>>>> As you already made it run, do you think you could take care of that
>> issue
>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>> Best
>>>>>>> --Zoi
>>>>>>> 
>>>>>>>  Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>> Geng
>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>>>> 
>>>>>>> Dear community,
>>>>>>> 
>>>>>>> Thanks for your efforts for creating this project! I am new to
>> Wayang and
>>>>>>> want to follow instructions to run a quick demo. I finally managed
>> to do
>>>>>>> that and could see outputs like the following(I wrote some notes
>> about the
>>>>>>> process in this issue’s comment<
>>>>>>> 
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%25252523issuecomment-1507208045%252526source%25253Dgmail-imap%252526ust%25253D1682062845000000%252526usg%25253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%2526source%253Dgmail-imap%2526ust%253D1682067936000000%2526usg%253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw06CRhhCuIpDwEbMTgY2TgF&source=gmail-imap&ust=1682491142000000&usg=AOvVaw2Rsab148FhEj8AKQI7B4oV
>>>>>>>> ):
>>>>>>> ```
>>>>>>> Found 689 words:
>>>>>>> 91x the
>>>>>>> 87x wayang
>>>>>>> 68x apache
>>>>>>> ```
>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>> problems, which makes me wondering if I am on the right direction:
>> should I
>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>> program
>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>> 
>>>>>>> Best,
>>>>>>> Biao Geng
>>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> databloom AI, Inc.
>>>>> 
>>>>> 3401 N. MIAMI AVE. STE 230
>>>>> 33127 Miami, Florida
>>>>> United States
>>>>> 
>>>>> 
>>>>> --  Please consider the environment before printing this
>>>>> email --
>>>>> 
>>>>> 
>>>>> 
>>>>> Disclaimer:
>>>>> The content of this message is confidential. If you
>>>>> have received it by mistake, please inform us by an email reply and
>> then
>>>>> delete the message. It is forbidden to copy, forward, or in any way
>> reveal
>>>>> the contents of this message to anyone. The integrity and security of
>> this
>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>> will
>>>>> not be held liable for any damage caused by the message.
>>>> 
>>>> 
>>>> --
>>>> databloom AI, Inc.
>>>> 
>>>> 3401 N. MIAMI AVE. STE 230
>>>> 33127 Miami, Florida
>>>> United States
>>>> 
>>>> 
>>>> --  Please consider the environment before printing this
>>>> email --
>>>> 
>>>> 
>>>> 
>>>> Disclaimer:
>>>> The content of this message is confidential. If you
>>>> have received it by mistake, please inform us by an email reply and then
>>>> delete the message. It is forbidden to copy, forward, or in any way
>> reveal
>>>> the contents of this message to anyone. The integrity and security of
>> this
>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>> not be held liable for any damage caused by the message.
>>>> 
>>>> 
>> 
>> 
>> --
>> databloom AI, Inc.
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>> 
>> 
>> --  Please consider the environment before printing this
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
>> 
>> 

-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten-Lorenz <al...@databloom.ai>.

Hey Biao,

Binaries are typical a release, and the main branch contains only code. I did a build test and that worked, so I think we are good to merge and when we publish our next release we have only binaries in the respective tgz. 

What you think?

Cheers,
—Alex 

Sent from my iPhone

> On 19. Apr 2023, at 08:39, Biao Geng <bi...@gmail.com> wrote:
> 
> Hi Alexander,
> Great to hear from you that the codes can work! And thanks for the hinting
> about Apache license. I would fix it.
> But for the PR, I add jars in my branch to facilitate the verification but
> I think we should not add jars directly to the main branch, right? From my
> experience, it may be better to create a tar.gz including all necessary
> jars and put it on the apache wayang's website or somewhere else provided
> by Apache.
> I did not add the tar.gz in my wordcount_fix branch because its size is
> larger than 100mb, which cannot be uploaded directly to Github. But I think
> all of us can build the tar.gz using wayang-assembly module(thanks to the
> previous work from other people) following my tutorial and maybe our
> release manager can publish the tar.gz so everyone of us can validate the
> release candidate.
> 
> Best,
> Biao Geng
> 
> 
> 
> Alexander Alten <al...@databloom.ai> 于2023年4月19日周三 03:02写道：
> 
>> Hey,
>> 
>> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
>> u please review?
>> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/pull/300&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0tTMAVXLDtf1nrrGef1Gi6
>> 
>> @Biao, please add the valid Apache Software License 2 headers,  see
>> Wordcount fix · apache/incubator-wayang@4431aed (github.com) <
>> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr%3D300%23step:6:141&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0PTqlEt48VuUq8L-MSH4xJ>
>> ff
>> 
>> Cheers,
>> —Alex
>> 
>>>> On 18. Apr 2023, at 19:52, Biao Geng <bi...@gmail.com> wrote:
>>> 
>>> Hi folks,
>>> I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
>> zkaoudi@yahoo.gr.INVALID>.
>>> So, you can find the built binary files hers:
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw1oHka8SFQc3UKYAHxgjP7W&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0p7wEfxyYvYyF5rDPhpchB
>>> I also wrote a simple tutorial<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw3KEAVSGYPTSTUqy9UU0Mzh&source=gmail-imap&ust=1682491142000000&usg=AOvVaw3n-a2AHlEcvAcHwqqZFXnm>
>> based on README in the project. It would be great if anyone else can follow
>> the instructions in the doc to verify the word count example. If there are
>> any problems, please let me know.
>>> 
>>> Besides, there are some interesting discoveries:
>>> 
>>> 1.  We already have the wayang-assembly module, which would help us
>> build the binary easily. In fact, I directly used it in my wordcount_fix
>> branch instead of pushing my previous jars.
>>> 2.  Though the built binary files can work, it would still output some
>> annoying information, which I have mentioned in the issue<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw34LIeGiMvoHFNEp2lwHUt7&source=gmail-imap&ust=1682491142000000&usg=AOvVaw374wnAzaTdF9LIHsRJDsZt>.
>> I will spend some time later to figure out if we can avoid it.
>>> 
>>> Best,
>>> Biao Geng
>>> 
>>> 
>>> From: Biao Geng <bi...@gmail.com>
>>> Date: Tuesday, April 18, 2023 at 11:26 PM
>>> To: dev@wayang.apache.org <de...@wayang.apache.org>
>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>> Hi there,
>>> 
>>> Thanks a lot for your response and the discussion.
>>> Zoi’s proposal makes senses to me. I can take care of the compressed
>> file with the binaries for the new release. I will also add a doc for that
>> so you can verify it at least by running the word count example.
>>> I may take following steps:
>>> 
>>> 1.  I will create a fork based on current main branch(commitId is
>> d46f3c3<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw0KR103oRbBWOAn_lLoacih&source=gmail-imap&ust=1682491142000000&usg=AOvVaw1Z0reT6hP3FdL0xT0AG6eR>)
>> with workable jars for running the wordcount example.
>>> 2.  I will write a simple tutorial to show how to run the example
>> locally.
>>> I also create a jira<
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://issues.apache.org/jira/browse/WAYANG-48%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw0tJGfl2UkGmF1cW_PZWDrn&source=gmail-imap&ust=1682491142000000&usg=AOvVaw1bbjMe4Na9GBayFrhHdfNF>
>> to track the work. Once I am ready, I will update in this thread.
>>> 
>>> Best,
>>> Biao Geng
>>> 
>>> 
>>> From: Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>
>>> Date: Monday, April 17, 2023 at 11:51 PM
>>> To: dev@wayang.apache.org <de...@wayang.apache.org>
>>> Subject: Re: What's the proper way to run Wayang's WordCount Example?
>>> Welcome on board Biao and thanks a lot for your help to the project,
>> pretty much appreciated!!!
>>> 
>>> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
>> will also perform point 2) we will start point 3.
>>> 
>>> Best,
>>> Jorge
>>> 
>>>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
>>>> 
>>>> Great!
>>>> So, I propose to do the following:
>>>> 
>>>> 1. Biao creates the compressed file with the binaries for the new
>> release
>>>> 2. I get the file and test it in my machine
>>>> 
>>>> 3. Alex initiates the release process
>>>> How does this sound?
>>>> 
>>>> Best--
>>>> Zoi
>>>> 
>>>>  Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
>> Kaoudi <zk...@yahoo.gr.invalid> έγραψε:
>>>> 
>>>> Great!
>>>> So, I propose to do the following:
>>>> 
>>>> 1. Biao creates the compressed file with the binaries for the new
>> release2. I get the file and test it in my machine
>>>> 3. Alex initiates the release process
>>>> How does this sound?
>>>> Best
>>>> --
>>>> Zoi
>>>> 
>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
>> Alexander Alten <al...@databloom.ai> έγραψε:
>>>> 
>>>> Good point.
>>>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid>
>> wrote:
>>>>> 
>>>>> I think we should do a binary release first without changing anything
>> so that the installation problem is fixed asap. This won’t be a new release
>> but complementary to the current one. Isn’t that possible? Or is it
>> possible to just replace the current file we have with a new one?
>>>> 
>>>> Yes, we need a new release.
>>>> 
>>>>> Then, we can take care to remove Java 8 and graphchi in a new release.
>> But this requires more time.
>>>> 
>>>> +1
>>>> 
>>>>> Best—Zoi
>>>>> 
>>>>> 
>>>>> Sent from Yahoo Mail for iPhone
>>>>> 
>>>>> 
>>>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai
>> <ma...@databloom.ai>> wrote:
>>>>> 
>>>>> Hi, and welcome Biao :)
>>>>> 
>>>>> Yes, we should certainly plan a new release as soon as we have
>> finished the cleanup process. From my point of view we should eliminate
>> Java 8 support due security concerns. I’m also in for to end support for
>> GraphChi, since this project is dead since 8 years. To end support for J8
>> and GraphChi I think we need to clarify the reasons in the release notes.
>> Maybe it’s a good idea to start a new thread which contains the content of
>> the next release? Just to make sure that we have a clear path.
>>>>> 
>>>>> Objections and comments are welcome, @community!
>>>>> 
>>>>> —Alex
>>>>> 
>>>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid>
>> wrote:
>>>>>> 
>>>>>> Yes, I totally agree that we need to correct the current release and
>> provide the binaries and not the source code.
>>>>>> I am also not very familiar with the release process but I think Alex
>> and/or Chris could help with that.@Alex, what do you think?
>>>>>> In the meantime, maybe you could add/modify the README instructions
>> for someone that wants to clone and build wayang and run the wordcount
>> locally? For example, I could also build it successfully in my laptop but
>> then it's not clear what I have to do to be able to run the main class.
>>>>>> 
>>>>>> Best
>>>>>> --
>>>>>> Zoi
>>>>>> 
>>>>>>   Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
>> Biao Geng <bi...@gmail.com> έγραψε:
>>>>>> 
>>>>>> Hi Zoi,
>>>>>> Thanks for the response! I see the point that the command-line tool
>> is for
>>>>>> production and the library is for development. That's consistent with
>> my
>>>>>> use experience of big data engines like spark and flink.
>>>>>> As for the issue <
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%252526source%25253Dgmail-imap%252526ust%25253D1682062845000000%252526usg%25253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%2526source%253Dgmail-imap%2526ust%253D1682067936000000%2526usg%253DAOvVaw2HrQCr-TFdIaR9pWi8r0FP%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw0vHkl7Ko0mYRm0HSSsWKJB&source=gmail-imap&ust=1682491142000000&usg=AOvVaw0gWUoplrSdBvFQbB_Ei6Dj>,
>> I
>>>>>> found the discussion
>>>>>> <
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%252526source%25253Dgmail-imap%252526ust%25253D1682062845000000%252526usg%25253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%2526source%253Dgmail-imap%2526ust%253D1682067936000000%2526usg%253DAOvVaw1hioJ8F2lCcfVtFYmtvlLd%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw1m4D4wACfxT02JUaM_xkvi&source=gmail-imap&ust=1682491142000000&usg=AOvVaw3TzmdxiF_9es899NcxN8d5>
>> and
>>>>>> sure, I can help to solve the problem. But I believe my current
>> solution is
>>>>>> not what we really want in the long run, right? The key part is to
>> correct
>>>>>> the downloaded zip file so other new users do not need to debug by
>>>>>> themselves to add missing jars. While I am not quite familiar with
>> Wayand's
>>>>>> release process, will there be someone else with more experience to
>> figure
>>>>>> it out?
>>>>>> Then I can take care of the other parts like validating the new
>> zip/tar
>>>>>> file, improving the README or solving some other problems in the
>> process.
>>>>>> What do you think?
>>>>>> 
>>>>>> Again, thanks for your help in the mailing list and the github issue.
>>>>>> 
>>>>>> Best,
>>>>>> Biao Geng
>>>>>> 
>>>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
>> 于2023年4月14日周五 03:32写道：
>>>>>> 
>>>>>>> Dear Biao,
>>>>>>> welcome to the Wayang community :)
>>>>>>> It's great you could run Wayang and yes you are in the right
>> direction.
>>>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>>>> suggested to have two different ways in the documentation. One is
>> using the
>>>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>>>> download and then you just run your jobs. This is meant more for
>>>>>>> production. The other is as you said like a library that you can use
>> in
>>>>>>> your java application when developing.
>>>>>>> 
>>>>>>> As you already made it run, do you think you could take care of that
>> issue
>>>>>>> and Michalis could take care of a different issue.What do you think?
>>>>>>> Best
>>>>>>> --Zoi
>>>>>>> 
>>>>>>>   Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
>> Geng
>>>>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>>>> 
>>>>>>> Dear community,
>>>>>>> 
>>>>>>> Thanks for your efforts for creating this project! I am new to
>> Wayang and
>>>>>>> want to follow instructions to run a quick demo. I finally managed
>> to do
>>>>>>> that and could see outputs like the following(I wrote some notes
>> about the
>>>>>>> process in this issue’s comment<
>>>>>>> 
>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://www.google.com/url?q%25253Dhttps://github.com/apache/incubator-wayang/issues/282%25252523issuecomment-1507208045%252526source%25253Dgmail-imap%252526ust%25253D1682062845000000%252526usg%25253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%2526source%253Dgmail-imap%2526ust%253D1682067936000000%2526usg%253DAOvVaw2X2G1wcJuRkyCm6fpuksdX%26source%3Dgmail-imap%26ust%3D1682445157000000%26usg%3DAOvVaw06CRhhCuIpDwEbMTgY2TgF&source=gmail-imap&ust=1682491142000000&usg=AOvVaw2Rsab148FhEj8AKQI7B4oV
>>>>>>>> ):
>>>>>>> ```
>>>>>>> Found 689 words:
>>>>>>> 91x the
>>>>>>> 87x wayang
>>>>>>> 68x apache
>>>>>>> ```
>>>>>>> But in the process, I had to figure out some installation/running
>>>>>>> problems, which makes me wondering if I am on the right direction:
>> should I
>>>>>>> use wayang-submit or consider Wayang as a library(i.e. write java
>> program
>>>>>>> and build a fat jar)? Which one is recommended?
>>>>>>> 
>>>>>>> Best,
>>>>>>> Biao Geng
>>>>>>> 
>>>>> 
>>>>> 
>>>>> --
>>>>> databloom AI, Inc.
>>>>> 
>>>>> 3401 N. MIAMI AVE. STE 230
>>>>> 33127 Miami, Florida
>>>>> United States
>>>>> 
>>>>> 
>>>>> --  Please consider the environment before printing this
>>>>> email --
>>>>> 
>>>>> 
>>>>> 
>>>>> Disclaimer:
>>>>> The content of this message is confidential. If you
>>>>> have received it by mistake, please inform us by an email reply and
>> then
>>>>> delete the message. It is forbidden to copy, forward, or in any way
>> reveal
>>>>> the contents of this message to anyone. The integrity and security of
>> this
>>>>> email cannot be guaranteed over the Internet. Therefore, the sender
>> will
>>>>> not be held liable for any damage caused by the message.
>>>> 
>>>> 
>>>> --
>>>> databloom AI, Inc.
>>>> 
>>>> 3401 N. MIAMI AVE. STE 230
>>>> 33127 Miami, Florida
>>>> United States
>>>> 
>>>> 
>>>> --  Please consider the environment before printing this
>>>> email --
>>>> 
>>>> 
>>>> 
>>>> Disclaimer:
>>>> The content of this message is confidential. If you
>>>> have received it by mistake, please inform us by an email reply and then
>>>> delete the message. It is forbidden to copy, forward, or in any way
>> reveal
>>>> the contents of this message to anyone. The integrity and security of
>> this
>>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>>> not be held liable for any damage caused by the message.
>>>> 
>>>> 
>> 
>> 
>> --
>> databloom AI, Inc.
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>> 
>> 
>> --  Please consider the environment before printing this
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
>> 
>> 

-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Biao Geng <bi...@gmail.com>.

Hi Alexander,
Great to hear from you that the codes can work! And thanks for the hinting
about Apache license. I would fix it.
But for the PR, I add jars in my branch to facilitate the verification but
I think we should not add jars directly to the main branch, right? From my
experience, it may be better to create a tar.gz including all necessary
jars and put it on the apache wayang's website or somewhere else provided
by Apache.
I did not add the tar.gz in my wordcount_fix branch because its size is
larger than 100mb, which cannot be uploaded directly to Github. But I think
all of us can build the tar.gz using wayang-assembly module(thanks to the
previous work from other people) following my tutorial and maybe our
release manager can publish the tar.gz so everyone of us can validate the
release candidate.

Best,
Biao Geng



Alexander Alten <al...@databloom.ai> 于2023年4月19日周三 03:02写道：

> Hey,
>
> Thats great and it worked for me - I created a PR on your behalf. Zoi, can
> u please review?
> https://github.com/apache/incubator-wayang/pull/300
>
> @Biao, please add the valid Apache Software License 2 headers,  see
> Wordcount fix · apache/incubator-wayang@4431aed (github.com) <
> https://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr=300#step:6:141>
> ff
>
> Cheers,
>  —Alex
>
> > On 18. Apr 2023, at 19:52, Biao Geng <bi...@gmail.com> wrote:
> >
> > Hi folks,
> > I have finished the step 1 proposed by @Zoi Kaoudi<mailto:
> zkaoudi@yahoo.gr.INVALID>.
> > So, you can find the built binary files hers:
> https://www.google.com/url?q=https://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT&source=gmail-imap&ust=1682445157000000&usg=AOvVaw1oHka8SFQc3UKYAHxgjP7W
> > I also wrote a simple tutorial<
> https://www.google.com/url?q=https://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md&source=gmail-imap&ust=1682445157000000&usg=AOvVaw3KEAVSGYPTSTUqy9UU0Mzh>
> based on README in the project. It would be great if anyone else can follow
> the instructions in the doc to verify the word count example. If there are
> any problems, please let me know.
> >
> > Besides, there are some interesting discoveries:
> >
> >  1.  We already have the wayang-assembly module, which would help us
> build the binary easily. In fact, I directly used it in my wordcount_fix
> branch instead of pushing my previous jars.
> >  2.  Though the built binary files can work, it would still output some
> annoying information, which I have mentioned in the issue<
> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/issues/282&source=gmail-imap&ust=1682445157000000&usg=AOvVaw34LIeGiMvoHFNEp2lwHUt7>.
> I will spend some time later to figure out if we can avoid it.
> >
> > Best,
> > Biao Geng
> >
> >
> > From: Biao Geng <bi...@gmail.com>
> > Date: Tuesday, April 18, 2023 at 11:26 PM
> > To: dev@wayang.apache.org <de...@wayang.apache.org>
> > Subject: Re: What's the proper way to run Wayang's WordCount Example?
> > Hi there,
> >
> > Thanks a lot for your response and the discussion.
> > Zoi’s proposal makes senses to me. I can take care of the compressed
> file with the binaries for the new release. I will also add a doc for that
> so you can verify it at least by running the word count example.
> > I may take following steps:
> >
> >  1.  I will create a fork based on current main branch(commitId is
> d46f3c3<
> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431&source=gmail-imap&ust=1682445157000000&usg=AOvVaw0KR103oRbBWOAn_lLoacih>)
> with workable jars for running the wordcount example.
> >  2.  I will write a simple tutorial to show how to run the example
> locally.
> > I also create a jira<
> https://www.google.com/url?q=https://issues.apache.org/jira/browse/WAYANG-48&source=gmail-imap&ust=1682445157000000&usg=AOvVaw0tJGfl2UkGmF1cW_PZWDrn>
> to track the work. Once I am ready, I will update in this thread.
> >
> > Best,
> > Biao Geng
> >
> >
> > From: Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>
> > Date: Monday, April 17, 2023 at 11:51 PM
> > To: dev@wayang.apache.org <de...@wayang.apache.org>
> > Subject: Re: What's the proper way to run Wayang's WordCount Example?
> > Welcome on board Biao and thanks a lot for your help to the project,
> pretty much appreciated!!!
> >
> > I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I
> will also perform point 2) we will start point 3.
> >
> > Best,
> > Jorge
> >
> >> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
> >>
> >> Great!
> >> So, I propose to do the following:
> >>
> >> 1. Biao creates the compressed file with the binaries for the new
> release
> >> 2. I get the file and test it in my machine
> >>
> >> 3. Alex initiates the release process
> >> How does this sound?
> >>
> >> Best--
> >> Zoi
> >>
> >>   Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi
> Kaoudi <zk...@yahoo.gr.invalid> έγραψε:
> >>
> >> Great!
> >> So, I propose to do the following:
> >>
> >> 1. Biao creates the compressed file with the binaries for the new
> release2. I get the file and test it in my machine
> >> 3. Alex initiates the release process
> >> How does this sound?
> >> Best
> >> --
> >> Zoi
> >>
> >>    Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης
> Alexander Alten <al...@databloom.ai> έγραψε:
> >>
> >> Good point.
> >>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid>
> wrote:
> >>>
> >>> I think we should do a binary release first without changing anything
> so that the installation problem is fixed asap. This won’t be a new release
> but complementary to the current one. Isn’t that possible? Or is it
> possible to just replace the current file we have with a new one?
> >>
> >> Yes, we need a new release.
> >>
> >>> Then, we can take care to remove Java 8 and graphchi in a new release.
> But this requires more time.
> >>
> >> +1
> >>
> >>> Best—Zoi
> >>>
> >>>
> >>> Sent from Yahoo Mail for iPhone
> >>>
> >>>
> >>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai
> <ma...@databloom.ai>> wrote:
> >>>
> >>> Hi, and welcome Biao :)
> >>>
> >>> Yes, we should certainly plan a new release as soon as we have
> finished the cleanup process. From my point of view we should eliminate
> Java 8 support due security concerns. I’m also in for to end support for
> GraphChi, since this project is dead since 8 years. To end support for J8
> and GraphChi I think we need to clarify the reasons in the release notes.
> Maybe it’s a good idea to start a new thread which contains the content of
> the next release? Just to make sure that we have a clear path.
> >>>
> >>> Objections and comments are welcome, @community!
> >>>
> >>> —Alex
> >>>
> >>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid>
> wrote:
> >>>>
> >>>> Yes, I totally agree that we need to correct the current release and
> provide the binaries and not the source code.
> >>>> I am also not very familiar with the release process but I think Alex
> and/or Chris could help with that.@Alex, what do you think?
> >>>> In the meantime, maybe you could add/modify the README instructions
> for someone that wants to clone and build wayang and run the wordcount
> locally? For example, I could also build it successfully in my laptop but
> then it's not clear what I have to do to be able to run the main class.
> >>>>
> >>>> Best
> >>>> --
> >>>> Zoi
> >>>>
> >>>>    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης
> Biao Geng <bi...@gmail.com> έγραψε:
> >>>>
> >>>> Hi Zoi,
> >>>> Thanks for the response! I see the point that the command-line tool
> is for
> >>>> production and the library is for development. That's consistent with
> my
> >>>> use experience of big data engines like spark and flink.
> >>>> As for the issue <
> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%2526source%253Dgmail-imap%2526ust%253D1682062845000000%2526usg%253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%26source%3Dgmail-imap%26ust%3D1682067936000000%26usg%3DAOvVaw2HrQCr-TFdIaR9pWi8r0FP&source=gmail-imap&ust=1682445157000000&usg=AOvVaw0vHkl7Ko0mYRm0HSSsWKJB>,
> I
> >>>> found the discussion
> >>>> <
> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2526source%253Dgmail-imap%2526ust%253D1682062845000000%2526usg%253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%26source%3Dgmail-imap%26ust%3D1682067936000000%26usg%3DAOvVaw1hioJ8F2lCcfVtFYmtvlLd&source=gmail-imap&ust=1682445157000000&usg=AOvVaw1m4D4wACfxT02JUaM_xkvi>
> and
> >>>> sure, I can help to solve the problem. But I believe my current
> solution is
> >>>> not what we really want in the long run, right? The key part is to
> correct
> >>>> the downloaded zip file so other new users do not need to debug by
> >>>> themselves to add missing jars. While I am not quite familiar with
> Wayand's
> >>>> release process, will there be someone else with more experience to
> figure
> >>>> it out?
> >>>> Then I can take care of the other parts like validating the new
> zip/tar
> >>>> file, improving the README or solving some other problems in the
> process.
> >>>> What do you think?
> >>>>
> >>>> Again, thanks for your help in the mailing list and the github issue.
> >>>>
> >>>> Best,
> >>>> Biao Geng
> >>>>
> >>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>>
> 于2023年4月14日周五 03:32写道：
> >>>>
> >>>>>  Dear Biao,
> >>>>> welcome to the Wayang community :)
> >>>>> It's great you could run Wayang and yes you are in the right
> direction.
> >>>>> There is no right way on how to use Wayang that is why in the issue I
> >>>>> suggested to have two different ways in the documentation. One is
> using the
> >>>>> wayang-submit but it has to be with a prebuilt package that you can
> >>>>> download and then you just run your jobs. This is meant more for
> >>>>> production. The other is as you said like a library that you can use
> in
> >>>>> your java application when developing.
> >>>>>
> >>>>> As you already made it run, do you think you could take care of that
> issue
> >>>>> and Michalis could take care of a different issue.What do you think?
> >>>>> Best
> >>>>> --Zoi
> >>>>>
> >>>>>    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao
> Geng
> >>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
> >>>>>
> >>>>>  Dear community,
> >>>>>
> >>>>> Thanks for your efforts for creating this project! I am new to
> Wayang and
> >>>>> want to follow instructions to run a quick demo. I finally managed
> to do
> >>>>> that and could see outputs like the following(I wrote some notes
> about the
> >>>>> process in this issue’s comment<
> >>>>>
> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%252523issuecomment-1507208045%2526source%253Dgmail-imap%2526ust%253D1682062845000000%2526usg%253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%26source%3Dgmail-imap%26ust%3D1682067936000000%26usg%3DAOvVaw2X2G1wcJuRkyCm6fpuksdX&source=gmail-imap&ust=1682445157000000&usg=AOvVaw06CRhhCuIpDwEbMTgY2TgF
> >>>>>> ):
> >>>>> ```
> >>>>> Found 689 words:
> >>>>> 91x the
> >>>>> 87x wayang
> >>>>> 68x apache
> >>>>> ```
> >>>>> But in the process, I had to figure out some installation/running
> >>>>> problems, which makes me wondering if I am on the right direction:
> should I
> >>>>> use wayang-submit or consider Wayang as a library(i.e. write java
> program
> >>>>> and build a fat jar)? Which one is recommended?
> >>>>>
> >>>>> Best,
> >>>>> Biao Geng
> >>>>>
> >>>
> >>>
> >>> --
> >>> databloom AI, Inc.
> >>>
> >>> 3401 N. MIAMI AVE. STE 230
> >>> 33127 Miami, Florida
> >>> United States
> >>>
> >>>
> >>> --  Please consider the environment before printing this
> >>> email --
> >>>
> >>>
> >>>
> >>> Disclaimer:
> >>> The content of this message is confidential. If you
> >>> have received it by mistake, please inform us by an email reply and
> then
> >>> delete the message. It is forbidden to copy, forward, or in any way
> reveal
> >>> the contents of this message to anyone. The integrity and security of
> this
> >>> email cannot be guaranteed over the Internet. Therefore, the sender
> will
> >>> not be held liable for any damage caused by the message.
> >>
> >>
> >> --
> >> databloom AI, Inc.
> >>
> >> 3401 N. MIAMI AVE. STE 230
> >> 33127 Miami, Florida
> >> United States
> >>
> >>
> >> --  Please consider the environment before printing this
> >> email --
> >>
> >>
> >>
> >> Disclaimer:
> >> The content of this message is confidential. If you
> >> have received it by mistake, please inform us by an email reply and then
> >> delete the message. It is forbidden to copy, forward, or in any way
> reveal
> >> the contents of this message to anyone. The integrity and security of
> this
> >> email cannot be guaranteed over the Internet. Therefore, the sender will
> >> not be held liable for any damage caused by the message.
> >>
> >>
>
>
> --
> databloom AI, Inc.
>
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
>
>
> --  Please consider the environment before printing this
> email --
>
>
>
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.
>
>

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten <al...@databloom.ai>.

Hey,

Thats great and it worked for me - I created a PR on your behalf. Zoi, can u please review?
https://github.com/apache/incubator-wayang/pull/300

@Biao, please add the valid Apache Software License 2 headers,  see 
Wordcount fix · apache/incubator-wayang@4431aed (github.com) <https://github.com/apache/incubator-wayang/actions/runs/4735975917/jobs/8406911741?pr=300#step:6:141> ff

Cheers,
 —Alex 

> On 18. Apr 2023, at 19:52, Biao Geng <bi...@gmail.com> wrote:
> 
> Hi folks,
> I have finished the step 1 proposed by @Zoi Kaoudi<ma...@yahoo.gr.INVALID>.
> So, you can find the built binary files hers: https://www.google.com/url?q=https://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT&source=gmail-imap&ust=1682445157000000&usg=AOvVaw1oHka8SFQc3UKYAHxgjP7W
> I also wrote a simple tutorial<https://www.google.com/url?q=https://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md&source=gmail-imap&ust=1682445157000000&usg=AOvVaw3KEAVSGYPTSTUqy9UU0Mzh> based on README in the project. It would be great if anyone else can follow the instructions in the doc to verify the word count example. If there are any problems, please let me know.
> 
> Besides, there are some interesting discoveries:
> 
>  1.  We already have the wayang-assembly module, which would help us build the binary easily. In fact, I directly used it in my wordcount_fix  branch instead of pushing my previous jars.
>  2.  Though the built binary files can work, it would still output some annoying information, which I have mentioned in the issue<https://www.google.com/url?q=https://github.com/apache/incubator-wayang/issues/282&source=gmail-imap&ust=1682445157000000&usg=AOvVaw34LIeGiMvoHFNEp2lwHUt7>. I will spend some time later to figure out if we can avoid it.
> 
> Best,
> Biao Geng
> 
> 
> From: Biao Geng <bi...@gmail.com>
> Date: Tuesday, April 18, 2023 at 11:26 PM
> To: dev@wayang.apache.org <de...@wayang.apache.org>
> Subject: Re: What's the proper way to run Wayang's WordCount Example?
> Hi there,
> 
> Thanks a lot for your response and the discussion.
> Zoi’s proposal makes senses to me. I can take care of the compressed file with the binaries for the new release. I will also add a doc for that so you can verify it at least by running the word count example.
> I may take following steps:
> 
>  1.  I will create a fork based on current main branch(commitId is d46f3c3<https://www.google.com/url?q=https://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431&source=gmail-imap&ust=1682445157000000&usg=AOvVaw0KR103oRbBWOAn_lLoacih>) with workable jars for running the wordcount example.
>  2.  I will write a simple tutorial to show how to run the example locally.
> I also create a jira<https://www.google.com/url?q=https://issues.apache.org/jira/browse/WAYANG-48&source=gmail-imap&ust=1682445157000000&usg=AOvVaw0tJGfl2UkGmF1cW_PZWDrn> to track the work. Once I am ready, I will update in this thread.
> 
> Best,
> Biao Geng
> 
> 
> From: Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>
> Date: Monday, April 17, 2023 at 11:51 PM
> To: dev@wayang.apache.org <de...@wayang.apache.org>
> Subject: Re: What's the proper way to run Wayang's WordCount Example?
> Welcome on board Biao and thanks a lot for your help to the project, pretty much appreciated!!!
> 
> I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I will also perform point 2) we will start point 3.
> 
> Best,
> Jorge
> 
>> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
>> 
>> Great!
>> So, I propose to do the following:
>> 
>> 1. Biao creates the compressed file with the binaries for the new release
>> 2. I get the file and test it in my machine
>> 
>> 3. Alex initiates the release process
>> How does this sound?
>> 
>> Best--
>> Zoi
>> 
>>   Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi Kaoudi <zk...@yahoo.gr.invalid> έγραψε:
>> 
>> Great!
>> So, I propose to do the following:
>> 
>> 1. Biao creates the compressed file with the binaries for the new release2. I get the file and test it in my machine
>> 3. Alex initiates the release process
>> How does this sound?
>> Best
>> --
>> Zoi
>> 
>>    Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:
>> 
>> Good point.
>>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>> 
>>> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?
>> 
>> Yes, we need a new release.
>> 
>>> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.
>> 
>> +1
>> 
>>> Best—Zoi
>>> 
>>> 
>>> Sent from Yahoo Mail for iPhone
>>> 
>>> 
>>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
>>> 
>>> Hi, and welcome Biao :)
>>> 
>>> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
>>> 
>>> Objections and comments are welcome, @community!
>>> 
>>> —Alex
>>> 
>>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>>> 
>>>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code.
>>>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>>>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>>>> 
>>>> Best
>>>> --
>>>> Zoi
>>>> 
>>>>    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:
>>>> 
>>>> Hi Zoi,
>>>> Thanks for the response! I see the point that the command-line tool is for
>>>> production and the library is for development. That's consistent with my
>>>> use experience of big data engines like spark and flink.
>>>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%2526source%253Dgmail-imap%2526ust%253D1682062845000000%2526usg%253DAOvVaw2Z4shFYJDRBcxO-cFQAYtz%26source%3Dgmail-imap%26ust%3D1682067936000000%26usg%3DAOvVaw2HrQCr-TFdIaR9pWi8r0FP&source=gmail-imap&ust=1682445157000000&usg=AOvVaw0vHkl7Ko0mYRm0HSSsWKJB>, I
>>>> found the discussion
>>>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%2526source%253Dgmail-imap%2526ust%253D1682062845000000%2526usg%253DAOvVaw0FEGBKyRWimgKhGwvhuDqu%26source%3Dgmail-imap%26ust%3D1682067936000000%26usg%3DAOvVaw1hioJ8F2lCcfVtFYmtvlLd&source=gmail-imap&ust=1682445157000000&usg=AOvVaw1m4D4wACfxT02JUaM_xkvi> and
>>>> sure, I can help to solve the problem. But I believe my current solution is
>>>> not what we really want in the long run, right? The key part is to correct
>>>> the downloaded zip file so other new users do not need to debug by
>>>> themselves to add missing jars. While I am not quite familiar with Wayand's
>>>> release process, will there be someone else with more experience to figure
>>>> it out?
>>>> Then I can take care of the other parts like validating the new zip/tar
>>>> file, improving the README or solving some other problems in the process.
>>>> What do you think?
>>>> 
>>>> Again, thanks for your help in the mailing list and the github issue.
>>>> 
>>>> Best,
>>>> Biao Geng
>>>> 
>>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>>>> 
>>>>>  Dear Biao,
>>>>> welcome to the Wayang community :)
>>>>> It's great you could run Wayang and yes you are in the right direction.
>>>>> There is no right way on how to use Wayang that is why in the issue I
>>>>> suggested to have two different ways in the documentation. One is using the
>>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>>> download and then you just run your jobs. This is meant more for
>>>>> production. The other is as you said like a library that you can use in
>>>>> your java application when developing.
>>>>> 
>>>>> As you already made it run, do you think you could take care of that issue
>>>>> and Michalis could take care of a different issue.What do you think?
>>>>> Best
>>>>> --Zoi
>>>>> 
>>>>>    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>> 
>>>>>  Dear community,
>>>>> 
>>>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>>>> want to follow instructions to run a quick demo. I finally managed to do
>>>>> that and could see outputs like the following(I wrote some notes about the
>>>>> process in this issue’s comment<
>>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://www.google.com/url?q%253Dhttps://github.com/apache/incubator-wayang/issues/282%252523issuecomment-1507208045%2526source%253Dgmail-imap%2526ust%253D1682062845000000%2526usg%253DAOvVaw07ndTlXkUpbDXTuVHSNUGt%26source%3Dgmail-imap%26ust%3D1682067936000000%26usg%3DAOvVaw2X2G1wcJuRkyCm6fpuksdX&source=gmail-imap&ust=1682445157000000&usg=AOvVaw06CRhhCuIpDwEbMTgY2TgF
>>>>>> ):
>>>>> ```
>>>>> Found 689 words:
>>>>> 91x the
>>>>> 87x wayang
>>>>> 68x apache
>>>>> ```
>>>>> But in the process, I had to figure out some installation/running
>>>>> problems, which makes me wondering if I am on the right direction: should I
>>>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>>>> and build a fat jar)? Which one is recommended?
>>>>> 
>>>>> Best,
>>>>> Biao Geng
>>>>> 
>>> 
>>> 
>>> --
>>> databloom AI, Inc.
>>> 
>>> 3401 N. MIAMI AVE. STE 230
>>> 33127 Miami, Florida
>>> United States
>>> 
>>> 
>>> --  Please consider the environment before printing this
>>> email --
>>> 
>>> 
>>> 
>>> Disclaimer:
>>> The content of this message is confidential. If you
>>> have received it by mistake, please inform us by an email reply and then
>>> delete the message. It is forbidden to copy, forward, or in any way reveal
>>> the contents of this message to anyone. The integrity and security of this
>>> email cannot be guaranteed over the Internet. Therefore, the sender will
>>> not be held liable for any damage caused by the message.
>> 
>> 
>> --
>> databloom AI, Inc.
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>> 
>> 
>> --  Please consider the environment before printing this
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
>> 
>> 


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Biao Geng <bi...@gmail.com>.

Hi folks,
I have finished the step 1 proposed by @Zoi Kaoudi<ma...@yahoo.gr.INVALID>.
So, you can find the built binary files hers: https://github.com/bgeng777/incubator-wayang/tree/wordcount_fix/tmpBinaries/wayang-0.6.1-SNAPSHOT
I also wrote a simple tutorial<https://github.com/bgeng777/incubator-wayang/blob/wordcount_fix/Tutorial.md> based on README in the project. It would be great if anyone else can follow the instructions in the doc to verify the word count example. If there are any problems, please let me know.

Besides, there are some interesting discoveries:

  1.  We already have the wayang-assembly module, which would help us build the binary easily. In fact, I directly used it in my wordcount_fix  branch instead of pushing my previous jars.
  2.  Though the built binary files can work, it would still output some annoying information, which I have mentioned in the issue<https://github.com/apache/incubator-wayang/issues/282>. I will spend some time later to figure out if we can avoid it.

Best,
Biao Geng


From: Biao Geng <bi...@gmail.com>
Date: Tuesday, April 18, 2023 at 11:26 PM
To: dev@wayang.apache.org <de...@wayang.apache.org>
Subject: Re: What's the proper way to run Wayang's WordCount Example?
Hi there,

Thanks a lot for your response and the discussion.
Zoi’s proposal makes senses to me. I can take care of the compressed file with the binaries for the new release. I will also add a doc for that so you can verify it at least by running the word count example.
I may take following steps:

  1.  I will create a fork based on current main branch(commitId is d46f3c3<https://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431>) with workable jars for running the wordcount example.
  2.  I will write a simple tutorial to show how to run the example locally.
I also create a jira<https://issues.apache.org/jira/browse/WAYANG-48> to track the work. Once I am ready, I will update in this thread.

Best,
Biao Geng


From: Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>
Date: Monday, April 17, 2023 at 11:51 PM
To: dev@wayang.apache.org <de...@wayang.apache.org>
Subject: Re: What's the proper way to run Wayang's WordCount Example?
Welcome on board Biao and thanks a lot for your help to the project, pretty much appreciated!!!

I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I will also perform point 2) we will start point 3.

Best,
Jorge

> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
>
> Great!
> So, I propose to do the following:
>
> 1. Biao creates the compressed file with the binaries for the new release
> 2. I get the file and test it in my machine
>
> 3. Alex initiates the release process
> How does this sound?
>
> Best--
> Zoi
>
>    Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi Kaoudi <zk...@yahoo.gr.invalid> έγραψε:
>
>  Great!
> So, I propose to do the following:
>
> 1. Biao creates the compressed file with the binaries for the new release2. I get the file and test it in my machine
> 3. Alex initiates the release process
> How does this sound?
> Best
> --
> Zoi
>
>     Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:
>
> Good point.
>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>
>> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?
>
> Yes, we need a new release.
>
>> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.
>
> +1
>
>> Best—Zoi
>>
>>
>> Sent from Yahoo Mail for iPhone
>>
>>
>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
>>
>> Hi, and welcome Biao :)
>>
>> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
>>
>> Objections and comments are welcome, @community!
>>
>> —Alex
>>
>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>>
>>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code.
>>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>>>
>>> Best
>>> --
>>> Zoi
>>>
>>>     Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:
>>>
>>> Hi Zoi,
>>> Thanks for the response! I see the point that the command-line tool is for
>>> production and the library is for development. That's consistent with my
>>> use experience of big data engines like spark and flink.
>>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw2Z4shFYJDRBcxO-cFQAYtz&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2HrQCr-TFdIaR9pWi8r0FP>, I
>>> found the discussion
>>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw0FEGBKyRWimgKhGwvhuDqu&source=gmail-imap&ust=1682067936000000&usg=AOvVaw1hioJ8F2lCcfVtFYmtvlLd> and
>>> sure, I can help to solve the problem. But I believe my current solution is
>>> not what we really want in the long run, right? The key part is to correct
>>> the downloaded zip file so other new users do not need to debug by
>>> themselves to add missing jars. While I am not quite familiar with Wayand's
>>> release process, will there be someone else with more experience to figure
>>> it out?
>>> Then I can take care of the other parts like validating the new zip/tar
>>> file, improving the README or solving some other problems in the process.
>>> What do you think?
>>>
>>> Again, thanks for your help in the mailing list and the github issue.
>>>
>>> Best,
>>> Biao Geng
>>>
>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>>>
>>>>   Dear Biao,
>>>> welcome to the Wayang community :)
>>>> It's great you could run Wayang and yes you are in the right direction.
>>>> There is no right way on how to use Wayang that is why in the issue I
>>>> suggested to have two different ways in the documentation. One is using the
>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>> download and then you just run your jobs. This is meant more for
>>>> production. The other is as you said like a library that you can use in
>>>> your java application when developing.
>>>>
>>>> As you already made it run, do you think you could take care of that issue
>>>> and Michalis could take care of a different issue.What do you think?
>>>> Best
>>>> --Zoi
>>>>
>>>>     Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>
>>>>   Dear community,
>>>>
>>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>>> want to follow instructions to run a quick demo. I finally managed to do
>>>> that and could see outputs like the following(I wrote some notes about the
>>>> process in this issue’s comment<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%2523issuecomment-1507208045%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw07ndTlXkUpbDXTuVHSNUGt&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2X2G1wcJuRkyCm6fpuksdX
>>>>> ):
>>>> ```
>>>> Found 689 words:
>>>> 91x the
>>>> 87x wayang
>>>> 68x apache
>>>> ```
>>>> But in the process, I had to figure out some installation/running
>>>> problems, which makes me wondering if I am on the right direction: should I
>>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>>> and build a fat jar)? Which one is recommended?
>>>>
>>>> Best,
>>>> Biao Geng
>>>>
>>
>>
>> --
>> databloom AI, Inc.
>>
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>>
>>
>> --  Please consider the environment before printing this
>> email --
>>
>>
>>
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
>
>
> --
> databloom AI, Inc.
>
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
>
>
> --  Please consider the environment before printing this
> email --
>
>
>
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.
>
>

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Biao Geng <bi...@gmail.com>.

Hi there,

Thanks a lot for your response and the discussion.
Zoi’s proposal makes senses to me. I can take care of the compressed file with the binaries for the new release. I will also add a doc for that so you can verify it at least by running the word count example.
I may take following steps:

  1.  I will create a fork based on current main branch(commitId is d46f3c3<https://github.com/apache/incubator-wayang/commit/d46f3c3f0fb963c2ee2640f00a106042fba55431>) with workable jars for running the wordcount example.
  2.  I will write a simple tutorial to show how to run the example locally.
I also create a jira<https://issues.apache.org/jira/browse/WAYANG-48> to track the work. Once I am ready, I will update in this thread.

Best,
Biao Geng


From: Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>
Date: Monday, April 17, 2023 at 11:51 PM
To: dev@wayang.apache.org <de...@wayang.apache.org>
Subject: Re: What's the proper way to run Wayang's WordCount Example?
Welcome on board Biao and thanks a lot for your help to the project, pretty much appreciated!!!

I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I will also perform point 2) we will start point 3.

Best,
Jorge

> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
>
> Great!
> So, I propose to do the following:
>
> 1. Biao creates the compressed file with the binaries for the new release
> 2. I get the file and test it in my machine
>
> 3. Alex initiates the release process
> How does this sound?
>
> Best--
> Zoi
>
>    Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi Kaoudi <zk...@yahoo.gr.invalid> έγραψε:
>
>  Great!
> So, I propose to do the following:
>
> 1. Biao creates the compressed file with the binaries for the new release2. I get the file and test it in my machine
> 3. Alex initiates the release process
> How does this sound?
> Best
> --
> Zoi
>
>     Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:
>
> Good point.
>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>
>> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?
>
> Yes, we need a new release.
>
>> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.
>
> +1
>
>> Best—Zoi
>>
>>
>> Sent from Yahoo Mail for iPhone
>>
>>
>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
>>
>> Hi, and welcome Biao :)
>>
>> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
>>
>> Objections and comments are welcome, @community!
>>
>> —Alex
>>
>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>>
>>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code.
>>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>>>
>>> Best
>>> --
>>> Zoi
>>>
>>>     Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:
>>>
>>> Hi Zoi,
>>> Thanks for the response! I see the point that the command-line tool is for
>>> production and the library is for development. That's consistent with my
>>> use experience of big data engines like spark and flink.
>>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw2Z4shFYJDRBcxO-cFQAYtz&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2HrQCr-TFdIaR9pWi8r0FP>, I
>>> found the discussion
>>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw0FEGBKyRWimgKhGwvhuDqu&source=gmail-imap&ust=1682067936000000&usg=AOvVaw1hioJ8F2lCcfVtFYmtvlLd> and
>>> sure, I can help to solve the problem. But I believe my current solution is
>>> not what we really want in the long run, right? The key part is to correct
>>> the downloaded zip file so other new users do not need to debug by
>>> themselves to add missing jars. While I am not quite familiar with Wayand's
>>> release process, will there be someone else with more experience to figure
>>> it out?
>>> Then I can take care of the other parts like validating the new zip/tar
>>> file, improving the README or solving some other problems in the process.
>>> What do you think?
>>>
>>> Again, thanks for your help in the mailing list and the github issue.
>>>
>>> Best,
>>> Biao Geng
>>>
>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>>>
>>>>   Dear Biao,
>>>> welcome to the Wayang community :)
>>>> It's great you could run Wayang and yes you are in the right direction.
>>>> There is no right way on how to use Wayang that is why in the issue I
>>>> suggested to have two different ways in the documentation. One is using the
>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>> download and then you just run your jobs. This is meant more for
>>>> production. The other is as you said like a library that you can use in
>>>> your java application when developing.
>>>>
>>>> As you already made it run, do you think you could take care of that issue
>>>> and Michalis could take care of a different issue.What do you think?
>>>> Best
>>>> --Zoi
>>>>
>>>>     Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>>
>>>>   Dear community,
>>>>
>>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>>> want to follow instructions to run a quick demo. I finally managed to do
>>>> that and could see outputs like the following(I wrote some notes about the
>>>> process in this issue’s comment<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%2523issuecomment-1507208045%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw07ndTlXkUpbDXTuVHSNUGt&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2X2G1wcJuRkyCm6fpuksdX
>>>>> ):
>>>> ```
>>>> Found 689 words:
>>>> 91x the
>>>> 87x wayang
>>>> 68x apache
>>>> ```
>>>> But in the process, I had to figure out some installation/running
>>>> problems, which makes me wondering if I am on the right direction: should I
>>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>>> and build a fat jar)? Which one is recommended?
>>>>
>>>> Best,
>>>> Biao Geng
>>>>
>>
>>
>> --
>> databloom AI, Inc.
>>
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida
>> United States
>>
>>
>> --  Please consider the environment before printing this
>> email --
>>
>>
>>
>> Disclaimer:
>> The content of this message is confidential. If you
>> have received it by mistake, please inform us by an email reply and then
>> delete the message. It is forbidden to copy, forward, or in any way reveal
>> the contents of this message to anyone. The integrity and security of this
>> email cannot be guaranteed over the Internet. Therefore, the sender will
>> not be held liable for any damage caused by the message.
>
>
> --
> databloom AI, Inc.
>
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida
> United States
>
>
> --  Please consider the environment before printing this
> email --
>
>
>
> Disclaimer:
> The content of this message is confidential. If you
> have received it by mistake, please inform us by an email reply and then
> delete the message. It is forbidden to copy, forward, or in any way reveal
> the contents of this message to anyone. The integrity and security of this
> email cannot be guaranteed over the Internet. Therefore, the sender will
> not be held liable for any damage caused by the message.
>
>

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Jorge Arnulfo Quiané Ruiz <qu...@gmail.com>.

Welcome on board Biao and thanks a lot for your help to the project, pretty much appreciated!!!

I agree with the proposed plan by Zoi. Once we have points 1 and 2 (I will also perform point 2) we will start point 3.

Best,
Jorge

> On 14 Apr 2023, at 14.44, Zoi Kaoudi <zk...@yahoo.gr.INVALID> wrote:
> 
> Great! 
> So, I propose to do the following: 
> 
> 1. Biao creates the compressed file with the binaries for the new release
> 2. I get the file and test it in my machine
> 
> 3. Alex initiates the release process
> How does this sound?
> 
> Best--
> Zoi
> 
>    Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi Kaoudi <zk...@yahoo.gr.invalid> έγραψε:  
> 
>  Great! 
> So, I propose to do the following: 
> 
> 1. Biao creates the compressed file with the binaries for the new release2. I get the file and test it in my machine
> 3. Alex initiates the release process
> How does this sound?
> Best
> --
> Zoi
> 
>     Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:  
> 
> Good point. 
>> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>> 
>> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?
> 
> Yes, we need a new release. 
> 
>> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.
> 
> +1
> 
>> Best—Zoi
>> 
>> 
>> Sent from Yahoo Mail for iPhone
>> 
>> 
>> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
>> 
>> Hi, and welcome Biao :) 
>> 
>> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
>> 
>> Objections and comments are welcome, @community!
>> 
>> —Alex 
>> 
>>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>>> 
>>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
>>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>>> 
>>> Best
>>> --
>>> Zoi
>>> 
>>>     Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
>>> 
>>> Hi Zoi,
>>> Thanks for the response! I see the point that the command-line tool is for
>>> production and the library is for development. That's consistent with my
>>> use experience of big data engines like spark and flink.
>>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw2Z4shFYJDRBcxO-cFQAYtz&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2HrQCr-TFdIaR9pWi8r0FP>, I
>>> found the discussion
>>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw0FEGBKyRWimgKhGwvhuDqu&source=gmail-imap&ust=1682067936000000&usg=AOvVaw1hioJ8F2lCcfVtFYmtvlLd> and
>>> sure, I can help to solve the problem. But I believe my current solution is
>>> not what we really want in the long run, right? The key part is to correct
>>> the downloaded zip file so other new users do not need to debug by
>>> themselves to add missing jars. While I am not quite familiar with Wayand's
>>> release process, will there be someone else with more experience to figure
>>> it out?
>>> Then I can take care of the other parts like validating the new zip/tar
>>> file, improving the README or solving some other problems in the process.
>>> What do you think?
>>> 
>>> Again, thanks for your help in the mailing list and the github issue.
>>> 
>>> Best,
>>> Biao Geng
>>> 
>>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>>> 
>>>>   Dear Biao,
>>>> welcome to the Wayang community :)
>>>> It's great you could run Wayang and yes you are in the right direction.
>>>> There is no right way on how to use Wayang that is why in the issue I
>>>> suggested to have two different ways in the documentation. One is using the
>>>> wayang-submit but it has to be with a prebuilt package that you can
>>>> download and then you just run your jobs. This is meant more for
>>>> production. The other is as you said like a library that you can use in
>>>> your java application when developing.
>>>> 
>>>> As you already made it run, do you think you could take care of that issue
>>>> and Michalis could take care of a different issue.What do you think?
>>>> Best
>>>> --Zoi
>>>> 
>>>>     Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>>> 
>>>>   Dear community,
>>>> 
>>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>>> want to follow instructions to run a quick demo. I finally managed to do
>>>> that and could see outputs like the following(I wrote some notes about the
>>>> process in this issue’s comment<
>>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%2523issuecomment-1507208045%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw07ndTlXkUpbDXTuVHSNUGt&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2X2G1wcJuRkyCm6fpuksdX
>>>>> ):
>>>> ```
>>>> Found 689 words:
>>>> 91x the
>>>> 87x wayang
>>>> 68x apache
>>>> ```
>>>> But in the process, I had to figure out some installation/running
>>>> problems, which makes me wondering if I am on the right direction: should I
>>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>>> and build a fat jar)? Which one is recommended?
>>>> 
>>>> Best,
>>>> Biao Geng
>>>> 
>> 
>> 
>> -- 
>> databloom AI, Inc.  
>> 
>> 3401 N. MIAMI AVE. STE 230
>> 33127 Miami, Florida 
>> United States
>> 
>> 
>> --  Please consider the environment before printing this 
>> email --
>> 
>> 
>> 
>> Disclaimer:
>> The content of this message is confidential. If you 
>> have received it by mistake, please inform us by an email reply and then 
>> delete the message. It is forbidden to copy, forward, or in any way reveal 
>> the contents of this message to anyone. The integrity and security of this 
>> email cannot be guaranteed over the Internet. Therefore, the sender will 
>> not be held liable for any damage caused by the message.
> 
> 
> -- 
> databloom AI, Inc.  
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida 
> United States
> 
> 
> --  Please consider the environment before printing this 
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you 
> have received it by mistake, please inform us by an email reply and then 
> delete the message. It is forbidden to copy, forward, or in any way reveal 
> the contents of this message to anyone. The integrity and security of this 
> email cannot be guaranteed over the Internet. Therefore, the sender will 
> not be held liable for any damage caused by the message.
> 
>

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

 Great! 
So, I propose to do the following: 

1. Biao creates the compressed file with the binaries for the new release
2. I get the file and test it in my machine

3. Alex initiates the release process
How does this sound?

Best--
Zoi

    Στις Παρασκευή 14 Απριλίου 2023 - 02:42:51 μ.μ. CEST, ο χρήστης Zoi Kaoudi <zk...@yahoo.gr.invalid> έγραψε:  
 
  Great! 
So, I propose to do the following: 

1. Biao creates the compressed file with the binaries for the new release2. I get the file and test it in my machine
3. Alex initiates the release process
How does this sound?
Best
--
Zoi

    Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:  
 
 Good point. 
> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
> 
> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?

Yes, we need a new release. 

> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.

+1

> Best—Zoi
> 
> 
> Sent from Yahoo Mail for iPhone
> 
> 
> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
> 
> Hi, and welcome Biao :) 
> 
> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
> 
> Objections and comments are welcome, @community!
> 
> —Alex 
> 
>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>> 
>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>> 
>> Best
>> --
>> Zoi
>> 
>>    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
>> 
>> Hi Zoi,
>> Thanks for the response! I see the point that the command-line tool is for
>> production and the library is for development. That's consistent with my
>> use experience of big data engines like spark and flink.
>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw2Z4shFYJDRBcxO-cFQAYtz&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2HrQCr-TFdIaR9pWi8r0FP>, I
>> found the discussion
>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw0FEGBKyRWimgKhGwvhuDqu&source=gmail-imap&ust=1682067936000000&usg=AOvVaw1hioJ8F2lCcfVtFYmtvlLd> and
>> sure, I can help to solve the problem. But I believe my current solution is
>> not what we really want in the long run, right? The key part is to correct
>> the downloaded zip file so other new users do not need to debug by
>> themselves to add missing jars. While I am not quite familiar with Wayand's
>> release process, will there be someone else with more experience to figure
>> it out?
>> Then I can take care of the other parts like validating the new zip/tar
>> file, improving the README or solving some other problems in the process.
>> What do you think?
>> 
>> Again, thanks for your help in the mailing list and the github issue.
>> 
>> Best,
>> Biao Geng
>> 
>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>> 
>>>  Dear Biao,
>>> welcome to the Wayang community :)
>>> It's great you could run Wayang and yes you are in the right direction.
>>> There is no right way on how to use Wayang that is why in the issue I
>>> suggested to have two different ways in the documentation. One is using the
>>> wayang-submit but it has to be with a prebuilt package that you can
>>> download and then you just run your jobs. This is meant more for
>>> production. The other is as you said like a library that you can use in
>>> your java application when developing.
>>> 
>>> As you already made it run, do you think you could take care of that issue
>>> and Michalis could take care of a different issue.What do you think?
>>> Best
>>> --Zoi
>>> 
>>>    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>> 
>>>  Dear community,
>>> 
>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>> want to follow instructions to run a quick demo. I finally managed to do
>>> that and could see outputs like the following(I wrote some notes about the
>>> process in this issue’s comment<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%2523issuecomment-1507208045%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw07ndTlXkUpbDXTuVHSNUGt&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2X2G1wcJuRkyCm6fpuksdX
>>>> ):
>>> ```
>>> Found 689 words:
>>> 91x the
>>> 87x wayang
>>> 68x apache
>>> ```
>>> But in the process, I had to figure out some installation/running
>>> problems, which makes me wondering if I am on the right direction: should I
>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>> and build a fat jar)? Which one is recommended?
>>> 
>>> Best,
>>> Biao Geng
>>> 
> 
> 
> -- 
> databloom AI, Inc.  
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida 
> United States
> 
> 
> --  Please consider the environment before printing this 
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you 
> have received it by mistake, please inform us by an email reply and then 
> delete the message. It is forbidden to copy, forward, or in any way reveal 
> the contents of this message to anyone. The integrity and security of this 
> email cannot be guaranteed over the Internet. Therefore, the sender will 
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

 Great! 
So, I propose to do the following: 

1. Biao creates the compressed file with the binaries for the new release2. I get the file and test it in my machine
3. Alex initiates the release process
How does this sound?
Best
--
Zoi

    Στις Παρασκευή 14 Απριλίου 2023 - 11:40:36 π.μ. CEST, ο χρήστης Alexander Alten <al...@databloom.ai> έγραψε:  
 
 Good point. 
> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
> 
> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?

Yes, we need a new release. 

> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.

+1

> Best—Zoi
> 
> 
> Sent from Yahoo Mail for iPhone
> 
> 
> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
> 
> Hi, and welcome Biao :) 
> 
> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
> 
> Objections and comments are welcome, @community!
> 
> —Alex 
> 
>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>> 
>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>> 
>> Best
>> --
>> Zoi
>> 
>>    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
>> 
>> Hi Zoi,
>> Thanks for the response! I see the point that the command-line tool is for
>> production and the library is for development. That's consistent with my
>> use experience of big data engines like spark and flink.
>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw2Z4shFYJDRBcxO-cFQAYtz&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2HrQCr-TFdIaR9pWi8r0FP>, I
>> found the discussion
>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw0FEGBKyRWimgKhGwvhuDqu&source=gmail-imap&ust=1682067936000000&usg=AOvVaw1hioJ8F2lCcfVtFYmtvlLd> and
>> sure, I can help to solve the problem. But I believe my current solution is
>> not what we really want in the long run, right? The key part is to correct
>> the downloaded zip file so other new users do not need to debug by
>> themselves to add missing jars. While I am not quite familiar with Wayand's
>> release process, will there be someone else with more experience to figure
>> it out?
>> Then I can take care of the other parts like validating the new zip/tar
>> file, improving the README or solving some other problems in the process.
>> What do you think?
>> 
>> Again, thanks for your help in the mailing list and the github issue.
>> 
>> Best,
>> Biao Geng
>> 
>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>> 
>>>  Dear Biao,
>>> welcome to the Wayang community :)
>>> It's great you could run Wayang and yes you are in the right direction.
>>> There is no right way on how to use Wayang that is why in the issue I
>>> suggested to have two different ways in the documentation. One is using the
>>> wayang-submit but it has to be with a prebuilt package that you can
>>> download and then you just run your jobs. This is meant more for
>>> production. The other is as you said like a library that you can use in
>>> your java application when developing.
>>> 
>>> As you already made it run, do you think you could take care of that issue
>>> and Michalis could take care of a different issue.What do you think?
>>> Best
>>> --Zoi
>>> 
>>>    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>> 
>>>  Dear community,
>>> 
>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>> want to follow instructions to run a quick demo. I finally managed to do
>>> that and could see outputs like the following(I wrote some notes about the
>>> process in this issue’s comment<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%2523issuecomment-1507208045%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw07ndTlXkUpbDXTuVHSNUGt&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2X2G1wcJuRkyCm6fpuksdX
>>>> ):
>>> ```
>>> Found 689 words:
>>> 91x the
>>> 87x wayang
>>> 68x apache
>>> ```
>>> But in the process, I had to figure out some installation/running
>>> problems, which makes me wondering if I am on the right direction: should I
>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>> and build a fat jar)? Which one is recommended?
>>> 
>>> Best,
>>> Biao Geng
>>> 
> 
> 
> -- 
> databloom AI, Inc.  
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida 
> United States
> 
> 
> --  Please consider the environment before printing this 
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you 
> have received it by mistake, please inform us by an email reply and then 
> delete the message. It is forbidden to copy, forward, or in any way reveal 
> the contents of this message to anyone. The integrity and security of this 
> email cannot be guaranteed over the Internet. Therefore, the sender will 
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten <al...@databloom.ai>.

Good point. 
> On 14. Apr 2023, at 11:05, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
> 
> I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?

Yes, we need a new release. 

> Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.

+1

> Best—Zoi
> 
> 
> Sent from Yahoo Mail for iPhone
> 
> 
> On Friday, April 14, 2023, 09:52, Alexander Alten <alo@databloom.ai <ma...@databloom.ai>> wrote:
> 
> Hi, and welcome Biao :) 
> 
> Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.
> 
> Objections and comments are welcome, @community!
> 
> —Alex 
> 
>> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
>> 
>> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
>> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
>> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
>> 
>> Best
>> --
>> Zoi
>> 
>>     Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
>> 
>> Hi Zoi,
>> Thanks for the response! I see the point that the command-line tool is for
>> production and the library is for development. That's consistent with my
>> use experience of big data engines like spark and flink.
>> As for the issue <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw2Z4shFYJDRBcxO-cFQAYtz&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2HrQCr-TFdIaR9pWi8r0FP>, I
>> found the discussion
>> <https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw0FEGBKyRWimgKhGwvhuDqu&source=gmail-imap&ust=1682067936000000&usg=AOvVaw1hioJ8F2lCcfVtFYmtvlLd> and
>> sure, I can help to solve the problem. But I believe my current solution is
>> not what we really want in the long run, right? The key part is to correct
>> the downloaded zip file so other new users do not need to debug by
>> themselves to add missing jars. While I am not quite familiar with Wayand's
>> release process, will there be someone else with more experience to figure
>> it out?
>> Then I can take care of the other parts like validating the new zip/tar
>> file, improving the README or solving some other problems in the process.
>> What do you think?
>> 
>> Again, thanks for your help in the mailing list and the github issue.
>> 
>> Best,
>> Biao Geng
>> 
>> Zoi Kaoudi <zkaoudi@yahoo.gr.invalid <ma...@yahoo.gr.invalid>> 于2023年4月14日周五 03:32写道：
>> 
>>>   Dear Biao,
>>> welcome to the Wayang community :)
>>> It's great you could run Wayang and yes you are in the right direction.
>>> There is no right way on how to use Wayang that is why in the issue I
>>> suggested to have two different ways in the documentation. One is using the
>>> wayang-submit but it has to be with a prebuilt package that you can
>>> download and then you just run your jobs. This is meant more for
>>> production. The other is as you said like a library that you can use in
>>> your java application when developing.
>>> 
>>> As you already made it run, do you think you could take care of that issue
>>> and Michalis could take care of a different issue.What do you think?
>>> Best
>>> --Zoi
>>> 
>>>     Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>>> <biaogeng7@gmail.com <ma...@gmail.com>> έγραψε:
>>> 
>>>   Dear community,
>>> 
>>> Thanks for your efforts for creating this project! I am new to Wayang and
>>> want to follow instructions to run a quick demo. I finally managed to do
>>> that and could see outputs like the following(I wrote some notes about the
>>> process in this issue’s comment<
>>> https://www.google.com/url?q=https://www.google.com/url?q%3Dhttps://github.com/apache/incubator-wayang/issues/282%2523issuecomment-1507208045%26source%3Dgmail-imap%26ust%3D1682062845000000%26usg%3DAOvVaw07ndTlXkUpbDXTuVHSNUGt&source=gmail-imap&ust=1682067936000000&usg=AOvVaw2X2G1wcJuRkyCm6fpuksdX
>>>> ):
>>> ```
>>> Found 689 words:
>>> 91x the
>>> 87x wayang
>>> 68x apache
>>> ```
>>> But in the process, I had to figure out some installation/running
>>> problems, which makes me wondering if I am on the right direction: should I
>>> use wayang-submit or consider Wayang as a library(i.e. write java program
>>> and build a fat jar)? Which one is recommended?
>>> 
>>> Best,
>>> Biao Geng
>>> 
> 
> 
> -- 
> databloom AI, Inc.  
> 
> 3401 N. MIAMI AVE. STE 230
> 33127 Miami, Florida 
> United States
> 
> 
> --  Please consider the environment before printing this 
> email --
> 
> 
> 
> Disclaimer:
> The content of this message is confidential. If you 
> have received it by mistake, please inform us by an email reply and then 
> delete the message. It is forbidden to copy, forward, or in any way reveal 
> the contents of this message to anyone. The integrity and security of this 
> email cannot be guaranteed over the Internet. Therefore, the sender will 
> not be held liable for any damage caused by the message.


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

I think we should do a binary release first without changing anything so that the installation problem is fixed asap. This won’t be a new release but complementary to the current one. Isn’t that possible? Or is it possible to just replace the current file we have with a new one?
Then, we can take care to remove Java 8 and graphchi in a new release. But this requires more time.
Best—Zoi


Sent from Yahoo Mail for iPhone


On Friday, April 14, 2023, 09:52, Alexander Alten <al...@databloom.ai> wrote:

Hi, and welcome Biao :) 

Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.

Objections and comments are welcome, @community!

—Alex 

> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
> 
> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
> 
> Best
> --
> Zoi
> 
>    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
> 
> Hi Zoi,
> Thanks for the response! I see the point that the command-line tool is for
> production and the library is for development. That's consistent with my
> use experience of big data engines like spark and flink.
> As for the issue <https://www.google.com/url?q=https://github.com/apache/incubator-wayang/issues/282&source=gmail-imap&ust=1682062845000000&usg=AOvVaw2Z4shFYJDRBcxO-cFQAYtz>, I
> found the discussion
> <https://www.google.com/url?q=https://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88&source=gmail-imap&ust=1682062845000000&usg=AOvVaw0FEGBKyRWimgKhGwvhuDqu> and
> sure, I can help to solve the problem. But I believe my current solution is
> not what we really want in the long run, right? The key part is to correct
> the downloaded zip file so other new users do not need to debug by
> themselves to add missing jars. While I am not quite familiar with Wayand's
> release process, will there be someone else with more experience to figure
> it out?
> Then I can take care of the other parts like validating the new zip/tar
> file, improving the README or solving some other problems in the process.
> What do you think?
> 
> Again, thanks for your help in the mailing list and the github issue.
> 
> Best,
> Biao Geng
> 
> Zoi Kaoudi <zk...@yahoo.gr.invalid> 于2023年4月14日周五 03:32写道：
> 
>>  Dear Biao,
>> welcome to the Wayang community :)
>> It's great you could run Wayang and yes you are in the right direction.
>> There is no right way on how to use Wayang that is why in the issue I
>> suggested to have two different ways in the documentation. One is using the
>> wayang-submit but it has to be with a prebuilt package that you can
>> download and then you just run your jobs. This is meant more for
>> production. The other is as you said like a library that you can use in
>> your java application when developing.
>> 
>> As you already made it run, do you think you could take care of that issue
>> and Michalis could take care of a different issue.What do you think?
>> Best
>> --Zoi
>> 
>>    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>> <bi...@gmail.com> έγραψε:
>> 
>>  Dear community,
>> 
>> Thanks for your efforts for creating this project! I am new to Wayang and
>> want to follow instructions to run a quick demo. I finally managed to do
>> that and could see outputs like the following(I wrote some notes about the
>> process in this issue’s comment<
>> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/issues/282%23issuecomment-1507208045&source=gmail-imap&ust=1682062845000000&usg=AOvVaw07ndTlXkUpbDXTuVHSNUGt
>>> ):
>> ```
>> Found 689 words:
>> 91x the
>> 87x wayang
>> 68x apache
>> ```
>> But in the process, I had to figure out some installation/running
>> problems, which makes me wondering if I am on the right direction: should I
>> use wayang-submit or consider Wayang as a library(i.e. write java program
>> and build a fat jar)? Which one is recommended?
>> 
>> Best,
>> Biao Geng
>> 


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Alexander Alten <al...@databloom.ai>.

Hi, and welcome Biao :) 

Yes, we should certainly plan a new release as soon as we have finished the cleanup process. From my point of view we should eliminate Java 8 support due security concerns. I’m also in for to end support for GraphChi, since this project is dead since 8 years. To end support for J8 and GraphChi I think we need to clarify the reasons in the release notes. Maybe it’s a good idea to start a new thread which contains the content of the next release? Just to make sure that we have a clear path.

Objections and comments are welcome, @community!

—Alex 

> On 14. Apr 2023, at 09:40, Zoi Kaoudi <zk...@yahoo.gr.invalid> wrote:
> 
> Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
> I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
> In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.
> 
> Best
> --
> Zoi
> 
>    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
> 
> Hi Zoi,
> Thanks for the response! I see the point that the command-line tool is for
> production and the library is for development. That's consistent with my
> use experience of big data engines like spark and flink.
> As for the issue <https://www.google.com/url?q=https://github.com/apache/incubator-wayang/issues/282&source=gmail-imap&ust=1682062845000000&usg=AOvVaw2Z4shFYJDRBcxO-cFQAYtz>, I
> found the discussion
> <https://www.google.com/url?q=https://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88&source=gmail-imap&ust=1682062845000000&usg=AOvVaw0FEGBKyRWimgKhGwvhuDqu> and
> sure, I can help to solve the problem. But I believe my current solution is
> not what we really want in the long run, right? The key part is to correct
> the downloaded zip file so other new users do not need to debug by
> themselves to add missing jars. While I am not quite familiar with Wayand's
> release process, will there be someone else with more experience to figure
> it out?
> Then I can take care of the other parts like validating the new zip/tar
> file, improving the README or solving some other problems in the process.
> What do you think?
> 
> Again, thanks for your help in the mailing list and the github issue.
> 
> Best,
> Biao Geng
> 
> Zoi Kaoudi <zk...@yahoo.gr.invalid> 于2023年4月14日周五 03:32写道：
> 
>>   Dear Biao,
>> welcome to the Wayang community :)
>> It's great you could run Wayang and yes you are in the right direction.
>> There is no right way on how to use Wayang that is why in the issue I
>> suggested to have two different ways in the documentation. One is using the
>> wayang-submit but it has to be with a prebuilt package that you can
>> download and then you just run your jobs. This is meant more for
>> production. The other is as you said like a library that you can use in
>> your java application when developing.
>> 
>> As you already made it run, do you think you could take care of that issue
>> and Michalis could take care of a different issue.What do you think?
>> Best
>> --Zoi
>> 
>>     Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
>> <bi...@gmail.com> έγραψε:
>> 
>>   Dear community,
>> 
>> Thanks for your efforts for creating this project! I am new to Wayang and
>> want to follow instructions to run a quick demo. I finally managed to do
>> that and could see outputs like the following(I wrote some notes about the
>> process in this issue’s comment<
>> https://www.google.com/url?q=https://github.com/apache/incubator-wayang/issues/282%23issuecomment-1507208045&source=gmail-imap&ust=1682062845000000&usg=AOvVaw07ndTlXkUpbDXTuVHSNUGt
>>> ):
>> ```
>> Found 689 words:
>> 91x the
>> 87x wayang
>> 68x apache
>> ```
>> But in the process, I had to figure out some installation/running
>> problems, which makes me wondering if I am on the right direction: should I
>> use wayang-submit or consider Wayang as a library(i.e. write java program
>> and build a fat jar)? Which one is recommended?
>> 
>> Best,
>> Biao Geng
>> 


-- 
databloom AI, Inc.  

3401 N. MIAMI AVE. STE 230
33127 Miami, Florida 
United States


--  Please consider the environment before printing this 
email --



Disclaimer:
The content of this message is confidential. If you 
have received it by mistake, please inform us by an email reply and then 
delete the message. It is forbidden to copy, forward, or in any way reveal 
the contents of this message to anyone. The integrity and security of this 
email cannot be guaranteed over the Internet. Therefore, the sender will 
not be held liable for any damage caused by the message.

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

 Yes, I totally agree that we need to correct the current release and provide the binaries and not the source code. 
I am also not very familiar with the release process but I think Alex and/or Chris could help with that.@Alex, what do you think?
In the meantime, maybe you could add/modify the README instructions for someone that wants to clone and build wayang and run the wordcount locally? For example, I could also build it successfully in my laptop but then it's not clear what I have to do to be able to run the main class.

Best
--
Zoi

    Στις Παρασκευή 14 Απριλίου 2023 - 09:28:00 π.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
 
 Hi Zoi,
Thanks for the response! I see the point that the command-line tool is for
production and the library is for development. That's consistent with my
use experience of big data engines like spark and flink.
As for the issue <https://github.com/apache/incubator-wayang/issues/282>, I
found the discussion
<https://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88> and
sure, I can help to solve the problem. But I believe my current solution is
not what we really want in the long run, right? The key part is to correct
the downloaded zip file so other new users do not need to debug by
themselves to add missing jars. While I am not quite familiar with Wayand's
release process, will there be someone else with more experience to figure
it out?
Then I can take care of the other parts like validating the new zip/tar
file, improving the README or solving some other problems in the process.
What do you think?

Again, thanks for your help in the mailing list and the github issue.

Best,
Biao Geng

Zoi Kaoudi <zk...@yahoo.gr.invalid> 于2023年4月14日周五 03:32写道：

>  Dear Biao,
> welcome to the Wayang community :)
> It's great you could run Wayang and yes you are in the right direction.
> There is no right way on how to use Wayang that is why in the issue I
> suggested to have two different ways in the documentation. One is using the
> wayang-submit but it has to be with a prebuilt package that you can
> download and then you just run your jobs. This is meant more for
> production. The other is as you said like a library that you can use in
> your java application when developing.
>
> As you already made it run, do you think you could take care of that issue
> and Michalis could take care of a different issue.What do you think?
> Best
> --Zoi
>
>    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
> <bi...@gmail.com> έγραψε:
>
>  Dear community,
>
> Thanks for your efforts for creating this project! I am new to Wayang and
> want to follow instructions to run a quick demo. I finally managed to do
> that and could see outputs like the following(I wrote some notes about the
> process in this issue’s comment<
> https://github.com/apache/incubator-wayang/issues/282#issuecomment-1507208045
> >):
> ```
> Found 689 words:
> 91x the
> 87x wayang
> 68x apache
> ```
> But in the process, I had to figure out some installation/running
> problems, which makes me wondering if I am on the right direction: should I
> use wayang-submit or consider Wayang as a library(i.e. write java program
> and build a fat jar)? Which one is recommended?
>
> Best,
> Biao Geng
>

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Biao Geng <bi...@gmail.com>.

Hi Zoi,
Thanks for the response! I see the point that the command-line tool is for
production and the library is for development. That's consistent with my
use experience of big data engines like spark and flink.
As for the issue <https://github.com/apache/incubator-wayang/issues/282>, I
found the discussion
<https://lists.apache.org/thread/5czmqpzk5vmw06z258jg7p6d2r1y4c88> and
sure, I can help to solve the problem. But I believe my current solution is
not what we really want in the long run, right? The key part is to correct
the downloaded zip file so other new users do not need to debug by
themselves to add missing jars. While I am not quite familiar with Wayand's
release process, will there be someone else with more experience to figure
it out?
Then I can take care of the other parts like validating the new zip/tar
file, improving the README or solving some other problems in the process.
What do you think?

Again, thanks for your help in the mailing list and the github issue.

Best,
Biao Geng

Zoi Kaoudi <zk...@yahoo.gr.invalid> 于2023年4月14日周五 03:32写道：

>  Dear Biao,
> welcome to the Wayang community :)
> It's great you could run Wayang and yes you are in the right direction.
> There is no right way on how to use Wayang that is why in the issue I
> suggested to have two different ways in the documentation. One is using the
> wayang-submit but it has to be with a prebuilt package that you can
> download and then you just run your jobs. This is meant more for
> production. The other is as you said like a library that you can use in
> your java application when developing.
>
> As you already made it run, do you think you could take care of that issue
> and Michalis could take care of a different issue.What do you think?
> Best
> --Zoi
>
>     Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng
> <bi...@gmail.com> έγραψε:
>
>  Dear community,
>
> Thanks for your efforts for creating this project! I am new to Wayang and
> want to follow instructions to run a quick demo. I finally managed to do
> that and could see outputs like the following(I wrote some notes about the
> process in this issue’s comment<
> https://github.com/apache/incubator-wayang/issues/282#issuecomment-1507208045
> >):
> ```
> Found 689 words:
> 91x the
> 87x wayang
> 68x apache
> ```
> But in the process, I had to figure out some installation/running
> problems, which makes me wondering if I am on the right direction: should I
> use wayang-submit or consider Wayang as a library(i.e. write java program
> and build a fat jar)? Which one is recommended?
>
> Best,
> Biao Geng
>

Re: What's the proper way to run Wayang's WordCount Example?

Posted by Zoi Kaoudi <zk...@yahoo.gr.INVALID>.

 Dear Biao,
welcome to the Wayang community :)
It's great you could run Wayang and yes you are in the right direction. There is no right way on how to use Wayang that is why in the issue I suggested to have two different ways in the documentation. One is using the wayang-submit but it has to be with a prebuilt package that you can download and then you just run your jobs. This is meant more for production. The other is as you said like a library that you can use in your java application when developing.

As you already made it run, do you think you could take care of that issue and Michalis could take care of a different issue.What do you think?
Best
--Zoi

    Στις Πέμπτη 13 Απριλίου 2023 - 05:55:39 μ.μ. CEST, ο χρήστης Biao Geng <bi...@gmail.com> έγραψε:  
 
 Dear community,

Thanks for your efforts for creating this project! I am new to Wayang and want to follow instructions to run a quick demo. I finally managed to do that and could see outputs like the following(I wrote some notes about the process in this issue’s comment<https://github.com/apache/incubator-wayang/issues/282#issuecomment-1507208045>):
```
Found 689 words:
91x the
87x wayang
68x apache
```
But in the process, I had to figure out some installation/running problems, which makes me wondering if I am on the right direction: should I use wayang-submit or consider Wayang as a library(i.e. write java program and build a fat jar)? Which one is recommended?

Best,
Biao Geng