You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by traef <tr...@wewatchyourwebsite.com> on 2021/06/25 10:04:48 UTC

Looking for example code

I'm just starting with Flink. I've been trying all the examples online and none of them work.I am not a Java programmer but have been programming since 1982.I would like example code to read from a Pulsar topic and output to another Pulsar topic.Pulsar version 2.8.0Flink version 1.13.1Scala version 2.11Thank you in advance. 

Re: Looking for example code

Posted by Thomas Raef <tr...@wewatchyourwebsite.com>.
Thanks, I'll check them out.

Thomas J. Raef
Founder, WeWatchYourWebsite.com
http://wewatchyourwebsite.com
traef@wewatchyourwebsite.com
LinkedIn <https://www.linkedin.com/in/thomas-raef-74b93a14/>
Facebook <https://www.facebook.com/WeWatchYourWebsite>



On Mon, Jun 28, 2021 at 11:16 AM Piotr Nowojski <pn...@apache.org>
wrote:

> Have you seen the documents that I linked? Isn't it enough?
>
> First pular link that I posted [4] has some example code. Literally the
> first link inside the second pulsar blog I referenced [5] leads to the
> pulsar connector repository which also has some examples [6].
>
> Piotrek
>
> [6] https://github.com/streamnative/pulsar-flink/
>
> pon., 28 cze 2021 o 17:08 Thomas Raef <tr...@wewatchyourwebsite.com>
> napisał(a):
>
>> I need it to connect to Pulsar and stream from Pulsar. I could not find
>> any code on how to connect to Pulsar. I've done the WordCount, but I need
>> sample code for how to connect to Pulsar.
>>
>> Thomas J. Raef
>> Founder, WeWatchYourWebsite.com
>> http://wewatchyourwebsite.com
>> traef@wewatchyourwebsite.com
>> LinkedIn <https://www.linkedin.com/in/thomas-raef-74b93a14/>
>> Facebook <https://www.facebook.com/WeWatchYourWebsite>
>>
>>
>>
>> On Mon, Jun 28, 2021 at 8:54 AM Piotr Nowojski <pn...@apache.org>
>> wrote:
>>
>>> Hi,
>>>
>>> We are glad that you want to try out Flink, but if you would like to get
>>> help you need to be a bit more specific. What are you exactly doing, and
>>> what, on which step exactly and how is not working (including logs and/or
>>> error messages) is necessary for someone to help you.
>>>
>>> In terms of how to start, I would suggest starting with running the
>>> WordCount example on your cluster [1]. This one assumes starting a small
>>> cluster on your local machine. If you are interested in different methods
>>> of running Flink cluster check docs -> deployment -> resource providers [2].
>>>
>>> For developing a simple application and running it from your IDE please
>>> take a look at this Fraud Detection with the DataStream API example [3].
>>>
>>> Regarding the Pulsar connector, I don't know much about it, but there
>>> are a couple of resources that I have found via simple search, that might
>>> be helpful [4],[5]
>>>
>>> Piotrek
>>>
>>> [1]
>>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/local_installation/
>>> [2]
>>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/
>>> [3]
>>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/datastream/
>>> [4]
>>> https://flink.apache.org/news/2019/11/25/query-pulsar-streams-using-apache-flink.html
>>> [5] https://flink.apache.org/2021/01/07/pulsar-flink-connector-270.html
>>>
>>> pt., 25 cze 2021 o 12:05 traef <tr...@wewatchyourwebsite.com>
>>> napisał(a):
>>>
>>>> I'm just starting with Flink. I've been trying all the examples online
>>>> and none of them work.
>>>>
>>>> I am not a Java programmer but have been programming since 1982.
>>>>
>>>> I would like example code to read from a Pulsar topic and output to
>>>> another Pulsar topic.
>>>>
>>>> Pulsar version 2.8.0
>>>> Flink version 1.13.1
>>>> Scala version 2.11
>>>>
>>>> Thank you in advance.
>>>>
>>>

Re: Looking for example code

Posted by Piotr Nowojski <pn...@apache.org>.
Have you seen the documents that I linked? Isn't it enough?

First pular link that I posted [4] has some example code. Literally the
first link inside the second pulsar blog I referenced [5] leads to the
pulsar connector repository which also has some examples [6].

Piotrek

[6] https://github.com/streamnative/pulsar-flink/

pon., 28 cze 2021 o 17:08 Thomas Raef <tr...@wewatchyourwebsite.com>
napisał(a):

> I need it to connect to Pulsar and stream from Pulsar. I could not find
> any code on how to connect to Pulsar. I've done the WordCount, but I need
> sample code for how to connect to Pulsar.
>
> Thomas J. Raef
> Founder, WeWatchYourWebsite.com
> http://wewatchyourwebsite.com
> traef@wewatchyourwebsite.com
> LinkedIn <https://www.linkedin.com/in/thomas-raef-74b93a14/>
> Facebook <https://www.facebook.com/WeWatchYourWebsite>
>
>
>
> On Mon, Jun 28, 2021 at 8:54 AM Piotr Nowojski <pn...@apache.org>
> wrote:
>
>> Hi,
>>
>> We are glad that you want to try out Flink, but if you would like to get
>> help you need to be a bit more specific. What are you exactly doing, and
>> what, on which step exactly and how is not working (including logs and/or
>> error messages) is necessary for someone to help you.
>>
>> In terms of how to start, I would suggest starting with running the
>> WordCount example on your cluster [1]. This one assumes starting a small
>> cluster on your local machine. If you are interested in different methods
>> of running Flink cluster check docs -> deployment -> resource providers [2].
>>
>> For developing a simple application and running it from your IDE please
>> take a look at this Fraud Detection with the DataStream API example [3].
>>
>> Regarding the Pulsar connector, I don't know much about it, but there are
>> a couple of resources that I have found via simple search, that might
>> be helpful [4],[5]
>>
>> Piotrek
>>
>> [1]
>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/local_installation/
>> [2]
>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/
>> [3]
>> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/datastream/
>> [4]
>> https://flink.apache.org/news/2019/11/25/query-pulsar-streams-using-apache-flink.html
>> [5] https://flink.apache.org/2021/01/07/pulsar-flink-connector-270.html
>>
>> pt., 25 cze 2021 o 12:05 traef <tr...@wewatchyourwebsite.com> napisał(a):
>>
>>> I'm just starting with Flink. I've been trying all the examples online
>>> and none of them work.
>>>
>>> I am not a Java programmer but have been programming since 1982.
>>>
>>> I would like example code to read from a Pulsar topic and output to
>>> another Pulsar topic.
>>>
>>> Pulsar version 2.8.0
>>> Flink version 1.13.1
>>> Scala version 2.11
>>>
>>> Thank you in advance.
>>>
>>

Re: Looking for example code

Posted by Thomas Raef <tr...@wewatchyourwebsite.com>.
I need it to connect to Pulsar and stream from Pulsar. I could not find any
code on how to connect to Pulsar. I've done the WordCount, but I need
sample code for how to connect to Pulsar.

Thomas J. Raef
Founder, WeWatchYourWebsite.com
http://wewatchyourwebsite.com
traef@wewatchyourwebsite.com
LinkedIn <https://www.linkedin.com/in/thomas-raef-74b93a14/>
Facebook <https://www.facebook.com/WeWatchYourWebsite>



On Mon, Jun 28, 2021 at 8:54 AM Piotr Nowojski <pn...@apache.org> wrote:

> Hi,
>
> We are glad that you want to try out Flink, but if you would like to get
> help you need to be a bit more specific. What are you exactly doing, and
> what, on which step exactly and how is not working (including logs and/or
> error messages) is necessary for someone to help you.
>
> In terms of how to start, I would suggest starting with running the
> WordCount example on your cluster [1]. This one assumes starting a small
> cluster on your local machine. If you are interested in different methods
> of running Flink cluster check docs -> deployment -> resource providers [2].
>
> For developing a simple application and running it from your IDE please
> take a look at this Fraud Detection with the DataStream API example [3].
>
> Regarding the Pulsar connector, I don't know much about it, but there are
> a couple of resources that I have found via simple search, that might
> be helpful [4],[5]
>
> Piotrek
>
> [1]
> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/local_installation/
> [2]
> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/
> [3]
> https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/datastream/
> [4]
> https://flink.apache.org/news/2019/11/25/query-pulsar-streams-using-apache-flink.html
> [5] https://flink.apache.org/2021/01/07/pulsar-flink-connector-270.html
>
> pt., 25 cze 2021 o 12:05 traef <tr...@wewatchyourwebsite.com> napisał(a):
>
>> I'm just starting with Flink. I've been trying all the examples online
>> and none of them work.
>>
>> I am not a Java programmer but have been programming since 1982.
>>
>> I would like example code to read from a Pulsar topic and output to
>> another Pulsar topic.
>>
>> Pulsar version 2.8.0
>> Flink version 1.13.1
>> Scala version 2.11
>>
>> Thank you in advance.
>>
>

Re: Looking for example code

Posted by Piotr Nowojski <pn...@apache.org>.
Hi,

We are glad that you want to try out Flink, but if you would like to get
help you need to be a bit more specific. What are you exactly doing, and
what, on which step exactly and how is not working (including logs and/or
error messages) is necessary for someone to help you.

In terms of how to start, I would suggest starting with running the
WordCount example on your cluster [1]. This one assumes starting a small
cluster on your local machine. If you are interested in different methods
of running Flink cluster check docs -> deployment -> resource providers [2].

For developing a simple application and running it from your IDE please
take a look at this Fraud Detection with the DataStream API example [3].

Regarding the Pulsar connector, I don't know much about it, but there are a
couple of resources that I have found via simple search, that might
be helpful [4],[5]

Piotrek

[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/local_installation/
[2]
https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/deployment/resource-providers/
[3]
https://ci.apache.org/projects/flink/flink-docs-release-1.13/docs/try-flink/datastream/
[4]
https://flink.apache.org/news/2019/11/25/query-pulsar-streams-using-apache-flink.html
[5] https://flink.apache.org/2021/01/07/pulsar-flink-connector-270.html

pt., 25 cze 2021 o 12:05 traef <tr...@wewatchyourwebsite.com> napisał(a):

> I'm just starting with Flink. I've been trying all the examples online and
> none of them work.
>
> I am not a Java programmer but have been programming since 1982.
>
> I would like example code to read from a Pulsar topic and output to
> another Pulsar topic.
>
> Pulsar version 2.8.0
> Flink version 1.13.1
> Scala version 2.11
>
> Thank you in advance.
>