You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by Gaurav P <gp...@gpism.com> on 2022/07/26 00:42:18 UTC
Re: Looking forward to Contribute in Stream pipes : Digital twin
HI Andrews ,
I am planning to generate digital twins for industry 4.0 assets like the
entire factory using unreal and display sensor data on 3d model
For data processing and sensor data and integration with backend systems
like ERP already deployed, I am experimenting with using stream pipes
For Now, I am exploring the following
1) How ingrate with backend systems, is there any adapter for apache camel,
if not can I build /contribute? so that we access 300+ integrations
2) Can we integrate with apache Nifi?
Also can please give me access to slack channel also?I tried the click on
invite link but gives a error message
Regards,
Gaurav
On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
> Hi Gaurav,
>
> great to hear that you want to contribute!
> Have a look at our developer wiki where you can find information on how to
> start development:
> https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Started
> There are manuals for UI development as well as backend development.
>
> Also have a look at the manual of the StreamPipes CLI, which can be found
> in the "installer/cli" directory of StreamPipes.
>
> What kind of digital twin capability are you thinking of?
>
> Best,
> Dominik
>
>
> -----Original Message-----
> From: Gaurav P <gp...@gpism.com>
> Sent: Thursday, April 21, 2022 4:37 AM
> To: dev@streampipes.apache.org
> Subject: Looking forward to Contribute in Stream pipes : Digital twin
>
> Hi All ,
> Yesterday I discovered Stream pipes and am really happy to see such an
> end to end, user-friendly platform, I look forward to contributing to
> adding digital twin capability to stream pipes i or integrating with the
> one I am building
>
> Is there any guide on how setup source and build it ? I can find the
> docker but not any instruction on how to build from source , any link would
> be helpful
>
> Also can we also dev channels on slack or discord , using email list like
> can be slow crubsome
>
> Regards ,
> Gaurav
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
AW: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Philipp Zehnder <ph...@bytefabrik.ai>.
Hi Gaurav,
it seems that you are using an old version of StreamPipes.
The current version is 0.92.0.
We have updated our documentation, you can find the latest version here [1].
Please let us know if you experience similar problems with the latest version.
Cheers,
Philipp
[1] https://streampipes.apache.org/docs/user-guide-introduction
Von: Gaurav P <gp...@gpism.com>
Datum: Dienstag, 26. September 2023 um 04:59
An: dev@streampipes.apache.org <de...@streampipes.apache.org>
Betreff: Re: Looking forward to Contribute in Stream pipes : Digital twin
also half of the documentation links are dead , giving 404 , I tried on
unbutu sever earlier WSL windows and it partially worked till I got
Full Logs here
https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
ERROR: pull access denied for apachestreampipes/connect-worker, repository
does not exist or may require 'docker login': denied: requested access to
the resource is denied
I hope this project is still active and I can contribute
On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com> wrote:
> Thanks ,
> I followed the links below and having a problem getting the dev setup ,
>
> I am getting this issue in ubuntu running on wsl 2 windows
> Welcome to Apache StreamPipes - wait for installation to be finished...
>
> [INFO] Version: 0.68.0
> [INFO] Environment: 'pipeline-element'
> [INFO] Mode: Development mode, all ports mapped
> [INFO] Docker network 'spnet' already exists. Continuing
>
> more logs on
> https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
>
> Please help me get started with development seup
>
> I have created 5-6 processors but unable to install or test
>
>
> On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
> dominik.riemer@bytefabrik.ai> wrote:
>
>> Hi Gaurav,
>>
>> sounds cool!
>>
>> Are you looking for Camel/Nifi adapters to receive data or sinks to
>> publish data from StreamPipes as a sink?
>> We don't have any specific processors for that, but you can probably
>> exchange data over MQTT or some other protocol supported by both systems.
>>
>> Having said that, it would be really cool to have a tighter integration,
>> e.g., for data sinks we have a tutorial at [1], many existing processors as
>> some inspiration at [2] and a project containing configuration examples at
>> [3]. You might also be interested in using the Maven archetypes [4] for
>> processor development, or you can directly extend our extensions module and
>> create a PR. For adapters, we currently don't have a documentation, but you
>> can also check the examples in the repo.
>>
>> Regarding the Slack channel, we are not longer supporting this (need to
>> update the website 😉), so the best way is to communicate over the mailing
>> list or the Apache Slack channel in case you are an ASF committer.
>>
>> Please ask if you have any questions!
>>
>> Best
>> Dominik
>>
>> [1]
>> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.html
>> [2]
>> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-extensions
>> [3]
>> https://github.com/apache/incubator-streampipes-examples/tree/dev/streampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/apache/streampipes/pe/examples/jvm
>> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
>>
>>
>>
>> -----Original Message-----
>> From: Gaurav P <gp...@gpism.com>
>> Sent: Tuesday, July 26, 2022 2:42 AM
>> To: dev@streampipes.apache.org
>> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>>
>> HI Andrews ,
>>
>> I am planning to generate digital twins for industry 4.0 assets like the
>> entire factory using unreal and display sensor data on 3d model
>>
>> For data processing and sensor data and integration with backend systems
>> like ERP already deployed, I am experimenting with using stream pipes
>>
>> For Now, I am exploring the following
>> 1) How ingrate with backend systems, is there any adapter for apache
>> camel, if not can I build /contribute? so that we access 300+ integrations
>> 2) Can we integrate with apache Nifi?
>>
>> Also can please give me access to slack channel also?I tried the click on
>> invite link but gives a error message
>>
>> Regards,
>> Gaurav
>>
>>
>> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
>>
>> > Hi Gaurav,
>> >
>> > great to hear that you want to contribute!
>> > Have a look at our developer wiki where you can find information on
>> > how to start development:
>> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Starte
>> > d There are manuals for UI development as well as backend development.
>> >
>> > Also have a look at the manual of the StreamPipes CLI, which can be
>> > found in the "installer/cli" directory of StreamPipes.
>> >
>> > What kind of digital twin capability are you thinking of?
>> >
>> > Best,
>> > Dominik
>> >
>> >
>> > -----Original Message-----
>> > From: Gaurav P <gp...@gpism.com>
>> > Sent: Thursday, April 21, 2022 4:37 AM
>> > To: dev@streampipes.apache.org
>> > Subject: Looking forward to Contribute in Stream pipes : Digital twin
>> >
>> > Hi All ,
>> > Yesterday I discovered Stream pipes and am really happy to see such
>> > an end to end, user-friendly platform, I look forward to contributing
>> > to adding digital twin capability to stream pipes i or integrating
>> > with the one I am building
>> >
>> > Is there any guide on how setup source and build it ? I can find the
>> > docker but not any instruction on how to build from source , any link
>> > would be helpful
>> >
>> > Also can we also dev channels on slack or discord , using email list
>> > like can be slow crubsome
>> >
>> > Regards ,
>> > Gaurav
>> >
>> > --
>> > B*e * the *Ch*ange
>> >
>>
>>
>> --
>> B*e * the *Ch*ange
>>
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
Re: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Gaurav P <gp...@gpism.com>.
Thanks let me try this
I was able to create a Processor using maven archeotype generated
boilerplate , so to deploy this processor in my dev instance I need to run
it as a docker ad run it will automatically discover.?
Do I really need docker to test, can it serve as a microservice that can be
discovered ...or do I need to browse it manually via browse end point
feature
[image: image.png]
If I am able to deploy this process and if it works fine, I am planning to
create step by step guide on youtube , hopefully will help others to get
started fast
On Wed, Sep 27, 2023 at 10:06 PM Dominik Riemer <
dominik.riemer@bytefabrik.ai> wrote:
> We applied some changes to the website to fix a trailing slash problem in
> some browsers.
> Please have a look at the documentation on info how to create custom
> elements (e.g., [1], [2]). You can use the dev setup (using the CLI) to
> develop your own extensions and can run the system in production either in
> Docker or K8s.
> There are also many examples on Github (make sure to choose the correct
> branch for your version) at [3]
>
> Cheers
> Dominik
>
>
> [1] https://streampipes.apache.org/docs/extend-cli/
> [2] https://streampipes.apache.org/docs/extend-archetypes/
> [3] https://github.com/apache/streampipes/tree/dev/streampipes-extensions
>
> From: Gaurav P <gp...@gpism.com>
> Sent: Wednesday, September 27, 2023 2:12 PM
> To: dev@streampipes.apache.org
> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>
> Hi All ,
> Can please let point me to the updated document with instruction that
> works ? for dev setup ...its really urgent as I have demo scheduled
>
> Also is dev setup required ? Can I install and test stream pipes in
> running production /running instance
>
>
>
> On Wed, Sep 27, 2023 at 7:17 AM Gaurav P <gp...@gpism.com>>
> wrote:
> I followed this link
> https://streampipes.apache.org/docs/user-guide-introduction
> almost all the links I clicked are broken (404) , after that I did google
> search , is there any working documentation or instruction which works ?
> I need to give demo to my management team ,with custom adapters ,
> processors but so journey is really frustrating though love the concepts
> [cid:ii_ln13434c0]
>
> On Wed, Sep 27, 2023 at 2:24 AM Dominik Riemer <
> dominik.riemer@bytefabrik.ai<ma...@bytefabrik.ai>> wrote:
> Hi Gaurav,
>
> 0.68.0 is a really old version (more than 2 years old). I suggest that you
> download the latest release and start with a clean installation, making
> sure that any volumes are removed before installing the new version. Newer
> version of StreamPipes are backwards compatible (we support automatic
> updates from one version to the next).
>
> Concerning the website, did you find broken links when you were coming
> from Google or directly in the documentation?
> We've changed the path of the documentation, which was obviously a bad
> idea since Google hasn't picked up the changes for months now (guess we
> need an SEO expert in the team), but if you've found broken links in the
> documentation itself, it would be great if you could share the links.
>
> Cheers
> Dominik
>
>
>
> -----Original Message-----
> From: Gaurav P <gp...@gpism.com>>
> Sent: Tuesday, September 26, 2023 4:58 AM
> To: dev@streampipes.apache.org<ma...@streampipes.apache.org>
> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>
> also half of the documentation links are dead , giving 404 , I tried on
> unbutu sever earlier WSL windows and it partially worked till I got
>
> Full Logs here
> https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
>
> Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
> ERROR: pull access denied for apachestreampipes/connect-worker, repository
> does not exist or may require 'docker login': denied: requested access to
> the resource is denied I hope this project is still active and I can
> contribute
>
>
>
> On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com>>
> wrote:
>
> > Thanks ,
> > I followed the links below and having a problem getting the dev setup
> > ,
> >
> > I am getting this issue in ubuntu running on wsl 2 windows Welcome to
> > Apache StreamPipes - wait for installation to be finished...
> >
> > [INFO] Version: 0.68.0
> > [INFO] Environment: 'pipeline-element'
> > [INFO] Mode: Development mode, all ports mapped [INFO] Docker network
> > 'spnet' already exists. Continuing
> >
> > more logs on
> > https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
> >
> > Please help me get started with development seup
> >
> > I have created 5-6 processors but unable to install or test
> >
> >
> > On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
> > dominik.riemer@bytefabrik.ai<ma...@bytefabrik.ai>>
> wrote:
> >
> >> Hi Gaurav,
> >>
> >> sounds cool!
> >>
> >> Are you looking for Camel/Nifi adapters to receive data or sinks to
> >> publish data from StreamPipes as a sink?
> >> We don't have any specific processors for that, but you can probably
> >> exchange data over MQTT or some other protocol supported by both
> systems.
> >>
> >> Having said that, it would be really cool to have a tighter
> >> integration, e.g., for data sinks we have a tutorial at [1], many
> >> existing processors as some inspiration at [2] and a project
> >> containing configuration examples at [3]. You might also be
> >> interested in using the Maven archetypes [4] for processor
> >> development, or you can directly extend our extensions module and
> >> create a PR. For adapters, we currently don't have a documentation, but
> you can also check the examples in the repo.
> >>
> >> Regarding the Slack channel, we are not longer supporting this (need
> >> to update the website 😉), so the best way is to communicate over the
> >> mailing list or the Apache Slack channel in case you are an ASF
> committer.
> >>
> >> Please ask if you have any questions!
> >>
> >> Best
> >> Dominik
> >>
> >> [1]
> >> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.h
> >> tml
> >> [2]
> >> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-
> >> extensions
> >> [3]
> >> https://github.com/apache/incubator-streampipes-examples/tree/dev/str
> >> eampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/
> >> apache/streampipes/pe/examples/jvm
> >> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Gaurav P <gp...@gpism.com>>
> >> Sent: Tuesday, July 26, 2022 2:42 AM
> >> To: dev@streampipes.apache.org<ma...@streampipes.apache.org>
> >> Subject: Re: Looking forward to Contribute in Stream pipes : Digital
> >> twin
> >>
> >> HI Andrews ,
> >>
> >> I am planning to generate digital twins for industry 4.0 assets like
> >> the entire factory using unreal and display sensor data on 3d model
> >>
> >> For data processing and sensor data and integration with backend
> >> systems like ERP already deployed, I am experimenting with using
> >> stream pipes
> >>
> >> For Now, I am exploring the following
> >> 1) How ingrate with backend systems, is there any adapter for apache
> >> camel, if not can I build /contribute? so that we access 300+
> >> integrations
> >> 2) Can we integrate with apache Nifi?
> >>
> >> Also can please give me access to slack channel also?I tried the
> >> click on invite link but gives a error message
> >>
> >> Regards,
> >> Gaurav
> >>
> >>
> >> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <riemer@fzi.de<mailto:
> riemer@fzi.de>> wrote:
> >>
> >> > Hi Gaurav,
> >> >
> >> > great to hear that you want to contribute!
> >> > Have a look at our developer wiki where you can find information on
> >> > how to start development:
> >> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Sta
> >> > rte d There are manuals for UI development as well as backend
> >> > development.
> >> >
> >> > Also have a look at the manual of the StreamPipes CLI, which can be
> >> > found in the "installer/cli" directory of StreamPipes.
> >> >
> >> > What kind of digital twin capability are you thinking of?
> >> >
> >> > Best,
> >> > Dominik
> >> >
> >> >
> >> > -----Original Message-----
> >> > From: Gaurav P <gp...@gpism.com>>
> >> > Sent: Thursday, April 21, 2022 4:37 AM
> >> > To: dev@streampipes.apache.org<ma...@streampipes.apache.org>
> >> > Subject: Looking forward to Contribute in Stream pipes : Digital
> >> > twin
> >> >
> >> > Hi All ,
> >> > Yesterday I discovered Stream pipes and am really happy to see
> >> > such an end to end, user-friendly platform, I look forward to
> >> > contributing to adding digital twin capability to stream pipes i or
> >> > integrating with the one I am building
> >> >
> >> > Is there any guide on how setup source and build it ? I can find
> >> > the docker but not any instruction on how to build from source ,
> >> > any link would be helpful
> >> >
> >> > Also can we also dev channels on slack or discord , using email
> >> > list like can be slow crubsome
> >> >
> >> > Regards ,
> >> > Gaurav
> >> >
> >> > --
> >> > B*e * the *Ch*ange
> >> >
> >>
> >>
> >> --
> >> B*e * the *Ch*ange
> >>
> >
> >
> > --
> > B*e * the *Ch*ange
> >
>
>
> --
> B*e * the *Ch*ange
>
>
> --
> Be the Change
>
>
> --
> Be the Change
>
--
B*e * the *Ch*ange
RE: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Dominik Riemer <do...@bytefabrik.ai>.
We applied some changes to the website to fix a trailing slash problem in some browsers.
Please have a look at the documentation on info how to create custom elements (e.g., [1], [2]). You can use the dev setup (using the CLI) to develop your own extensions and can run the system in production either in Docker or K8s.
There are also many examples on Github (make sure to choose the correct branch for your version) at [3]
Cheers
Dominik
[1] https://streampipes.apache.org/docs/extend-cli/
[2] https://streampipes.apache.org/docs/extend-archetypes/
[3] https://github.com/apache/streampipes/tree/dev/streampipes-extensions
From: Gaurav P <gp...@gpism.com>
Sent: Wednesday, September 27, 2023 2:12 PM
To: dev@streampipes.apache.org
Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
Hi All ,
Can please let point me to the updated document with instruction that works ? for dev setup ...its really urgent as I have demo scheduled
Also is dev setup required ? Can I install and test stream pipes in running production /running instance
On Wed, Sep 27, 2023 at 7:17 AM Gaurav P <gp...@gpism.com>> wrote:
I followed this link https://streampipes.apache.org/docs/user-guide-introduction
almost all the links I clicked are broken (404) , after that I did google search , is there any working documentation or instruction which works ? I need to give demo to my management team ,with custom adapters , processors but so journey is really frustrating though love the concepts
[cid:ii_ln13434c0]
On Wed, Sep 27, 2023 at 2:24 AM Dominik Riemer <do...@bytefabrik.ai>> wrote:
Hi Gaurav,
0.68.0 is a really old version (more than 2 years old). I suggest that you download the latest release and start with a clean installation, making sure that any volumes are removed before installing the new version. Newer version of StreamPipes are backwards compatible (we support automatic updates from one version to the next).
Concerning the website, did you find broken links when you were coming from Google or directly in the documentation?
We've changed the path of the documentation, which was obviously a bad idea since Google hasn't picked up the changes for months now (guess we need an SEO expert in the team), but if you've found broken links in the documentation itself, it would be great if you could share the links.
Cheers
Dominik
-----Original Message-----
From: Gaurav P <gp...@gpism.com>>
Sent: Tuesday, September 26, 2023 4:58 AM
To: dev@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
also half of the documentation links are dead , giving 404 , I tried on unbutu sever earlier WSL windows and it partially worked till I got
Full Logs here
https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
ERROR: pull access denied for apachestreampipes/connect-worker, repository does not exist or may require 'docker login': denied: requested access to the resource is denied I hope this project is still active and I can contribute
On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com>> wrote:
> Thanks ,
> I followed the links below and having a problem getting the dev setup
> ,
>
> I am getting this issue in ubuntu running on wsl 2 windows Welcome to
> Apache StreamPipes - wait for installation to be finished...
>
> [INFO] Version: 0.68.0
> [INFO] Environment: 'pipeline-element'
> [INFO] Mode: Development mode, all ports mapped [INFO] Docker network
> 'spnet' already exists. Continuing
>
> more logs on
> https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
>
> Please help me get started with development seup
>
> I have created 5-6 processors but unable to install or test
>
>
> On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
> dominik.riemer@bytefabrik.ai<ma...@bytefabrik.ai>> wrote:
>
>> Hi Gaurav,
>>
>> sounds cool!
>>
>> Are you looking for Camel/Nifi adapters to receive data or sinks to
>> publish data from StreamPipes as a sink?
>> We don't have any specific processors for that, but you can probably
>> exchange data over MQTT or some other protocol supported by both systems.
>>
>> Having said that, it would be really cool to have a tighter
>> integration, e.g., for data sinks we have a tutorial at [1], many
>> existing processors as some inspiration at [2] and a project
>> containing configuration examples at [3]. You might also be
>> interested in using the Maven archetypes [4] for processor
>> development, or you can directly extend our extensions module and
>> create a PR. For adapters, we currently don't have a documentation, but you can also check the examples in the repo.
>>
>> Regarding the Slack channel, we are not longer supporting this (need
>> to update the website 😉), so the best way is to communicate over the
>> mailing list or the Apache Slack channel in case you are an ASF committer.
>>
>> Please ask if you have any questions!
>>
>> Best
>> Dominik
>>
>> [1]
>> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.h
>> tml
>> [2]
>> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-
>> extensions
>> [3]
>> https://github.com/apache/incubator-streampipes-examples/tree/dev/str
>> eampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/
>> apache/streampipes/pe/examples/jvm
>> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
>>
>>
>>
>> -----Original Message-----
>> From: Gaurav P <gp...@gpism.com>>
>> Sent: Tuesday, July 26, 2022 2:42 AM
>> To: dev@streampipes.apache.org<ma...@streampipes.apache.org>
>> Subject: Re: Looking forward to Contribute in Stream pipes : Digital
>> twin
>>
>> HI Andrews ,
>>
>> I am planning to generate digital twins for industry 4.0 assets like
>> the entire factory using unreal and display sensor data on 3d model
>>
>> For data processing and sensor data and integration with backend
>> systems like ERP already deployed, I am experimenting with using
>> stream pipes
>>
>> For Now, I am exploring the following
>> 1) How ingrate with backend systems, is there any adapter for apache
>> camel, if not can I build /contribute? so that we access 300+
>> integrations
>> 2) Can we integrate with apache Nifi?
>>
>> Also can please give me access to slack channel also?I tried the
>> click on invite link but gives a error message
>>
>> Regards,
>> Gaurav
>>
>>
>> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de>> wrote:
>>
>> > Hi Gaurav,
>> >
>> > great to hear that you want to contribute!
>> > Have a look at our developer wiki where you can find information on
>> > how to start development:
>> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Sta
>> > rte d There are manuals for UI development as well as backend
>> > development.
>> >
>> > Also have a look at the manual of the StreamPipes CLI, which can be
>> > found in the "installer/cli" directory of StreamPipes.
>> >
>> > What kind of digital twin capability are you thinking of?
>> >
>> > Best,
>> > Dominik
>> >
>> >
>> > -----Original Message-----
>> > From: Gaurav P <gp...@gpism.com>>
>> > Sent: Thursday, April 21, 2022 4:37 AM
>> > To: dev@streampipes.apache.org<ma...@streampipes.apache.org>
>> > Subject: Looking forward to Contribute in Stream pipes : Digital
>> > twin
>> >
>> > Hi All ,
>> > Yesterday I discovered Stream pipes and am really happy to see
>> > such an end to end, user-friendly platform, I look forward to
>> > contributing to adding digital twin capability to stream pipes i or
>> > integrating with the one I am building
>> >
>> > Is there any guide on how setup source and build it ? I can find
>> > the docker but not any instruction on how to build from source ,
>> > any link would be helpful
>> >
>> > Also can we also dev channels on slack or discord , using email
>> > list like can be slow crubsome
>> >
>> > Regards ,
>> > Gaurav
>> >
>> > --
>> > B*e * the *Ch*ange
>> >
>>
>>
>> --
>> B*e * the *Ch*ange
>>
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
--
Be the Change
--
Be the Change
Re: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Gaurav P <gp...@gpism.com>.
Hi All ,
Can please let point me to the updated document with instruction that works
? for dev setup ...its really urgent as I have demo scheduled
Also is dev setup required ? Can I install and test stream pipes in running
production /running instance
On Wed, Sep 27, 2023 at 7:17 AM Gaurav P <gp...@gpism.com> wrote:
> I followed this link
> https://streampipes.apache.org/docs/user-guide-introduction
> almost all the links I clicked are broken (404) , after that I did google
> search , is there any working documentation or instruction which works ?
> I need to give demo to my management team ,with custom adapters ,
> processors but so journey is really frustrating though love the concepts
> [image: image.png]
>
> On Wed, Sep 27, 2023 at 2:24 AM Dominik Riemer <
> dominik.riemer@bytefabrik.ai> wrote:
>
>> Hi Gaurav,
>>
>> 0.68.0 is a really old version (more than 2 years old). I suggest that
>> you download the latest release and start with a clean installation, making
>> sure that any volumes are removed before installing the new version. Newer
>> version of StreamPipes are backwards compatible (we support automatic
>> updates from one version to the next).
>>
>> Concerning the website, did you find broken links when you were coming
>> from Google or directly in the documentation?
>> We've changed the path of the documentation, which was obviously a bad
>> idea since Google hasn't picked up the changes for months now (guess we
>> need an SEO expert in the team), but if you've found broken links in the
>> documentation itself, it would be great if you could share the links.
>>
>> Cheers
>> Dominik
>>
>>
>>
>> -----Original Message-----
>> From: Gaurav P <gp...@gpism.com>
>> Sent: Tuesday, September 26, 2023 4:58 AM
>> To: dev@streampipes.apache.org
>> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>>
>> also half of the documentation links are dead , giving 404 , I tried on
>> unbutu sever earlier WSL windows and it partially worked till I got
>>
>> Full Logs here
>> https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
>>
>> Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
>> ERROR: pull access denied for apachestreampipes/connect-worker,
>> repository does not exist or may require 'docker login': denied: requested
>> access to the resource is denied I hope this project is still active and I
>> can contribute
>>
>>
>>
>> On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com> wrote:
>>
>> > Thanks ,
>> > I followed the links below and having a problem getting the dev setup
>> > ,
>> >
>> > I am getting this issue in ubuntu running on wsl 2 windows Welcome to
>> > Apache StreamPipes - wait for installation to be finished...
>> >
>> > [INFO] Version: 0.68.0
>> > [INFO] Environment: 'pipeline-element'
>> > [INFO] Mode: Development mode, all ports mapped [INFO] Docker network
>> > 'spnet' already exists. Continuing
>> >
>> > more logs on
>> > https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
>> >
>> > Please help me get started with development seup
>> >
>> > I have created 5-6 processors but unable to install or test
>> >
>> >
>> > On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
>> > dominik.riemer@bytefabrik.ai> wrote:
>> >
>> >> Hi Gaurav,
>> >>
>> >> sounds cool!
>> >>
>> >> Are you looking for Camel/Nifi adapters to receive data or sinks to
>> >> publish data from StreamPipes as a sink?
>> >> We don't have any specific processors for that, but you can probably
>> >> exchange data over MQTT or some other protocol supported by both
>> systems.
>> >>
>> >> Having said that, it would be really cool to have a tighter
>> >> integration, e.g., for data sinks we have a tutorial at [1], many
>> >> existing processors as some inspiration at [2] and a project
>> >> containing configuration examples at [3]. You might also be
>> >> interested in using the Maven archetypes [4] for processor
>> >> development, or you can directly extend our extensions module and
>> >> create a PR. For adapters, we currently don't have a documentation,
>> but you can also check the examples in the repo.
>> >>
>> >> Regarding the Slack channel, we are not longer supporting this (need
>> >> to update the website 😉), so the best way is to communicate over the
>> >> mailing list or the Apache Slack channel in case you are an ASF
>> committer.
>> >>
>> >> Please ask if you have any questions!
>> >>
>> >> Best
>> >> Dominik
>> >>
>> >> [1]
>> >> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.h
>> >> tml
>> >> [2]
>> >> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-
>> >> extensions
>> >> [3]
>> >> https://github.com/apache/incubator-streampipes-examples/tree/dev/str
>> >> eampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/
>> >> apache/streampipes/pe/examples/jvm
>> >> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
>> >>
>> >>
>> >>
>> >> -----Original Message-----
>> >> From: Gaurav P <gp...@gpism.com>
>> >> Sent: Tuesday, July 26, 2022 2:42 AM
>> >> To: dev@streampipes.apache.org
>> >> Subject: Re: Looking forward to Contribute in Stream pipes : Digital
>> >> twin
>> >>
>> >> HI Andrews ,
>> >>
>> >> I am planning to generate digital twins for industry 4.0 assets like
>> >> the entire factory using unreal and display sensor data on 3d model
>> >>
>> >> For data processing and sensor data and integration with backend
>> >> systems like ERP already deployed, I am experimenting with using
>> >> stream pipes
>> >>
>> >> For Now, I am exploring the following
>> >> 1) How ingrate with backend systems, is there any adapter for apache
>> >> camel, if not can I build /contribute? so that we access 300+
>> >> integrations
>> >> 2) Can we integrate with apache Nifi?
>> >>
>> >> Also can please give me access to slack channel also?I tried the
>> >> click on invite link but gives a error message
>> >>
>> >> Regards,
>> >> Gaurav
>> >>
>> >>
>> >> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
>> >>
>> >> > Hi Gaurav,
>> >> >
>> >> > great to hear that you want to contribute!
>> >> > Have a look at our developer wiki where you can find information on
>> >> > how to start development:
>> >> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Sta
>> >> > rte d There are manuals for UI development as well as backend
>> >> > development.
>> >> >
>> >> > Also have a look at the manual of the StreamPipes CLI, which can be
>> >> > found in the "installer/cli" directory of StreamPipes.
>> >> >
>> >> > What kind of digital twin capability are you thinking of?
>> >> >
>> >> > Best,
>> >> > Dominik
>> >> >
>> >> >
>> >> > -----Original Message-----
>> >> > From: Gaurav P <gp...@gpism.com>
>> >> > Sent: Thursday, April 21, 2022 4:37 AM
>> >> > To: dev@streampipes.apache.org
>> >> > Subject: Looking forward to Contribute in Stream pipes : Digital
>> >> > twin
>> >> >
>> >> > Hi All ,
>> >> > Yesterday I discovered Stream pipes and am really happy to see
>> >> > such an end to end, user-friendly platform, I look forward to
>> >> > contributing to adding digital twin capability to stream pipes i or
>> >> > integrating with the one I am building
>> >> >
>> >> > Is there any guide on how setup source and build it ? I can find
>> >> > the docker but not any instruction on how to build from source ,
>> >> > any link would be helpful
>> >> >
>> >> > Also can we also dev channels on slack or discord , using email
>> >> > list like can be slow crubsome
>> >> >
>> >> > Regards ,
>> >> > Gaurav
>> >> >
>> >> > --
>> >> > B*e * the *Ch*ange
>> >> >
>> >>
>> >>
>> >> --
>> >> B*e * the *Ch*ange
>> >>
>> >
>> >
>> > --
>> > B*e * the *Ch*ange
>> >
>>
>>
>> --
>> B*e * the *Ch*ange
>>
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
Re: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Gaurav P <gp...@gpism.com>.
I followed this link
https://streampipes.apache.org/docs/user-guide-introduction
almost all the links I clicked are broken (404) , after that I did google
search , is there any working documentation or instruction which works ?
I need to give demo to my management team ,with custom adapters ,
processors but so journey is really frustrating though love the concepts
[image: image.png]
On Wed, Sep 27, 2023 at 2:24 AM Dominik Riemer <do...@bytefabrik.ai>
wrote:
> Hi Gaurav,
>
> 0.68.0 is a really old version (more than 2 years old). I suggest that you
> download the latest release and start with a clean installation, making
> sure that any volumes are removed before installing the new version. Newer
> version of StreamPipes are backwards compatible (we support automatic
> updates from one version to the next).
>
> Concerning the website, did you find broken links when you were coming
> from Google or directly in the documentation?
> We've changed the path of the documentation, which was obviously a bad
> idea since Google hasn't picked up the changes for months now (guess we
> need an SEO expert in the team), but if you've found broken links in the
> documentation itself, it would be great if you could share the links.
>
> Cheers
> Dominik
>
>
>
> -----Original Message-----
> From: Gaurav P <gp...@gpism.com>
> Sent: Tuesday, September 26, 2023 4:58 AM
> To: dev@streampipes.apache.org
> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>
> also half of the documentation links are dead , giving 404 , I tried on
> unbutu sever earlier WSL windows and it partially worked till I got
>
> Full Logs here
> https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
>
> Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
> ERROR: pull access denied for apachestreampipes/connect-worker, repository
> does not exist or may require 'docker login': denied: requested access to
> the resource is denied I hope this project is still active and I can
> contribute
>
>
>
> On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com> wrote:
>
> > Thanks ,
> > I followed the links below and having a problem getting the dev setup
> > ,
> >
> > I am getting this issue in ubuntu running on wsl 2 windows Welcome to
> > Apache StreamPipes - wait for installation to be finished...
> >
> > [INFO] Version: 0.68.0
> > [INFO] Environment: 'pipeline-element'
> > [INFO] Mode: Development mode, all ports mapped [INFO] Docker network
> > 'spnet' already exists. Continuing
> >
> > more logs on
> > https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
> >
> > Please help me get started with development seup
> >
> > I have created 5-6 processors but unable to install or test
> >
> >
> > On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
> > dominik.riemer@bytefabrik.ai> wrote:
> >
> >> Hi Gaurav,
> >>
> >> sounds cool!
> >>
> >> Are you looking for Camel/Nifi adapters to receive data or sinks to
> >> publish data from StreamPipes as a sink?
> >> We don't have any specific processors for that, but you can probably
> >> exchange data over MQTT or some other protocol supported by both
> systems.
> >>
> >> Having said that, it would be really cool to have a tighter
> >> integration, e.g., for data sinks we have a tutorial at [1], many
> >> existing processors as some inspiration at [2] and a project
> >> containing configuration examples at [3]. You might also be
> >> interested in using the Maven archetypes [4] for processor
> >> development, or you can directly extend our extensions module and
> >> create a PR. For adapters, we currently don't have a documentation, but
> you can also check the examples in the repo.
> >>
> >> Regarding the Slack channel, we are not longer supporting this (need
> >> to update the website 😉), so the best way is to communicate over the
> >> mailing list or the Apache Slack channel in case you are an ASF
> committer.
> >>
> >> Please ask if you have any questions!
> >>
> >> Best
> >> Dominik
> >>
> >> [1]
> >> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.h
> >> tml
> >> [2]
> >> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-
> >> extensions
> >> [3]
> >> https://github.com/apache/incubator-streampipes-examples/tree/dev/str
> >> eampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/
> >> apache/streampipes/pe/examples/jvm
> >> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
> >>
> >>
> >>
> >> -----Original Message-----
> >> From: Gaurav P <gp...@gpism.com>
> >> Sent: Tuesday, July 26, 2022 2:42 AM
> >> To: dev@streampipes.apache.org
> >> Subject: Re: Looking forward to Contribute in Stream pipes : Digital
> >> twin
> >>
> >> HI Andrews ,
> >>
> >> I am planning to generate digital twins for industry 4.0 assets like
> >> the entire factory using unreal and display sensor data on 3d model
> >>
> >> For data processing and sensor data and integration with backend
> >> systems like ERP already deployed, I am experimenting with using
> >> stream pipes
> >>
> >> For Now, I am exploring the following
> >> 1) How ingrate with backend systems, is there any adapter for apache
> >> camel, if not can I build /contribute? so that we access 300+
> >> integrations
> >> 2) Can we integrate with apache Nifi?
> >>
> >> Also can please give me access to slack channel also?I tried the
> >> click on invite link but gives a error message
> >>
> >> Regards,
> >> Gaurav
> >>
> >>
> >> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
> >>
> >> > Hi Gaurav,
> >> >
> >> > great to hear that you want to contribute!
> >> > Have a look at our developer wiki where you can find information on
> >> > how to start development:
> >> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Sta
> >> > rte d There are manuals for UI development as well as backend
> >> > development.
> >> >
> >> > Also have a look at the manual of the StreamPipes CLI, which can be
> >> > found in the "installer/cli" directory of StreamPipes.
> >> >
> >> > What kind of digital twin capability are you thinking of?
> >> >
> >> > Best,
> >> > Dominik
> >> >
> >> >
> >> > -----Original Message-----
> >> > From: Gaurav P <gp...@gpism.com>
> >> > Sent: Thursday, April 21, 2022 4:37 AM
> >> > To: dev@streampipes.apache.org
> >> > Subject: Looking forward to Contribute in Stream pipes : Digital
> >> > twin
> >> >
> >> > Hi All ,
> >> > Yesterday I discovered Stream pipes and am really happy to see
> >> > such an end to end, user-friendly platform, I look forward to
> >> > contributing to adding digital twin capability to stream pipes i or
> >> > integrating with the one I am building
> >> >
> >> > Is there any guide on how setup source and build it ? I can find
> >> > the docker but not any instruction on how to build from source ,
> >> > any link would be helpful
> >> >
> >> > Also can we also dev channels on slack or discord , using email
> >> > list like can be slow crubsome
> >> >
> >> > Regards ,
> >> > Gaurav
> >> >
> >> > --
> >> > B*e * the *Ch*ange
> >> >
> >>
> >>
> >> --
> >> B*e * the *Ch*ange
> >>
> >
> >
> > --
> > B*e * the *Ch*ange
> >
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
RE: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Gaurav,
0.68.0 is a really old version (more than 2 years old). I suggest that you download the latest release and start with a clean installation, making sure that any volumes are removed before installing the new version. Newer version of StreamPipes are backwards compatible (we support automatic updates from one version to the next).
Concerning the website, did you find broken links when you were coming from Google or directly in the documentation?
We've changed the path of the documentation, which was obviously a bad idea since Google hasn't picked up the changes for months now (guess we need an SEO expert in the team), but if you've found broken links in the documentation itself, it would be great if you could share the links.
Cheers
Dominik
-----Original Message-----
From: Gaurav P <gp...@gpism.com>
Sent: Tuesday, September 26, 2023 4:58 AM
To: dev@streampipes.apache.org
Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
also half of the documentation links are dead , giving 404 , I tried on unbutu sever earlier WSL windows and it partially worked till I got
Full Logs here
https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
ERROR: pull access denied for apachestreampipes/connect-worker, repository does not exist or may require 'docker login': denied: requested access to the resource is denied I hope this project is still active and I can contribute
On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com> wrote:
> Thanks ,
> I followed the links below and having a problem getting the dev setup
> ,
>
> I am getting this issue in ubuntu running on wsl 2 windows Welcome to
> Apache StreamPipes - wait for installation to be finished...
>
> [INFO] Version: 0.68.0
> [INFO] Environment: 'pipeline-element'
> [INFO] Mode: Development mode, all ports mapped [INFO] Docker network
> 'spnet' already exists. Continuing
>
> more logs on
> https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
>
> Please help me get started with development seup
>
> I have created 5-6 processors but unable to install or test
>
>
> On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
> dominik.riemer@bytefabrik.ai> wrote:
>
>> Hi Gaurav,
>>
>> sounds cool!
>>
>> Are you looking for Camel/Nifi adapters to receive data or sinks to
>> publish data from StreamPipes as a sink?
>> We don't have any specific processors for that, but you can probably
>> exchange data over MQTT or some other protocol supported by both systems.
>>
>> Having said that, it would be really cool to have a tighter
>> integration, e.g., for data sinks we have a tutorial at [1], many
>> existing processors as some inspiration at [2] and a project
>> containing configuration examples at [3]. You might also be
>> interested in using the Maven archetypes [4] for processor
>> development, or you can directly extend our extensions module and
>> create a PR. For adapters, we currently don't have a documentation, but you can also check the examples in the repo.
>>
>> Regarding the Slack channel, we are not longer supporting this (need
>> to update the website 😉), so the best way is to communicate over the
>> mailing list or the Apache Slack channel in case you are an ASF committer.
>>
>> Please ask if you have any questions!
>>
>> Best
>> Dominik
>>
>> [1]
>> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.h
>> tml
>> [2]
>> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-
>> extensions
>> [3]
>> https://github.com/apache/incubator-streampipes-examples/tree/dev/str
>> eampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/
>> apache/streampipes/pe/examples/jvm
>> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
>>
>>
>>
>> -----Original Message-----
>> From: Gaurav P <gp...@gpism.com>
>> Sent: Tuesday, July 26, 2022 2:42 AM
>> To: dev@streampipes.apache.org
>> Subject: Re: Looking forward to Contribute in Stream pipes : Digital
>> twin
>>
>> HI Andrews ,
>>
>> I am planning to generate digital twins for industry 4.0 assets like
>> the entire factory using unreal and display sensor data on 3d model
>>
>> For data processing and sensor data and integration with backend
>> systems like ERP already deployed, I am experimenting with using
>> stream pipes
>>
>> For Now, I am exploring the following
>> 1) How ingrate with backend systems, is there any adapter for apache
>> camel, if not can I build /contribute? so that we access 300+
>> integrations
>> 2) Can we integrate with apache Nifi?
>>
>> Also can please give me access to slack channel also?I tried the
>> click on invite link but gives a error message
>>
>> Regards,
>> Gaurav
>>
>>
>> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
>>
>> > Hi Gaurav,
>> >
>> > great to hear that you want to contribute!
>> > Have a look at our developer wiki where you can find information on
>> > how to start development:
>> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Sta
>> > rte d There are manuals for UI development as well as backend
>> > development.
>> >
>> > Also have a look at the manual of the StreamPipes CLI, which can be
>> > found in the "installer/cli" directory of StreamPipes.
>> >
>> > What kind of digital twin capability are you thinking of?
>> >
>> > Best,
>> > Dominik
>> >
>> >
>> > -----Original Message-----
>> > From: Gaurav P <gp...@gpism.com>
>> > Sent: Thursday, April 21, 2022 4:37 AM
>> > To: dev@streampipes.apache.org
>> > Subject: Looking forward to Contribute in Stream pipes : Digital
>> > twin
>> >
>> > Hi All ,
>> > Yesterday I discovered Stream pipes and am really happy to see
>> > such an end to end, user-friendly platform, I look forward to
>> > contributing to adding digital twin capability to stream pipes i or
>> > integrating with the one I am building
>> >
>> > Is there any guide on how setup source and build it ? I can find
>> > the docker but not any instruction on how to build from source ,
>> > any link would be helpful
>> >
>> > Also can we also dev channels on slack or discord , using email
>> > list like can be slow crubsome
>> >
>> > Regards ,
>> > Gaurav
>> >
>> > --
>> > B*e * the *Ch*ange
>> >
>>
>>
>> --
>> B*e * the *Ch*ange
>>
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
Re: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Gaurav P <gp...@gpism.com>.
also half of the documentation links are dead , giving 404 , I tried on
unbutu sever earlier WSL windows and it partially worked till I got
Full Logs here
https://gist.github.com/gpism/dc248b24d03420c8a86e78062fb4939d
Pulling connect-worker-main (apachestreampipes/connect-worker:0.68.0)...
ERROR: pull access denied for apachestreampipes/connect-worker, repository
does not exist or may require 'docker login': denied: requested access to
the resource is denied
I hope this project is still active and I can contribute
On Tue, Sep 26, 2023 at 7:54 AM Gaurav P <gp...@gpism.com> wrote:
> Thanks ,
> I followed the links below and having a problem getting the dev setup ,
>
> I am getting this issue in ubuntu running on wsl 2 windows
> Welcome to Apache StreamPipes - wait for installation to be finished...
>
> [INFO] Version: 0.68.0
> [INFO] Environment: 'pipeline-element'
> [INFO] Mode: Development mode, all ports mapped
> [INFO] Docker network 'spnet' already exists. Continuing
>
> more logs on
> https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
>
> Please help me get started with development seup
>
> I have created 5-6 processors but unable to install or test
>
>
> On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
> dominik.riemer@bytefabrik.ai> wrote:
>
>> Hi Gaurav,
>>
>> sounds cool!
>>
>> Are you looking for Camel/Nifi adapters to receive data or sinks to
>> publish data from StreamPipes as a sink?
>> We don't have any specific processors for that, but you can probably
>> exchange data over MQTT or some other protocol supported by both systems.
>>
>> Having said that, it would be really cool to have a tighter integration,
>> e.g., for data sinks we have a tutorial at [1], many existing processors as
>> some inspiration at [2] and a project containing configuration examples at
>> [3]. You might also be interested in using the Maven archetypes [4] for
>> processor development, or you can directly extend our extensions module and
>> create a PR. For adapters, we currently don't have a documentation, but you
>> can also check the examples in the repo.
>>
>> Regarding the Slack channel, we are not longer supporting this (need to
>> update the website 😉), so the best way is to communicate over the mailing
>> list or the Apache Slack channel in case you are an ASF committer.
>>
>> Please ask if you have any questions!
>>
>> Best
>> Dominik
>>
>> [1]
>> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.html
>> [2]
>> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-extensions
>> [3]
>> https://github.com/apache/incubator-streampipes-examples/tree/dev/streampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/apache/streampipes/pe/examples/jvm
>> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
>>
>>
>>
>> -----Original Message-----
>> From: Gaurav P <gp...@gpism.com>
>> Sent: Tuesday, July 26, 2022 2:42 AM
>> To: dev@streampipes.apache.org
>> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>>
>> HI Andrews ,
>>
>> I am planning to generate digital twins for industry 4.0 assets like the
>> entire factory using unreal and display sensor data on 3d model
>>
>> For data processing and sensor data and integration with backend systems
>> like ERP already deployed, I am experimenting with using stream pipes
>>
>> For Now, I am exploring the following
>> 1) How ingrate with backend systems, is there any adapter for apache
>> camel, if not can I build /contribute? so that we access 300+ integrations
>> 2) Can we integrate with apache Nifi?
>>
>> Also can please give me access to slack channel also?I tried the click on
>> invite link but gives a error message
>>
>> Regards,
>> Gaurav
>>
>>
>> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
>>
>> > Hi Gaurav,
>> >
>> > great to hear that you want to contribute!
>> > Have a look at our developer wiki where you can find information on
>> > how to start development:
>> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Starte
>> > d There are manuals for UI development as well as backend development.
>> >
>> > Also have a look at the manual of the StreamPipes CLI, which can be
>> > found in the "installer/cli" directory of StreamPipes.
>> >
>> > What kind of digital twin capability are you thinking of?
>> >
>> > Best,
>> > Dominik
>> >
>> >
>> > -----Original Message-----
>> > From: Gaurav P <gp...@gpism.com>
>> > Sent: Thursday, April 21, 2022 4:37 AM
>> > To: dev@streampipes.apache.org
>> > Subject: Looking forward to Contribute in Stream pipes : Digital twin
>> >
>> > Hi All ,
>> > Yesterday I discovered Stream pipes and am really happy to see such
>> > an end to end, user-friendly platform, I look forward to contributing
>> > to adding digital twin capability to stream pipes i or integrating
>> > with the one I am building
>> >
>> > Is there any guide on how setup source and build it ? I can find the
>> > docker but not any instruction on how to build from source , any link
>> > would be helpful
>> >
>> > Also can we also dev channels on slack or discord , using email list
>> > like can be slow crubsome
>> >
>> > Regards ,
>> > Gaurav
>> >
>> > --
>> > B*e * the *Ch*ange
>> >
>>
>>
>> --
>> B*e * the *Ch*ange
>>
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
Re: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Gaurav P <gp...@gpism.com>.
Thanks ,
I followed the links below and having a problem getting the dev setup ,
I am getting this issue in ubuntu running on wsl 2 windows
Welcome to Apache StreamPipes - wait for installation to be finished...
[INFO] Version: 0.68.0
[INFO] Environment: 'pipeline-element'
[INFO] Mode: Development mode, all ports mapped
[INFO] Docker network 'spnet' already exists. Continuing
more logs on
https://gist.github.com/gpism/3a256026f8d1c3dd52773d5e76938ee6
Please help me get started with development seup
I have created 5-6 processors but unable to install or test
On Tue, Jul 26, 2022 at 11:29 PM Dominik Riemer <
dominik.riemer@bytefabrik.ai> wrote:
> Hi Gaurav,
>
> sounds cool!
>
> Are you looking for Camel/Nifi adapters to receive data or sinks to
> publish data from StreamPipes as a sink?
> We don't have any specific processors for that, but you can probably
> exchange data over MQTT or some other protocol supported by both systems.
>
> Having said that, it would be really cool to have a tighter integration,
> e.g., for data sinks we have a tutorial at [1], many existing processors as
> some inspiration at [2] and a project containing configuration examples at
> [3]. You might also be interested in using the Maven archetypes [4] for
> processor development, or you can directly extend our extensions module and
> create a PR. For adapters, we currently don't have a documentation, but you
> can also check the examples in the repo.
>
> Regarding the Slack channel, we are not longer supporting this (need to
> update the website 😉), so the best way is to communicate over the mailing
> list or the Apache Slack channel in case you are an ASF committer.
>
> Please ask if you have any questions!
>
> Best
> Dominik
>
> [1]
> https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.html
> [2]
> https://github.com/apache/incubator-streampipes/tree/dev/streampipes-extensions
> [3]
> https://github.com/apache/incubator-streampipes-examples/tree/dev/streampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/apache/streampipes/pe/examples/jvm
> [4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
>
>
>
> -----Original Message-----
> From: Gaurav P <gp...@gpism.com>
> Sent: Tuesday, July 26, 2022 2:42 AM
> To: dev@streampipes.apache.org
> Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
>
> HI Andrews ,
>
> I am planning to generate digital twins for industry 4.0 assets like the
> entire factory using unreal and display sensor data on 3d model
>
> For data processing and sensor data and integration with backend systems
> like ERP already deployed, I am experimenting with using stream pipes
>
> For Now, I am exploring the following
> 1) How ingrate with backend systems, is there any adapter for apache
> camel, if not can I build /contribute? so that we access 300+ integrations
> 2) Can we integrate with apache Nifi?
>
> Also can please give me access to slack channel also?I tried the click on
> invite link but gives a error message
>
> Regards,
> Gaurav
>
>
> On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
>
> > Hi Gaurav,
> >
> > great to hear that you want to contribute!
> > Have a look at our developer wiki where you can find information on
> > how to start development:
> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Starte
> > d There are manuals for UI development as well as backend development.
> >
> > Also have a look at the manual of the StreamPipes CLI, which can be
> > found in the "installer/cli" directory of StreamPipes.
> >
> > What kind of digital twin capability are you thinking of?
> >
> > Best,
> > Dominik
> >
> >
> > -----Original Message-----
> > From: Gaurav P <gp...@gpism.com>
> > Sent: Thursday, April 21, 2022 4:37 AM
> > To: dev@streampipes.apache.org
> > Subject: Looking forward to Contribute in Stream pipes : Digital twin
> >
> > Hi All ,
> > Yesterday I discovered Stream pipes and am really happy to see such
> > an end to end, user-friendly platform, I look forward to contributing
> > to adding digital twin capability to stream pipes i or integrating
> > with the one I am building
> >
> > Is there any guide on how setup source and build it ? I can find the
> > docker but not any instruction on how to build from source , any link
> > would be helpful
> >
> > Also can we also dev channels on slack or discord , using email list
> > like can be slow crubsome
> >
> > Regards ,
> > Gaurav
> >
> > --
> > B*e * the *Ch*ange
> >
>
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange
RE: Looking forward to Contribute in Stream pipes : Digital twin
Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Gaurav,
sounds cool!
Are you looking for Camel/Nifi adapters to receive data or sinks to publish data from StreamPipes as a sink?
We don't have any specific processors for that, but you can probably exchange data over MQTT or some other protocol supported by both systems.
Having said that, it would be really cool to have a tighter integration, e.g., for data sinks we have a tutorial at [1], many existing processors as some inspiration at [2] and a project containing configuration examples at [3]. You might also be interested in using the Maven archetypes [4] for processor development, or you can directly extend our extensions module and create a PR. For adapters, we currently don't have a documentation, but you can also check the examples in the repo.
Regarding the Slack channel, we are not longer supporting this (need to update the website 😉), so the best way is to communicate over the mailing list or the Apache Slack channel in case you are an ASF committer.
Please ask if you have any questions!
Best
Dominik
[1] https://streampipes.apache.org/docs/docs/extend-tutorial-data-sinks.html
[2] https://github.com/apache/incubator-streampipes/tree/dev/streampipes-extensions
[3] https://github.com/apache/incubator-streampipes-examples/tree/dev/streampipes-pipeline-elements-examples-processors-jvm/src/main/java/org/apache/streampipes/pe/examples/jvm
[4] https://streampipes.apache.org/docs/docs/extend-archetypes.html
-----Original Message-----
From: Gaurav P <gp...@gpism.com>
Sent: Tuesday, July 26, 2022 2:42 AM
To: dev@streampipes.apache.org
Subject: Re: Looking forward to Contribute in Stream pipes : Digital twin
HI Andrews ,
I am planning to generate digital twins for industry 4.0 assets like the entire factory using unreal and display sensor data on 3d model
For data processing and sensor data and integration with backend systems like ERP already deployed, I am experimenting with using stream pipes
For Now, I am exploring the following
1) How ingrate with backend systems, is there any adapter for apache camel, if not can I build /contribute? so that we access 300+ integrations
2) Can we integrate with apache Nifi?
Also can please give me access to slack channel also?I tried the click on invite link but gives a error message
Regards,
Gaurav
On Thu, Apr 21, 2022 at 8:19 PM Dominik Riemer <ri...@fzi.de> wrote:
> Hi Gaurav,
>
> great to hear that you want to contribute!
> Have a look at our developer wiki where you can find information on
> how to start development:
> https://cwiki.apache.org/confluence/display/STREAMPIPES/Getting+Starte
> d There are manuals for UI development as well as backend development.
>
> Also have a look at the manual of the StreamPipes CLI, which can be
> found in the "installer/cli" directory of StreamPipes.
>
> What kind of digital twin capability are you thinking of?
>
> Best,
> Dominik
>
>
> -----Original Message-----
> From: Gaurav P <gp...@gpism.com>
> Sent: Thursday, April 21, 2022 4:37 AM
> To: dev@streampipes.apache.org
> Subject: Looking forward to Contribute in Stream pipes : Digital twin
>
> Hi All ,
> Yesterday I discovered Stream pipes and am really happy to see such
> an end to end, user-friendly platform, I look forward to contributing
> to adding digital twin capability to stream pipes i or integrating
> with the one I am building
>
> Is there any guide on how setup source and build it ? I can find the
> docker but not any instruction on how to build from source , any link
> would be helpful
>
> Also can we also dev channels on slack or discord , using email list
> like can be slow crubsome
>
> Regards ,
> Gaurav
>
> --
> B*e * the *Ch*ange
>
--
B*e * the *Ch*ange