You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@streampipes.apache.org by Florian Micklich <mi...@apache.org> on 2022/08/02 09:13:44 UTC

Setup Streampipes Extensions in Community Edition?

Hi all,
I want to re-setup my dev environment.I got the latest dev branch from
here  [1].Unfortunatelly I got only the IntelliJ Community edition and
have a lot of problems to get startet.
I was able to import the project but get following build error after I
run the processors-geo-jvm02.08.22, 11:03 - Build completed with 20
errors and 3 warnings in 4 sec, 939 ms


I am also using openjdk 8.../incubator-streampipes-extensions(dev)$
java -versionopenjdk version "1.8.0_302"OpenJDK Runtime Environment
(build 1.8.0_302-b08)OpenJDK 64-Bit Server VM (build 25.302-b08, mixed
mode)

It seems to be some maven dependencies are also missing.Before I post
my errors: It is possible to use the community edition without
problems?
Kind regardsFlorian

[1] https://github.com/apache/incubator-streampipes-extensions


Re: Setup Streampipes Extensions in Community Edition?

Posted by Florian Micklich <fl...@mailbox.org.INVALID>.
Perfekt.Message is gone :-) 

Am Mittwoch, dem 03.08.2022 um 09:33 +0000 schrieb Dominik Riemer:
> Hi Florian,thanks for pointing at this - we currently mainly use the
> extensions-all-jvm module over pipeline-elements-all-jvm where we
> also integrate all adapters. But the security message you got came
> from a missing setting in the StandaloneModelSubmitter, which I've
> updated just now.
> So, please try to pull and the message should be gone 😉
> CheersDominik
> 
> -----Original Message-----From: Florian Micklich <
> florian.micklich@mailbox.org.INVALID> Sent: Wednesday, August 3, 2022
> 11:24 AMTo: dev@streampipes.apache.org
> Subject: Re: Setup Streampipes Extensions in Community Edition?
> Ho Dominik,new day new start and it looks much better now.First I
> have checked if I use the correct installer you mentioned. Afterwards
> I did a 'streampipes clean' und startet the CLI again and now
> everything looks much better if start Intellij as well:Using
> generated security password: XXXXX This generated password is for
> development use only. Your security configuration must be updated
> before running your application in production.2022-08-03
> 10:49:20.020  INFO 13373 ---
> [           main]io.undertow                              : starting
> server: Undertow -2.2.17.Final2022-08-03 10:49:20.042  INFO 13373 ---
> [           main]org.xnio                                 : XNIO
> version3.8.6.Final2022-08-03 10:49:20.085  INFO 13373 ---
> [           main]org.xnio.nio                             : XNIO NIO
> ImplementationVersion 3.8.6.Final2022-08-03 10:49:20.290  INFO 13373
> ---[           main] org.jboss.threads                        :
> JBossThreads version 3.1.0.Final2022-08-03 10:49:20.356  INFO 13373
> ---[           main] o.s.b.w.e.undertow.UndertowWebServer     :
> Undertowstarted on port(s) 7023 (http)2022-08-03 10:49:20.372  INFO
> 13373 ---[           main] o.a.s.pe.jvm.AllPipelineElementsInit     :
> StartedAllPipelineElementsInit in 4.279 seconds (JVM running for
> 10.858)
> After logging in with  admin@streampipes.apache.org everything looks
> good.I will dive deeper now :) What is the purpose of the generated
> security password?Florian
> Am Dienstag, dem 02.08.2022 um 18:31 +0000 schrieb Dominik Riemer:
> > Hi Florian,just to make sure - you used the installer from
> > incubator- streampipes/installer/cli? The old installer repo has
> > also been merged into the main repo.Can you debug the service to
> > see where the service tries to register?You can set a breakpoint in
> > ConsulProvider, starting from line 61.BestDominik
> > -----Original Message-----From: Florian Micklich < 
> > florian.micklich@mailbox.org.INVALID> Sent: Tuesday, August 2,
> > 20226:36 PMTo: dev@streampipes.apache.org
> > Subject: Re: Setup Streampipes Extensions in Community Edition?Hi
> > Dominik,the SP_DEBUG=true  is already set like here [1]I just
> > uncomment SP_HOST and set my local IP address.[1]
> > https://github.com/apache/incubator-streampipes/blob/dev/streampipes-e
> > xtensions/streampipes-pipeline-elements-all-
> > jvm/development/envid="-x-evo-selection-start-marker">Is this
> > correct or do I miss something?FlorianAm Dienstag, dem 02.08.2022
> > um 13:57 +0000 schrieb Dominik Riemer:
> > > Hi Florian,can you try to provide an SP_DEBUG=true env variable
> > > to make sure that localhost is used as the Consul target?If this
> > > doesn't work, it would be interesting to see where the service
> > > tries to reach Consul and if the Consul port is
> > > open.CheersDOminik -----Original Message-----From: Florian
> > > Micklich < micklich@apache.org
> > > > Sent: Tuesday, August 2, 2022 3:13 PMTo: 
> > > > dev@streampipes.apache.org
> > > Subject: Re: Setup Streampipes Extensions in Community Edition?I
> > > did some adjustments in../incubator-streampipes/streampipes-
> > > extensions/streampipes-pipeline-elements-all-
> > > jvm/development/envandset the SP_HOST variable according to my
> > > local ip address but nothing has changed.Still getting
> > > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider -
> > > Checking if consul is available...Any suggestion what to
> > > do?FlorianAm Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb
> > > Florian Micklich:
> > > > Thanks Dominik!that was working like charming.I switched
> > > > backtoJava11 and startedthe project from the repository  you
> > > > mentioned.After downloading the maven resources I was able to
> > > > start the "all- pipeline-elements-jvm"But there I get
> > > > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider -
> > > > Could notconnect to Consul instance...I suspect this has
> > > > something to do with the host.docker.internalcommand on linux
> > > > as mentioned here:For Linux user: You must change
> > > > theenvironment variables stating host.docker.internal to you
> > > > localmachine's IP  [1]For me it is not clear where to make that
> > > > adjustment.[1] 
> > > > https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> > > > 
> > > > 
> > > > Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb
> > > > DominikRiemer:
> > > > > Hi Florian,IntelliJ community should work without
> > > > > problems.Two things which might be useful:- We integrated the
> > > > > incubator- streampipes-extensions project into incubator-
> > > > > streampipes to haveeverything in a single repo (the
> > > > > extensions can be found there under"streampipes-extensions"). 
> > > > > So please clone theprojectfrom[1].- Therecent dev version
> > > > > requires minimum Java version 11 (which probablycauses some
> > > > > errors in your current setup). Can you update Java andsee if
> > > > > the errors disappear?If this doesn't help, we'll take a
> > > > > deeper look 😉CheersDominik [1] 
> > > > > https://github.com/apache/incubator-streampipes
> > > > > 
> > > > > 
> > > > > -----Original Message-----From: Florian Micklich < 
> > > > > micklich@apache.org
> > > > > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > > > > dev@streampipes.apache.org
> > > > > Subject: Setup Streampipes Extensions in Community Edition?Hi
> > > > > all,I want to re-setup my dev environment.I got the latest
> > > > > devbranch from here  [1].Unfortunatelly I got only the
> > > > > IntelliJCommunity edition and have a lot of problems to get
> > > > > startet.I wasable to import the project but get following
> > > > > build error after I runthe processors- geo-jvm02.08.22, 11:03
> > > > > - Build completed with 20errors and 3 warnings in 4 sec, 939
> > > > > ms I am also using openjdk 8.../incubator-streampipes-
> > > > > extensions(dev)$java -versionopenjdk version
> > > > > "1.8.0_302"OpenJDKRuntime Environment (build 1.8.0_302-
> > > > > b08)OpenJDK 64-Bit Server VM(build 25.302-b08, mixedmode)It
> > > > > seems to be some maven dependencies are also missing.Before I
> > > > > postmy errors: It is possible to use the community edition
> > > > > withoutproblems?Kind regardsFlorian[1] 
> > > > > https://github.com/apache/incubator-streampipes-extensions
> > > > > 

RE: Setup Streampipes Extensions in Community Edition?

Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Florian,
thanks for pointing at this - we currently mainly use the extensions-all-jvm module over pipeline-elements-all-jvm where we also integrate all adapters. But the security message you got came from a missing setting in the StandaloneModelSubmitter, which I've updated just now.

So, please try to pull and the message should be gone 😉

Cheers
Dominik


-----Original Message-----
From: Florian Micklich <fl...@mailbox.org.INVALID> 
Sent: Wednesday, August 3, 2022 11:24 AM
To: dev@streampipes.apache.org
Subject: Re: Setup Streampipes Extensions in Community Edition?

Ho Dominik,
new day new start and it looks much better now.First I have checked if I use the correct installer you mentioned. Afterwards I did a 'streampipes clean' und startet the CLI again and now everything looks much better if start Intellij as well:
Using generated security password: XXXXX This generated password is for development use only. Your security configuration must be updated before running your application in production.
2022-08-03 10:49:20.020  INFO 13373 --- [           main]
io.undertow                              : starting server: Undertow -
2.2.17.Final2022-08-03 10:49:20.042  INFO 13373 --- [           main]
org.xnio                                 : XNIO version
3.8.6.Final2022-08-03 10:49:20.085  INFO 13373 --- [           main]
org.xnio.nio                             : XNIO NIO Implementation
Version 3.8.6.Final2022-08-03 10:49:20.290  INFO 13373 ---
[           main] org.jboss.threads                        : JBoss
Threads version 3.1.0.Final2022-08-03 10:49:20.356  INFO 13373 ---
[           main] o.s.b.w.e.undertow.UndertowWebServer     : Undertow
started on port(s) 7023 (http)2022-08-03 10:49:20.372  INFO 13373 ---
[           main] o.a.s.pe.jvm.AllPipelineElementsInit     : Started
AllPipelineElementsInit in 4.279 seconds (JVM running for 10.858)

After logging in with  admin@streampipes.apache.org everything looks good.I will dive deeper now :) What is the purpose of the generated security password?
Florian

Am Dienstag, dem 02.08.2022 um 18:31 +0000 schrieb Dominik Riemer:
> Hi Florian,just to make sure - you used the installer from incubator- 
> streampipes/installer/cli? The old installer repo has also been merged 
> into the main repo.
> Can you debug the service to see where the service tries to 
> register?You can set a breakpoint in ConsulProvider, starting from 
> line 61.
> BestDominik
> 
> -----Original Message-----From: Florian Micklich < 
> florian.micklich@mailbox.org.INVALID> Sent: Tuesday, August 2, 2022
> 6:36 PMTo: dev@streampipes.apache.org
> Subject: Re: Setup Streampipes Extensions in Community Edition?
> Hi Dominik,the SP_DEBUG=true  is already set like here [1]I just 
> uncomment SP_HOST and set my local IP address.
> [1]
> https://github.com/apache/incubator-streampipes/blob/dev/streampipes-e
> xtensions/streampipes-pipeline-elements-all-jvm/development/env
> id="-x-evo-selection-start-marker">Is this correct or do I miss 
> something?FlorianAm Dienstag, dem 02.08.2022 um 13:57 +0000 schrieb 
> Dominik Riemer:
> > Hi Florian,can you try to provide an SP_DEBUG=true env variable to 
> > make sure that localhost is used as the Consul target?If this 
> > doesn't work, it would be interesting to see where the service tries 
> > to reach Consul and if the Consul port is open.CheersDOminik 
> > -----Original Message-----From: Florian Micklich < 
> > micklich@apache.org
> > > Sent: Tuesday, August 2, 2022 3:13 PMTo: 
> > > dev@streampipes.apache.org
> > Subject: Re: Setup Streampipes Extensions in Community Edition?I did 
> > some adjustments in../incubator-streampipes/streampipes-
> > extensions/streampipes-pipeline-elements-all-
> > jvm/development/envandset the SP_HOST variable according to my local 
> > ip address but nothing has changed.Still getting 
> > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider - 
> > Checking if consul is available...Any suggestion what to 
> > do?FlorianAm Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb Florian 
> > Micklich:
> > > Thanks Dominik!that was working like charming.I switched back
> > > toJava11 and startedthe project from the repository  you 
> > > mentioned.After downloading the maven resources I was able to 
> > > start the "all- pipeline-elements-jvm"But there I get 
> > > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider - 
> > > Could notconnect to Consul instance...I suspect this has something 
> > > to do with the host.docker.internalcommand on linux as mentioned 
> > > here:For Linux user: You must change theenvironment variables 
> > > stating host.docker.internal to you localmachine's IP  [1]For me 
> > > it is not clear where to make that adjustment.[1] 
> > > https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> > > 
> > > 
> > > Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik
> > > Riemer:
> > > > Hi Florian,IntelliJ community should work without problems.Two 
> > > > things which might be useful:- We integrated the incubator- 
> > > > streampipes-extensions project into incubator-streampipes to 
> > > > haveeverything in a single repo (the extensions can be found 
> > > > there under"streampipes-extensions"). So please clone the
> > > > projectfrom[1].- Therecent dev version requires minimum Java 
> > > > version 11 (which probablycauses some errors in your current 
> > > > setup). Can you update Java andsee if the errors disappear?If 
> > > > this doesn't help, we'll take a deeper look 😉CheersDominik [1] 
> > > > https://github.com/apache/incubator-streampipes
> > > > 
> > > > 
> > > > -----Original Message-----From: Florian Micklich < 
> > > > micklich@apache.org
> > > > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > > > dev@streampipes.apache.org
> > > > Subject: Setup Streampipes Extensions in Community Edition?Hi 
> > > > all,I want to re-setup my dev environment.I got the latest 
> > > > devbranch from here  [1].Unfortunatelly I got only the 
> > > > IntelliJCommunity edition and have a lot of problems to get 
> > > > startet.I wasable to import the project but get following build 
> > > > error after I runthe processors- geo-jvm02.08.22, 11:03 - Build 
> > > > completed with 20errors and 3 warnings in 4 sec, 939 ms I am 
> > > > also using openjdk 8.../incubator-streampipes- 
> > > > extensions(dev)$java -versionopenjdk version 
> > > > "1.8.0_302"OpenJDKRuntime Environment (build 1.8.0_302- 
> > > > b08)OpenJDK 64-Bit Server VM(build 25.302-b08, mixedmode)It 
> > > > seems to be some maven dependencies are also missing.Before I 
> > > > postmy errors: It is possible to use the community edition 
> > > > withoutproblems?Kind regardsFlorian[1] 
> > > > https://github.com/apache/incubator-streampipes-extensions
> > > > 

Re: Setup Streampipes Extensions in Community Edition?

Posted by Florian Micklich <fl...@mailbox.org.INVALID>.
Ho Dominik,
new day new start and it looks much better now.First I have checked if
I use the correct installer you mentioned. Afterwards I did a
'streampipes clean' und startet the CLI again and now everything looks
much better if start Intellij as well:
Using generated security password: XXXXX
This generated password is for development use only. Your security
configuration must be updated before running your application in
production.
2022-08-03 10:49:20.020  INFO 13373 --- [           main]
io.undertow                              : starting server: Undertow -
2.2.17.Final2022-08-03 10:49:20.042  INFO 13373 --- [           main]
org.xnio                                 : XNIO version
3.8.6.Final2022-08-03 10:49:20.085  INFO 13373 --- [           main]
org.xnio.nio                             : XNIO NIO Implementation
Version 3.8.6.Final2022-08-03 10:49:20.290  INFO 13373 ---
[           main] org.jboss.threads                        : JBoss
Threads version 3.1.0.Final2022-08-03 10:49:20.356  INFO 13373 ---
[           main] o.s.b.w.e.undertow.UndertowWebServer     : Undertow
started on port(s) 7023 (http)2022-08-03 10:49:20.372  INFO 13373 ---
[           main] o.a.s.pe.jvm.AllPipelineElementsInit     : Started
AllPipelineElementsInit in 4.279 seconds (JVM running for 10.858)

After logging in with  admin@streampipes.apache.org everything looks
good.I will dive deeper now :)
What is the purpose of the generated security password?
Florian

Am Dienstag, dem 02.08.2022 um 18:31 +0000 schrieb Dominik Riemer:
> Hi Florian,just to make sure - you used the installer from incubator-
> streampipes/installer/cli? The old installer repo has also been
> merged into the main repo.
> Can you debug the service to see where the service tries to
> register?You can set a breakpoint in ConsulProvider, starting from
> line 61.
> BestDominik
> 
> -----Original Message-----From: Florian Micklich <
> florian.micklich@mailbox.org.INVALID> Sent: Tuesday, August 2, 2022
> 6:36 PMTo: dev@streampipes.apache.org
> Subject: Re: Setup Streampipes Extensions in Community Edition?
> Hi Dominik,the SP_DEBUG=true  is already set like here [1]I just
> uncomment SP_HOST and set my local IP address.
> [1]
> https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env
> id="-x-evo-selection-start-marker">Is this correct or do I miss
> something?FlorianAm Dienstag, dem 02.08.2022 um 13:57 +0000 schrieb
> Dominik Riemer:
> > Hi Florian,can you try to provide an SP_DEBUG=true env variable to
> > make sure that localhost is used as the Consul target?If this
> > doesn't work, it would be interesting to see where the service
> > tries to reach Consul and if the Consul port is open.CheersDOminik
> > -----Original Message-----From: Florian Micklich <
> > micklich@apache.org
> > > Sent: Tuesday, August 2, 2022 3:13 PMTo: 
> > > dev@streampipes.apache.org
> > Subject: Re: Setup Streampipes Extensions in Community Edition?I
> > did some adjustments in../incubator-streampipes/streampipes-
> > extensions/streampipes-pipeline-elements-all-
> > jvm/development/envandset the SP_HOST variable according to my
> > local ip address but nothing has changed.Still getting
> > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider -
> > Checking if consul is available...Any suggestion what to
> > do?FlorianAm Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb
> > Florian Micklich:
> > > Thanks Dominik!that was working like charming.I switched back
> > > toJava11 and startedthe project from the repository  you
> > > mentioned.After downloading the maven resources I was able to
> > > start the "all- pipeline-elements-jvm"But there I get
> > > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider -
> > > Could notconnect to Consul instance...I suspect this has
> > > something to do with the host.docker.internalcommand on linux as
> > > mentioned here:For Linux user: You must change theenvironment
> > > variables stating host.docker.internal to you localmachine's
> > > IP  [1]For me it is not clear where to make that adjustment.[1] 
> > > https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> > > 
> > > 
> > > Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik
> > > Riemer:
> > > > Hi Florian,IntelliJ community should work without problems.Two
> > > > things which might be useful:- We integrated the incubator-
> > > > streampipes-extensions project into incubator-streampipes to
> > > > haveeverything in a single repo (the extensions can be found
> > > > there under"streampipes-extensions"). So please clone the
> > > > projectfrom[1].- Therecent dev version requires minimum Java
> > > > version 11 (which probablycauses some errors in your current
> > > > setup). Can you update Java andsee if the errors disappear?If
> > > > this doesn't help, we'll take a deeper look 😉CheersDominik [1]
> > > > https://github.com/apache/incubator-streampipes
> > > > 
> > > > 
> > > > -----Original Message-----From: Florian Micklich < 
> > > > micklich@apache.org
> > > > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > > > dev@streampipes.apache.org
> > > > Subject: Setup Streampipes Extensions in Community Edition?Hi
> > > > all,I want to re-setup my dev environment.I got the latest
> > > > devbranch from here  [1].Unfortunatelly I got only the
> > > > IntelliJCommunity edition and have a lot of problems to get
> > > > startet.I wasable to import the project but get following build
> > > > error after I runthe processors- geo-jvm02.08.22, 11:03 - Build
> > > > completed with 20errors and 3 warnings in 4 sec, 939 ms I am
> > > > also using openjdk 8.../incubator-streampipes-
> > > > extensions(dev)$java -versionopenjdk version
> > > > "1.8.0_302"OpenJDKRuntime Environment (build 1.8.0_302-
> > > > b08)OpenJDK 64-Bit Server VM(build 25.302-b08, mixedmode)It
> > > > seems to be some maven dependencies are also missing.Before I
> > > > postmy errors: It is possible to use the community edition
> > > > withoutproblems?Kind regardsFlorian[1] 
> > > > https://github.com/apache/incubator-streampipes-extensions
> > > > 

RE: Setup Streampipes Extensions in Community Edition?

Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Florian,
just to make sure - you used the installer from incubator-streampipes/installer/cli? The old installer repo has also been merged into the main repo.

Can you debug the service to see where the service tries to register?
You can set a breakpoint in ConsulProvider, starting from line 61.

Best
Dominik


-----Original Message-----
From: Florian Micklich <fl...@mailbox.org.INVALID> 
Sent: Tuesday, August 2, 2022 6:36 PM
To: dev@streampipes.apache.org
Subject: Re: Setup Streampipes Extensions in Community Edition?

Hi Dominik,
the SP_DEBUG=true  is already set like here [1]I just uncomment SP_HOST and set my local IP address.

[1]
https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env id="-x-evo-selection-start-marker">
Is this correct or do I miss something?
Florian
Am Dienstag, dem 02.08.2022 um 13:57 +0000 schrieb Dominik Riemer:
> Hi Florian,
> can you try to provide an SP_DEBUG=true env variable to make sure that 
> localhost is used as the Consul target?
> If this doesn't work, it would be interesting to see where the service 
> tries to reach Consul and if the Consul port is open.
> CheersDOminik
> 
> -----Original Message-----From: Florian Micklich <micklich@apache.org
> > Sent: Tuesday, August 2, 2022 3:13 PMTo: dev@streampipes.apache.org
> Subject: Re: Setup Streampipes Extensions in Community Edition?
> I did some adjustments in../incubator-streampipes/streampipes-
> extensions/streampipes-pipeline-elements-all-jvm/development/envand
> set the SP_HOST variable according to my local ip address but nothing 
> has changed.Still getting 
> INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider - 
> Checking if consul is available...Any suggestion what to do?FlorianAm 
> Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb Florian Micklich:
> > Thanks Dominik!that was working like charming.I switched back to
> > Java11 and startedthe project from the repository  you 
> > mentioned.After downloading the maven resources I was able to start 
> > the "all- pipeline-elements-jvm"But there I get 
> > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider - 
> > Could notconnect to Consul instance...I suspect this has something 
> > to do with the host.docker.internalcommand on linux as mentioned 
> > here:For Linux user: You must change theenvironment variables 
> > stating host.docker.internal to you localmachine's IP  [1]For me it 
> > is not clear where to make that adjustment.[1] 
> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> > 
> > 
> > Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik Riemer:
> > > Hi Florian,IntelliJ community should work without problems.Two 
> > > things which might be useful:- We integrated the incubator- 
> > > streampipes-extensions project into incubator-streampipes to 
> > > haveeverything in a single repo (the extensions can be found there 
> > > under"streampipes-extensions"). So please clone the project
> > > from[1].- Therecent dev version requires minimum Java version 11 
> > > (which probablycauses some errors in your current setup). Can you 
> > > update Java andsee if the errors disappear?If this doesn't help, 
> > > we'll take a deeper look 😉CheersDominik [1] 
> > > https://github.com/apache/incubator-streampipes
> > > 
> > > 
> > > -----Original Message-----From: Florian Micklich < 
> > > micklich@apache.org
> > > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > > dev@streampipes.apache.org
> > > Subject: Setup Streampipes Extensions in Community Edition?Hi 
> > > all,I want to re-setup my dev environment.I got the latest 
> > > devbranch from here  [1].Unfortunatelly I got only the 
> > > IntelliJCommunity edition and have a lot of problems to get 
> > > startet.I wasable to import the project but get following build 
> > > error after I runthe processors- geo-jvm02.08.22, 11:03 - Build 
> > > completed with 20errors and 3 warnings in 4 sec, 939 ms I am also 
> > > using openjdk 8.../incubator-streampipes- extensions(dev)$java 
> > > -versionopenjdk version "1.8.0_302"OpenJDKRuntime Environment 
> > > (build 1.8.0_302-b08)OpenJDK 64-Bit Server VM(build 25.302-b08, 
> > > mixedmode)It seems to be some maven dependencies are also 
> > > missing.Before I postmy errors: It is possible to use the 
> > > community edition withoutproblems?Kind regardsFlorian[1] 
> > > https://github.com/apache/incubator-streampipes-extensions
> > > 

Re: Setup Streampipes Extensions in Community Edition?

Posted by Florian Micklich <fl...@mailbox.org.INVALID>.
Hi Dominik,
the SP_DEBUG=true  is already set like here [1]I just uncomment SP_HOST
and set my local IP address.

[1] 
https://github.com/apache/incubator-streampipes/blob/dev/streampipes-extensions/streampipes-pipeline-elements-all-jvm/development/env id="-x-evo-selection-start-marker">
Is this correct or do I miss something?
Florian
Am Dienstag, dem 02.08.2022 um 13:57 +0000 schrieb Dominik Riemer:
> Hi Florian,
> can you try to provide an SP_DEBUG=true env variable to make sure
> that localhost is used as the Consul target?
> If this doesn't work, it would be interesting to see where the
> service tries to reach Consul and if the Consul port is open.
> CheersDOminik
> 
> -----Original Message-----From: Florian Micklich <micklich@apache.org
> > Sent: Tuesday, August 2, 2022 3:13 PMTo: dev@streampipes.apache.org
> Subject: Re: Setup Streampipes Extensions in Community Edition?
> I did some adjustments in../incubator-streampipes/streampipes-
> extensions/streampipes-pipeline-elements-all-jvm/development/envand
> set the SP_HOST variable according to my local ip address but nothing
> has changed.Still getting
> INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider -
> Checking if consul is available...Any suggestion what to do?FlorianAm
> Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb Florian Micklich:
> > Thanks Dominik!that was working like charming.I switched back to
> > Java11 and startedthe project from the repository  you
> > mentioned.After downloading the maven resources I was able to start
> > the "all- pipeline-elements-jvm"But there I get
> > INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider -
> > Could notconnect to Consul instance...I suspect this has something
> > to do with the host.docker.internalcommand on linux as mentioned
> > here:For Linux user: You must change theenvironment variables
> > stating host.docker.internal to you localmachine's IP  [1]For me it
> > is not clear where to make that adjustment.[1]
> > https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> > 
> > 
> > Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik Riemer:
> > > Hi Florian,IntelliJ community should work without problems.Two
> > > things which might be useful:- We integrated the incubator-
> > > streampipes-extensions project into incubator-streampipes to
> > > haveeverything in a single repo (the extensions can be found
> > > there under"streampipes-extensions"). So please clone the project
> > > from[1].- Therecent dev version requires minimum Java version 11
> > > (which probablycauses some errors in your current setup). Can you
> > > update Java andsee if the errors disappear?If this doesn't help,
> > > we'll take a deeper look 😉CheersDominik [1] 
> > > https://github.com/apache/incubator-streampipes
> > > 
> > > 
> > > -----Original Message-----From: Florian Micklich < 
> > > micklich@apache.org
> > > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > > dev@streampipes.apache.org
> > > Subject: Setup Streampipes Extensions in Community Edition?Hi
> > > all,I want to re-setup my dev environment.I got the latest
> > > devbranch from here  [1].Unfortunatelly I got only the
> > > IntelliJCommunity edition and have a lot of problems to get
> > > startet.I wasable to import the project but get following build
> > > error after I runthe processors- geo-jvm02.08.22, 11:03 - Build
> > > completed with 20errors and 3 warnings in 4 sec, 939 ms I am also
> > > using openjdk 8.../incubator-streampipes- extensions(dev)$java
> > > -versionopenjdk version "1.8.0_302"OpenJDKRuntime Environment
> > > (build 1.8.0_302-b08)OpenJDK 64-Bit Server VM(build 25.302-b08,
> > > mixedmode)It seems to be some maven dependencies are also
> > > missing.Before I postmy errors: It is possible to use the
> > > community edition withoutproblems?Kind regardsFlorian[1] 
> > > https://github.com/apache/incubator-streampipes-extensions
> > > 

RE: Setup Streampipes Extensions in Community Edition?

Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Florian,

can you try to provide an SP_DEBUG=true env variable to make sure that localhost is used as the Consul target?

If this doesn't work, it would be interesting to see where the service tries to reach Consul and if the Consul port is open.

Cheers
DOminik


-----Original Message-----
From: Florian Micklich <mi...@apache.org> 
Sent: Tuesday, August 2, 2022 3:13 PM
To: dev@streampipes.apache.org
Subject: Re: Setup Streampipes Extensions in Community Edition?

I did some adjustments in
../incubator-streampipes/streampipes-extensions/streampipes-pipeline-
elements-all-jvm/development/env
and set the SP_HOST variable according to my local ip address but nothing has changed.
Still getting INFO
org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Checking if consul is available...
Any suggestion what to do?
Florian
Am Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb Florian Micklich:
> Thanks Dominik!that was working like charming.I switched back to Java
> 11 and startedthe project from the repository  you mentioned.After 
> downloading the maven resources I was able to start the "all- 
> pipeline-elements-jvm"But there I get 
> INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider - Could 
> notconnect to Consul instance...I suspect this has something to do 
> with the host.docker.internalcommand on linux as mentioned here:For 
> Linux user: You must change theenvironment variables stating 
> host.docker.internal to you localmachine's IP  [1]For me it is not 
> clear where to make that adjustment.
> [1]
> https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> 
> 
> Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik Riemer:
> > Hi Florian,IntelliJ community should work without problems.Two 
> > things which might be useful:- We integrated the incubator- 
> > streampipes-extensions project into incubator-streampipes to 
> > haveeverything in a single repo (the extensions can be found there 
> > under"streampipes-extensions"). So please clone the project from
> > [1].- Therecent dev version requires minimum Java version 11 (which 
> > probablycauses some errors in your current setup). Can you update 
> > Java andsee if the errors disappear?If this doesn't help, we'll take 
> > a deeper look 😉CheersDominik [1] 
> > https://github.com/apache/incubator-streampipes
> > 
> > 
> > -----Original Message-----From: Florian Micklich < 
> > micklich@apache.org
> > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > dev@streampipes.apache.org
> > Subject: Setup Streampipes Extensions in Community Edition?Hi all,I 
> > want to re-setup my dev environment.I got the latest devbranch from 
> > here  [1].Unfortunatelly I got only the IntelliJCommunity edition 
> > and have a lot of problems to get startet.I wasable to import the 
> > project but get following build error after I runthe processors- 
> > geo-jvm02.08.22, 11:03 - Build completed with 20errors and 3 
> > warnings in 4 sec, 939 ms I am also using openjdk 
> > 8.../incubator-streampipes- extensions(dev)$java -versionopenjdk 
> > version "1.8.0_302"OpenJDKRuntime Environment (build 
> > 1.8.0_302-b08)OpenJDK 64-Bit Server VM(build 25.302-b08, 
> > mixedmode)It seems to be some maven dependencies are also 
> > missing.Before I postmy errors: It is possible to use the community 
> > edition withoutproblems?Kind regardsFlorian[1] 
> > https://github.com/apache/incubator-streampipes-extensions
> > 

Re: Setup Streampipes Extensions in Community Edition?

Posted by Florian Micklich <mi...@apache.org>.
I did some adjustments in
../incubator-streampipes/streampipes-extensions/streampipes-pipeline-
elements-all-jvm/development/env
and set the SP_HOST variable according to my local ip address but
nothing has changed.
Still getting INFO
org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Checking if
consul is available...
Any suggestion what to do?
Florian
Am Dienstag, dem 02.08.2022 um 13:43 +0200 schrieb Florian Micklich:
> Thanks Dominik!that was working like charming.I switched back to Java
> 11 and startedthe project from the repository  you mentioned.After
> downloading the maven resources I was able to start the "all-
> pipeline-elements-jvm"But there I get
> INFOorg.apache.streampipes.svcdiscovery.consul.ConsulProvider - Could
> notconnect to Consul instance...I suspect this has something to do
> with the host.docker.internalcommand on linux as mentioned here:For
> Linux user: You must change theenvironment variables stating
> host.docker.internal to you localmachine's IP  [1]For me it is not
> clear where to make that adjustment.
> [1] 
> https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions
> 
> 
> Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik Riemer:
> > Hi Florian,IntelliJ community should work without problems.Two
> > things which might be useful:- We integrated the incubator-
> > streampipes-extensions project into incubator-streampipes to
> > haveeverything in a single repo (the extensions can be found there
> > under"streampipes-extensions"). So please clone the project from
> > [1].- Therecent dev version requires minimum Java version 11 (which
> > probablycauses some errors in your current setup). Can you update
> > Java andsee if the errors disappear?If this doesn't help, we'll
> > take a deeper look 😉CheersDominik [1] 
> > https://github.com/apache/incubator-streampipes
> > 
> > 
> > -----Original Message-----From: Florian Micklich <
> > micklich@apache.org
> > > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> > dev@streampipes.apache.org
> > Subject: Setup Streampipes Extensions in Community Edition?Hi all,I
> > want to re-setup my dev environment.I got the latest devbranch from
> > here  [1].Unfortunatelly I got only the IntelliJCommunity edition
> > and have a lot of problems to get startet.I wasable to import the
> > project but get following build error after I runthe processors-
> > geo-jvm02.08.22, 11:03 - Build completed with 20errors and 3
> > warnings in 4 sec, 939 ms
> > I am also using openjdk 8.../incubator-streampipes-
> > extensions(dev)$java -versionopenjdk version
> > "1.8.0_302"OpenJDKRuntime Environment (build 1.8.0_302-b08)OpenJDK
> > 64-Bit Server VM(build 25.302-b08, mixedmode)It seems to be some
> > maven dependencies are also missing.Before I postmy errors: It is
> > possible to use the community edition withoutproblems?Kind
> > regardsFlorian[1] 
> > https://github.com/apache/incubator-streampipes-extensions
> > 

Re: Setup Streampipes Extensions in Community Edition?

Posted by Florian Micklich <mi...@apache.org>.
Thanks Dominik!
that was working like charming.I switched back to Java 11 and started
the project from the repository  you mentioned.
After downloading the maven resources I was able to start the "all-
pipeline-elements-jvm"But there I get INFO
org.apache.streampipes.svcdiscovery.consul.ConsulProvider - Could not
connect to Consul instance...
I suspect this has something to do with the host.docker.internal
command on linux as mentioned here:For Linux user: You must change the
environment variables stating host.docker.internal to you local
machine's IP  [1]
For me it is not clear where to make that adjustment.

[1] https://cwiki.apache.org/confluence/display/STREAMPIPES/Extensions


Am Dienstag, dem 02.08.2022 um 09:27 +0000 schrieb Dominik Riemer:
> Hi Florian,
> IntelliJ community should work without problems.
> Two things which might be useful:- We integrated the incubator-
> streampipes-extensions project into incubator-streampipes to have
> everything in a single repo (the extensions can be found there under
> "streampipes-extensions"). So please clone the project from [1].- The
> recent dev version requires minimum Java version 11 (which probably
> causes some errors in your current setup). Can you update Java and
> see if the errors disappear?
> If this doesn't help, we'll take a deeper look 😉
> CheersDominik 
> [1] https://github.com/apache/incubator-streampipes
> 
> 
> -----Original Message-----From: Florian Micklich <micklich@apache.org
> > Sent: Tuesday, August 2, 2022 11:14 AMTo: 
> dev@streampipes.apache.org
> Subject: Setup Streampipes Extensions in Community Edition?
> Hi all,I want to re-setup my dev environment.I got the latest dev
> branch from here  [1].Unfortunatelly I got only the IntelliJ
> Community edition and have a lot of problems to get startet.I was
> able to import the project but get following build error after I run
> the processors-geo-jvm02.08.22, 11:03 - Build completed with 20
> errors and 3 warnings in 4 sec, 939 ms
> 
> I am also using openjdk 8.../incubator-streampipes-
> extensions(dev)$java -versionopenjdk version "1.8.0_302"OpenJDK
> Runtime Environment (build 1.8.0_302-b08)OpenJDK 64-Bit Server VM
> (build 25.302-b08, mixedmode)
> It seems to be some maven dependencies are also missing.Before I post
> my errors: It is possible to use the community edition without
> problems?Kind regardsFlorian
> [1] https://github.com/apache/incubator-streampipes-extensions
> 

RE: Setup Streampipes Extensions in Community Edition?

Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Florian,

IntelliJ community should work without problems.

Two things which might be useful:
- We integrated the incubator-streampipes-extensions project into incubator-streampipes to have everything in a single repo (the extensions can be found there under "streampipes-extensions"). So please clone the project from [1].
- The recent dev version requires minimum Java version 11 (which probably causes some errors in your current setup). Can you update Java and see if the errors disappear?

If this doesn't help, we'll take a deeper look 😉

Cheers
Dominik 

[1] https://github.com/apache/incubator-streampipes


-----Original Message-----
From: Florian Micklich <mi...@apache.org> 
Sent: Tuesday, August 2, 2022 11:14 AM
To: dev@streampipes.apache.org
Subject: Setup Streampipes Extensions in Community Edition?

Hi all,
I want to re-setup my dev environment.I got the latest dev branch from here  [1].Unfortunatelly I got only the IntelliJ Community edition and have a lot of problems to get startet.
I was able to import the project but get following build error after I run the processors-geo-jvm02.08.22, 11:03 - Build completed with 20 errors and 3 warnings in 4 sec, 939 ms


I am also using openjdk 8.../incubator-streampipes-extensions(dev)$
java -versionopenjdk version "1.8.0_302"OpenJDK Runtime Environment (build 1.8.0_302-b08)OpenJDK 64-Bit Server VM (build 25.302-b08, mixed
mode)

It seems to be some maven dependencies are also missing.Before I post my errors: It is possible to use the community edition without problems?
Kind regardsFlorian

[1] https://github.com/apache/incubator-streampipes-extensions