You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@streampipes.apache.org by "Rullo, Federico" <Fe...@gft.com> on 2022/08/11 10:09:38 UTC
Custom Components not showing in the full environment
Hello,
I have integrated my custom components in SP and when I run it in the pipeline-elements environment it all works fine.
On the other hand, when I use the full environment, my custom image doesn't appear to be used.
Looking at the docker file of the installer folder I see that you guys use the streampipes-elements-all-jvm for the lite version and the streampipes-elementes-all-flink for the full version, but the flink one does not appear to be using the streampipes-extensions-all-jvm image, hence if I build a custom image from it it is not used.
How can I integrate my extensions in the full environment?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Societ? sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
RE: Custom Components not showing in the full environment
Posted by "Rullo, Federico" <Fe...@gft.com>.
Hi Philipp,
Yes, I call my component from extensions-all-jvm, which, from what I saw, is called by the elements-all-jvm container, should I put my custom component in the pipeline-elements-all-jvm container?
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Philipp Zehnder <ph...@bytefabrik.ai>
Sent: venerdì 12 agosto 2022 17:44
To: users@streampipes.apache.org
Subject: Re: Custom Components not showing in the full environment
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
the light version uses "extensions-all-jvm" to start adapters and all jvm processors in one container. I guess you integrated your component into this service, right?
In the full version multiple containers are started:
* connect-adapters
* connect-adapters-iiot
* pipeline-elements-all-jvm
* pipeline-elements-all-flink
When you want to use you component in the full version as well, it must be registered at one of the services.
Cheers,
Philipp
________________________________
Von: Rullo, Federico <Fe...@gft.com>>
Gesendet: Donnerstag, August 11, 2022 12:09 PM
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: Custom Components not showing in the full environment
Hello,
I have integrated my custom components in SP and when I run it in the pipeline-elements environment it all works fine.
On the other hand, when I use the full environment, my custom image doesn't appear to be used.
Looking at the docker file of the installer folder I see that you guys use the streampipes-elements-all-jvm for the lite version and the streampipes-elementes-all-flink for the full version, but the flink one does not appear to be using the streampipes-extensions-all-jvm image, hence if I build a custom image from it it is not used.
How can I integrate my extensions in the full environment?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7C9e01a011d2bd442f0b8b08da7c79a30a%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959159113477630%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Dn%2BEy9GBUfw7X1WKsJJGx6MsPzBBHAkNfca0pxA24Xc%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C9e01a011d2bd442f0b8b08da7c79a30a%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959159113477630%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ConmV5FWlbwWz0ELpcRzpm1GWHWE8mMr0n4YdE5ajoA%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C9e01a011d2bd442f0b8b08da7c79a30a%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959159113477630%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=H03zpL0NlT4kQsrr2GafgHQBxumKKCrlpNchWWu6i28%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it&data=05%7C01%7CFederico.Rullo%40gft.com%7C9e01a011d2bd442f0b8b08da7c79a30a%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959159113477630%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=13oGE9CWXhep92zlcc6ofK%2BxL7ImTNTz%2BRx7zSn69ss%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B6DA.FBC5F550]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7C9e01a011d2bd442f0b8b08da7c79a30a%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959159113633842%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=bsjzITCnHvYtzEzORb2drj%2FenhgU%2BJIs88idMN15k3U%3D&reserved=0>
Re: Custom Components not showing in the full environment
Posted by Philipp Zehnder <ph...@bytefabrik.ai>.
Hi Frederico,
the light version uses "extensions-all-jvm" to start adapters and all jvm processors in one container. I guess you integrated your component into this service, right?
In the full version multiple containers are started:
* connect-adapters
* connect-adapters-iiot
* pipeline-elements-all-jvm
* pipeline-elements-all-flink
When you want to use you component in the full version as well, it must be registered at one of the services.
Cheers,
Philipp
________________________________
Von: Rullo, Federico <Fe...@gft.com>
Gesendet: Donnerstag, August 11, 2022 12:09 PM
An: users@streampipes.apache.org <us...@streampipes.apache.org>
Betreff: Custom Components not showing in the full environment
Hello,
I have integrated my custom components in SP and when I run it in the pipeline-elements environment it all works fine.
On the other hand, when I use the full environment, my custom image doesn’t appear to be used.
Looking at the docker file of the installer folder I see that you guys use the streampipes-elements-all-jvm for the lite version and the streampipes-elementes-all-flink for the full version, but the flink one does not appear to be using the streampipes-extensions-all-jvm image, hence if I build a custom image from it it is not used.
How can I integrate my extensions in the full environment?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>