You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@streampipes.apache.org by "Rullo, Federico" <Fe...@gft.com> on 2022/09/19 07:24:35 UTC
Error Messages
Hello,
I was running SP in full environment, using custom image for pipeline-elements-all-jvm, and when I look at the logs I see some errors like,
Could not register adapter at url from iiot and adapters, and Unauthorized request-require full authentication from backend.
Can you give me more info about it?
Thank you in advance,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Societ? sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
RE: Error Messages
Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Federico,
409 refers to a non-matching schema in the data lake sink (e.g., when trying to write a different schema to an already existing data lake measurement).
You can choose another measurement or delete the existing measurement under Settings/Data Lake.
Best
Dominik
From: Rullo, Federico <Fe...@gft.com>
Sent: Tuesday, September 20, 2022 3:13 PM
To: users@streampipes.apache.org
Subject: RE: Error Messages
Hi Dominik,
I have restarted SP, and now I don't see errors regarding authentication anymore.
But for some of our components, they cannot send their output to the Datalake, basically when a middle value is calculated two output collection instructions are called, this way:
event.addField("interpolation_value", yi);
if(yi!=0 && xi!=0) {
event.getFieldBySelector(this.timestamp_value).setValue(xi);
out.collect(event);
event.getFieldBySelector(this.timestamp_value).setValue(timestamp);
out.collect(event);
}else{
out.collect(event);
}
If I run the live preview everything works fine, but if I try to send it to the datalake, it doesn't receive anything.
And I get this error:
SP-log.log:pipeline-elements-all-jvm_1 | 08:04:13.557 SP [XNIO-1 task-2] ERROR o.a.s.c.a.InvocablePipelineElementResource - Could not invoke pipeline element Data Lake due to the following error: 409 -
SP-log.log:backend_1 | 08:08:06.716 SP [http-nio-8030-exec-6] ERROR o.a.c.c.C.[.[.[.[.a.s.b.StreamPipesResourceConfig] - Servlet.service() for servlet [org.apache.streampipes.backend.StreamPipesResourceConfig] in context with path [/streampipes-backend] threw exception [java.lang.NullPointerException] with root cause.
Do you have any idea what can be the reason?
Thanks in advance,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it%20>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8CD8C.6B7F9AF0]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Dominik Riemer <do...@bytefabrik.ai>>
Sent: martedì 20 settembre 2022 14:57
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: RE: Error Messages
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
do you see any output in the logs which refers to the authentication method used?
E.g., "Configured anonymous access for this service, consider providing an authentication option."
Or is there any other output related to authentication?
Best
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Monday, September 19, 2022 9:25 AM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Error Messages
Hello,
I was running SP in full environment, using custom image for pipeline-elements-all-jvm, and when I look at the logs I see some errors like,
Could not register adapter at url from iiot and adapters, and Unauthorized request-require full authentication from backend.
Can you give me more info about it?
Thank you in advance,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Fxdo%2Febn9vXwMzolS%2Bd8W57aDf3eM4oVK7RSTBK5I9s%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5a5rOA2Lh%2FLH9PpLfxAHTxB7f4YrKS2MT4cWBgIzWbQ%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4dSd9qhdgjbKIbtf10Tvria%2FsY4aeBM%2BJ24lnQ59LrQ%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DZcLeHUySZpaJd5pGZ%2BWF5UoDvl9zxz%2FhGsSr2UWzCg%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8CD8C.6B7F9AF0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gRy38RwkVZaROZmxZuVV3vlAnVIdXMaOxYggM31LkUU%3D&reserved=0>
RE: Error Messages
Posted by "Rullo, Federico" <Fe...@gft.com>.
Hi Dominik,
I have restarted SP, and now I don't see errors regarding authentication anymore.
But for some of our components, they cannot send their output to the Datalake, basically when a middle value is calculated two output collection instructions are called, this way:
event.addField("interpolation_value", yi);
if(yi!=0 && xi!=0) {
event.getFieldBySelector(this.timestamp_value).setValue(xi);
out.collect(event);
event.getFieldBySelector(this.timestamp_value).setValue(timestamp);
out.collect(event);
}else{
out.collect(event);
}
If I run the live preview everything works fine, but if I try to send it to the datalake, it doesn't receive anything.
And I get this error:
SP-log.log:pipeline-elements-all-jvm_1 | 08:04:13.557 SP [XNIO-1 task-2] ERROR o.a.s.c.a.InvocablePipelineElementResource - Could not invoke pipeline element Data Lake due to the following error: 409 -
SP-log.log:backend_1 | 08:08:06.716 SP [http-nio-8030-exec-6] ERROR o.a.c.c.C.[.[.[.[.a.s.b.StreamPipesResourceConfig] - Servlet.service() for servlet [org.apache.streampipes.backend.StreamPipesResourceConfig] in context with path [/streampipes-backend] threw exception [java.lang.NullPointerException] with root cause.
Do you have any idea what can be the reason?
Thanks in advance,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Dominik Riemer <do...@bytefabrik.ai>
Sent: martedì 20 settembre 2022 14:57
To: users@streampipes.apache.org
Subject: RE: Error Messages
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
do you see any output in the logs which refers to the authentication method used?
E.g., "Configured anonymous access for this service, consider providing an authentication option."
Or is there any other output related to authentication?
Best
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Monday, September 19, 2022 9:25 AM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Error Messages
Hello,
I was running SP in full environment, using custom image for pipeline-elements-all-jvm, and when I look at the logs I see some errors like,
Could not register adapter at url from iiot and adapters, and Unauthorized request-require full authentication from backend.
Can you give me more info about it?
Thank you in advance,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Fxdo%2Febn9vXwMzolS%2Bd8W57aDf3eM4oVK7RSTBK5I9s%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=5a5rOA2Lh%2FLH9PpLfxAHTxB7f4YrKS2MT4cWBgIzWbQ%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=4dSd9qhdgjbKIbtf10Tvria%2FsY4aeBM%2BJ24lnQ59LrQ%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=DZcLeHUySZpaJd5pGZ%2BWF5UoDvl9zxz%2FhGsSr2UWzCg%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8CD02.CDBEC590]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7C0af9404dc5b545b090a908da9b079933%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637992754188154830%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gRy38RwkVZaROZmxZuVV3vlAnVIdXMaOxYggM31LkUU%3D&reserved=0>
RE: Error Messages
Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Federico,
do you see any output in the logs which refers to the authentication method used?
E.g., "Configured anonymous access for this service, consider providing an authentication option."
Or is there any other output related to authentication?
Best
Dominik
From: Rullo, Federico <Fe...@gft.com>
Sent: Monday, September 19, 2022 9:25 AM
To: users@streampipes.apache.org
Subject: Error Messages
Hello,
I was running SP in full environment, using custom image for pipeline-elements-all-jvm, and when I look at the logs I see some errors like,
Could not register adapter at url from iiot and adapters, and Unauthorized request-require full authentication from backend.
Can you give me more info about it?
Thank you in advance,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it%20>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8CD01.2ADD7ED0]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>