You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@streampipes.apache.org by "Rullo, Federico" <Fe...@gft.com> on 2022/08/02 12:18:03 UTC
Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let's say I don't receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Societ? sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
Re: Processors Output
Posted by Philipp Zehnder <ph...@bytefabrik.ai>.
Hi Frederico,
when the timestamp is the same it overrides the event in the database.
To avoid this you need to either set another value for the timestamp or add a new field that is marked as a dimension property. If two events have the same timestamp with different dimension properties you can group the results in the widget of the data explorer.
Cheers,
Philipp
________________________________
Von: Rullo, Federico <Fe...@gft.com>
Gesendet: Mittwoch, August 24, 2022 11:27 AM
An: users@streampipes.apache.org <us...@streampipes.apache.org>
Betreff: RE: Processors Output
Hi Philipp,
I have tried without putting the delay, but from what I am seeing the timestamps are the same for both events.
Which means that my custom value and the actual value are put in the exact same spot in the graph, while I want the custom value before.
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Philipp Zehnder <ph...@bytefabrik.ai>
Sent: venerdì 12 agosto 2022 18:10
To: users@streampipes.apache.org
Subject: Re: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
do the events have different timestamps? The data is stored in a timeseries database that takes the timestamp as an index.
Usually, you do not need a delay when sending the data. You can call the output collector multiple times after each other.
Cheers,
Philipp
________________________________
Von: Rullo, Federico <Fe...@gft.com>>
Gesendet: Donnerstag, August 11, 2022 11:07 AM
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: RE: Processors Output
Hi Philipp,
Following our conversation and your reply I have tried to implement it.
Before collecting the event I have created a customEvent variable which is an exact copy of the event, the only difference is that the value I send is the one I have calculated, after I collect the customEvent I put a delay of around 500 ms and then collect the regular event, the problem is that the second event overwrites the previous one so I only see one event in the data explorer.
Is there something I am doing wrong? Or is there anything else I have to do before this, maybe configure the OutputCollector?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vTt3MuVotfPpwzi3zHr8ioV8bjoUC7ZWpwGKlRbR3OQ%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8qTO3XOnYjXkAbibzLaUaZWEhCqLPkUGrNDxtG%2BAMZg%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ipIHRk%2F9CdJzp78FcLbdtaf5mo7Ret2EYagqE0t5iUU%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Z5Yc90CC5ND%2B3v6J3wmh9jWKg9Rp39GOoByoVLocRW8%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B7AC.6B19A3D0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3ByI%2FJJMqW29r5KACgyx3ZtADL%2BIVAd2WsMEUgBq2S0%3D&reserved=0>
From: Philipp Zehnder <ph...@bytefabrik.ai>>
Sent: venerdì 5 agosto 2022 16:12
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: AW: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
in general, it is possible to call the out.collect(event) method multiple times.
Each event will be sent to the following processors.
However, the only restriction is, that the event schema must be the same.
The reason for that is, that the following processor needs to know how an event looks like.
E.g. when a filter component filters the events based on the field “temperature” it must be within the event.
I hope this helps.
Kind regards,
Philipp
Von: Rullo, Federico <Fe...@gft.com>>
Datum: Donnerstag, 4. August 2022 um 15:58
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: RE: Processors Output
Hi Dominik,
Thanks for the reply.
This could work but I was looking for something different.
I was wondering if we could queue one more event before the normal one.
For example, I calculate and obtain a new event that needs to be outputted before the regular one.
Can we call the OutputCollector function explicitly, one call for our calculated event and one for the normal event to maintain the correct TimeSeries?
out.collect(event_custom);
out.collect(event);
Something like this.
Thank in advance for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vTt3MuVotfPpwzi3zHr8ioV8bjoUC7ZWpwGKlRbR3OQ%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8qTO3XOnYjXkAbibzLaUaZWEhCqLPkUGrNDxtG%2BAMZg%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ipIHRk%2F9CdJzp78FcLbdtaf5mo7Ret2EYagqE0t5iUU%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1rLMXIy%2F%2FBurAUA6nSdLPFOzfva4y9%2FzVoZBA%2FffdsM%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B7AC.6B19A3D0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3ByI%2FJJMqW29r5KACgyx3ZtADL%2BIVAd2WsMEUgBq2S0%3D&reserved=0>
From: Dominik Riemer <do...@bytefabrik.ai>>
Sent: martedì 2 agosto 2022 16:33
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: RE: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
I’ve never tried this, but I’d say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let’s say I don’t receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vTt3MuVotfPpwzi3zHr8ioV8bjoUC7ZWpwGKlRbR3OQ%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8qTO3XOnYjXkAbibzLaUaZWEhCqLPkUGrNDxtG%2BAMZg%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ipIHRk%2F9CdJzp78FcLbdtaf5mo7Ret2EYagqE0t5iUU%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1rLMXIy%2F%2FBurAUA6nSdLPFOzfva4y9%2FzVoZBA%2FffdsM%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B7AC.6B19A3D0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3ByI%2FJJMqW29r5KACgyx3ZtADL%2BIVAd2WsMEUgBq2S0%3D&reserved=0>
RE: Processors Output
Posted by "Rullo, Federico" <Fe...@gft.com>.
Hi Philipp,
I have tried without putting the delay, but from what I am seeing the timestamps are the same for both events.
Which means that my custom value and the actual value are put in the exact same spot in the graph, while I want the custom value before.
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Philipp Zehnder <ph...@bytefabrik.ai>
Sent: venerdì 12 agosto 2022 18:10
To: users@streampipes.apache.org
Subject: Re: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
do the events have different timestamps? The data is stored in a timeseries database that takes the timestamp as an index.
Usually, you do not need a delay when sending the data. You can call the output collector multiple times after each other.
Cheers,
Philipp
________________________________
Von: Rullo, Federico <Fe...@gft.com>>
Gesendet: Donnerstag, August 11, 2022 11:07 AM
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: RE: Processors Output
Hi Philipp,
Following our conversation and your reply I have tried to implement it.
Before collecting the event I have created a customEvent variable which is an exact copy of the event, the only difference is that the value I send is the one I have calculated, after I collect the customEvent I put a delay of around 500 ms and then collect the regular event, the problem is that the second event overwrites the previous one so I only see one event in the data explorer.
Is there something I am doing wrong? Or is there anything else I have to do before this, maybe configure the OutputCollector?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vTt3MuVotfPpwzi3zHr8ioV8bjoUC7ZWpwGKlRbR3OQ%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8qTO3XOnYjXkAbibzLaUaZWEhCqLPkUGrNDxtG%2BAMZg%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ipIHRk%2F9CdJzp78FcLbdtaf5mo7Ret2EYagqE0t5iUU%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=Z5Yc90CC5ND%2B3v6J3wmh9jWKg9Rp39GOoByoVLocRW8%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B7AC.6B19A3D0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3ByI%2FJJMqW29r5KACgyx3ZtADL%2BIVAd2WsMEUgBq2S0%3D&reserved=0>
From: Philipp Zehnder <ph...@bytefabrik.ai>>
Sent: venerdì 5 agosto 2022 16:12
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: AW: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
in general, it is possible to call the out.collect(event) method multiple times.
Each event will be sent to the following processors.
However, the only restriction is, that the event schema must be the same.
The reason for that is, that the following processor needs to know how an event looks like.
E.g. when a filter component filters the events based on the field "temperature" it must be within the event.
I hope this helps.
Kind regards,
Philipp
Von: Rullo, Federico <Fe...@gft.com>>
Datum: Donnerstag, 4. August 2022 um 15:58
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: RE: Processors Output
Hi Dominik,
Thanks for the reply.
This could work but I was looking for something different.
I was wondering if we could queue one more event before the normal one.
For example, I calculate and obtain a new event that needs to be outputted before the regular one.
Can we call the OutputCollector function explicitly, one call for our calculated event and one for the normal event to maintain the correct TimeSeries?
out.collect(event_custom);
out.collect(event);
Something like this.
Thank in advance for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vTt3MuVotfPpwzi3zHr8ioV8bjoUC7ZWpwGKlRbR3OQ%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8qTO3XOnYjXkAbibzLaUaZWEhCqLPkUGrNDxtG%2BAMZg%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ipIHRk%2F9CdJzp78FcLbdtaf5mo7Ret2EYagqE0t5iUU%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1rLMXIy%2F%2FBurAUA6nSdLPFOzfva4y9%2FzVoZBA%2FffdsM%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B7AC.6B19A3D0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3ByI%2FJJMqW29r5KACgyx3ZtADL%2BIVAd2WsMEUgBq2S0%3D&reserved=0>
From: Dominik Riemer <do...@bytefabrik.ai>>
Sent: martedì 2 agosto 2022 16:33
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: RE: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
I've never tried this, but I'd say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let's say I don't receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=vTt3MuVotfPpwzi3zHr8ioV8bjoUC7ZWpwGKlRbR3OQ%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=8qTO3XOnYjXkAbibzLaUaZWEhCqLPkUGrNDxtG%2BAMZg%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ipIHRk%2F9CdJzp78FcLbdtaf5mo7Ret2EYagqE0t5iUU%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1rLMXIy%2F%2FBurAUA6nSdLPFOzfva4y9%2FzVoZBA%2FffdsM%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8B7AC.6B19A3D0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cf2ebf805d742459ec87208da7c7d3507%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637959174452420394%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=3ByI%2FJJMqW29r5KACgyx3ZtADL%2BIVAd2WsMEUgBq2S0%3D&reserved=0>
Re: Processors Output
Posted by Philipp Zehnder <ph...@bytefabrik.ai>.
Hi Frederico,
do the events have different timestamps? The data is stored in a timeseries database that takes the timestamp as an index.
Usually, you do not need a delay when sending the data. You can call the output collector multiple times after each other.
Cheers,
Philipp
________________________________
Von: Rullo, Federico <Fe...@gft.com>
Gesendet: Donnerstag, August 11, 2022 11:07 AM
An: users@streampipes.apache.org <us...@streampipes.apache.org>
Betreff: RE: Processors Output
Hi Philipp,
Following our conversation and your reply I have tried to implement it.
Before collecting the event I have created a customEvent variable which is an exact copy of the event, the only difference is that the value I send is the one I have calculated, after I collect the customEvent I put a delay of around 500 ms and then collect the regular event, the problem is that the second event overwrites the previous one so I only see one event in the data explorer.
Is there something I am doing wrong? Or is there anything else I have to do before this, maybe configure the OutputCollector?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Philipp Zehnder <ph...@bytefabrik.ai>
Sent: venerdì 5 agosto 2022 16:12
To: users@streampipes.apache.org
Subject: AW: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
in general, it is possible to call the out.collect(event) method multiple times.
Each event will be sent to the following processors.
However, the only restriction is, that the event schema must be the same.
The reason for that is, that the following processor needs to know how an event looks like.
E.g. when a filter component filters the events based on the field “temperature” it must be within the event.
I hope this helps.
Kind regards,
Philipp
Von: Rullo, Federico <Fe...@gft.com>>
Datum: Donnerstag, 4. August 2022 um 15:58
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: RE: Processors Output
Hi Dominik,
Thanks for the reply.
This could work but I was looking for something different.
I was wondering if we could queue one more event before the normal one.
For example, I calculate and obtain a new event that needs to be outputted before the regular one.
Can we call the OutputCollector function explicitly, one call for our calculated event and one for the normal event to maintain the correct TimeSeries?
out.collect(event_custom);
out.collect(event);
Something like this.
Thank in advance for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361656176%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yKYEgLDpWJFwkRnRGOPAa9kjvc6Q6Gq0hyDdndaVdlY%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361656176%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0PXcZRGei%2FHASRfgmL8pp%2BoYr0U6k395Cx32Eu%2BQZHY%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=FGJOD5yEhOYN3%2FQkRhECpIoh348WK1fbekDBqTptueo%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WlE28TzzDAITDIi75anlNyR0BPlWZ4HpIxD2BVYq8LU%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8AD72.70FDFC40]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1wURPfMkXXd9HJcfDVluUDuBnkKvOQQAHueP0BS3PmQ%3D&reserved=0>
From: Dominik Riemer <do...@bytefabrik.ai>>
Sent: martedì 2 agosto 2022 16:33
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: RE: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
I’ve never tried this, but I’d say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let’s say I don’t receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OMaqjIcwdsSCbhH4jivE1LhzGnn2fEmevhAjlpWMv2s%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yRMmD%2Bwb%2FSDkHI31pA%2Bqlg3acV1yKGsotj8Zv1O%2Bl9I%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=FGJOD5yEhOYN3%2FQkRhECpIoh348WK1fbekDBqTptueo%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WlE28TzzDAITDIi75anlNyR0BPlWZ4HpIxD2BVYq8LU%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8AD72.70FDFC40]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1wURPfMkXXd9HJcfDVluUDuBnkKvOQQAHueP0BS3PmQ%3D&reserved=0>
RE: Processors Output
Posted by "Rullo, Federico" <Fe...@gft.com>.
Hi Philipp,
Following our conversation and your reply I have tried to implement it.
Before collecting the event I have created a customEvent variable which is an exact copy of the event, the only difference is that the value I send is the one I have calculated, after I collect the customEvent I put a delay of around 500 ms and then collect the regular event, the problem is that the second event overwrites the previous one so I only see one event in the data explorer.
Is there something I am doing wrong? Or is there anything else I have to do before this, maybe configure the OutputCollector?
Thanks for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Philipp Zehnder <ph...@bytefabrik.ai>
Sent: venerdì 5 agosto 2022 16:12
To: users@streampipes.apache.org
Subject: AW: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Frederico,
in general, it is possible to call the out.collect(event) method multiple times.
Each event will be sent to the following processors.
However, the only restriction is, that the event schema must be the same.
The reason for that is, that the following processor needs to know how an event looks like.
E.g. when a filter component filters the events based on the field "temperature" it must be within the event.
I hope this helps.
Kind regards,
Philipp
Von: Rullo, Federico <Fe...@gft.com>>
Datum: Donnerstag, 4. August 2022 um 15:58
An: users@streampipes.apache.org<ma...@streampipes.apache.org> <us...@streampipes.apache.org>>
Betreff: RE: Processors Output
Hi Dominik,
Thanks for the reply.
This could work but I was looking for something different.
I was wondering if we could queue one more event before the normal one.
For example, I calculate and obtain a new event that needs to be outputted before the regular one.
Can we call the OutputCollector function explicitly, one call for our calculated event and one for the normal event to maintain the correct TimeSeries?
out.collect(event_custom);
out.collect(event);
Something like this.
Thank in advance for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361656176%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yKYEgLDpWJFwkRnRGOPAa9kjvc6Q6Gq0hyDdndaVdlY%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361656176%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=0PXcZRGei%2FHASRfgmL8pp%2BoYr0U6k395Cx32Eu%2BQZHY%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=FGJOD5yEhOYN3%2FQkRhECpIoh348WK1fbekDBqTptueo%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WlE28TzzDAITDIi75anlNyR0BPlWZ4HpIxD2BVYq8LU%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8AD72.70FDFC40]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1wURPfMkXXd9HJcfDVluUDuBnkKvOQQAHueP0BS3PmQ%3D&reserved=0>
From: Dominik Riemer <do...@bytefabrik.ai>>
Sent: martedì 2 agosto 2022 16:33
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: RE: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
I've never tried this, but I'd say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let's say I don't receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=OMaqjIcwdsSCbhH4jivE1LhzGnn2fEmevhAjlpWMv2s%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yRMmD%2Bwb%2FSDkHI31pA%2Bqlg3acV1yKGsotj8Zv1O%2Bl9I%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=FGJOD5yEhOYN3%2FQkRhECpIoh348WK1fbekDBqTptueo%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=WlE28TzzDAITDIi75anlNyR0BPlWZ4HpIxD2BVYq8LU%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8AD72.70FDFC40]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7Cfac0212b0d114e6f796e08da76ec7f09%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637953055361812400%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=1wURPfMkXXd9HJcfDVluUDuBnkKvOQQAHueP0BS3PmQ%3D&reserved=0>
AW: Processors Output
Posted by Philipp Zehnder <ph...@bytefabrik.ai>.
Hi Frederico,
in general, it is possible to call the out.collect(event) method multiple times.
Each event will be sent to the following processors.
However, the only restriction is, that the event schema must be the same.
The reason for that is, that the following processor needs to know how an event looks like.
E.g. when a filter component filters the events based on the field “temperature” it must be within the event.
I hope this helps.
Kind regards,
Philipp
Von: Rullo, Federico <Fe...@gft.com>
Datum: Donnerstag, 4. August 2022 um 15:58
An: users@streampipes.apache.org <us...@streampipes.apache.org>
Betreff: RE: Processors Output
Hi Dominik,
Thanks for the reply.
This could work but I was looking for something different.
I was wondering if we could queue one more event before the normal one.
For example, I calculate and obtain a new event that needs to be outputted before the regular one.
Can we call the OutputCollector function explicitly, one call for our calculated event and one for the normal event to maintain the correct TimeSeries?
out.collect(event_custom);
out.collect(event);
Something like this.
Thank in advance for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it%20>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8A817.6AC095F0]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Dominik Riemer <do...@bytefabrik.ai>
Sent: martedì 2 agosto 2022 16:33
To: users@streampipes.apache.org
Subject: RE: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
I’ve never tried this, but I’d say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let’s say I don’t receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=sRrvfGBq6y8cZaBCrNRPTR%2FgF6gLy6BmKnH2p%2Fn99mE%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMXbpDVFwlIUfHRaXjp9bZnYk4kvWdR2H55SzcGVP5A%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=IozXlwX8xQoZZO%2BDx6TW0u9RhpUS%2Fon6VrEHAgQEGhM%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tnYdYQK74KpRMB5Cptl6oW7MpxK3ntKFSInxGmiPLAI%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all’azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8A817.6AC095F0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gNRXvBtsNmQ%2Fn9HUYxTxVVHuGBfZ7Ov84iDoZ233vho%3D&reserved=0>
RE: Processors Output
Posted by "Rullo, Federico" <Fe...@gft.com>.
Hi Dominik,
Thanks for the reply.
This could work but I was looking for something different.
I was wondering if we could queue one more event before the normal one.
For example, I calculate and obtain a new event that needs to be outputted before the regular one.
Can we call the OutputCollector function explicitly, one call for our calculated event and one for the normal event to maintain the correct TimeSeries?
out.collect(event_custom);
out.collect(event);
Something like this.
Thank in advance for the reply,
Best,
Federico.
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:firmaGPTWdefinitivo_da82df40-8928-4ee9-afd7-5c490fe3d6f0.png]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>
From: Dominik Riemer <do...@bytefabrik.ai>
Sent: martedì 2 agosto 2022 16:33
To: users@streampipes.apache.org
Subject: RE: Processors Output
[EXTERNAL EMAIL]
This email originated from outside of the organization or was sent unauthenticated. Do not click links or open attachments unless you confirm the sender and know the content is safe.
Hi Federico,
I've never tried this, but I'd say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org<ma...@streampipes.apache.org>
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let's say I don't receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.gft.com%2Fit&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=sRrvfGBq6y8cZaBCrNRPTR%2FgF6gLy6BmKnH2p%2Fn99mE%3D&reserved=0>
https://blog.gft.com<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fblog.gft.com%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=yMXbpDVFwlIUfHRaXjp9bZnYk4kvWdR2H55SzcGVP5A%3D&reserved=0>
https://www.linkedin.com/company/gft-group/<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.linkedin.com%2Fcompany%2Fgft-group%2F&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=IozXlwX8xQoZZO%2BDx6TW0u9RhpUS%2Fon6VrEHAgQEGhM%3D&reserved=0>
www.twitter.com/gft_it <https://eur02.safelinks.protection.outlook.com/?url=http%3A%2F%2Fwww.twitter.com%2Fgft_it%2520&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=tnYdYQK74KpRMB5Cptl6oW7MpxK3ntKFSInxGmiPLAI%3D&reserved=0>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8A817.6AC095F0]<https://eur02.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.gft.com%2Fit%2Fit%2Fsolutions%2FSOLUTIONS%2Fit%2FIT-Metaverso&data=05%7C01%7CFederico.Rullo%40gft.com%7C20e6719bd386494c906208da7493e0df%7C55a2bc67aec14ad29a9c5b2457b91dcd%7C0%7C0%7C637950475731729021%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=gNRXvBtsNmQ%2Fn9HUYxTxVVHuGBfZ7Ov84iDoZ233vho%3D&reserved=0>
RE: Processors Output
Posted by Dominik Riemer <do...@bytefabrik.ai>.
Hi Federico,
I've never tried this, but I'd say it could work by having a scheduled timer or something like that which is started upon pipeline invocation and runs in a separate thread. Once the pipeline is stopped, you would need to stop the timer to make sure no further events are sent.
Best,
Dominik
From: Rullo, Federico <Fe...@gft.com>
Sent: Tuesday, August 2, 2022 2:18 PM
To: users@streampipes.apache.org
Subject: Processors Output
Hello everyone,
I was wondering if it is possible to have a function being activated and outputting results without receiving and event as an input to activate functions such as OnEvent.
For example let's say I don't receive any inputs in a given time window and I want to output a fictional value to fill this gap, is it possible to output such event without receiving any input? If so, how can I do it?
Thanks in advance for your reply,
Best,
Federico
Federico Rullo
_________________________________________________________________
GFT Italia S.r.l.
Via A. Rimassa, 51/2
16129 Genova, Italy
T +39 025 8158169
Federico.Rullo@gft.com<ma...@gft.com>
www.gft.com/it<http://www.gft.com/it>
https://blog.gft.com
https://www.linkedin.com/company/gft-group/
www.twitter.com/gft_it <http://www.twitter.com/gft_it%20>
Registered office: GFT Italia S.r.l., Via Sile 18, 20139 Milan (Italy)
VAT Code and number of registration with the Companies' Register of Milan: 00819200478
Corporate capital: Euro 1,000,000 fully paid-in
Company subject to the direction and coordination activity of GFT Technologies SE
Ai sensi del Regolamento UE 2016/679 (GDPR) e delle Linee Guida per posta elettronica ed Internet del Garante Privacy si rende noto che le informazioni contenute nella presente comunicazione e i relativi allegati possono essere riservate e sono, comunque, destinate esclusivamente alle persone o alla Società sopraindicati. Le stesse non sono da considerarsi comunicazioni personali, quindi eventuali risposte potranno essere conosciute da persone appartenenti all'azienda.
In accordance with Regulation EU 2016/679 (General Data Protection Regulation) and Guidelines Applying to the Use of E-Mails and the Internet in the Employment Context of Italian Data Protection Authority it is announced that the information in this communication (which includes any documents with it) is confidential and meant only for above-mentioned persons and/or Companies; the information is not personal therefore, It is intended for the addressee only and any replies will be known by people belonging to the company.
_________________________________________________________________
[cid:image001.png@01D8A68D.790F6040]<https://www.gft.com/it/it/solutions/SOLUTIONS/it/IT-Metaverso>