You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Steven Nelson <sn...@sourceallies.com> on 2019/06/18 16:02:14 UTC
Flink error handling
Hello!
We are internally having a debate on how best to handle exceptions within our operators. Some advocate for wrapping maps/flatMaps inside a processfunction and sending the error to a side output. Other options are returning a custom Either that gets filtered and mapped into different sinks.
Are there any recommendations or standard solutions to this?
-Steve
Re: Flink error handling
Posted by Steven Nelson <sn...@sourceallies.com>.
We ended up using side outputs for now and basically implementing our own map/flatMap that internally uses a ProcessFunction.
Sent from my iPhone
> On Jul 3, 2019, at 6:02 AM, Halfon, Roey <ro...@sap.com> wrote:
>
> Hi,
> Do you have any progress with that?
>
> -----Original Message-----
> From: Steven Nelson <sn...@sourceallies.com>
> Sent: Tuesday, June 18, 2019 7:02 PM
> To: user@flink.apache.org
> Subject: Flink error handling
>
>
> Hello!
>
> We are internally having a debate on how best to handle exceptions within our operators. Some advocate for wrapping maps/flatMaps inside a processfunction and sending the error to a side output. Other options are returning a custom Either that gets filtered and mapped into different sinks.
>
> Are there any recommendations or standard solutions to this?
>
> -Steve
RE: Flink error handling
Posted by "Halfon, Roey" <ro...@sap.com>.
Hi,
Do you have any progress with that?
-----Original Message-----
From: Steven Nelson <sn...@sourceallies.com>
Sent: Tuesday, June 18, 2019 7:02 PM
To: user@flink.apache.org
Subject: Flink error handling
Hello!
We are internally having a debate on how best to handle exceptions within our operators. Some advocate for wrapping maps/flatMaps inside a processfunction and sending the error to a side output. Other options are returning a custom Either that gets filtered and mapped into different sinks.
Are there any recommendations or standard solutions to this?
-Steve