You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Taher Koitawala <ta...@gslab.com> on 2019/02/27 07:35:48 UTC
Split Stream on a Split Stream
Hi All,
We are currently working with Flink 1.7.2 version and we are get
the below given exception when doing a split on a split.
SplitStream<String>splitStream=stream1.split(new SomeSplitLogic());
DataStream select1=splitStream.select("1");
DataStream select2=splitStream.select("2");
select2.split(new AnotherSplitLogic()).select("3");
Basically the exception is recommending to use SideOutput, however the only
way I see to get a side output is by using a process function. Can someone
suggest a better way of doing this?
Exception :
Caused by: java.lang.IllegalStateException: Consecutive multiple splits
are not supported. Splits are deprecated. Please use side-outputs
Regards,
Taher Koitawala
GS Lab Pune
+91 8407979163
Re: Split Stream on a Split Stream
Posted by Taher Koitawala <ta...@gslab.com>.
No particular reason for not using the process function, just wanted to
clarify if that was the correct way to do it. Thanks Knauf.
Regards,
Taher Koitawala
GS Lab Pune
+91 8407979163
On Wed, Feb 27, 2019 at 8:23 PM Konstantin Knauf <ko...@ververica.com>
wrote:
> Hi Taher ,
>
> a ProcessFunction is actually the way to do this. When chained to the
> previous operator the overhead of such a ProcessFunction in negligible.
>
> Any particular reason you don't want to go for a ProcessFunctio?
>
> Cheers,
>
> Konstantin
>
> On Wed, Feb 27, 2019 at 8:36 AM Taher Koitawala <ta...@gslab.com>
> wrote:
>
>> Hi All,
>> We are currently working with Flink 1.7.2 version and we are
>> get the below given exception when doing a split on a split.
>>
>> SplitStream<String>splitStream=stream1.split(new SomeSplitLogic());
>>
>> DataStream select1=splitStream.select("1");
>> DataStream select2=splitStream.select("2");
>>
>>
>> select2.split(new AnotherSplitLogic()).select("3");
>>
>>
>> Basically the exception is recommending to use SideOutput, however the
>> only way I see to get a side output is by using a process function. Can
>> someone suggest a better way of doing this?
>>
>> Exception :
>> Caused by: java.lang.IllegalStateException: Consecutive multiple splits
>> are not supported. Splits are deprecated. Please use side-outputs
>>
>>
>> Regards,
>> Taher Koitawala
>> GS Lab Pune
>> +91 8407979163
>>
>
>
> --
>
> Konstantin Knauf | Solutions Architect
>
> +49 160 91394525
>
> <https://www.ververica.com/>
>
> Follow us @VervericaData
>
> --
>
> Join Flink Forward <https://flink-forward.org/> - The Apache Flink
> Conference
>
> Stream Processing | Event Driven | Real Time
>
> --
>
> Data Artisans GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
>
> --
> Data Artisans GmbH
> Registered at Amtsgericht Charlottenburg: HRB 158244 B
> Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen
>
Re: Split Stream on a Split Stream
Posted by Konstantin Knauf <ko...@ververica.com>.
Hi Taher ,
a ProcessFunction is actually the way to do this. When chained to the
previous operator the overhead of such a ProcessFunction in negligible.
Any particular reason you don't want to go for a ProcessFunctio?
Cheers,
Konstantin
On Wed, Feb 27, 2019 at 8:36 AM Taher Koitawala <ta...@gslab.com>
wrote:
> Hi All,
> We are currently working with Flink 1.7.2 version and we are get
> the below given exception when doing a split on a split.
>
> SplitStream<String>splitStream=stream1.split(new SomeSplitLogic());
>
> DataStream select1=splitStream.select("1");
> DataStream select2=splitStream.select("2");
>
>
> select2.split(new AnotherSplitLogic()).select("3");
>
>
> Basically the exception is recommending to use SideOutput, however the
> only way I see to get a side output is by using a process function. Can
> someone suggest a better way of doing this?
>
> Exception :
> Caused by: java.lang.IllegalStateException: Consecutive multiple splits
> are not supported. Splits are deprecated. Please use side-outputs
>
>
> Regards,
> Taher Koitawala
> GS Lab Pune
> +91 8407979163
>
--
Konstantin Knauf | Solutions Architect
+49 160 91394525
<https://www.ververica.com/>
Follow us @VervericaData
--
Join Flink Forward <https://flink-forward.org/> - The Apache Flink
Conference
Stream Processing | Event Driven | Real Time
--
Data Artisans GmbH | Invalidenstrasse 115, 10115 Berlin, Germany
--
Data Artisans GmbH
Registered at Amtsgericht Charlottenburg: HRB 158244 B
Managing Directors: Dr. Kostas Tzoumas, Dr. Stephan Ewen