You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Taher Koitawala <ta...@gmail.com> on 2025/03/02 09:40:11 UTC
Flink vs beam-flink-runner benchmark
Hi All,
Curious question! Has someone done a benchmark on native flink vs
beam-flink-runner?
Im wanting to know or ask, if there are differences in the following areas(
Consider Streaming only)
1. Network stack
2. Operators
3. Usecases that would be faster in flink or beam flink runner
4. Chaining
I ask this to assess what is a better approach for us as we are wanting to
choose an engine for our stream processing platform.
Regards,
Taher Koitawala
Re: Flink vs beam-flink-runner benchmark
Posted by XQ Hu via dev <de...@beam.apache.org>.
From the Beam side, I am not aware we have any benchmark about the native
Flink vs FlinkRunner.
Beam does regularly run some benchmarks with FlinkRunner using the GitHub
workflows: https://github.com/apache/beam/tree/master/.github/workflows
On Tue, Mar 4, 2025 at 9:42 AM Taher Koitawala <ta...@gmail.com> wrote:
> Any help here?
>
>
> On Sun, 2 Mar 2025 at 1:40 PM, Taher Koitawala <ta...@gmail.com> wrote:
>
>> Hi All,
>> Curious question! Has someone done a benchmark on native flink
>> vs beam-flink-runner?
>>
>> Im wanting to know or ask, if there are differences in the following
>> areas( Consider Streaming only)
>> 1. Network stack
>> 2. Operators
>> 3. Usecases that would be faster in flink or beam flink runner
>> 4. Chaining
>>
>> I ask this to assess what is a better approach for us as we are wanting
>> to choose an engine for our stream processing platform.
>>
>>
>> Regards,
>> Taher Koitawala
>>
>
Re: Flink vs beam-flink-runner benchmark
Posted by XQ Hu <xq...@google.com.INVALID>.
From the Beam side, I am not aware we have any benchmark about the native
Flink vs FlinkRunner.
Beam does regularly run some benchmarks with FlinkRunner using the GitHub
workflows: https://github.com/apache/beam/tree/master/.github/workflows
On Tue, Mar 4, 2025 at 9:42 AM Taher Koitawala <ta...@gmail.com> wrote:
> Any help here?
>
>
> On Sun, 2 Mar 2025 at 1:40 PM, Taher Koitawala <ta...@gmail.com> wrote:
>
>> Hi All,
>> Curious question! Has someone done a benchmark on native flink
>> vs beam-flink-runner?
>>
>> Im wanting to know or ask, if there are differences in the following
>> areas( Consider Streaming only)
>> 1. Network stack
>> 2. Operators
>> 3. Usecases that would be faster in flink or beam flink runner
>> 4. Chaining
>>
>> I ask this to assess what is a better approach for us as we are wanting
>> to choose an engine for our stream processing platform.
>>
>>
>> Regards,
>> Taher Koitawala
>>
>
Re: Flink vs beam-flink-runner benchmark
Posted by Taher Koitawala <ta...@gmail.com>.
Any help here?
On Sun, 2 Mar 2025 at 1:40 PM, Taher Koitawala <ta...@gmail.com> wrote:
> Hi All,
> Curious question! Has someone done a benchmark on native flink
> vs beam-flink-runner?
>
> Im wanting to know or ask, if there are differences in the following
> areas( Consider Streaming only)
> 1. Network stack
> 2. Operators
> 3. Usecases that would be faster in flink or beam flink runner
> 4. Chaining
>
> I ask this to assess what is a better approach for us as we are wanting to
> choose an engine for our stream processing platform.
>
>
> Regards,
> Taher Koitawala
>
Re: Flink vs beam-flink-runner benchmark
Posted by Taher Koitawala <ta...@gmail.com>.
Any help here?
On Sun, 2 Mar 2025 at 1:40 PM, Taher Koitawala <ta...@gmail.com> wrote:
> Hi All,
> Curious question! Has someone done a benchmark on native flink
> vs beam-flink-runner?
>
> Im wanting to know or ask, if there are differences in the following
> areas( Consider Streaming only)
> 1. Network stack
> 2. Operators
> 3. Usecases that would be faster in flink or beam flink runner
> 4. Chaining
>
> I ask this to assess what is a better approach for us as we are wanting to
> choose an engine for our stream processing platform.
>
>
> Regards,
> Taher Koitawala
>