You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "swy (JIRA)" <ji...@apache.org> on 2018/06/15 14:59:00 UTC

[jira] [Created] (FLINK-9597) Flink fail to scale!

swy created FLINK-9597:
--------------------------

             Summary: Flink fail to scale!
                 Key: FLINK-9597
                 URL: https://issues.apache.org/jira/browse/FLINK-9597
             Project: Flink
          Issue Type: Bug
          Components: Core
    Affects Versions: 1.5.0
            Reporter: swy


Hi, we found that our Flink application with simple logic, which using process function is not scale-able when scale from 8 parallelism onward even though with sufficient resources. Below it the result where is capped at around 250k TPS. No matter how we tune the parallelism of the operators it just not work, same to increase source parallelism.

Please refer to "scaleNotWork.png"
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8
1. fixed source parallelism 4, other operators parallelism 8





--
This message was sent by Atlassian JIRA
(v7.6.3#76005)