You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by GREEN <12...@qq.com.INVALID> on 2023/04/14 07:55:45 UTC

[DISCUSS FLINKSQL PARALLELISM]

Problem：&nbsp;


Currently, FlinkSQL can&nbsp; set a unified parallelism in the job,it cannot set parallelism for each operator.
This can cause resource waste&nbsp; On the occasion of&nbsp; high parallelism and small data volume.there may also be too many small file&nbsp; for&nbsp; writing HDFS Scene.


Solution：
I can modify FlinkSQL to support parallelism.Is it meaningful to do this？Let's discuss.