[jira] [Created] (FLINK-17392) enable configuring minicluster in Flink SQL in IDE

["Bowen Li (Jira)" <ji...@apache.org>]

Bowen Li created FLINK-17392:
--------------------------------

             Summary: enable configuring minicluster in Flink SQL in IDE
                 Key: FLINK-17392
                 URL: https://issues.apache.org/jira/browse/FLINK-17392
             Project: Flink
          Issue Type: Improvement
          Components: Table SQL / API
    Affects Versions: 1.11.0
            Reporter: Bowen Li
            Assignee: Kurt Young
             Fix For: 1.11.0


It's very common case that users who want to learn and test Flink SQL will try to run a SQL job in IDE like Intellij, with Flink minicluster. Currently it's fine to do so with a simple job requiring only one task slot, which is the default resource config of minicluster.

However, users cannot run even a little bit more complicated job since they cannot configure task slots of minicluster thru Flink SQL, e.g. single parallelism job requires shuffle. This incapability has been very frustrating to new users.

There are two solutions to this problem:
- in minicluster, if it is single parallelism job, then chain all operators together
- enable configuring minicluster in Flink SQL in IDE.

The latter feels more proper.

Expected: users can configure minicluster resources via either SQL ("set ...=...") or TableEnvironment ("tEnv.setMiniclusterResources(..., ...)"). 

[~jark] [~lzljs3620320]




--
This message was sent by Atlassian Jira
(v8.3.4#803005)