You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Jingsong Lee (Jira)" <ji...@apache.org> on 2019/11/15 03:29:00 UTC
[jira] [Updated] (FLINK-14676) Introduce parallelism inference for
source
[ https://issues.apache.org/jira/browse/FLINK-14676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jingsong Lee updated FLINK-14676:
---------------------------------
Summary: Introduce parallelism inference for source (was: Introduce parallelism inference for InputFormatTableSource)
> Introduce parallelism inference for source
> ------------------------------------------
>
> Key: FLINK-14676
> URL: https://issues.apache.org/jira/browse/FLINK-14676
> Project: Flink
> Issue Type: Sub-task
> Components: Table SQL / Planner
> Reporter: Jingsong Lee
> Assignee: Jingsong Lee
> Priority: Major
> Labels: pull-request-available
> Time Spent: 10m
> Remaining Estimate: 0h
>
> FLINK-12801 has introduce parallelism setting for table, but because TableSource generate DataStream, maybe DataStream is not a real source, that will lead to some shuffle errors. So FLINK-13494 remove these implementations.
> In this ticket, I would like to introduce parallelism inference only for InputFormatTableSource, the RowCount of InputFormatTableSource is more accurate than downstream stages. It is worth to automatically generate its parallelism.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)