You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user-zh@flink.apache.org by 李航飞 <te...@163.com> on 2021/08/25 08:38:53 UTC

mini-batch配置信息没产生效果


Configuration conf = new Configuration();
conf.setString("table.exec.mini-batch.enabled","true");
conf.setString("table.exec.mini-batch.allow-latency","15s");
conf.setString("table.exec.mini-batch.size","50");


StreamExecutionEnvironment execEnv = StreamExecutionEnvironment.getExecutionEnvironment();
execEnv.configure(conf,this.getClass().getClassLoader());
EnvironmentSetting setting = ...
StreamTableEnvironment.create(execEnv,setting);


基于flink1.13.2
微批配置信息如上,kafka流数据,测试效果数据计算没有延迟15s 

Re:mini-batch配置信息没产生效果

Posted by 东东 <do...@163.com>.


这里说得很清楚,只是"allow"的最大latency,并不是固定这么长


|
table.exec.mini-batch.allow-latency

Streaming | 0 ms | Duration | The maximum latency can be used for MiniBatch to buffer input records. MiniBatch is an optimization to buffer input records to reduce state access. MiniBatch is triggered with the allowed latency interval and when the maximum number of buffered records reached. NOTE: If table.exec.mini-batch.enabled is set true, its value must be greater than zero. |








在 2021-08-25 16:38:53,"李航飞" <te...@163.com> 写道:
>
>
>Configuration conf = new Configuration();
>conf.setString("table.exec.mini-batch.enabled","true");
>conf.setString("table.exec.mini-batch.allow-latency","15s");
>conf.setString("table.exec.mini-batch.size","50");
>
>
>StreamExecutionEnvironment execEnv = StreamExecutionEnvironment.getExecutionEnvironment();
>execEnv.configure(conf,this.getClass().getClassLoader());
>EnvironmentSetting setting = ...
>StreamTableEnvironment.create(execEnv,setting);
>
>
>基于flink1.13.2
>微批配置信息如上,kafka流数据,测试效果数据计算没有延迟15s