You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Gary Yao (Jira)" <ji...@apache.org> on 2020/01/29 13:40:00 UTC

[jira] [Commented] (FLINK-15781) Manual Smoke Test with Batch Job

    [ https://issues.apache.org/jira/browse/FLINK-15781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17025876#comment-17025876 ] 

Gary Yao commented on FLINK-15781:
----------------------------------

I tested with an adapted version of {{DataSetAllroundTestProgram}} with a parallelism of 100 and load factor 100, 200, and 500. Furthermore, I tested ExecutionModes {{BATCH}} and {{PIPELINED}} with all aforementioned load factors. Flink was deployed on a YARN cluster hosted on AWS EMR with 25 m5.xlarge NodeManagers. The job finished reliably in all configurations.

> Manual Smoke Test with Batch Job
> --------------------------------
>
>                 Key: FLINK-15781
>                 URL: https://issues.apache.org/jira/browse/FLINK-15781
>             Project: Flink
>          Issue Type: Task
>    Affects Versions: 1.10.0
>            Reporter: Gary Yao
>            Assignee: Gary Yao
>            Priority: Critical
>
> Try out a (larger) scale batch job with {{"jobmanager.scheduler: ng"}} enabled in {{flink-conf.yaml}}.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)