You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "Fabian Hueske (Jira)" <ji...@apache.org> on 2019/09/06 12:26:00 UTC

[jira] [Commented] (FLINK-12749) Getting Started - Docker Playgrounds - Flink Cluster Playground

    [ https://issues.apache.org/jira/browse/FLINK-12749?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924205#comment-16924205 ] 

Fabian Hueske commented on FLINK-12749:
---------------------------------------

Playground job code removed from master (1.10) with 8998b2fe286d4ac788011f03fc6953f8b040b119
Playground readded to master with a17623ba51f7cae83bc789cd4f8ffc7f105a8715

added to release-1.9 with cd756d6609064254cfe50191635ea762af477793
added to release-1.8 with 9868ae1dde0ac6709b4b7a8afa6e7121cfb72b4d

> Getting Started - Docker Playgrounds - Flink Cluster Playground
> ---------------------------------------------------------------
>
>                 Key: FLINK-12749
>                 URL: https://issues.apache.org/jira/browse/FLINK-12749
>             Project: Flink
>          Issue Type: Sub-task
>          Components: Documentation
>            Reporter: Konstantin Knauf
>            Assignee: Konstantin Knauf
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 1.10.0
>
>          Time Spent: 1h 20m
>  Remaining Estimate: 0h
>
> The planned structure for the new Getting Started Guide is
> * Flink Overview (~ two pages)
> * Project Setup
> ** Java
> ** Scala
> ** Python
> * Quickstarts
> ** Example Walkthrough - Table API / SQL
> ** Example Walkthrough - DataStream API
> * Docker Playgrounds
> ** Flink Cluster Playground
> ** Flink Interactive SQL Playground
> In this ticket we add the Flink Cluster Playground, a docker-compose based setup consisting of Apache Kafka and Apache Flink (Flink Session Cluster), including a step-by-step guide for some common commands (job submission, savepoints, etc).
> *Some Open Questions:*
> * Which Flink images to use? `library/flink` with dynamic properties would be the most maintainable, I think. It would be preferable, if we don't need to host any custom images for this, but can rely on the existing plain Flink images.
> * Which Flink jobs to use? An updated version {{org.apache.flink.streaming.examples.statemachine.StateMachineExample}} might be a good option as it can with or without Kafka and contains a data generator writing to Kafka already (see next questions).
> * How to get data into Kafka? Maybe just provide a small bash script/one-liner to produce into Kafka topic or see question above.
> * Which Kafka Images to use? https://hub.docker.com/r/wurstmeister/kafka/ seems to be well-maintained and is openly available.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)