You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Henry Saputra <he...@gmail.com> on 2015/03/31 22:28:50 UTC
[QUESTION] In the DataExchangeMode.BATCH how does the consumer being
notified to start consumer the data?
HI Flinksters,
Have one quick question, hopefully someone could help me get some answers:
When is the DataExchangeMode.BATCH is actually being used, and how
does the consumer know when to start consuming the buffer
In the pipelined mode, the producer tell JobManager via JobManager !
ScheduleOrUpdateConsumers to create network connection. But I could
not find trigger for blocking/ batch mode of execution.
- Henry
Re: [QUESTION] In the DataExchangeMode.BATCH how does the consumer
being notified to start consumer the data?
Posted by Henry Saputra <he...@gmail.com>.
Ah cool. Thanks for the explanation, Ufuk.
Really helpful.
- Henry
On Tuesday, March 31, 2015, Ufuk Celebi <uc...@apache.org> wrote:
> Hey Henry,
>
> 1) There is no extra message, but this is piggy backed with the finished
> state transition (see Execution#markAsFinished). There it is essentially
> the same mechanism.
>
> 2) It's part of my plan for this week to add documentation for exactly
> this flow of RPC messages related to the runtime results.
>
> – Ufuk
>
> On Tuesday, March 31, 2015, Henry Saputra <henry.saputra@gmail.com
> <javascript:;>> wrote:
>
> > HI Flinksters,
> >
> > Have one quick question, hopefully someone could help me get some
> answers:
> >
> > When is the DataExchangeMode.BATCH is actually being used, and how
> > does the consumer know when to start consuming the buffer
> >
> > In the pipelined mode, the producer tell JobManager via JobManager !
> > ScheduleOrUpdateConsumers to create network connection. But I could
> > not find trigger for blocking/ batch mode of execution.
> >
> > - Henry
> >
>
Re: [QUESTION] In the DataExchangeMode.BATCH how does the consumer
being notified to start consumer the data?
Posted by Ufuk Celebi <uc...@apache.org>.
Hey Henry,
1) There is no extra message, but this is piggy backed with the finished
state transition (see Execution#markAsFinished). There it is essentially
the same mechanism.
2) It's part of my plan for this week to add documentation for exactly
this flow of RPC messages related to the runtime results.
– Ufuk
On Tuesday, March 31, 2015, Henry Saputra <he...@gmail.com> wrote:
> HI Flinksters,
>
> Have one quick question, hopefully someone could help me get some answers:
>
> When is the DataExchangeMode.BATCH is actually being used, and how
> does the consumer know when to start consuming the buffer
>
> In the pipelined mode, the producer tell JobManager via JobManager !
> ScheduleOrUpdateConsumers to create network connection. But I could
> not find trigger for blocking/ batch mode of execution.
>
> - Henry
>