You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by CPC <ac...@gmail.com> on 2016/06/16 14:46:25 UTC
DagConnection tempMode vs breakPipeline property
Hi everybody,
I am trying to understand flink optimizer in DataSet api. But i dont
understant tempMode and breakPipeline properties. TempMode enum also has a
breakPipeline property but they both accessed and set in different places.
DagConnection.breakPipeline is used to select network io DataExchangeMode.
Though i dont understand DagConnection.TempMode and also tempMode in
Channel. Could somebody explain why there is two different breakPipeline
property and the duty of TempMode. Thank you in advance.
Re: DagConnection tempMode vs breakPipeline property
Posted by CPC <ac...@gmail.com>.
Thank you ufuk. Yes it helps alot. Yardımın için teşekkürler.
On Jul 4, 2016 2:02 PM, "Ufuk Celebi" <uc...@apache.org> wrote:
> The data exchange mode has been introduced recently as a replacement
> for the pipeline break logic, which was buggy. I'm not too familiar
> with the optimizer, but I would expect everything that goes back to
> the DataExchangeMode to be correct. The rest should be an artifact of
> the old pipeline breaker logic and not be used any more. Does this
> help in any way?
>
> On Thu, Jun 16, 2016 at 4:46 PM, CPC <ac...@gmail.com> wrote:
> > Hi everybody,
> >
> > I am trying to understand flink optimizer in DataSet api. But i dont
> > understant tempMode and breakPipeline properties. TempMode enum also has
> a
> > breakPipeline property but they both accessed and set in different
> places.
> > DagConnection.breakPipeline is used to select network io
> DataExchangeMode.
> > Though i dont understand DagConnection.TempMode and also tempMode in
> > Channel. Could somebody explain why there is two different breakPipeline
> > property and the duty of TempMode. Thank you in advance.
>
Re: DagConnection tempMode vs breakPipeline property
Posted by Ufuk Celebi <uc...@apache.org>.
The data exchange mode has been introduced recently as a replacement
for the pipeline break logic, which was buggy. I'm not too familiar
with the optimizer, but I would expect everything that goes back to
the DataExchangeMode to be correct. The rest should be an artifact of
the old pipeline breaker logic and not be used any more. Does this
help in any way?
On Thu, Jun 16, 2016 at 4:46 PM, CPC <ac...@gmail.com> wrote:
> Hi everybody,
>
> I am trying to understand flink optimizer in DataSet api. But i dont
> understant tempMode and breakPipeline properties. TempMode enum also has a
> breakPipeline property but they both accessed and set in different places.
> DagConnection.breakPipeline is used to select network io DataExchangeMode.
> Though i dont understand DagConnection.TempMode and also tempMode in
> Channel. Could somebody explain why there is two different breakPipeline
> property and the duty of TempMode. Thank you in advance.