You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by Márton Balassi <ba...@gmail.com> on 2016/03/09 12:38:13 UTC
Accessing the Configuration
Hey,
I was wondering whether there is a way to access the Configuration from an
(Stream)ExecutionEnviroment or a RichFunction. Practically I would like to
set a temporary persist path in the Configuration and access the location
somewhere during the topology.
I have followed the way the streaming checkpointdir is used, but it goes
through the getEnvironment() function of the AbstractInvokable, a path that
is rather low level for my use case.
Thanks,
Marton
Re: Accessing the Configuration
Posted by Michal Fijolek <mi...@gmail.com>.
Oh I see now
thanks!
--
View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Accessing-the-Configuration-tp10696p10760.html
Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.
Re: Accessing the Configuration
Posted by Robert Metzger <rm...@apache.org>.
No, the RichFunction.open(Configuration) parameter is a feature from the
DataSet API. Its for passing an operator-specific configuration through the
".withParameters(Configuration)" method.
For more infos, just search for "withParameters" here:
https://ci.apache.org/projects/flink/flink-docs-master/apis/batch/index.html
On Sun, Mar 13, 2016 at 12:22 PM, Michal Fijolek <mi...@gmail.com>
wrote:
> Isn't it what RichFunction.open(Configuration parameters) is for?
>
>
>
> --
> View this message in context:
> http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Accessing-the-Configuration-tp10696p10756.html
> Sent from the Apache Flink Mailing List archive. mailing list archive at
> Nabble.com.
>
Re: Accessing the Configuration
Posted by Michal Fijolek <mi...@gmail.com>.
Isn't it what RichFunction.open(Configuration parameters) is for?
--
View this message in context: http://apache-flink-mailing-list-archive.1008284.n3.nabble.com/Accessing-the-Configuration-tp10696p10756.html
Sent from the Apache Flink Mailing List archive. mailing list archive at Nabble.com.
Re: Accessing the Configuration
Posted by Márton Balassi <ba...@gmail.com>.
Thanks for the clarification.
On Wed, Mar 9, 2016 at 2:00 PM, Stephan Ewen <se...@apache.org> wrote:
> I think that is not possible currently. Would not be too hard to give
> access to the TM config via the RuntimeContext (in a similar way as the
> user code classloader, for example).
>
> On Wed, Mar 9, 2016 at 12:38 PM, Márton Balassi <ba...@gmail.com>
> wrote:
>
> > Hey,
> >
> > I was wondering whether there is a way to access the Configuration from
> an
> > (Stream)ExecutionEnviroment or a RichFunction. Practically I would like
> to
> > set a temporary persist path in the Configuration and access the location
> > somewhere during the topology.
> >
> > I have followed the way the streaming checkpointdir is used, but it goes
> > through the getEnvironment() function of the AbstractInvokable, a path
> that
> > is rather low level for my use case.
> >
> > Thanks,
> >
> > Marton
> >
>
Re: Accessing the Configuration
Posted by Stephan Ewen <se...@apache.org>.
I think that is not possible currently. Would not be too hard to give
access to the TM config via the RuntimeContext (in a similar way as the
user code classloader, for example).
On Wed, Mar 9, 2016 at 12:38 PM, Márton Balassi <ba...@gmail.com>
wrote:
> Hey,
>
> I was wondering whether there is a way to access the Configuration from an
> (Stream)ExecutionEnviroment or a RichFunction. Practically I would like to
> set a temporary persist path in the Configuration and access the location
> somewhere during the topology.
>
> I have followed the way the streaming checkpointdir is used, but it goes
> through the getEnvironment() function of the AbstractInvokable, a path that
> is rather low level for my use case.
>
> Thanks,
>
> Marton
>