You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@apex.apache.org by "Ganelin, Ilya" <Il...@capitalone.com> on 2016/05/19 17:04:53 UTC
Get ApplicationId from inside Application
Hi all – is it possible to retrieve the Apex application ID: e.g.application_1463594017097_0024 within the Apex program? For example from the DAG object or some other object?
________________________________________________________
The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Re: Get ApplicationId from inside Application
Posted by Sandeep Deshmukh <sa...@datatorrent.com>.
The populateDAG function is invoked before it is submitted to YARN. So the
app id not assigned yet.
Hi guys - when I try to retrieve the application id with:
("{ApplicationId=" + dag.getValue(Context.DAGContext.APPLICATION_ID) +
"}\n”) the applicationId is reported as null.
I’m trying to run this inside of the “populateDAG” function.
Am I doing something wrong?
On 5/19/16, 11:20 AM, "Gaurav Gupta" <ga...@gmail.com> wrote:
>In an operator you can get it using
>
>String appid = Context.OperatorContext.getValue(Context.DAGContext.
>APPLICATION_ID);
>
>On Thu, May 19, 2016 at 11:04 AM, David Yan <da...@datatorrent.com> wrote:
>
>> Specifically, you can try:
>>
>> String appid = dag.getValue(DAGContext.APPLICATION_ID);
>>
>> David
>>
>> On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <sa...@datatorrent.com>
>> wrote:
>>
>> > Yes, use the conf object passed to StreamingApplication.
>> >
>> > On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <
>> Ilya.Ganelin@capitalone.com>
>> > wrote:
>> >
>> > > Hi all – is it possible to retrieve the Apex application ID:
>> > > e.g.application_1463594017097_0024 within the Apex program? For
example
>> > > from the DAG object or some other object?
>> > > ________________________________________________________
>> > >
>> > > The information contained in this e-mail is confidential and/or
>> > > proprietary to Capital One and/or its affiliates and may only be used
>> > > solely in performance of work or services for Capital One. The
>> > information
>> > > transmitted herewith is intended only for use by the individual or
>> entity
>> > > to which it is addressed. If the reader of this message is not the
>> > intended
>> > > recipient, you are hereby notified that any review, retransmission,
>> > > dissemination, distribution, copying or other use of, or taking of
any
>> > > action in reliance upon this information is strictly prohibited. If
you
>> > > have received this communication in error, please contact the sender
>> and
>> > > delete the material from your computer.
>> > >
>> >
>>
________________________________________________________
The information contained in this e-mail is confidential and/or proprietary
to Capital One and/or its affiliates and may only be used solely in
performance of work or services for Capital One. The information
transmitted herewith is intended only for use by the individual or entity
to which it is addressed. If the reader of this message is not the intended
recipient, you are hereby notified that any review, retransmission,
dissemination, distribution, copying or other use of, or taking of any
action in reliance upon this information is strictly prohibited. If you
have received this communication in error, please contact the sender and
delete the material from your computer.
Re: Get ApplicationId from inside Application
Posted by David Yan <da...@datatorrent.com>.
Right. If you want to change an operator property according to the app id,
you can do it in the setup method in the operator, using the operator
context.
David
On Wed, May 25, 2016 at 11:26 AM, Munagala Ramanath <ra...@datatorrent.com>
wrote:
> You can't do it in populateDAG since the id is not known when that function
> runs.
>
> You need to do it in the operator as suggested by Gaurav:
>
> String appid = Context.OperatorContext.getValue(Context.DAGContext.
> APPLICATION_ID);
>
> Ram
>
> On Wed, May 25, 2016 at 11:00 AM, Ganelin, Ilya <
> Ilya.Ganelin@capitalone.com
> > wrote:
>
> > Hi guys - when I try to retrieve the application id with:
> > ("{ApplicationId=" + dag.getValue(Context.DAGContext.APPLICATION_ID) +
> > "}\n”) the applicationId is reported as null.
> >
> >
> >
> > I’m trying to run this inside of the “populateDAG” function.
> >
> > Am I doing something wrong?
> >
> > On 5/19/16, 11:20 AM, "Gaurav Gupta" <ga...@gmail.com> wrote:
> >
> > >In an operator you can get it using
> > >
> > >String appid = Context.OperatorContext.getValue(Context.DAGContext.
> > >APPLICATION_ID);
> > >
> > >On Thu, May 19, 2016 at 11:04 AM, David Yan <da...@datatorrent.com>
> > wrote:
> > >
> > >> Specifically, you can try:
> > >>
> > >> String appid = dag.getValue(DAGContext.APPLICATION_ID);
> > >>
> > >> David
> > >>
> > >> On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <
> > sandesh@datatorrent.com>
> > >> wrote:
> > >>
> > >> > Yes, use the conf object passed to StreamingApplication.
> > >> >
> > >> > On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <
> > >> Ilya.Ganelin@capitalone.com>
> > >> > wrote:
> > >> >
> > >> > > Hi all – is it possible to retrieve the Apex application ID:
> > >> > > e.g.application_1463594017097_0024 within the Apex program? For
> > example
> > >> > > from the DAG object or some other object?
> > >> > > ________________________________________________________
> > >> > >
> > >> > > The information contained in this e-mail is confidential and/or
> > >> > > proprietary to Capital One and/or its affiliates and may only be
> > used
> > >> > > solely in performance of work or services for Capital One. The
> > >> > information
> > >> > > transmitted herewith is intended only for use by the individual or
> > >> entity
> > >> > > to which it is addressed. If the reader of this message is not the
> > >> > intended
> > >> > > recipient, you are hereby notified that any review,
> retransmission,
> > >> > > dissemination, distribution, copying or other use of, or taking of
> > any
> > >> > > action in reliance upon this information is strictly prohibited.
> If
> > you
> > >> > > have received this communication in error, please contact the
> sender
> > >> and
> > >> > > delete the material from your computer.
> > >> > >
> > >> >
> > >>
> > ________________________________________________________
> >
> > The information contained in this e-mail is confidential and/or
> > proprietary to Capital One and/or its affiliates and may only be used
> > solely in performance of work or services for Capital One. The
> information
> > transmitted herewith is intended only for use by the individual or entity
> > to which it is addressed. If the reader of this message is not the
> intended
> > recipient, you are hereby notified that any review, retransmission,
> > dissemination, distribution, copying or other use of, or taking of any
> > action in reliance upon this information is strictly prohibited. If you
> > have received this communication in error, please contact the sender and
> > delete the material from your computer.
> >
>
Re: Get ApplicationId from inside Application
Posted by Munagala Ramanath <ra...@datatorrent.com>.
You can't do it in populateDAG since the id is not known when that function
runs.
You need to do it in the operator as suggested by Gaurav:
String appid = Context.OperatorContext.getValue(Context.DAGContext.
APPLICATION_ID);
Ram
On Wed, May 25, 2016 at 11:00 AM, Ganelin, Ilya <Ilya.Ganelin@capitalone.com
> wrote:
> Hi guys - when I try to retrieve the application id with:
> ("{ApplicationId=" + dag.getValue(Context.DAGContext.APPLICATION_ID) +
> "}\n”) the applicationId is reported as null.
>
>
>
> I’m trying to run this inside of the “populateDAG” function.
>
> Am I doing something wrong?
>
> On 5/19/16, 11:20 AM, "Gaurav Gupta" <ga...@gmail.com> wrote:
>
> >In an operator you can get it using
> >
> >String appid = Context.OperatorContext.getValue(Context.DAGContext.
> >APPLICATION_ID);
> >
> >On Thu, May 19, 2016 at 11:04 AM, David Yan <da...@datatorrent.com>
> wrote:
> >
> >> Specifically, you can try:
> >>
> >> String appid = dag.getValue(DAGContext.APPLICATION_ID);
> >>
> >> David
> >>
> >> On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <
> sandesh@datatorrent.com>
> >> wrote:
> >>
> >> > Yes, use the conf object passed to StreamingApplication.
> >> >
> >> > On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <
> >> Ilya.Ganelin@capitalone.com>
> >> > wrote:
> >> >
> >> > > Hi all – is it possible to retrieve the Apex application ID:
> >> > > e.g.application_1463594017097_0024 within the Apex program? For
> example
> >> > > from the DAG object or some other object?
> >> > > ________________________________________________________
> >> > >
> >> > > The information contained in this e-mail is confidential and/or
> >> > > proprietary to Capital One and/or its affiliates and may only be
> used
> >> > > solely in performance of work or services for Capital One. The
> >> > information
> >> > > transmitted herewith is intended only for use by the individual or
> >> entity
> >> > > to which it is addressed. If the reader of this message is not the
> >> > intended
> >> > > recipient, you are hereby notified that any review, retransmission,
> >> > > dissemination, distribution, copying or other use of, or taking of
> any
> >> > > action in reliance upon this information is strictly prohibited. If
> you
> >> > > have received this communication in error, please contact the sender
> >> and
> >> > > delete the material from your computer.
> >> > >
> >> >
> >>
> ________________________________________________________
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>
Re: Get ApplicationId from inside Application
Posted by Chandni Singh <si...@gmail.com>.
Hey Ilya,
The application id is assigned to an application once it is launched.
In populateDag() phase, the logical plan is being created but the actual
yarn application is not created so there isn't an application id created
yet which is why it is null.
Chandni
On Wed, May 25, 2016 at 11:00 AM, Ganelin, Ilya <Ilya.Ganelin@capitalone.com
> wrote:
> Hi guys - when I try to retrieve the application id with:
> ("{ApplicationId=" + dag.getValue(Context.DAGContext.APPLICATION_ID) +
> "}\n”) the applicationId is reported as null.
>
>
>
> I’m trying to run this inside of the “populateDAG” function.
>
> Am I doing something wrong?
>
> On 5/19/16, 11:20 AM, "Gaurav Gupta" <ga...@gmail.com> wrote:
>
> >In an operator you can get it using
> >
> >String appid = Context.OperatorContext.getValue(Context.DAGContext.
> >APPLICATION_ID);
> >
> >On Thu, May 19, 2016 at 11:04 AM, David Yan <da...@datatorrent.com>
> wrote:
> >
> >> Specifically, you can try:
> >>
> >> String appid = dag.getValue(DAGContext.APPLICATION_ID);
> >>
> >> David
> >>
> >> On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <
> sandesh@datatorrent.com>
> >> wrote:
> >>
> >> > Yes, use the conf object passed to StreamingApplication.
> >> >
> >> > On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <
> >> Ilya.Ganelin@capitalone.com>
> >> > wrote:
> >> >
> >> > > Hi all – is it possible to retrieve the Apex application ID:
> >> > > e.g.application_1463594017097_0024 within the Apex program? For
> example
> >> > > from the DAG object or some other object?
> >> > > ________________________________________________________
> >> > >
> >> > > The information contained in this e-mail is confidential and/or
> >> > > proprietary to Capital One and/or its affiliates and may only be
> used
> >> > > solely in performance of work or services for Capital One. The
> >> > information
> >> > > transmitted herewith is intended only for use by the individual or
> >> entity
> >> > > to which it is addressed. If the reader of this message is not the
> >> > intended
> >> > > recipient, you are hereby notified that any review, retransmission,
> >> > > dissemination, distribution, copying or other use of, or taking of
> any
> >> > > action in reliance upon this information is strictly prohibited. If
> you
> >> > > have received this communication in error, please contact the sender
> >> and
> >> > > delete the material from your computer.
> >> > >
> >> >
> >>
> ________________________________________________________
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>
Re: Get ApplicationId from inside Application
Posted by "Ganelin, Ilya" <Il...@capitalone.com>.
Hi guys - when I try to retrieve the application id with:
("{ApplicationId=" + dag.getValue(Context.DAGContext.APPLICATION_ID) + "}\n”) the applicationId is reported as null.
I’m trying to run this inside of the “populateDAG” function.
Am I doing something wrong?
On 5/19/16, 11:20 AM, "Gaurav Gupta" <ga...@gmail.com> wrote:
>In an operator you can get it using
>
>String appid = Context.OperatorContext.getValue(Context.DAGContext.
>APPLICATION_ID);
>
>On Thu, May 19, 2016 at 11:04 AM, David Yan <da...@datatorrent.com> wrote:
>
>> Specifically, you can try:
>>
>> String appid = dag.getValue(DAGContext.APPLICATION_ID);
>>
>> David
>>
>> On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <sa...@datatorrent.com>
>> wrote:
>>
>> > Yes, use the conf object passed to StreamingApplication.
>> >
>> > On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <
>> Ilya.Ganelin@capitalone.com>
>> > wrote:
>> >
>> > > Hi all – is it possible to retrieve the Apex application ID:
>> > > e.g.application_1463594017097_0024 within the Apex program? For example
>> > > from the DAG object or some other object?
>> > > ________________________________________________________
>> > >
>> > > The information contained in this e-mail is confidential and/or
>> > > proprietary to Capital One and/or its affiliates and may only be used
>> > > solely in performance of work or services for Capital One. The
>> > information
>> > > transmitted herewith is intended only for use by the individual or
>> entity
>> > > to which it is addressed. If the reader of this message is not the
>> > intended
>> > > recipient, you are hereby notified that any review, retransmission,
>> > > dissemination, distribution, copying or other use of, or taking of any
>> > > action in reliance upon this information is strictly prohibited. If you
>> > > have received this communication in error, please contact the sender
>> and
>> > > delete the material from your computer.
>> > >
>> >
>>
________________________________________________________
The information contained in this e-mail is confidential and/or proprietary to Capital One and/or its affiliates and may only be used solely in performance of work or services for Capital One. The information transmitted herewith is intended only for use by the individual or entity to which it is addressed. If the reader of this message is not the intended recipient, you are hereby notified that any review, retransmission, dissemination, distribution, copying or other use of, or taking of any action in reliance upon this information is strictly prohibited. If you have received this communication in error, please contact the sender and delete the material from your computer.
Re: Get ApplicationId from inside Application
Posted by Gaurav Gupta <ga...@gmail.com>.
In an operator you can get it using
String appid = Context.OperatorContext.getValue(Context.DAGContext.
APPLICATION_ID);
On Thu, May 19, 2016 at 11:04 AM, David Yan <da...@datatorrent.com> wrote:
> Specifically, you can try:
>
> String appid = dag.getValue(DAGContext.APPLICATION_ID);
>
> David
>
> On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <sa...@datatorrent.com>
> wrote:
>
> > Yes, use the conf object passed to StreamingApplication.
> >
> > On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <
> Ilya.Ganelin@capitalone.com>
> > wrote:
> >
> > > Hi all – is it possible to retrieve the Apex application ID:
> > > e.g.application_1463594017097_0024 within the Apex program? For example
> > > from the DAG object or some other object?
> > > ________________________________________________________
> > >
> > > The information contained in this e-mail is confidential and/or
> > > proprietary to Capital One and/or its affiliates and may only be used
> > > solely in performance of work or services for Capital One. The
> > information
> > > transmitted herewith is intended only for use by the individual or
> entity
> > > to which it is addressed. If the reader of this message is not the
> > intended
> > > recipient, you are hereby notified that any review, retransmission,
> > > dissemination, distribution, copying or other use of, or taking of any
> > > action in reliance upon this information is strictly prohibited. If you
> > > have received this communication in error, please contact the sender
> and
> > > delete the material from your computer.
> > >
> >
>
Re: Get ApplicationId from inside Application
Posted by David Yan <da...@datatorrent.com>.
Specifically, you can try:
String appid = dag.getValue(DAGContext.APPLICATION_ID);
David
On Thu, May 19, 2016 at 10:12 AM, Sandesh Hegde <sa...@datatorrent.com>
wrote:
> Yes, use the conf object passed to StreamingApplication.
>
> On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <Il...@capitalone.com>
> wrote:
>
> > Hi all – is it possible to retrieve the Apex application ID:
> > e.g.application_1463594017097_0024 within the Apex program? For example
> > from the DAG object or some other object?
> > ________________________________________________________
> >
> > The information contained in this e-mail is confidential and/or
> > proprietary to Capital One and/or its affiliates and may only be used
> > solely in performance of work or services for Capital One. The
> information
> > transmitted herewith is intended only for use by the individual or entity
> > to which it is addressed. If the reader of this message is not the
> intended
> > recipient, you are hereby notified that any review, retransmission,
> > dissemination, distribution, copying or other use of, or taking of any
> > action in reliance upon this information is strictly prohibited. If you
> > have received this communication in error, please contact the sender and
> > delete the material from your computer.
> >
>
Re: Get ApplicationId from inside Application
Posted by Sandesh Hegde <sa...@datatorrent.com>.
Yes, use the conf object passed to StreamingApplication.
On Thu, May 19, 2016, 10:09 AM Ganelin, Ilya <Il...@capitalone.com>
wrote:
> Hi all – is it possible to retrieve the Apex application ID:
> e.g.application_1463594017097_0024 within the Apex program? For example
> from the DAG object or some other object?
> ________________________________________________________
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>