You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@oozie.apache.org by Shwetha Shivalingamurthy <ss...@hortonworks.com> on 2015/04/01 08:34:02 UTC

Re: Passing config parameters to individual workflow instance(jvm).

Yes

On 31/03/15 5:56 pm, "Harshal Vora" <ha...@gmail.com> wrote:

>Thanks Shweta.
>Does this also work for command line parameters (String[] args) which are
>passed to the Java Main class?
>
>Regards,
>
>On Tue, Mar 31, 2015 at 4:48 PM, Shwetha Shivalingamurthy <
>sshivalingamurthy@hortonworks.com> wrote:
>
>> Java action doc:
>> 
>>http://oozie.apache.org/docs/4.1.0/WorkflowFunctionalSpec.html#a3.2.7_Jav
>>a_
>> Action
>>
>>
>> In the java action, you can use
>> <java-opts>-Xmx ${xmx}</java-opts>
>>
>>
>> Here xmx is a variable with pre-set value. You can re-run the workflow
>>by
>> overriding this parameter. See
>> http://oozie.apache.org/docs/4.1.0/DG_WorkflowReRun.html for more info
>>on
>> re-runs
>>
>> -Shwetha
>>
>> On 31/03/15 12:33 pm, "Harshal Vora" <ha...@gmail.com> wrote:
>>
>> >Dear Swetha,
>> >
>> >Are you referring <arg> tag in workflow for java class?
>> >Or are you talking about the <key,value> config file that is provided
>> >when you launch a new coordinator instance?
>> >
>> >Can you kindly provide an example or point me to any documentation
>> >regarding this.
>> >Appreciate your help.
>> >
>> >Thanks,
>> >Regards,
>> >
>> >Regards,
>> >Harshal Vora
>> >www.radiolocus.com
>> >
>> >On 03/31/2015 11:32 AM, Shwetha Shivalingamurthy wrote:
>> >> The workflow can be parameterised for jvm params or xmx value. You
>>can
>> >> then rerun the workflow by overriding the parameter
>> >>
>> >> -Shwetha
>> >>
>> >>
>> >> On 28/03/15 7:10 am, "Harshal Vora" <ha...@gmail.com> wrote:
>> >>
>> >>> Hi,
>> >>>
>> >>> Assume that we have a coordinator job which has already spawned and
>> >>> successfully run 100 instances of the workflow which contains JAVA
>> >>>jobs.
>> >>>
>> >>> Now if we want to rerun a particular instance say instance number
>>80 of
>> >>> the workflow.
>> >>>
>> >>> Is it possible to pass command line arguments to the Java main class
>> >>> while we rerun a particular instance?
>> >>>
>> >>> The requirement is that original job might have processed data for
>>10
>> >>> different clients at once, but we might only want to rerun for one
>> >>> particular client if there is discrepancy within the generated
>>output.
>> >>> OR
>> >>> A particular instance has to process much larger data set then all
>>the
>> >>> other regular data sets and in that scenario, we need to provide a
>> >>> higher -Xmx value.
>> >>>
>> >>> Regards,
>> >>>
>> >>> --
>> >>> Regards,
>> >>> Harshal Vora
>> >>> www.radiolocus.com
>> >>>
>> >
>>
>>
>
>
>-- 
>Harshal Vora

Re: Passing config parameters to individual workflow instance(jvm).

Posted by Jaydeep Vishwakarma <ja...@inmobi.com>.
You can try -config option in coord action rerun. This feature is available
in oozie 4.2.0 .

Phone = typos not my fault
On Jul 20, 2015 10:27 PM, "Harshal Vora" <ha...@gmail.com> wrote:

> Dear Shweta,
>
> I have been successfully able to rerun workflow instances with replaced
> parameter values (by passing -D<parameter>=<value> while rerunning the
> workflow instance) that are specified in the <arg></arg> list to a Java
> Main class in a Java action.
> Is there any way that we can rerun a coordinator instance instead of a
> workflow and also replace the parameters?
>
> I could not find anything specific related to that in the documentation
> and the page that you referred to is specifically for workflows.
>
> Thanks for your help.
>
> Regards,
>
> Harshal Vora
> www.radiolocus.com
>
> On 04/01/2015 12:04 PM, Shwetha Shivalingamurthy wrote:
>
>> Yes
>>
>> On 31/03/15 5:56 pm, "Harshal Vora" <ha...@gmail.com> wrote:
>>
>>  Thanks Shweta.
>>> Does this also work for command line parameters (String[] args) which are
>>> passed to the Java Main class?
>>>
>>> Regards,
>>>
>>> On Tue, Mar 31, 2015 at 4:48 PM, Shwetha Shivalingamurthy <
>>> sshivalingamurthy@hortonworks.com> wrote:
>>>
>>>  Java action doc:
>>>>
>>>>
>>>> http://oozie.apache.org/docs/4.1.0/WorkflowFunctionalSpec.html#a3.2.7_Jav
>>>> a_
>>>> Action
>>>>
>>>>
>>>> In the java action, you can use
>>>> <java-opts>-Xmx ${xmx}</java-opts>
>>>>
>>>>
>>>> Here xmx is a variable with pre-set value. You can re-run the workflow
>>>> by
>>>> overriding this parameter. See
>>>> http://oozie.apache.org/docs/4.1.0/DG_WorkflowReRun.html for more info
>>>> on
>>>> re-runs
>>>>
>>>> -Shwetha
>>>>
>>>> On 31/03/15 12:33 pm, "Harshal Vora" <ha...@gmail.com> wrote:
>>>>
>>>>  Dear Swetha,
>>>>>
>>>>> Are you referring <arg> tag in workflow for java class?
>>>>> Or are you talking about the <key,value> config file that is provided
>>>>> when you launch a new coordinator instance?
>>>>>
>>>>> Can you kindly provide an example or point me to any documentation
>>>>> regarding this.
>>>>> Appreciate your help.
>>>>>
>>>>> Thanks,
>>>>> Regards,
>>>>>
>>>>> Regards,
>>>>> Harshal Vora
>>>>> www.radiolocus.com
>>>>>
>>>>> On 03/31/2015 11:32 AM, Shwetha Shivalingamurthy wrote:
>>>>>
>>>>>> The workflow can be parameterised for jvm params or xmx value. You
>>>>>>
>>>>> can
>>>>
>>>>> then rerun the workflow by overriding the parameter
>>>>>>
>>>>>> -Shwetha
>>>>>>
>>>>>>
>>>>>> On 28/03/15 7:10 am, "Harshal Vora" <ha...@gmail.com> wrote:
>>>>>>
>>>>>>  Hi,
>>>>>>>
>>>>>>> Assume that we have a coordinator job which has already spawned and
>>>>>>> successfully run 100 instances of the workflow which contains JAVA
>>>>>>> jobs.
>>>>>>>
>>>>>>> Now if we want to rerun a particular instance say instance number
>>>>>>>
>>>>>> 80 of
>>>>
>>>>> the workflow.
>>>>>>>
>>>>>>> Is it possible to pass command line arguments to the Java main class
>>>>>>> while we rerun a particular instance?
>>>>>>>
>>>>>>> The requirement is that original job might have processed data for
>>>>>>>
>>>>>> 10
>>>>
>>>>> different clients at once, but we might only want to rerun for one
>>>>>>> particular client if there is discrepancy within the generated
>>>>>>>
>>>>>> output.
>>>>
>>>>> OR
>>>>>>> A particular instance has to process much larger data set then all
>>>>>>>
>>>>>> the
>>>>
>>>>> other regular data sets and in that scenario, we need to provide a
>>>>>>> higher -Xmx value.
>>>>>>>
>>>>>>> Regards,
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>> Harshal Vora
>>>>>>> www.radiolocus.com
>>>>>>>
>>>>>>>
>>>>
>>> --
>>> Harshal Vora
>>>
>>
>

-- 
_____________________________________________________________
The information contained in this communication is intended solely for the 
use of the individual or entity to whom it is addressed and others 
authorized to receive it. It may contain confidential or legally privileged 
information. If you are not the intended recipient you are hereby notified 
that any disclosure, copying, distribution or taking any action in reliance 
on the contents of this information is strictly prohibited and may be 
unlawful. If you have received this communication in error, please notify 
us immediately by responding to this email and then delete it from your 
system. The firm is neither liable for the proper and complete transmission 
of the information contained in this communication nor for any delay in its 
receipt.

Re: Passing config parameters to individual workflow instance(jvm).

Posted by Harshal Vora <ha...@gmail.com>.
Dear Shweta,

I have been successfully able to rerun workflow instances with replaced 
parameter values (by passing -D<parameter>=<value> while rerunning the 
workflow instance) that are specified in the <arg></arg> list to a Java 
Main class in a Java action.
Is there any way that we can rerun a coordinator instance instead of a 
workflow and also replace the parameters?

I could not find anything specific related to that in the documentation 
and the page that you referred to is specifically for workflows.

Thanks for your help.

Regards,

Harshal Vora
www.radiolocus.com

On 04/01/2015 12:04 PM, Shwetha Shivalingamurthy wrote:
> Yes
>
> On 31/03/15 5:56 pm, "Harshal Vora" <ha...@gmail.com> wrote:
>
>> Thanks Shweta.
>> Does this also work for command line parameters (String[] args) which are
>> passed to the Java Main class?
>>
>> Regards,
>>
>> On Tue, Mar 31, 2015 at 4:48 PM, Shwetha Shivalingamurthy <
>> sshivalingamurthy@hortonworks.com> wrote:
>>
>>> Java action doc:
>>>
>>> http://oozie.apache.org/docs/4.1.0/WorkflowFunctionalSpec.html#a3.2.7_Jav
>>> a_
>>> Action
>>>
>>>
>>> In the java action, you can use
>>> <java-opts>-Xmx ${xmx}</java-opts>
>>>
>>>
>>> Here xmx is a variable with pre-set value. You can re-run the workflow
>>> by
>>> overriding this parameter. See
>>> http://oozie.apache.org/docs/4.1.0/DG_WorkflowReRun.html for more info
>>> on
>>> re-runs
>>>
>>> -Shwetha
>>>
>>> On 31/03/15 12:33 pm, "Harshal Vora" <ha...@gmail.com> wrote:
>>>
>>>> Dear Swetha,
>>>>
>>>> Are you referring <arg> tag in workflow for java class?
>>>> Or are you talking about the <key,value> config file that is provided
>>>> when you launch a new coordinator instance?
>>>>
>>>> Can you kindly provide an example or point me to any documentation
>>>> regarding this.
>>>> Appreciate your help.
>>>>
>>>> Thanks,
>>>> Regards,
>>>>
>>>> Regards,
>>>> Harshal Vora
>>>> www.radiolocus.com
>>>>
>>>> On 03/31/2015 11:32 AM, Shwetha Shivalingamurthy wrote:
>>>>> The workflow can be parameterised for jvm params or xmx value. You
>>> can
>>>>> then rerun the workflow by overriding the parameter
>>>>>
>>>>> -Shwetha
>>>>>
>>>>>
>>>>> On 28/03/15 7:10 am, "Harshal Vora" <ha...@gmail.com> wrote:
>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> Assume that we have a coordinator job which has already spawned and
>>>>>> successfully run 100 instances of the workflow which contains JAVA
>>>>>> jobs.
>>>>>>
>>>>>> Now if we want to rerun a particular instance say instance number
>>> 80 of
>>>>>> the workflow.
>>>>>>
>>>>>> Is it possible to pass command line arguments to the Java main class
>>>>>> while we rerun a particular instance?
>>>>>>
>>>>>> The requirement is that original job might have processed data for
>>> 10
>>>>>> different clients at once, but we might only want to rerun for one
>>>>>> particular client if there is discrepancy within the generated
>>> output.
>>>>>> OR
>>>>>> A particular instance has to process much larger data set then all
>>> the
>>>>>> other regular data sets and in that scenario, we need to provide a
>>>>>> higher -Xmx value.
>>>>>>
>>>>>> Regards,
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>> Harshal Vora
>>>>>> www.radiolocus.com
>>>>>>
>>>
>>
>> -- 
>> Harshal Vora