You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Rohini Palaniswamy (JIRA)" <ji...@apache.org> on 2015/09/01 19:35:45 UTC
[jira] [Updated] (OOZIE-2345) Parallel job submission for forked
actions
[ https://issues.apache.org/jira/browse/OOZIE-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Rohini Palaniswamy updated OOZIE-2345:
--------------------------------------
Description:
We have few customers whose SLA is 8 min. They have around 30 actions. There are 25 actions in fork.
Though forked action jobs runs parallely in the cluster, forked action job submission is sequential.
Whenever NN is slow, job submission takes more time. Even if job submission is delay for 30 sec. Total WF delay will be ~12 min.
was:
We have few customers whose SLA is 8 min. They have around 30 actions. There are 25 actions in fork.
Though forked action jobs runs concurrently. forked action job submission is sequential.
Whenever NN is slow, job submission takes more time. Even if job submission is delay for 30 sec. Total WF delay will be ~12 min.
Summary: Parallel job submission for forked actions (was: Concurrent job submission for forked action)
oozie.workflow.parallel.fork.action.start - Can we make this true by default in oozie-default.xml ?
Change description {{If true, oozie will submit concurrent jobs for all actions in fork}} to {{Determines how Oozie processes starting of forked actions. If true, forked actions and their job submissions are done in parallel which is best for performance. If false, they are submitted sequentially which is the older approach}}
> Parallel job submission for forked actions
> ------------------------------------------
>
> Key: OOZIE-2345
> URL: https://issues.apache.org/jira/browse/OOZIE-2345
> Project: Oozie
> Issue Type: Bug
> Reporter: Purshotam Shah
> Assignee: Purshotam Shah
> Attachments: OOZIE-2345-V3.patch
>
>
> We have few customers whose SLA is 8 min. They have around 30 actions. There are 25 actions in fork.
> Though forked action jobs runs parallely in the cluster, forked action job submission is sequential.
> Whenever NN is slow, job submission takes more time. Even if job submission is delay for 30 sec. Total WF delay will be ~12 min.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)