You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@ode.apache.org by Gangadhar ireddy <ga...@gmail.com> on 2017/07/07 08:43:38 UTC

Flow activity issues on apache ode

Hi,

This is Gangadhar working for Altair, currently we are using Apache-ode and
facing few issues on flow activity.

1. Sometimes all the activities will not be released and when i check the
ode_job table there are some records not getting updated. But when i clean
ode_job table and create a new instance it works fine.

2. If i have more than 9 activities in flow , it takes large amount of time
to release all the tasks.


Can you help me to fix these issues.

Thanks,
Gangadhar.

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

ode-axis2.tx.factory.class=org.apache.ode.axis2.util.TomcatFactory

added  <Transaction
factory="bitronix.tm.BitronixUserTransactionObjectFactory"/> in
tomcat/conf/context.xml

Regards,
Gangadhar.

On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com> wrote:

> What is the setting for the below config parameter in your
> ode.axis2.properties file
> ode-axis2.tx.factory.class=
>
> Have you configured a Transaction Manager in your tomcat?
>
> On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
> > Hi Sathwik,
> >
> > Please find the details below:-
> >
> > ODE version :- 1.3.5
> > Server :- Apache tomcat
> > Database :- Oracle
> > OpenJPA or Hibernate:- Hibernate
> >
> > Regards,
> > Gangadhar.
> >
> > On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> >
> > > Can you provide these info please
> > > ODE version?
> > > Server?
> > > Database?
> > > OpenJPA or Hibernate?
> > >
> > > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com> wrote:
> > >
> > > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalService
> > -
> > > > Response:
> > > > <?xml version="1.0" encoding="UTF-8"?>
> > > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> xmlns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> xmlns:SOAP-ENV="
> > > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > > humanTaskInvokeResponse
> > > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > > xmlns:htds="
> > > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> > > > SubProcess24Task137Output></message>
> > > > 424519845 [ODEServer-513] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519851 [ODEServer-518] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519854 [ODEServer-508] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519853 [ODEServer-502] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519849 [ODEServer-506] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519852 [ODEServer-504] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519865 [ODEServer-506] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519865 [ODEServer-502] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519866 [ODEServer-508] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519863 [ODEServer-511] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519863 [ODEServer-507] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519862 [ODEServer-519] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519868 [ODEServer-511] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519862 [ODEServer-513] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519868 [ODEServer-507] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519868 [ODEServer-519] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519867 [ODEServer-518] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519866 [ODEServer-504] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424519866 [ODEServer-510] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> > > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424519870 [ODEServer-510] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 25s
> > > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService
> > -
> > > > Response:
> > > > <?xml version="1.0" encoding="UTF-8"?>
> > > > <message><SubProcess24Task131Output><SubProcess24Task131Output
> xmlns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> xmlns:SOAP-ENV="
> > > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > > > humanTaskInvokeResponse
> > > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > > xmlns:htds="
> > > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> > > > SubProcess24Task131Output></message>
> > > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService
> > -
> > > > Response:
> > > > <?xml version="1.0" encoding="UTF-8"?>
> > > > <message><SubProcess24Task132Output><SubProcess24Task132Output
> xmlns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> xmlns:SOAP-ENV="
> > > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > > > humanTaskInvokeResponse
> > > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > > xmlns:htds="
> > > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> > > > SubProcess24Task132Output></message>
> > > > 424573852 [ODEServer-513] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573856 [ODEServer-511] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573863 [ODEServer-504] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573865 [ODEServer-513] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573863 [ODEServer-517] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573863 [ODEServer-514] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573868 [ODEServer-508] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573868 [ODEServer-507] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573869 [ODEServer-517] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573869 [ODEServer-504] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573870 [ODEServer-514] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573870 [ODEServer-511] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573868 [ODEServer-519] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > a
> > > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13
> EDT
> > > > transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > > detailsExt: {})
> > > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > > BpelEngineImpl.java:394)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > BpelEngineImpl.java:403)
> > > > at
> > > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > BpelServerImpl.java:450)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:518)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > 1.call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:284)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > > SimpleScheduler.java:239)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:512)
> > > > at
> > > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > call(SimpleScheduler.java:496)
> > > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > ThreadPoolExecutor.java:1142)
> > > > at
> > > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > ThreadPoolExecutor.java:617)
> > > > at java.lang.Thread.run(Thread.java:745)
> > > > 424573870 [ODEServer-507] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573870 [ODEServer-508] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424573871 [ODEServer-519] ERROR
> > > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > > job, retrying in 125s
> > > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalService
> > -
> > > > Response:
> > > > <?xml version="1.0" encoding="UTF-8"?>
> > > > <message><SubProcess24Task135Output><SubProcess24Task135Output
> xmlns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> xmlns:SOAP-ENV="
> > > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > > > humanTaskInvokeResponse
> > > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > > xmlns:htds="
> > > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> > > > SubProcess24Task135Output></message>
> > > >
> > > >
> > > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > > >
> > > > > Attachment has not come through.
> > > > >
> > > > > put it inline
> > > > >
> > > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> > gangadhar.ireddy@gmail.com>
> > > > > wrote:
> > > > >
> > > > > > Sathwik,
> > > > > >
> > > > > > Please find the attached log.
> > > > > >
> > > > > > Regards,
> > > > > > Gangadhar.
> > > > > >
> > > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> sathwik.bp@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > >> Can you send the complete logs.
> > > > > >>
> > > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> > sathwik.bp@gmail.com>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Usually, the jobs gets executed pretty much quickly.
> > > > > >> >
> > > > > >> > Factors that might be delaying the execution of jobs is a slow
> > > > > database.
> > > > > >> >
> > > > > >> > How many concurrent messages is the process expecting?
> > > > > >> >
> > > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > > > gangadhar.ireddy@gmail.com
> > > > > >
> > > > > >> > wrote:
> > > > > >> >
> > > > > >> > We are waiting for the jobs and it releases many times, but
> few
> > > > times
> > > > > it
> > > > > >> > doesn't release, Is there any limit on the rescheduling?
> > > > > >> >
> > > > > >> > Regards,
> > > > > >> > Gangadhar.
> > > > > >> >
> > > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > > sathwik.bp@gmail.com>
> > > > > >> wrote:
> > > > > >> >
> > > > > >> > > This is normal. Concurrent messages are competing for the
> > > instance
> > > > > >> lock.
> > > > > >> > > Job that doesn't get the lock on the instance has to wait
> and
> > > will
> > > > > be
> > > > > >> > > rescheduled.
> > > > > >> > > You should never clear the job table.
> > > > > >> > >
> > > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > > > gangadhar.ireddy@gmail.com
> > > > > >> >
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > Sathwik,
> > > > > >> > >
> > > > > >> > > Please find the below log,
> > > > > >> > >
> > > > > >> > > <message><SubProcess24Task137Output><
> > SubProcess24Task137Output
> > > > > >> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137
> "
> > > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> > > > > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/
> > SubProcess24Task137
> > > > "><
> > > > > >> > > humanTaskInvokeResponse
> > > > > >> > > xmlns="http://www.altair.com/WF/Framework/
> HumanTaskDataSchema
> > "
> > > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > > > HumanTaskDataSchema
> > > > > >> > ">true</
> > > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> > > > > >> > > SubProcess24Task137Output></message>
> > > > > >> > > 424519845 [ODEServer-513] ERROR
> > > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> > > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
> > > details:
> > > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null
> > type:
> > > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > > correlationKeySet:
> > > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > > > >> lEngineImpl.acquireInstanceLoc
> > > > > >> > k(
> > > > > >> > > BpelEngineImpl.java:394)
> > > > > >> > >         at org.apache.ode.bpel.engine.
> > > > > BpelEngineImpl.onScheduledJob(
> > > > > >> > > BpelEngineImpl.java:403)
> > > > > >> > >         at org.apache.ode.bpel.engine.
> > > > > BpelServerImpl.onScheduledJob(
> > > > > >> > > BpelServerImpl.java:450)
> > > > > >> > >         at org.apache.ode.scheduler.
> > > > simple.SimpleScheduler$RunJob$
> > > > > >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> > >         at org.apache.ode.scheduler.
> > > > simple.SimpleScheduler$RunJob$
> > > > > >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > > >> > > execTransaction(
> > > > > >> > > SimpleScheduler.java:284)
> > > > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > > >> > > execTransaction(
> > > > > >> > > SimpleScheduler.java:239)
> > > > > >> > >         at org.apache.ode.scheduler.
> > > > simple.SimpleScheduler$RunJob.
> > > > > >> > > call(SimpleScheduler.java:512)
> > > > > >> > >         at org.apache.ode.scheduler.
> > > > simple.SimpleScheduler$RunJob.
> > > > > >> > > call(SimpleScheduler.java:496)
> > > > > >> > >         at java.util.concurrent.FutureTask.run(FutureTask.
> > > > java:266)
> > > > > >> > >         at java.util.concurrent.
> ThreadPoolExecutor.runWorker(
> > > > > >> > > ThreadPoolExecutor.java:1142)
> > > > > >> > >         at java.util.concurrent.
> > ThreadPoolExecutor$Worker.run(
> > > > > >> > > ThreadPoolExecutor.java:617)
> > > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > > > > >> > > 424519851 [ODEServer-518] ERROR
> > > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> > > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
> > > details:
> > > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null
> > type:
> > > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > > correlationKeySet:
> > > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > Regards,
> > > > > >> > >
> > > > > >> > > Gangadhar.
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > > > sathwik.bp@gmail.com
> > > > > >
> > > > > >> > > wrote:
> > > > > >> > >
> > > > > >> > > > There are multiple factors for intermittent issues. I can
> > only
> > > > > >> > speculate
> > > > > >> > > > here with limited information.
> > > > > >> > > >
> > > > > >> > > > Check your logs for failures when it happens and share it
> > > here,
> > > > so
> > > > > >> that
> > > > > >> > > we
> > > > > >> > > > can help you better. If possible put in a sample process
> to
> > > > > >> reproduce
> > > > > >> > > your
> > > > > >> > > > scenario and share here.
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > >
> > > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > > > >> > > >
> > > > > >> > > > > Sometimes the activity gets released, if it is due to
> > > failures
> > > > > in
> > > > > >> the
> > > > > >> > > > > process, it should fail every time right?
> > > > > >> > > > >
> > > > > >> > > > > Regards,
> > > > > >> > > > > Gangadhar.
> > > > > >> > > > >
> > > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > > > > >> sathwik.bp@gmail.com>
> > > > > >> > > > wrote:
> > > > > >> > > > >
> > > > > >> > > > > > Jobs might be getting rescheduled due to failures in
> the
> > > > > >> process.
> > > > > >> > > > > > Check the logs for errors.
> > > > > >> > > > > >
> > > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > > >> > > > > >
> > > > > >> > > > > > > Hi Sathwik,
> > > > > >> > > > > > >
> > > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for
> > > some
> > > > > >> tasks
> > > > > >> > it
> > > > > >> > > > will
> > > > > >> > > > > > be
> > > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
> > > Sometimes
> > > > it
> > > > > >> > takes
> > > > > >> > > > more
> > > > > >> > > > > > > time to release the tasks, sometimes it will not
> > > release.
> > > > > >> > > > > > >
> > > > > >> > > > > > > Regards,
> > > > > >> > > > > > > Ganga.
> > > > > >> > > > > > >
> > > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> > > > > >> > sathwik.bp@gmail.com>
> > > > > >> > > > > > wrote:
> > > > > >> > > > > > >
> > > > > >> > > > > > > > What kind of jobs are pending?
> > > > > >> > > > > > > > What activities do you have within your <flow>?
> > > > > >> > > > > > > >
> > > > > >> > > > > > > > regards,
> > > > > >> > > > > > > > sathwik
> > > > > >> > > > > > > >
> > > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > > > >> > > > > > > > > wrote:
> > > > > >> > > > > > > >
> > > > > >> > > > > > > > > Hi,
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > > > This is Gangadhar working for Altair, currently
> we
> > > are
> > > > > >> using
> > > > > >> > > > > > Apache-ode
> > > > > >> > > > > > > > and
> > > > > >> > > > > > > > > facing few issues on flow activity.
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > > > 1. Sometimes all the activities will not be
> > released
> > > > and
> > > > > >> > when i
> > > > > >> > > > > check
> > > > > >> > > > > > > the
> > > > > >> > > > > > > > > ode_job table there are some records not getting
> > > > > updated.
> > > > > >> But
> > > > > >> > > > when
> > > > > >> > > > > i
> > > > > >> > > > > > > > clean
> > > > > >> > > > > > > > > ode_job table and create a new instance it works
> > > fine.
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > > > 2. If i have more than 9 activities in flow , it
> > > takes
> > > > > >> large
> > > > > >> > > > amount
> > > > > >> > > > > > of
> > > > > >> > > > > > > > time
> > > > > >> > > > > > > > > to release all the tasks.
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > > > Can you help me to fix these issues.
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > > > Thanks,
> > > > > >> > > > > > > > > Gangadhar.
> > > > > >> > > > > > > > >
> > > > > >> > > > > > > >
> > > > > >> > > > > > >
> > > > > >> > > > > >
> > > > > >> > > > >
> > > > > >> > > >
> > > > > >> > >
> > > > > >> >
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

If you want to experiment making the change in job rescheduling then here
is the line
https://github.com/apache/ode/blob/ode-1.3.x/scheduler-simple/src/main/java/org/apache/ode/scheduler/simple/SimpleScheduler.java#L561

You will have to build the binary from 1.3.5 source.

Some user recently has compiled 1.3.5 source,
https://stackoverflow.com/questions/45439748/building-apache-ode-from-the-source-jruby-and-buildr

You will need to pickup just the simple scheduler jar
ode-scheduler-simple-*-.jar after the build.



On Wed, Jan 3, 2018 at 8:15 PM, Sathwik B P <sa...@gmail.com> wrote:

> Your process model creates a lot of contension on the process instance.
> This kind of model cannot scale.
>
> Human task activites are async in nature, not sure why is your model using
> sync invoke calls.
>
> Changing the job rescheduling mechanism is not feasible, because there is
> risk of completing the 10 retries much faster and ODE will remove the job
> after 10 unsuccessful retries.
>
> Look towards making one way invokes as against sync invokes or reduce
> parallel activities in the flow. Today you have 16 invokes, and the process
> might have more in future.
>
>
>
> On Jan 3, 2018 11:19, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> Sathwik,
>
> We made all activities as manual activities ,each is assigned to different
> user and these are not dependent, So all users can work in parallel.
>
> Regards,
> Gangadhar.
>
> On Wed, Jan 3, 2018 at 10:59 AM, Sathwik B P <sa...@gmail.com> wrote:
>
> > Oh, seems like the whole process is running in parallel. Any specific
> need
> > to design the process in such manner?
> >
> > On Jan 2, 2018 21:41, "Gangadhar ireddy" <ga...@gmail.com>
> > wrote:
> >
> > > Sathwik , Total 16 activities i have in parallel, I tried with the
> > > workaround you provided. Splitted the 16 invoke activities to 4 Flow
> > > activities, so each flow containing 4 activities. But still i see the
> > same
> > > problem. To get all these activities its taking 1hour. If they are more
> > > activities than 16, it takes 5hours(as it multiples time with 5
> > everytime).
> > >
> > > Regards,
> > > Gangadhar.
> > >
> > > On Tue, Jan 2, 2018 at 4:21 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > > > Its not configurable.
> > > >
> > > > What are those 8 activities that are running in parallel?
> > > >
> > > > Do you have to run all the 8 activities in parallel?
> > > >
> > > > A warkaround might be to break your 8 activities into 4 different
> flows
> > > > with 2 activities each. Does that work for you.
> > > >
> > > >
> > > >
> > > > On Tue, Jan 2, 2018 at 3:21 PM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com
> > > > > wrote:
> > > >
> > > > > Sathwik,
> > > > >
> > > > > I am still facing the issue with flow activity if it has more than
> 8
> > > > tasks
> > > > > in parallel. And also the retry time is getting increased
> > > > > everytime(multipled by 5) . So its a big delay for me to get the
> > > > activity.
> > > > > Is there any config file to change the retry time?
> > > > >
> > > > > Regards,
> > > > > Ganga.
> > > > >
> > > > > On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
> > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >
> > > > > > Sure Sathwik, let me try on a dedicated database, Thanks a lot
> for
> > > your
> > > > > > help.
> > > > > >
> > > > > > Regards,
> > > > > > Gangadhar.
> > > > > >
> > > > > > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <
> sathwik.bp@gmail.com
> > >
> > > > > wrote:
> > > > > >
> > > > > >> I have taken a specific job's execution time from your logs.
> > > > > >>
> > > > > >> Example:
> > > > > >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer
> [1]
> > > > > >> It could not acquire the instance lock and hence was scheduled
> for
> > > > 25sec
> > > > > >> later, refer [2]. This is the second retry iteration. The first
> > > > > iteration
> > > > > >> would have been with a 5sec delay, one should have seen this in
> > the
> > > > > logs,
> > > > > >> may be you have truncated that part of the logs.
> > > > > >> When the job got into execution the time should have been
> sometime
> > > > > >> approximately around 14:01:07 + 25sec = 14:01:32, but its time:
> > > > > 2017-07-11
> > > > > >> 14:02:13 EDT refer [3], shows a huge additional delay about
> 40sec
> > > > more.
> > > > > >> Due to slow running transactions, the Scheduler will throttle
> the
> > > > jobs.
> > > > > >>
> > > > > >> To improve the execution times,
> > > > > >> * Put off event generation (http://ode.apache.org/ode-exe
> > > > > >> cution-events.html
> > > > > >> ).
> > > > > >> * Have a dedicated database server with good hardware.
> > > > > >>
> > > > > >> [1]
> > > > > >> 424519845 [ODEServer-513] ERROR
> > > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > > >> processing a
> > > > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > 14:01:07
> > > > EDT
> > > > > >> transacted: true persisted: true details: JobDetails(
> instanceId:
> > > > 48210
> > > > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > > >> correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > > false
> > > > > >> detailsExt: {})
> > > > > >>
> > > > > >> [2]
> > > > > >> 424519862 [ODEServer-513] ERROR
> > > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > > processing
> > > > > >> job, retrying in 25s
> > > > > >>
> > > > > >> [3]
> > > > > >> 424573863 [ODEServer-517] ERROR
> > > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > > >> processing a
> > > > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > 14:02:13
> > > > EDT
> > > > > >> transacted: true persisted: true details: JobDetails(
> instanceId:
> > > > 48210
> > > > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > > >> correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > > false
> > > > > >> detailsExt: {})
> > > > > >>
> > > > > >> regards,
> > > > > >> sathwik
> > > > > >>
> > > > > >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <
> > sathwik.bp@gmail.com>
> > > > > >> wrote:
> > > > > >>
> > > > > >> > What is the setting for the below config parameter in your
> > > > > >> > ode.axis2.properties file
> > > > > >> > ode-axis2.tx.factory.class=
> > > > > >> >
> > > > > >> > Have you configured a Transaction Manager in your tomcat?
> > > > > >> >
> > > > > >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> > > > > >> > gangadhar.ireddy@gmail.com> wrote:
> > > > > >> >
> > > > > >> >> Hi Sathwik,
> > > > > >> >>
> > > > > >> >> Please find the details below:-
> > > > > >> >>
> > > > > >> >> ODE version :- 1.3.5
> > > > > >> >> Server :- Apache tomcat
> > > > > >> >> Database :- Oracle
> > > > > >> >> OpenJPA or Hibernate:- Hibernate
> > > > > >> >>
> > > > > >> >> Regards,
> > > > > >> >> Gangadhar.
> > > > > >> >>
> > > > > >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <
> > > > sathwik.bp@gmail.com>
> > > > > >> >> wrote:
> > > > > >> >>
> > > > > >> >> > Can you provide these info please
> > > > > >> >> > ODE version?
> > > > > >> >> > Server?
> > > > > >> >> > Database?
> > > > > >> >> > OpenJPA or Hibernate?
> > > > > >> >> >
> > > > > >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > > > > >> >> > gangadhar.ireddy@gmail.com> wrote:
> > > > > >> >> >
> > > > > >> >> > > 424519400 [ODEServer-505] INFO
> > > org.apache.ode.axis2.ExternalS
> > > > > >> ervice
> > > > > >> >> -
> > > > > >> >> > > Response:
> > > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > > >> >> > > <message><SubProcess24Task137Output><
> > > SubProcess24Task137Output
> > > > > >> >> xmlns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > > > >> >> xmlns:SOAP-ENV="
> > > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > > > >> >> > > humanTaskInvokeResponse
> > > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > > HumanTaskDataSchema"
> > > > > >> >> > > xmlns:htds="
> > > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > > >> >> > > ">true</humanTaskInvokeResponse></
> > > SubProcess24Task137Output></
> > > > > >> >> > > SubProcess24Task137Output></message>
> > > > > >> >> > > 424519845 [ODEServer-513] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> 2017-07-11
> > > > > 14:01:07
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE
> channel:
> > > 423
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519851 [ODEServer-518] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE
> channel:
> > > 269
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519854 [ODEServer-508] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE
> channel:
> > > 378
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519853 [ODEServer-502] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE
> channel:
> > > 316
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519849 [ODEServer-506] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE
> channel:
> > > 282
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519852 [ODEServer-504] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE
> channel:
> > > 401
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519865 [ODEServer-506] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519865 [ODEServer-502] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519866 [ODEServer-508] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519863 [ODEServer-511] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE
> channel:
> > > 383
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519863 [ODEServer-507] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE
> channel:
> > > 226
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519862 [ODEServer-519] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE
> channel:
> > > 365
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519868 [ODEServer-511] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519862 [ODEServer-513] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519868 [ODEServer-507] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519868 [ODEServer-519] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519867 [ODEServer-518] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519866 [ODEServer-504] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424519866 [ODEServer-510] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time:
> 2017-07-11
> > > > > 14:01:05
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE
> channel:
> > > 295
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424519870 [ODEServer-510] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 25s
> > > > > >> >> > > 424522517 [ODEServer-510] INFO
> > > org.apache.ode.axis2.ExternalS
> > > > > >> ervice
> > > > > >> >> -
> > > > > >> >> > > Response:
> > > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > > >> >> > > <message><SubProcess24Task131Output><
> > > SubProcess24Task131Output
> > > > > >> >> xmlns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> > > > > >> >> xmlns:SOAP-ENV="
> > > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > > > > >> >> > > humanTaskInvokeResponse
> > > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > > HumanTaskDataSchema"
> > > > > >> >> > > xmlns:htds="
> > > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > > >> >> > > ">true</humanTaskInvokeResponse></
> > > SubProcess24Task131Output></
> > > > > >> >> > > SubProcess24Task131Output></message>
> > > > > >> >> > > 424573639 [ODEServer-510] INFO
> > > org.apache.ode.axis2.ExternalS
> > > > > >> ervice
> > > > > >> >> -
> > > > > >> >> > > Response:
> > > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > > >> >> > > <message><SubProcess24Task132Output><
> > > SubProcess24Task132Output
> > > > > >> >> xmlns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> > > > > >> >> xmlns:SOAP-ENV="
> > > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > > > > >> >> > > humanTaskInvokeResponse
> > > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > > HumanTaskDataSchema"
> > > > > >> >> > > xmlns:htds="
> > > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > > >> >> > > ">true</humanTaskInvokeResponse></
> > > SubProcess24Task132Output></
> > > > > >> >> > > SubProcess24Task132Output></message>
> > > > > >> >> > > 424573852 [ODEServer-513] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE
> channel:
> > > 383
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573856 [ODEServer-511] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE
> channel:
> > > 365
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573863 [ODEServer-504] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE
> channel:
> > > 282
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573865 [ODEServer-513] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573863 [ODEServer-517] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE
> channel:
> > > 423
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573863 [ODEServer-514] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE
> channel:
> > > 269
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573868 [ODEServer-508] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE
> channel:
> > > 226
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573868 [ODEServer-507] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE
> channel:
> > > 401
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573869 [ODEServer-517] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573869 [ODEServer-504] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573870 [ODEServer-514] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573870 [ODEServer-511] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573868 [ODEServer-519] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > a
> > > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time:
> 2017-07-11
> > > > > 14:02:13
> > > > > >> >> EDT
> > > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > > instanceId:
> > > > > >> >> 48210
> > > > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE
> channel:
> > > 316
> > > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > > inMem:
> > > > > >> false
> > > > > >> >> > > detailsExt: {})
> > > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > > acquireInstanceLock(
> > > > > >> >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lEngineImpl.onScheduledJob(
> > > > > >> >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.bpel.engine.Bpe
> lServerImpl.onScheduledJob(
> > > > > >> >> > > BpelServerImpl.java:450)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:284)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > execTransaction(
> > > > > >> >> > > SimpleScheduler.java:239)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > at
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > > >> >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > at
> > > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > > >> >> > > 424573870 [ODEServer-507] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573870 [ODEServer-508] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424573871 [ODEServer-519] ERROR
> > > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > > while
> > > > > >> >> > processing
> > > > > >> >> > > job, retrying in 125s
> > > > > >> >> > > 424575807 [ODEServer-511] INFO
> > > org.apache.ode.axis2.ExternalS
> > > > > >> ervice
> > > > > >> >> -
> > > > > >> >> > > Response:
> > > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > > >> >> > > <message><SubProcess24Task135Output><
> > > SubProcess24Task135Output
> > > > > >> >> xmlns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> > > > > >> >> xmlns:SOAP-ENV="
> > > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > > > > >> >> > > humanTaskInvokeResponse
> > > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > > HumanTaskDataSchema"
> > > > > >> >> > > xmlns:htds="
> > > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > > >> >> > > ">true</humanTaskInvokeResponse></
> > > SubProcess24Task135Output></
> > > > > >> >> > > SubProcess24Task135Output></message>
> > > > > >> >> > >
> > > > > >> >> > >
> > > > > >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <
> > > > > sathwik.bp@gmail.com
> > > > > >> >
> > > > > >> >> > wrote:
> > > > > >> >> > >
> > > > > >> >> > > > Attachment has not come through.
> > > > > >> >> > > >
> > > > > >> >> > > > put it inline
> > > > > >> >> > > >
> > > > > >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> > > > > >> >> gangadhar.ireddy@gmail.com>
> > > > > >> >> > > > wrote:
> > > > > >> >> > > >
> > > > > >> >> > > > > Sathwik,
> > > > > >> >> > > > >
> > > > > >> >> > > > > Please find the attached log.
> > > > > >> >> > > > >
> > > > > >> >> > > > > Regards,
> > > > > >> >> > > > > Gangadhar.
> > > > > >> >> > > > >
> > > > > >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> > > > > >> >> sathwik.bp@gmail.com>
> > > > > >> >> > > > wrote:
> > > > > >> >> > > > >
> > > > > >> >> > > > >> Can you send the complete logs.
> > > > > >> >> > > > >>
> > > > > >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> > > > > >> >> sathwik.bp@gmail.com>
> > > > > >> >> > > > >> wrote:
> > > > > >> >> > > > >>
> > > > > >> >> > > > >> > Usually, the jobs gets executed pretty much
> quickly.
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > Factors that might be delaying the execution of
> jobs
> > > is
> > > > a
> > > > > >> slow
> > > > > >> >> > > > database.
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > How many concurrent messages is the process
> > expecting?
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > > > > >> >> > > gangadhar.ireddy@gmail.com
> > > > > >> >> > > > >
> > > > > >> >> > > > >> > wrote:
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > We are waiting for the jobs and it releases many
> > > times,
> > > > > but
> > > > > >> few
> > > > > >> >> > > times
> > > > > >> >> > > > it
> > > > > >> >> > > > >> > doesn't release, Is there any limit on the
> > > rescheduling?
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > Regards,
> > > > > >> >> > > > >> > Gangadhar.
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > > > > >> >> > sathwik.bp@gmail.com>
> > > > > >> >> > > > >> wrote:
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > > This is normal. Concurrent messages are
> competing
> > > for
> > > > > the
> > > > > >> >> > instance
> > > > > >> >> > > > >> lock.
> > > > > >> >> > > > >> > > Job that doesn't get the lock on the instance
> has
> > to
> > > > > wait
> > > > > >> and
> > > > > >> >> > will
> > > > > >> >> > > > be
> > > > > >> >> > > > >> > > rescheduled.
> > > > > >> >> > > > >> > > You should never clear the job table.
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > > > >> >> > > > gangadhar.ireddy@gmail.com
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> > > wrote:
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > Sathwik,
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > Please find the below log,
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > <message><SubProcess24Task137O
> > > > > >> utput><SubProcess24Task137Outp
> > > > > >> >> ut
> > > > > >> >> > > > >> > > xmlns="http://www.altair.com/E
> > > > > >> PM/Schema/SubProcess24Task137"
> > > > > >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas
> .xmlsoap.org/soap/
> > > > > envelope/
> > > > > >> "
> > > > > >> >> > > > >> > > xmlns:tns="http://www.altair.c
> > > > > >> om/EPM/Schema/SubProcess24Task
> > > > > >> >> 137
> > > > > >> >> > > "><
> > > > > >> >> > > > >> > > humanTaskInvokeResponse
> > > > > >> >> > > > >> > > xmlns="http://www.altair.com/W
> > > > > >> F/Framework/HumanTaskDataSchem
> > > > > >> >> a"
> > > > > >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > > > > >> >> > > HumanTaskDataSchema
> > > > > >> >> > > > >> > ">true</
> > > > > >> >> > > > >> > > humanTaskInvokeResponse></
> > > > SubProcess24Task137Output></
> > > > > >> >> > > > >> > > SubProcess24Task137Output></message>
> > > > > >> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> > > > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler
> > -
> > > > > Error
> > > > > >> >> while
> > > > > >> >> > > > >> > > processing a persisted job: Job
> > > hqejbhcnphrcfcpvi9xhf3
> > > > > >> time:
> > > > > >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true
> > persisted:
> > > > true
> > > > > >> >> > details:
> > > > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968
> > > processId:
> > > > > null
> > > > > >> >> type:
> > > > > >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > > > > >> >> > correlationKeySet:
> > > > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > > >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$
> > > > > JobProcessorException
> > > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > > > >> >> > > > >> lEngineImpl.acquireInstanceLoc
> > > > > >> >> > > > >> > k(
> > > > > >> >> > > > >> > > BpelEngineImpl.java:394)
> > > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > > >> >> > > > BpelEngineImpl.onScheduledJob(
> > > > > >> >> > > > >> > > BpelEngineImpl.java:403)
> > > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > > >> >> > > > BpelServerImpl.onScheduledJob(
> > > > > >> >> > > > >> > > BpelServerImpl.java:450)
> > > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > > >> >> > > simple.SimpleScheduler$RunJob$
> > > > > >> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> > > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > > >> >> > > simple.SimpleScheduler$RunJob$
> > > > > >> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> > > > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > > > >> e.SimpleScheduler.
> > > > > >> >> > > > >> > > execTransaction(
> > > > > >> >> > > > >> > > SimpleScheduler.java:284)
> > > > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > > > >> e.SimpleScheduler.
> > > > > >> >> > > > >> > > execTransaction(
> > > > > >> >> > > > >> > > SimpleScheduler.java:239)
> > > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > > >> >> > > simple.SimpleScheduler$RunJob.
> > > > > >> >> > > > >> > > call(SimpleScheduler.java:512)
> > > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > > >> >> > > simple.SimpleScheduler$RunJob.
> > > > > >> >> > > > >> > > call(SimpleScheduler.java:496)
> > > > > >> >> > > > >> > >         at java.util.concurrent.FutureTas
> > > > > >> k.run(FutureTask.
> > > > > >> >> > > java:266)
> > > > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > > > >> >> lExecutor.runWorker(
> > > > > >> >> > > > >> > > ThreadPoolExecutor.java:1142)
> > > > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > > > >> >> lExecutor$Worker.run(
> > > > > >> >> > > > >> > > ThreadPoolExecutor.java:617)
> > > > > >> >> > > > >> > >         at java.lang.Thread.run(Thread.ja
> va:745)
> > > > > >> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> > > > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler
> > -
> > > > > Error
> > > > > >> >> while
> > > > > >> >> > > > >> > > processing a persisted job: Job
> > > hqejbhcnphrcfcpvi9xhem
> > > > > >> time:
> > > > > >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true
> > persisted:
> > > > true
> > > > > >> >> > details:
> > > > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955
> > > processId:
> > > > > null
> > > > > >> >> type:
> > > > > >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > > > > >> >> > correlationKeySet:
> > > > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > Regards,
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > Gangadhar.
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > > > > >> >> > > sathwik.bp@gmail.com
> > > > > >> >> > > > >
> > > > > >> >> > > > >> > > wrote:
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> > > > There are multiple factors for intermittent
> > > issues.
> > > > I
> > > > > >> can
> > > > > >> >> only
> > > > > >> >> > > > >> > speculate
> > > > > >> >> > > > >> > > > here with limited information.
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > > Check your logs for failures when it happens
> and
> > > > share
> > > > > >> it
> > > > > >> >> > here,
> > > > > >> >> > > so
> > > > > >> >> > > > >> that
> > > > > >> >> > > > >> > > we
> > > > > >> >> > > > >> > > > can help you better. If possible put in a
> sample
> > > > > >> process to
> > > > > >> >> > > > >> reproduce
> > > > > >> >> > > > >> > > your
> > > > > >> >> > > > >> > > > scenario and share here.
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar
> > ireddy
> > > <
> > > > > >> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > > > > Sometimes the activity gets released, if it
> is
> > > due
> > > > > to
> > > > > >> >> > failures
> > > > > >> >> > > > in
> > > > > >> >> > > > >> the
> > > > > >> >> > > > >> > > > > process, it should fail every time right?
> > > > > >> >> > > > >> > > > >
> > > > > >> >> > > > >> > > > > Regards,
> > > > > >> >> > > > >> > > > > Gangadhar.
> > > > > >> >> > > > >> > > > >
> > > > > >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B
> P <
> > > > > >> >> > > > >> sathwik.bp@gmail.com>
> > > > > >> >> > > > >> > > > wrote:
> > > > > >> >> > > > >> > > > >
> > > > > >> >> > > > >> > > > > > Jobs might be getting rescheduled due to
> > > > failures
> > > > > in
> > > > > >> >> the
> > > > > >> >> > > > >> process.
> > > > > >> >> > > > >> > > > > > Check the logs for errors.
> > > > > >> >> > > > >> > > > > >
> > > > > >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM,
> Gangadhar
> > > > > ireddy <
> > > > > >> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > > >> >> > > > >> > > > > >
> > > > > >> >> > > > >> > > > > > > Hi Sathwik,
> > > > > >> >> > > > >> > > > > > >
> > > > > >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in
> ode_jobs
> > > > > >> table,for
> > > > > >> >> > some
> > > > > >> >> > > > >> tasks
> > > > > >> >> > > > >> > it
> > > > > >> >> > > > >> > > > will
> > > > > >> >> > > > >> > > > > > be
> > > > > >> >> > > > >> > > > > > > updated with INVOKE_CHECK from
> > > > INVOKE_RESPONSE.
> > > > > >> >> > Sometimes
> > > > > >> >> > > it
> > > > > >> >> > > > >> > takes
> > > > > >> >> > > > >> > > > more
> > > > > >> >> > > > >> > > > > > > time to release the tasks, sometimes it
> > will
> > > > not
> > > > > >> >> > release.
> > > > > >> >> > > > >> > > > > > >
> > > > > >> >> > > > >> > > > > > > Regards,
> > > > > >> >> > > > >> > > > > > > Ganga.
> > > > > >> >> > > > >> > > > > > >
> > > > > >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik
> B
> > P
> > > <
> > > > > >> >> > > > >> > sathwik.bp@gmail.com>
> > > > > >> >> > > > >> > > > > > wrote:
> > > > > >> >> > > > >> > > > > > >
> > > > > >> >> > > > >> > > > > > > > What kind of jobs are pending?
> > > > > >> >> > > > >> > > > > > > > What activities do you have within
> your
> > > > > <flow>?
> > > > > >> >> > > > >> > > > > > > >
> > > > > >> >> > > > >> > > > > > > > regards,
> > > > > >> >> > > > >> > > > > > > > sathwik
> > > > > >> >> > > > >> > > > > > > >
> > > > > >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM,
> > Gangadhar
> > > > > >> ireddy <
> > > > > >> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > > > >> >> > > > >> > > > > > > > > wrote:
> > > > > >> >> > > > >> > > > > > > >
> > > > > >> >> > > > >> > > > > > > > > Hi,
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > > > This is Gangadhar working for
> Altair,
> > > > > >> currently
> > > > > >> >> we
> > > > > >> >> > are
> > > > > >> >> > > > >> using
> > > > > >> >> > > > >> > > > > > Apache-ode
> > > > > >> >> > > > >> > > > > > > > and
> > > > > >> >> > > > >> > > > > > > > > facing few issues on flow activity.
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will
> > not
> > > > be
> > > > > >> >> released
> > > > > >> >> > > and
> > > > > >> >> > > > >> > when i
> > > > > >> >> > > > >> > > > > check
> > > > > >> >> > > > >> > > > > > > the
> > > > > >> >> > > > >> > > > > > > > > ode_job table there are some records
> > not
> > > > > >> getting
> > > > > >> >> > > > updated.
> > > > > >> >> > > > >> But
> > > > > >> >> > > > >> > > > when
> > > > > >> >> > > > >> > > > > i
> > > > > >> >> > > > >> > > > > > > > clean
> > > > > >> >> > > > >> > > > > > > > > ode_job table and create a new
> > instance
> > > it
> > > > > >> works
> > > > > >> >> > fine.
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities
> in
> > > > flow
> > > > > ,
> > > > > >> it
> > > > > >> >> > takes
> > > > > >> >> > > > >> large
> > > > > >> >> > > > >> > > > amount
> > > > > >> >> > > > >> > > > > > of
> > > > > >> >> > > > >> > > > > > > > time
> > > > > >> >> > > > >> > > > > > > > > to release all the tasks.
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > > > Thanks,
> > > > > >> >> > > > >> > > > > > > > > Gangadhar.
> > > > > >> >> > > > >> > > > > > > > >
> > > > > >> >> > > > >> > > > > > > >
> > > > > >> >> > > > >> > > > > > >
> > > > > >> >> > > > >> > > > > >
> > > > > >> >> > > > >> > > > >
> > > > > >> >> > > > >> > > >
> > > > > >> >> > > > >> > >
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >> >
> > > > > >> >> > > > >>
> > > > > >> >> > > > >
> > > > > >> >> > > > >
> > > > > >> >> > > >
> > > > > >> >> > >
> > > > > >> >> >
> > > > > >> >>
> > > > > >> >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Your process model creates a lot of contension on the process instance.
This kind of model cannot scale.

Human task activites are async in nature, not sure why is your model using
sync invoke calls.

Changing the job rescheduling mechanism is not feasible, because there is
risk of completing the 10 retries much faster and ODE will remove the job
after 10 unsuccessful retries.

Look towards making one way invokes as against sync invokes or reduce
parallel activities in the flow. Today you have 16 invokes, and the process
might have more in future.



On Jan 3, 2018 11:19, "Gangadhar ireddy" <ga...@gmail.com> wrote:

Sathwik,

We made all activities as manual activities ,each is assigned to different
user and these are not dependent, So all users can work in parallel.

Regards,
Gangadhar.

On Wed, Jan 3, 2018 at 10:59 AM, Sathwik B P <sa...@gmail.com> wrote:

> Oh, seems like the whole process is running in parallel. Any specific need
> to design the process in such manner?
>
> On Jan 2, 2018 21:41, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> > Sathwik , Total 16 activities i have in parallel, I tried with the
> > workaround you provided. Splitted the 16 invoke activities to 4 Flow
> > activities, so each flow containing 4 activities. But still i see the
> same
> > problem. To get all these activities its taking 1hour. If they are more
> > activities than 16, it takes 5hours(as it multiples time with 5
> everytime).
> >
> > Regards,
> > Gangadhar.
> >
> > On Tue, Jan 2, 2018 at 4:21 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > Its not configurable.
> > >
> > > What are those 8 activities that are running in parallel?
> > >
> > > Do you have to run all the 8 activities in parallel?
> > >
> > > A warkaround might be to break your 8 activities into 4 different
flows
> > > with 2 activities each. Does that work for you.
> > >
> > >
> > >
> > > On Tue, Jan 2, 2018 at 3:21 PM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com
> > > > wrote:
> > >
> > > > Sathwik,
> > > >
> > > > I am still facing the issue with flow activity if it has more than 8
> > > tasks
> > > > in parallel. And also the retry time is getting increased
> > > > everytime(multipled by 5) . So its a big delay for me to get the
> > > activity.
> > > > Is there any config file to change the retry time?
> > > >
> > > > Regards,
> > > > Ganga.
> > > >
> > > > On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >
> > > > > Sure Sathwik, let me try on a dedicated database, Thanks a lot for
> > your
> > > > > help.
> > > > >
> > > > > Regards,
> > > > > Gangadhar.
> > > > >
> > > > > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sathwik.bp@gmail.com
> >
> > > > wrote:
> > > > >
> > > > >> I have taken a specific job's execution time from your logs.
> > > > >>
> > > > >> Example:
> > > > >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer
[1]
> > > > >> It could not acquire the instance lock and hence was scheduled
for
> > > 25sec
> > > > >> later, refer [2]. This is the second retry iteration. The first
> > > > iteration
> > > > >> would have been with a 5sec delay, one should have seen this in
> the
> > > > logs,
> > > > >> may be you have truncated that part of the logs.
> > > > >> When the job got into execution the time should have been
sometime
> > > > >> approximately around 14:01:07 + 25sec = 14:01:32, but its time:
> > > > 2017-07-11
> > > > >> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec
> > > more.
> > > > >> Due to slow running transactions, the Scheduler will throttle the
> > > jobs.
> > > > >>
> > > > >> To improve the execution times,
> > > > >> * Put off event generation (http://ode.apache.org/ode-exe
> > > > >> cution-events.html
> > > > >> ).
> > > > >> * Have a dedicated database server with good hardware.
> > > > >>
> > > > >> [1]
> > > > >> 424519845 [ODEServer-513] ERROR
> > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > >> processing a
> > > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> 14:01:07
> > > EDT
> > > > >> transacted: true persisted: true details: JobDetails( instanceId:
> > > 48210
> > > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > >> correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > false
> > > > >> detailsExt: {})
> > > > >>
> > > > >> [2]
> > > > >> 424519862 [ODEServer-513] ERROR
> > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > processing
> > > > >> job, retrying in 25s
> > > > >>
> > > > >> [3]
> > > > >> 424573863 [ODEServer-517] ERROR
> > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > >> processing a
> > > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> 14:02:13
> > > EDT
> > > > >> transacted: true persisted: true details: JobDetails( instanceId:
> > > 48210
> > > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > >> correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > false
> > > > >> detailsExt: {})
> > > > >>
> > > > >> regards,
> > > > >> sathwik
> > > > >>
> > > > >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <
> sathwik.bp@gmail.com>
> > > > >> wrote:
> > > > >>
> > > > >> > What is the setting for the below config parameter in your
> > > > >> > ode.axis2.properties file
> > > > >> > ode-axis2.tx.factory.class=
> > > > >> >
> > > > >> > Have you configured a Transaction Manager in your tomcat?
> > > > >> >
> > > > >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> > > > >> > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >
> > > > >> >> Hi Sathwik,
> > > > >> >>
> > > > >> >> Please find the details below:-
> > > > >> >>
> > > > >> >> ODE version :- 1.3.5
> > > > >> >> Server :- Apache tomcat
> > > > >> >> Database :- Oracle
> > > > >> >> OpenJPA or Hibernate:- Hibernate
> > > > >> >>
> > > > >> >> Regards,
> > > > >> >> Gangadhar.
> > > > >> >>
> > > > >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <
> > > sathwik.bp@gmail.com>
> > > > >> >> wrote:
> > > > >> >>
> > > > >> >> > Can you provide these info please
> > > > >> >> > ODE version?
> > > > >> >> > Server?
> > > > >> >> > Database?
> > > > >> >> > OpenJPA or Hibernate?
> > > > >> >> >
> > > > >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > > > >> >> > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >> >
> > > > >> >> > > 424519400 [ODEServer-505] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task137Output><
> > SubProcess24Task137Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task137Output></
> > > > >> >> > > SubProcess24Task137Output></message>
> > > > >> >> > > 424519845 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > > > 14:01:07
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE
channel:
> > 423
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519851 [ODEServer-518] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE
channel:
> > 269
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519854 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE
channel:
> > 378
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519853 [ODEServer-502] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE
channel:
> > 316
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519849 [ODEServer-506] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE
channel:
> > 282
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519852 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE
channel:
> > 401
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519865 [ODEServer-506] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519865 [ODEServer-502] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519866 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519863 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE
channel:
> > 383
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519863 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE
channel:
> > 226
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519862 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE
channel:
> > 365
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519868 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519862 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519868 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519868 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519867 [ODEServer-518] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519866 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519866 [ODEServer-510] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE
channel:
> > 295
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519870 [ODEServer-510] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424522517 [ODEServer-510] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task131Output><
> > SubProcess24Task131Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task131Output></
> > > > >> >> > > SubProcess24Task131Output></message>
> > > > >> >> > > 424573639 [ODEServer-510] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task132Output><
> > SubProcess24Task132Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task132Output></
> > > > >> >> > > SubProcess24Task132Output></message>
> > > > >> >> > > 424573852 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE
channel:
> > 383
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573856 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE
channel:
> > 365
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573863 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE
channel:
> > 282
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573865 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573863 [ODEServer-517] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE
channel:
> > 423
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573863 [ODEServer-514] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE
channel:
> > 269
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573868 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE
channel:
> > 226
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573868 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE
channel:
> > 401
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573869 [ODEServer-517] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573869 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573870 [ODEServer-514] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573870 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573868 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE
channel:
> > 316
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573870 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573870 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573871 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424575807 [ODEServer-511] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task135Output><
> > SubProcess24Task135Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task135Output></
> > > > >> >> > > SubProcess24Task135Output></message>
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <
> > > > sathwik.bp@gmail.com
> > > > >> >
> > > > >> >> > wrote:
> > > > >> >> > >
> > > > >> >> > > > Attachment has not come through.
> > > > >> >> > > >
> > > > >> >> > > > put it inline
> > > > >> >> > > >
> > > > >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> > > > >> >> gangadhar.ireddy@gmail.com>
> > > > >> >> > > > wrote:
> > > > >> >> > > >
> > > > >> >> > > > > Sathwik,
> > > > >> >> > > > >
> > > > >> >> > > > > Please find the attached log.
> > > > >> >> > > > >
> > > > >> >> > > > > Regards,
> > > > >> >> > > > > Gangadhar.
> > > > >> >> > > > >
> > > > >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> > > > >> >> sathwik.bp@gmail.com>
> > > > >> >> > > > wrote:
> > > > >> >> > > > >
> > > > >> >> > > > >> Can you send the complete logs.
> > > > >> >> > > > >>
> > > > >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> > > > >> >> sathwik.bp@gmail.com>
> > > > >> >> > > > >> wrote:
> > > > >> >> > > > >>
> > > > >> >> > > > >> > Usually, the jobs gets executed pretty much
quickly.
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > Factors that might be delaying the execution of
jobs
> > is
> > > a
> > > > >> slow
> > > > >> >> > > > database.
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > How many concurrent messages is the process
> expecting?
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > > > >> >> > > gangadhar.ireddy@gmail.com
> > > > >> >> > > > >
> > > > >> >> > > > >> > wrote:
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > We are waiting for the jobs and it releases many
> > times,
> > > > but
> > > > >> few
> > > > >> >> > > times
> > > > >> >> > > > it
> > > > >> >> > > > >> > doesn't release, Is there any limit on the
> > rescheduling?
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > Regards,
> > > > >> >> > > > >> > Gangadhar.
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > > > >> >> > sathwik.bp@gmail.com>
> > > > >> >> > > > >> wrote:
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > > This is normal. Concurrent messages are competing
> > for
> > > > the
> > > > >> >> > instance
> > > > >> >> > > > >> lock.
> > > > >> >> > > > >> > > Job that doesn't get the lock on the instance has
> to
> > > > wait
> > > > >> and
> > > > >> >> > will
> > > > >> >> > > > be
> > > > >> >> > > > >> > > rescheduled.
> > > > >> >> > > > >> > > You should never clear the job table.
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > > >> >> > > > gangadhar.ireddy@gmail.com
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > > wrote:
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Sathwik,
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Please find the below log,
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > <message><SubProcess24Task137O
> > > > >> utput><SubProcess24Task137Outp
> > > > >> >> ut
> > > > >> >> > > > >> > > xmlns="http://www.altair.com/E
> > > > >> PM/Schema/SubProcess24Task137"
> > > > >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/
> > > > envelope/
> > > > >> "
> > > > >> >> > > > >> > > xmlns:tns="http://www.altair.c
> > > > >> om/EPM/Schema/SubProcess24Task
> > > > >> >> 137
> > > > >> >> > > "><
> > > > >> >> > > > >> > > humanTaskInvokeResponse
> > > > >> >> > > > >> > > xmlns="http://www.altair.com/W
> > > > >> F/Framework/HumanTaskDataSchem
> > > > >> >> a"
> > > > >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > > > >> >> > > HumanTaskDataSchema
> > > > >> >> > > > >> > ">true</
> > > > >> >> > > > >> > > humanTaskInvokeResponse></
> > > SubProcess24Task137Output></
> > > > >> >> > > > >> > > SubProcess24Task137Output></message>
> > > > >> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> > > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler
> -
> > > > Error
> > > > >> >> while
> > > > >> >> > > > >> > > processing a persisted job: Job
> > hqejbhcnphrcfcpvi9xhf3
> > > > >> time:
> > > > >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true
> persisted:
> > > true
> > > > >> >> > details:
> > > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968
> > processId:
> > > > null
> > > > >> >> type:
> > > > >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > > > >> >> > correlationKeySet:
> > > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$
> > > > JobProcessorException
> > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > > >> >> > > > >> lEngineImpl.acquireInstanceLoc
> > > > >> >> > > > >> > k(
> > > > >> >> > > > >> > > BpelEngineImpl.java:394)
> > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > >> >> > > > BpelEngineImpl.onScheduledJob(
> > > > >> >> > > > >> > > BpelEngineImpl.java:403)
> > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > >> >> > > > BpelServerImpl.onScheduledJob(
> > > > >> >> > > > >> > > BpelServerImpl.java:450)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob$
> > > > >> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob$
> > > > >> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > > >> e.SimpleScheduler.
> > > > >> >> > > > >> > > execTransaction(
> > > > >> >> > > > >> > > SimpleScheduler.java:284)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > > >> e.SimpleScheduler.
> > > > >> >> > > > >> > > execTransaction(
> > > > >> >> > > > >> > > SimpleScheduler.java:239)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob.
> > > > >> >> > > > >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob.
> > > > >> >> > > > >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > > >> > >         at java.util.concurrent.FutureTas
> > > > >> k.run(FutureTask.
> > > > >> >> > > java:266)
> > > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > > >> >> lExecutor.runWorker(
> > > > >> >> > > > >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > > >> >> lExecutor$Worker.run(
> > > > >> >> > > > >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> > > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler
> -
> > > > Error
> > > > >> >> while
> > > > >> >> > > > >> > > processing a persisted job: Job
> > hqejbhcnphrcfcpvi9xhem
> > > > >> time:
> > > > >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true
> persisted:
> > > true
> > > > >> >> > details:
> > > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955
> > processId:
> > > > null
> > > > >> >> type:
> > > > >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > > > >> >> > correlationKeySet:
> > > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Regards,
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Gangadhar.
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > > > >> >> > > sathwik.bp@gmail.com
> > > > >> >> > > > >
> > > > >> >> > > > >> > > wrote:
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > > There are multiple factors for intermittent
> > issues.
> > > I
> > > > >> can
> > > > >> >> only
> > > > >> >> > > > >> > speculate
> > > > >> >> > > > >> > > > here with limited information.
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > > Check your logs for failures when it happens
and
> > > share
> > > > >> it
> > > > >> >> > here,
> > > > >> >> > > so
> > > > >> >> > > > >> that
> > > > >> >> > > > >> > > we
> > > > >> >> > > > >> > > > can help you better. If possible put in a
sample
> > > > >> process to
> > > > >> >> > > > >> reproduce
> > > > >> >> > > > >> > > your
> > > > >> >> > > > >> > > > scenario and share here.
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar
> ireddy
> > <
> > > > >> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > > > Sometimes the activity gets released, if it
is
> > due
> > > > to
> > > > >> >> > failures
> > > > >> >> > > > in
> > > > >> >> > > > >> the
> > > > >> >> > > > >> > > > > process, it should fail every time right?
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > > > Regards,
> > > > >> >> > > > >> > > > > Gangadhar.
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P
<
> > > > >> >> > > > >> sathwik.bp@gmail.com>
> > > > >> >> > > > >> > > > wrote:
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > > > > Jobs might be getting rescheduled due to
> > > failures
> > > > in
> > > > >> >> the
> > > > >> >> > > > >> process.
> > > > >> >> > > > >> > > > > > Check the logs for errors.
> > > > >> >> > > > >> > > > > >
> > > > >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar
> > > > ireddy <
> > > > >> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >> > > > >> > > > > >
> > > > >> >> > > > >> > > > > > > Hi Sathwik,
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in
ode_jobs
> > > > >> table,for
> > > > >> >> > some
> > > > >> >> > > > >> tasks
> > > > >> >> > > > >> > it
> > > > >> >> > > > >> > > > will
> > > > >> >> > > > >> > > > > > be
> > > > >> >> > > > >> > > > > > > updated with INVOKE_CHECK from
> > > INVOKE_RESPONSE.
> > > > >> >> > Sometimes
> > > > >> >> > > it
> > > > >> >> > > > >> > takes
> > > > >> >> > > > >> > > > more
> > > > >> >> > > > >> > > > > > > time to release the tasks, sometimes it
> will
> > > not
> > > > >> >> > release.
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > Regards,
> > > > >> >> > > > >> > > > > > > Ganga.
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B
> P
> > <
> > > > >> >> > > > >> > sathwik.bp@gmail.com>
> > > > >> >> > > > >> > > > > > wrote:
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > > What kind of jobs are pending?
> > > > >> >> > > > >> > > > > > > > What activities do you have within your
> > > > <flow>?
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > > > regards,
> > > > >> >> > > > >> > > > > > > > sathwik
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM,
> Gangadhar
> > > > >> ireddy <
> > > > >> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > > >> >> > > > >> > > > > > > > > wrote:
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > > > > Hi,
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > This is Gangadhar working for Altair,
> > > > >> currently
> > > > >> >> we
> > > > >> >> > are
> > > > >> >> > > > >> using
> > > > >> >> > > > >> > > > > > Apache-ode
> > > > >> >> > > > >> > > > > > > > and
> > > > >> >> > > > >> > > > > > > > > facing few issues on flow activity.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will
> not
> > > be
> > > > >> >> released
> > > > >> >> > > and
> > > > >> >> > > > >> > when i
> > > > >> >> > > > >> > > > > check
> > > > >> >> > > > >> > > > > > > the
> > > > >> >> > > > >> > > > > > > > > ode_job table there are some records
> not
> > > > >> getting
> > > > >> >> > > > updated.
> > > > >> >> > > > >> But
> > > > >> >> > > > >> > > > when
> > > > >> >> > > > >> > > > > i
> > > > >> >> > > > >> > > > > > > > clean
> > > > >> >> > > > >> > > > > > > > > ode_job table and create a new
> instance
> > it
> > > > >> works
> > > > >> >> > fine.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities
in
> > > flow
> > > > ,
> > > > >> it
> > > > >> >> > takes
> > > > >> >> > > > >> large
> > > > >> >> > > > >> > > > amount
> > > > >> >> > > > >> > > > > > of
> > > > >> >> > > > >> > > > > > > > time
> > > > >> >> > > > >> > > > > > > > > to release all the tasks.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > Thanks,
> > > > >> >> > > > >> > > > > > > > > Gangadhar.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > >
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> >
> > > > >> >> > > > >> >
> > > > >> >> > > > >> >
> > > > >> >> > > > >>
> > > > >> >> > > > >
> > > > >> >> > > > >
> > > > >> >> > > >
> > > > >> >> > >
> > > > >> >> >
> > > > >> >>
> > > > >> >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sathwik,

We made all activities as manual activities ,each is assigned to different
user and these are not dependent, So all users can work in parallel.

Regards,
Gangadhar.

On Wed, Jan 3, 2018 at 10:59 AM, Sathwik B P <sa...@gmail.com> wrote:

> Oh, seems like the whole process is running in parallel. Any specific need
> to design the process in such manner?
>
> On Jan 2, 2018 21:41, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> > Sathwik , Total 16 activities i have in parallel, I tried with the
> > workaround you provided. Splitted the 16 invoke activities to 4 Flow
> > activities, so each flow containing 4 activities. But still i see the
> same
> > problem. To get all these activities its taking 1hour. If they are more
> > activities than 16, it takes 5hours(as it multiples time with 5
> everytime).
> >
> > Regards,
> > Gangadhar.
> >
> > On Tue, Jan 2, 2018 at 4:21 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > Its not configurable.
> > >
> > > What are those 8 activities that are running in parallel?
> > >
> > > Do you have to run all the 8 activities in parallel?
> > >
> > > A warkaround might be to break your 8 activities into 4 different flows
> > > with 2 activities each. Does that work for you.
> > >
> > >
> > >
> > > On Tue, Jan 2, 2018 at 3:21 PM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com
> > > > wrote:
> > >
> > > > Sathwik,
> > > >
> > > > I am still facing the issue with flow activity if it has more than 8
> > > tasks
> > > > in parallel. And also the retry time is getting increased
> > > > everytime(multipled by 5) . So its a big delay for me to get the
> > > activity.
> > > > Is there any config file to change the retry time?
> > > >
> > > > Regards,
> > > > Ganga.
> > > >
> > > > On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >
> > > > > Sure Sathwik, let me try on a dedicated database, Thanks a lot for
> > your
> > > > > help.
> > > > >
> > > > > Regards,
> > > > > Gangadhar.
> > > > >
> > > > > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sathwik.bp@gmail.com
> >
> > > > wrote:
> > > > >
> > > > >> I have taken a specific job's execution time from your logs.
> > > > >>
> > > > >> Example:
> > > > >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
> > > > >> It could not acquire the instance lock and hence was scheduled for
> > > 25sec
> > > > >> later, refer [2]. This is the second retry iteration. The first
> > > > iteration
> > > > >> would have been with a 5sec delay, one should have seen this in
> the
> > > > logs,
> > > > >> may be you have truncated that part of the logs.
> > > > >> When the job got into execution the time should have been sometime
> > > > >> approximately around 14:01:07 + 25sec = 14:01:32, but its time:
> > > > 2017-07-11
> > > > >> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec
> > > more.
> > > > >> Due to slow running transactions, the Scheduler will throttle the
> > > jobs.
> > > > >>
> > > > >> To improve the execution times,
> > > > >> * Put off event generation (http://ode.apache.org/ode-exe
> > > > >> cution-events.html
> > > > >> ).
> > > > >> * Have a dedicated database server with good hardware.
> > > > >>
> > > > >> [1]
> > > > >> 424519845 [ODEServer-513] ERROR
> > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > >> processing a
> > > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> 14:01:07
> > > EDT
> > > > >> transacted: true persisted: true details: JobDetails( instanceId:
> > > 48210
> > > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > >> correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > false
> > > > >> detailsExt: {})
> > > > >>
> > > > >> [2]
> > > > >> 424519862 [ODEServer-513] ERROR
> > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > processing
> > > > >> job, retrying in 25s
> > > > >>
> > > > >> [3]
> > > > >> 424573863 [ODEServer-517] ERROR
> > > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > > >> processing a
> > > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> 14:02:13
> > > EDT
> > > > >> transacted: true persisted: true details: JobDetails( instanceId:
> > > 48210
> > > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > > >> correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > false
> > > > >> detailsExt: {})
> > > > >>
> > > > >> regards,
> > > > >> sathwik
> > > > >>
> > > > >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <
> sathwik.bp@gmail.com>
> > > > >> wrote:
> > > > >>
> > > > >> > What is the setting for the below config parameter in your
> > > > >> > ode.axis2.properties file
> > > > >> > ode-axis2.tx.factory.class=
> > > > >> >
> > > > >> > Have you configured a Transaction Manager in your tomcat?
> > > > >> >
> > > > >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> > > > >> > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >
> > > > >> >> Hi Sathwik,
> > > > >> >>
> > > > >> >> Please find the details below:-
> > > > >> >>
> > > > >> >> ODE version :- 1.3.5
> > > > >> >> Server :- Apache tomcat
> > > > >> >> Database :- Oracle
> > > > >> >> OpenJPA or Hibernate:- Hibernate
> > > > >> >>
> > > > >> >> Regards,
> > > > >> >> Gangadhar.
> > > > >> >>
> > > > >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <
> > > sathwik.bp@gmail.com>
> > > > >> >> wrote:
> > > > >> >>
> > > > >> >> > Can you provide these info please
> > > > >> >> > ODE version?
> > > > >> >> > Server?
> > > > >> >> > Database?
> > > > >> >> > OpenJPA or Hibernate?
> > > > >> >> >
> > > > >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > > > >> >> > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >> >
> > > > >> >> > > 424519400 [ODEServer-505] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task137Output><
> > SubProcess24Task137Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task137Output></
> > > > >> >> > > SubProcess24Task137Output></message>
> > > > >> >> > > 424519845 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > > > 14:01:07
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel:
> > 423
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519851 [ODEServer-518] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel:
> > 269
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519854 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel:
> > 378
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519853 [ODEServer-502] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel:
> > 316
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519849 [ODEServer-506] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel:
> > 282
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519852 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel:
> > 401
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519865 [ODEServer-506] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519865 [ODEServer-502] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519866 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519863 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel:
> > 383
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519863 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel:
> > 226
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519862 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel:
> > 365
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519868 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519862 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519868 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519868 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519867 [ODEServer-518] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519866 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424519866 [ODEServer-510] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11
> > > > 14:01:05
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel:
> > 295
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424519870 [ODEServer-510] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 25s
> > > > >> >> > > 424522517 [ODEServer-510] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task131Output><
> > SubProcess24Task131Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task131Output></
> > > > >> >> > > SubProcess24Task131Output></message>
> > > > >> >> > > 424573639 [ODEServer-510] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task132Output><
> > SubProcess24Task132Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task132Output></
> > > > >> >> > > SubProcess24Task132Output></message>
> > > > >> >> > > 424573852 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel:
> > 383
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573856 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel:
> > 365
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573863 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel:
> > 282
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573865 [ODEServer-513] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573863 [ODEServer-517] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel:
> > 423
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573863 [ODEServer-514] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel:
> > 269
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573868 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel:
> > 226
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573868 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel:
> > 401
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573869 [ODEServer-517] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573869 [ODEServer-504] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573870 [ODEServer-514] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573870 [ODEServer-511] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573868 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > a
> > > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > > > 14:02:13
> > > > >> >> EDT
> > > > >> >> > > transacted: true persisted: true details: JobDetails(
> > > instanceId:
> > > > >> >> 48210
> > > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel:
> > 316
> > > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> > inMem:
> > > > >> false
> > > > >> >> > > detailsExt: {})
> > > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> > acquireInstanceLock(
> > > > >> >> > > BpelEngineImpl.java:394)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > > >> >> > > BpelEngineImpl.java:403)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > > >> >> > > BpelServerImpl.java:450)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:284)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > > >> >> > > SimpleScheduler.java:239)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > at
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > > >> >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > at
> > > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > > >> >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > 424573870 [ODEServer-507] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573870 [ODEServer-508] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424573871 [ODEServer-519] ERROR
> > > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> > while
> > > > >> >> > processing
> > > > >> >> > > job, retrying in 125s
> > > > >> >> > > 424575807 [ODEServer-511] INFO
> > org.apache.ode.axis2.ExternalS
> > > > >> ervice
> > > > >> >> -
> > > > >> >> > > Response:
> > > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > > >> >> > > <message><SubProcess24Task135Output><
> > SubProcess24Task135Output
> > > > >> >> xmlns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> > > > >> >> xmlns:SOAP-ENV="
> > > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > > > >> >> > > humanTaskInvokeResponse
> > > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema"
> > > > >> >> > > xmlns:htds="
> > > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > > >> >> > > ">true</humanTaskInvokeResponse></
> > SubProcess24Task135Output></
> > > > >> >> > > SubProcess24Task135Output></message>
> > > > >> >> > >
> > > > >> >> > >
> > > > >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <
> > > > sathwik.bp@gmail.com
> > > > >> >
> > > > >> >> > wrote:
> > > > >> >> > >
> > > > >> >> > > > Attachment has not come through.
> > > > >> >> > > >
> > > > >> >> > > > put it inline
> > > > >> >> > > >
> > > > >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> > > > >> >> gangadhar.ireddy@gmail.com>
> > > > >> >> > > > wrote:
> > > > >> >> > > >
> > > > >> >> > > > > Sathwik,
> > > > >> >> > > > >
> > > > >> >> > > > > Please find the attached log.
> > > > >> >> > > > >
> > > > >> >> > > > > Regards,
> > > > >> >> > > > > Gangadhar.
> > > > >> >> > > > >
> > > > >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> > > > >> >> sathwik.bp@gmail.com>
> > > > >> >> > > > wrote:
> > > > >> >> > > > >
> > > > >> >> > > > >> Can you send the complete logs.
> > > > >> >> > > > >>
> > > > >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> > > > >> >> sathwik.bp@gmail.com>
> > > > >> >> > > > >> wrote:
> > > > >> >> > > > >>
> > > > >> >> > > > >> > Usually, the jobs gets executed pretty much quickly.
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > Factors that might be delaying the execution of jobs
> > is
> > > a
> > > > >> slow
> > > > >> >> > > > database.
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > How many concurrent messages is the process
> expecting?
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > > > >> >> > > gangadhar.ireddy@gmail.com
> > > > >> >> > > > >
> > > > >> >> > > > >> > wrote:
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > We are waiting for the jobs and it releases many
> > times,
> > > > but
> > > > >> few
> > > > >> >> > > times
> > > > >> >> > > > it
> > > > >> >> > > > >> > doesn't release, Is there any limit on the
> > rescheduling?
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > Regards,
> > > > >> >> > > > >> > Gangadhar.
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > > > >> >> > sathwik.bp@gmail.com>
> > > > >> >> > > > >> wrote:
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > > This is normal. Concurrent messages are competing
> > for
> > > > the
> > > > >> >> > instance
> > > > >> >> > > > >> lock.
> > > > >> >> > > > >> > > Job that doesn't get the lock on the instance has
> to
> > > > wait
> > > > >> and
> > > > >> >> > will
> > > > >> >> > > > be
> > > > >> >> > > > >> > > rescheduled.
> > > > >> >> > > > >> > > You should never clear the job table.
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > > >> >> > > > gangadhar.ireddy@gmail.com
> > > > >> >> > > > >> >
> > > > >> >> > > > >> > > wrote:
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Sathwik,
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Please find the below log,
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > <message><SubProcess24Task137O
> > > > >> utput><SubProcess24Task137Outp
> > > > >> >> ut
> > > > >> >> > > > >> > > xmlns="http://www.altair.com/E
> > > > >> PM/Schema/SubProcess24Task137"
> > > > >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/
> > > > envelope/
> > > > >> "
> > > > >> >> > > > >> > > xmlns:tns="http://www.altair.c
> > > > >> om/EPM/Schema/SubProcess24Task
> > > > >> >> 137
> > > > >> >> > > "><
> > > > >> >> > > > >> > > humanTaskInvokeResponse
> > > > >> >> > > > >> > > xmlns="http://www.altair.com/W
> > > > >> F/Framework/HumanTaskDataSchem
> > > > >> >> a"
> > > > >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > > > >> >> > > HumanTaskDataSchema
> > > > >> >> > > > >> > ">true</
> > > > >> >> > > > >> > > humanTaskInvokeResponse></
> > > SubProcess24Task137Output></
> > > > >> >> > > > >> > > SubProcess24Task137Output></message>
> > > > >> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> > > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler
> -
> > > > Error
> > > > >> >> while
> > > > >> >> > > > >> > > processing a persisted job: Job
> > hqejbhcnphrcfcpvi9xhf3
> > > > >> time:
> > > > >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true
> persisted:
> > > true
> > > > >> >> > details:
> > > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968
> > processId:
> > > > null
> > > > >> >> type:
> > > > >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > > > >> >> > correlationKeySet:
> > > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$
> > > > JobProcessorException
> > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > > >> >> > > > >> lEngineImpl.acquireInstanceLoc
> > > > >> >> > > > >> > k(
> > > > >> >> > > > >> > > BpelEngineImpl.java:394)
> > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > >> >> > > > BpelEngineImpl.onScheduledJob(
> > > > >> >> > > > >> > > BpelEngineImpl.java:403)
> > > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > >> >> > > > BpelServerImpl.onScheduledJob(
> > > > >> >> > > > >> > > BpelServerImpl.java:450)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob$
> > > > >> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob$
> > > > >> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > > >> e.SimpleScheduler.
> > > > >> >> > > > >> > > execTransaction(
> > > > >> >> > > > >> > > SimpleScheduler.java:284)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > > >> e.SimpleScheduler.
> > > > >> >> > > > >> > > execTransaction(
> > > > >> >> > > > >> > > SimpleScheduler.java:239)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob.
> > > > >> >> > > > >> > > call(SimpleScheduler.java:512)
> > > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > > >> >> > > simple.SimpleScheduler$RunJob.
> > > > >> >> > > > >> > > call(SimpleScheduler.java:496)
> > > > >> >> > > > >> > >         at java.util.concurrent.FutureTas
> > > > >> k.run(FutureTask.
> > > > >> >> > > java:266)
> > > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > > >> >> lExecutor.runWorker(
> > > > >> >> > > > >> > > ThreadPoolExecutor.java:1142)
> > > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > > >> >> lExecutor$Worker.run(
> > > > >> >> > > > >> > > ThreadPoolExecutor.java:617)
> > > > >> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > > > >> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> > > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler
> -
> > > > Error
> > > > >> >> while
> > > > >> >> > > > >> > > processing a persisted job: Job
> > hqejbhcnphrcfcpvi9xhem
> > > > >> time:
> > > > >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true
> persisted:
> > > true
> > > > >> >> > details:
> > > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955
> > processId:
> > > > null
> > > > >> >> type:
> > > > >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > > > >> >> > correlationKeySet:
> > > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Regards,
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > Gangadhar.
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > > > >> >> > > sathwik.bp@gmail.com
> > > > >> >> > > > >
> > > > >> >> > > > >> > > wrote:
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> > > > There are multiple factors for intermittent
> > issues.
> > > I
> > > > >> can
> > > > >> >> only
> > > > >> >> > > > >> > speculate
> > > > >> >> > > > >> > > > here with limited information.
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > > Check your logs for failures when it happens and
> > > share
> > > > >> it
> > > > >> >> > here,
> > > > >> >> > > so
> > > > >> >> > > > >> that
> > > > >> >> > > > >> > > we
> > > > >> >> > > > >> > > > can help you better. If possible put in a sample
> > > > >> process to
> > > > >> >> > > > >> reproduce
> > > > >> >> > > > >> > > your
> > > > >> >> > > > >> > > > scenario and share here.
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar
> ireddy
> > <
> > > > >> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > > > > Sometimes the activity gets released, if it is
> > due
> > > > to
> > > > >> >> > failures
> > > > >> >> > > > in
> > > > >> >> > > > >> the
> > > > >> >> > > > >> > > > > process, it should fail every time right?
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > > > Regards,
> > > > >> >> > > > >> > > > > Gangadhar.
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > > > >> >> > > > >> sathwik.bp@gmail.com>
> > > > >> >> > > > >> > > > wrote:
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > > > > Jobs might be getting rescheduled due to
> > > failures
> > > > in
> > > > >> >> the
> > > > >> >> > > > >> process.
> > > > >> >> > > > >> > > > > > Check the logs for errors.
> > > > >> >> > > > >> > > > > >
> > > > >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar
> > > > ireddy <
> > > > >> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >> >> > > > >> > > > > >
> > > > >> >> > > > >> > > > > > > Hi Sathwik,
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs
> > > > >> table,for
> > > > >> >> > some
> > > > >> >> > > > >> tasks
> > > > >> >> > > > >> > it
> > > > >> >> > > > >> > > > will
> > > > >> >> > > > >> > > > > > be
> > > > >> >> > > > >> > > > > > > updated with INVOKE_CHECK from
> > > INVOKE_RESPONSE.
> > > > >> >> > Sometimes
> > > > >> >> > > it
> > > > >> >> > > > >> > takes
> > > > >> >> > > > >> > > > more
> > > > >> >> > > > >> > > > > > > time to release the tasks, sometimes it
> will
> > > not
> > > > >> >> > release.
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > Regards,
> > > > >> >> > > > >> > > > > > > Ganga.
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B
> P
> > <
> > > > >> >> > > > >> > sathwik.bp@gmail.com>
> > > > >> >> > > > >> > > > > > wrote:
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > > > > What kind of jobs are pending?
> > > > >> >> > > > >> > > > > > > > What activities do you have within your
> > > > <flow>?
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > > > regards,
> > > > >> >> > > > >> > > > > > > > sathwik
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM,
> Gangadhar
> > > > >> ireddy <
> > > > >> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > > >> >> > > > >> > > > > > > > > wrote:
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > > > > Hi,
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > This is Gangadhar working for Altair,
> > > > >> currently
> > > > >> >> we
> > > > >> >> > are
> > > > >> >> > > > >> using
> > > > >> >> > > > >> > > > > > Apache-ode
> > > > >> >> > > > >> > > > > > > > and
> > > > >> >> > > > >> > > > > > > > > facing few issues on flow activity.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will
> not
> > > be
> > > > >> >> released
> > > > >> >> > > and
> > > > >> >> > > > >> > when i
> > > > >> >> > > > >> > > > > check
> > > > >> >> > > > >> > > > > > > the
> > > > >> >> > > > >> > > > > > > > > ode_job table there are some records
> not
> > > > >> getting
> > > > >> >> > > > updated.
> > > > >> >> > > > >> But
> > > > >> >> > > > >> > > > when
> > > > >> >> > > > >> > > > > i
> > > > >> >> > > > >> > > > > > > > clean
> > > > >> >> > > > >> > > > > > > > > ode_job table and create a new
> instance
> > it
> > > > >> works
> > > > >> >> > fine.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in
> > > flow
> > > > ,
> > > > >> it
> > > > >> >> > takes
> > > > >> >> > > > >> large
> > > > >> >> > > > >> > > > amount
> > > > >> >> > > > >> > > > > > of
> > > > >> >> > > > >> > > > > > > > time
> > > > >> >> > > > >> > > > > > > > > to release all the tasks.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > > > Thanks,
> > > > >> >> > > > >> > > > > > > > > Gangadhar.
> > > > >> >> > > > >> > > > > > > > >
> > > > >> >> > > > >> > > > > > > >
> > > > >> >> > > > >> > > > > > >
> > > > >> >> > > > >> > > > > >
> > > > >> >> > > > >> > > > >
> > > > >> >> > > > >> > > >
> > > > >> >> > > > >> > >
> > > > >> >> > > > >> >
> > > > >> >> > > > >> >
> > > > >> >> > > > >> >
> > > > >> >> > > > >>
> > > > >> >> > > > >
> > > > >> >> > > > >
> > > > >> >> > > >
> > > > >> >> > >
> > > > >> >> >
> > > > >> >>
> > > > >> >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Oh, seems like the whole process is running in parallel. Any specific need
to design the process in such manner?

On Jan 2, 2018 21:41, "Gangadhar ireddy" <ga...@gmail.com> wrote:

> Sathwik , Total 16 activities i have in parallel, I tried with the
> workaround you provided. Splitted the 16 invoke activities to 4 Flow
> activities, so each flow containing 4 activities. But still i see the same
> problem. To get all these activities its taking 1hour. If they are more
> activities than 16, it takes 5hours(as it multiples time with 5 everytime).
>
> Regards,
> Gangadhar.
>
> On Tue, Jan 2, 2018 at 4:21 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > Its not configurable.
> >
> > What are those 8 activities that are running in parallel?
> >
> > Do you have to run all the 8 activities in parallel?
> >
> > A warkaround might be to break your 8 activities into 4 different flows
> > with 2 activities each. Does that work for you.
> >
> >
> >
> > On Tue, Jan 2, 2018 at 3:21 PM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com
> > > wrote:
> >
> > > Sathwik,
> > >
> > > I am still facing the issue with flow activity if it has more than 8
> > tasks
> > > in parallel. And also the retry time is getting increased
> > > everytime(multipled by 5) . So its a big delay for me to get the
> > activity.
> > > Is there any config file to change the retry time?
> > >
> > > Regards,
> > > Ganga.
> > >
> > > On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com> wrote:
> > >
> > > > Sure Sathwik, let me try on a dedicated database, Thanks a lot for
> your
> > > > help.
> > > >
> > > > Regards,
> > > > Gangadhar.
> > > >
> > > > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > > >
> > > >> I have taken a specific job's execution time from your logs.
> > > >>
> > > >> Example:
> > > >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
> > > >> It could not acquire the instance lock and hence was scheduled for
> > 25sec
> > > >> later, refer [2]. This is the second retry iteration. The first
> > > iteration
> > > >> would have been with a 5sec delay, one should have seen this in the
> > > logs,
> > > >> may be you have truncated that part of the logs.
> > > >> When the job got into execution the time should have been sometime
> > > >> approximately around 14:01:07 + 25sec = 14:01:32, but its time:
> > > 2017-07-11
> > > >> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec
> > more.
> > > >> Due to slow running transactions, the Scheduler will throttle the
> > jobs.
> > > >>
> > > >> To improve the execution times,
> > > >> * Put off event generation (http://ode.apache.org/ode-exe
> > > >> cution-events.html
> > > >> ).
> > > >> * Have a dedicated database server with good hardware.
> > > >>
> > > >> [1]
> > > >> 424519845 [ODEServer-513] ERROR
> > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > >> processing a
> > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07
> > EDT
> > > >> transacted: true persisted: true details: JobDetails( instanceId:
> > 48210
> > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > >> correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> > > >> detailsExt: {})
> > > >>
> > > >> [2]
> > > >> 424519862 [ODEServer-513] ERROR
> > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing
> > > >> job, retrying in 25s
> > > >>
> > > >> [3]
> > > >> 424573863 [ODEServer-517] ERROR
> > > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > >> processing a
> > > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13
> > EDT
> > > >> transacted: true persisted: true details: JobDetails( instanceId:
> > 48210
> > > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > >> correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> > > >> detailsExt: {})
> > > >>
> > > >> regards,
> > > >> sathwik
> > > >>
> > > >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > What is the setting for the below config parameter in your
> > > >> > ode.axis2.properties file
> > > >> > ode-axis2.tx.factory.class=
> > > >> >
> > > >> > Have you configured a Transaction Manager in your tomcat?
> > > >> >
> > > >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> > > >> > gangadhar.ireddy@gmail.com> wrote:
> > > >> >
> > > >> >> Hi Sathwik,
> > > >> >>
> > > >> >> Please find the details below:-
> > > >> >>
> > > >> >> ODE version :- 1.3.5
> > > >> >> Server :- Apache tomcat
> > > >> >> Database :- Oracle
> > > >> >> OpenJPA or Hibernate:- Hibernate
> > > >> >>
> > > >> >> Regards,
> > > >> >> Gangadhar.
> > > >> >>
> > > >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <
> > sathwik.bp@gmail.com>
> > > >> >> wrote:
> > > >> >>
> > > >> >> > Can you provide these info please
> > > >> >> > ODE version?
> > > >> >> > Server?
> > > >> >> > Database?
> > > >> >> > OpenJPA or Hibernate?
> > > >> >> >
> > > >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > > >> >> > gangadhar.ireddy@gmail.com> wrote:
> > > >> >> >
> > > >> >> > > 424519400 [ODEServer-505] INFO
> org.apache.ode.axis2.ExternalS
> > > >> ervice
> > > >> >> -
> > > >> >> > > Response:
> > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > >> >> > > <message><SubProcess24Task137Output><
> SubProcess24Task137Output
> > > >> >> xmlns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > >> >> xmlns:SOAP-ENV="
> > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > >> >> > > humanTaskInvokeResponse
> > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> HumanTaskDataSchema"
> > > >> >> > > xmlns:htds="
> > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > >> >> > > ">true</humanTaskInvokeResponse></
> SubProcess24Task137Output></
> > > >> >> > > SubProcess24Task137Output></message>
> > > >> >> > > 424519845 [ODEServer-513] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > > 14:01:07
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel:
> 423
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519851 [ODEServer-518] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel:
> 269
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519854 [ODEServer-508] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel:
> 378
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519853 [ODEServer-502] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel:
> 316
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519849 [ODEServer-506] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel:
> 282
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519852 [ODEServer-504] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel:
> 401
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519865 [ODEServer-506] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519865 [ODEServer-502] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519866 [ODEServer-508] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519863 [ODEServer-511] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel:
> 383
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519863 [ODEServer-507] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel:
> 226
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519862 [ODEServer-519] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel:
> 365
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519868 [ODEServer-511] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519862 [ODEServer-513] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519868 [ODEServer-507] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519868 [ODEServer-519] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519867 [ODEServer-518] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519866 [ODEServer-504] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424519866 [ODEServer-510] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11
> > > 14:01:05
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel:
> 295
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424519870 [ODEServer-510] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 25s
> > > >> >> > > 424522517 [ODEServer-510] INFO
> org.apache.ode.axis2.ExternalS
> > > >> ervice
> > > >> >> -
> > > >> >> > > Response:
> > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > >> >> > > <message><SubProcess24Task131Output><
> SubProcess24Task131Output
> > > >> >> xmlns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> > > >> >> xmlns:SOAP-ENV="
> > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > > >> >> > > humanTaskInvokeResponse
> > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> HumanTaskDataSchema"
> > > >> >> > > xmlns:htds="
> > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > >> >> > > ">true</humanTaskInvokeResponse></
> SubProcess24Task131Output></
> > > >> >> > > SubProcess24Task131Output></message>
> > > >> >> > > 424573639 [ODEServer-510] INFO
> org.apache.ode.axis2.ExternalS
> > > >> ervice
> > > >> >> -
> > > >> >> > > Response:
> > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > >> >> > > <message><SubProcess24Task132Output><
> SubProcess24Task132Output
> > > >> >> xmlns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> > > >> >> xmlns:SOAP-ENV="
> > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > > >> >> > > humanTaskInvokeResponse
> > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> HumanTaskDataSchema"
> > > >> >> > > xmlns:htds="
> > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > >> >> > > ">true</humanTaskInvokeResponse></
> SubProcess24Task132Output></
> > > >> >> > > SubProcess24Task132Output></message>
> > > >> >> > > 424573852 [ODEServer-513] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel:
> 383
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573856 [ODEServer-511] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel:
> 365
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573863 [ODEServer-504] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel:
> 282
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573865 [ODEServer-513] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573863 [ODEServer-517] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel:
> 423
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573863 [ODEServer-514] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel:
> 269
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573868 [ODEServer-508] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel:
> 226
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573868 [ODEServer-507] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel:
> 401
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573869 [ODEServer-517] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573869 [ODEServer-504] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573870 [ODEServer-514] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573870 [ODEServer-511] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573868 [ODEServer-519] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > a
> > > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > > 14:02:13
> > > >> >> EDT
> > > >> >> > > transacted: true persisted: true details: JobDetails(
> > instanceId:
> > > >> >> 48210
> > > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel:
> 316
> > > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2
> inMem:
> > > >> false
> > > >> >> > > detailsExt: {})
> > > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLock(
> > > >> >> > > BpelEngineImpl.java:394)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > >> >> > > BpelEngineImpl.java:403)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > >> >> > > BpelServerImpl.java:450)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > >> >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:284)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > > >> >> > > SimpleScheduler.java:239)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:512)
> > > >> >> > > at
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > >> >> > > call(SimpleScheduler.java:496)
> > > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > at
> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > 424573870 [ODEServer-507] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573870 [ODEServer-508] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424573871 [ODEServer-519] ERROR
> > > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > >> >> > processing
> > > >> >> > > job, retrying in 125s
> > > >> >> > > 424575807 [ODEServer-511] INFO
> org.apache.ode.axis2.ExternalS
> > > >> ervice
> > > >> >> -
> > > >> >> > > Response:
> > > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > > >> >> > > <message><SubProcess24Task135Output><
> SubProcess24Task135Output
> > > >> >> xmlns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> > > >> >> xmlns:SOAP-ENV="
> > > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > > >> >> > > humanTaskInvokeResponse
> > > >> >> > > xmlns="http://www.altair.com/WF/Framework/
> HumanTaskDataSchema"
> > > >> >> > > xmlns:htds="
> > > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > >> >> > > ">true</humanTaskInvokeResponse></
> SubProcess24Task135Output></
> > > >> >> > > SubProcess24Task135Output></message>
> > > >> >> > >
> > > >> >> > >
> > > >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <
> > > sathwik.bp@gmail.com
> > > >> >
> > > >> >> > wrote:
> > > >> >> > >
> > > >> >> > > > Attachment has not come through.
> > > >> >> > > >
> > > >> >> > > > put it inline
> > > >> >> > > >
> > > >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> > > >> >> gangadhar.ireddy@gmail.com>
> > > >> >> > > > wrote:
> > > >> >> > > >
> > > >> >> > > > > Sathwik,
> > > >> >> > > > >
> > > >> >> > > > > Please find the attached log.
> > > >> >> > > > >
> > > >> >> > > > > Regards,
> > > >> >> > > > > Gangadhar.
> > > >> >> > > > >
> > > >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> > > >> >> sathwik.bp@gmail.com>
> > > >> >> > > > wrote:
> > > >> >> > > > >
> > > >> >> > > > >> Can you send the complete logs.
> > > >> >> > > > >>
> > > >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> > > >> >> sathwik.bp@gmail.com>
> > > >> >> > > > >> wrote:
> > > >> >> > > > >>
> > > >> >> > > > >> > Usually, the jobs gets executed pretty much quickly.
> > > >> >> > > > >> >
> > > >> >> > > > >> > Factors that might be delaying the execution of jobs
> is
> > a
> > > >> slow
> > > >> >> > > > database.
> > > >> >> > > > >> >
> > > >> >> > > > >> > How many concurrent messages is the process expecting?
> > > >> >> > > > >> >
> > > >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > > >> >> > > gangadhar.ireddy@gmail.com
> > > >> >> > > > >
> > > >> >> > > > >> > wrote:
> > > >> >> > > > >> >
> > > >> >> > > > >> > We are waiting for the jobs and it releases many
> times,
> > > but
> > > >> few
> > > >> >> > > times
> > > >> >> > > > it
> > > >> >> > > > >> > doesn't release, Is there any limit on the
> rescheduling?
> > > >> >> > > > >> >
> > > >> >> > > > >> > Regards,
> > > >> >> > > > >> > Gangadhar.
> > > >> >> > > > >> >
> > > >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > > >> >> > sathwik.bp@gmail.com>
> > > >> >> > > > >> wrote:
> > > >> >> > > > >> >
> > > >> >> > > > >> > > This is normal. Concurrent messages are competing
> for
> > > the
> > > >> >> > instance
> > > >> >> > > > >> lock.
> > > >> >> > > > >> > > Job that doesn't get the lock on the instance has to
> > > wait
> > > >> and
> > > >> >> > will
> > > >> >> > > > be
> > > >> >> > > > >> > > rescheduled.
> > > >> >> > > > >> > > You should never clear the job table.
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > >> >> > > > gangadhar.ireddy@gmail.com
> > > >> >> > > > >> >
> > > >> >> > > > >> > > wrote:
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > Sathwik,
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > Please find the below log,
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > <message><SubProcess24Task137O
> > > >> utput><SubProcess24Task137Outp
> > > >> >> ut
> > > >> >> > > > >> > > xmlns="http://www.altair.com/E
> > > >> PM/Schema/SubProcess24Task137"
> > > >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/
> > > envelope/
> > > >> "
> > > >> >> > > > >> > > xmlns:tns="http://www.altair.c
> > > >> om/EPM/Schema/SubProcess24Task
> > > >> >> 137
> > > >> >> > > "><
> > > >> >> > > > >> > > humanTaskInvokeResponse
> > > >> >> > > > >> > > xmlns="http://www.altair.com/W
> > > >> F/Framework/HumanTaskDataSchem
> > > >> >> a"
> > > >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > > >> >> > > HumanTaskDataSchema
> > > >> >> > > > >> > ">true</
> > > >> >> > > > >> > > humanTaskInvokeResponse></
> > SubProcess24Task137Output></
> > > >> >> > > > >> > > SubProcess24Task137Output></message>
> > > >> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  -
> > > Error
> > > >> >> while
> > > >> >> > > > >> > > processing a persisted job: Job
> hqejbhcnphrcfcpvi9xhf3
> > > >> time:
> > > >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted:
> > true
> > > >> >> > details:
> > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968
> processId:
> > > null
> > > >> >> type:
> > > >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > > >> >> > correlationKeySet:
> > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$
> > > JobProcessorException
> > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > >> >> > > > >> lEngineImpl.acquireInstanceLoc
> > > >> >> > > > >> > k(
> > > >> >> > > > >> > > BpelEngineImpl.java:394)
> > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > >> >> > > > BpelEngineImpl.onScheduledJob(
> > > >> >> > > > >> > > BpelEngineImpl.java:403)
> > > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > > >> >> > > > BpelServerImpl.onScheduledJob(
> > > >> >> > > > >> > > BpelServerImpl.java:450)
> > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > >> >> > > simple.SimpleScheduler$RunJob$
> > > >> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > >> >> > > simple.SimpleScheduler$RunJob$
> > > >> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > >> e.SimpleScheduler.
> > > >> >> > > > >> > > execTransaction(
> > > >> >> > > > >> > > SimpleScheduler.java:284)
> > > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > > >> e.SimpleScheduler.
> > > >> >> > > > >> > > execTransaction(
> > > >> >> > > > >> > > SimpleScheduler.java:239)
> > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > >> >> > > simple.SimpleScheduler$RunJob.
> > > >> >> > > > >> > > call(SimpleScheduler.java:512)
> > > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > > >> >> > > simple.SimpleScheduler$RunJob.
> > > >> >> > > > >> > > call(SimpleScheduler.java:496)
> > > >> >> > > > >> > >         at java.util.concurrent.FutureTas
> > > >> k.run(FutureTask.
> > > >> >> > > java:266)
> > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > >> >> lExecutor.runWorker(
> > > >> >> > > > >> > > ThreadPoolExecutor.java:1142)
> > > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > > >> >> lExecutor$Worker.run(
> > > >> >> > > > >> > > ThreadPoolExecutor.java:617)
> > > >> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > > >> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> > > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  -
> > > Error
> > > >> >> while
> > > >> >> > > > >> > > processing a persisted job: Job
> hqejbhcnphrcfcpvi9xhem
> > > >> time:
> > > >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted:
> > true
> > > >> >> > details:
> > > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955
> processId:
> > > null
> > > >> >> type:
> > > >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > > >> >> > correlationKeySet:
> > > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > >> >> > > > >> > >
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > Regards,
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > Gangadhar.
> > > >> >> > > > >> > >
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > > >> >> > > sathwik.bp@gmail.com
> > > >> >> > > > >
> > > >> >> > > > >> > > wrote:
> > > >> >> > > > >> > >
> > > >> >> > > > >> > > > There are multiple factors for intermittent
> issues.
> > I
> > > >> can
> > > >> >> only
> > > >> >> > > > >> > speculate
> > > >> >> > > > >> > > > here with limited information.
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > > Check your logs for failures when it happens and
> > share
> > > >> it
> > > >> >> > here,
> > > >> >> > > so
> > > >> >> > > > >> that
> > > >> >> > > > >> > > we
> > > >> >> > > > >> > > > can help you better. If possible put in a sample
> > > >> process to
> > > >> >> > > > >> reproduce
> > > >> >> > > > >> > > your
> > > >> >> > > > >> > > > scenario and share here.
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy
> <
> > > >> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > > > > Sometimes the activity gets released, if it is
> due
> > > to
> > > >> >> > failures
> > > >> >> > > > in
> > > >> >> > > > >> the
> > > >> >> > > > >> > > > > process, it should fail every time right?
> > > >> >> > > > >> > > > >
> > > >> >> > > > >> > > > > Regards,
> > > >> >> > > > >> > > > > Gangadhar.
> > > >> >> > > > >> > > > >
> > > >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > > >> >> > > > >> sathwik.bp@gmail.com>
> > > >> >> > > > >> > > > wrote:
> > > >> >> > > > >> > > > >
> > > >> >> > > > >> > > > > > Jobs might be getting rescheduled due to
> > failures
> > > in
> > > >> >> the
> > > >> >> > > > >> process.
> > > >> >> > > > >> > > > > > Check the logs for errors.
> > > >> >> > > > >> > > > > >
> > > >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar
> > > ireddy <
> > > >> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > >> >> > > > >> > > > > >
> > > >> >> > > > >> > > > > > > Hi Sathwik,
> > > >> >> > > > >> > > > > > >
> > > >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs
> > > >> table,for
> > > >> >> > some
> > > >> >> > > > >> tasks
> > > >> >> > > > >> > it
> > > >> >> > > > >> > > > will
> > > >> >> > > > >> > > > > > be
> > > >> >> > > > >> > > > > > > updated with INVOKE_CHECK from
> > INVOKE_RESPONSE.
> > > >> >> > Sometimes
> > > >> >> > > it
> > > >> >> > > > >> > takes
> > > >> >> > > > >> > > > more
> > > >> >> > > > >> > > > > > > time to release the tasks, sometimes it will
> > not
> > > >> >> > release.
> > > >> >> > > > >> > > > > > >
> > > >> >> > > > >> > > > > > > Regards,
> > > >> >> > > > >> > > > > > > Ganga.
> > > >> >> > > > >> > > > > > >
> > > >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P
> <
> > > >> >> > > > >> > sathwik.bp@gmail.com>
> > > >> >> > > > >> > > > > > wrote:
> > > >> >> > > > >> > > > > > >
> > > >> >> > > > >> > > > > > > > What kind of jobs are pending?
> > > >> >> > > > >> > > > > > > > What activities do you have within your
> > > <flow>?
> > > >> >> > > > >> > > > > > > >
> > > >> >> > > > >> > > > > > > > regards,
> > > >> >> > > > >> > > > > > > > sathwik
> > > >> >> > > > >> > > > > > > >
> > > >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar
> > > >> ireddy <
> > > >> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > >> >> > > > >> > > > > > > > > wrote:
> > > >> >> > > > >> > > > > > > >
> > > >> >> > > > >> > > > > > > > > Hi,
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > > > This is Gangadhar working for Altair,
> > > >> currently
> > > >> >> we
> > > >> >> > are
> > > >> >> > > > >> using
> > > >> >> > > > >> > > > > > Apache-ode
> > > >> >> > > > >> > > > > > > > and
> > > >> >> > > > >> > > > > > > > > facing few issues on flow activity.
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will not
> > be
> > > >> >> released
> > > >> >> > > and
> > > >> >> > > > >> > when i
> > > >> >> > > > >> > > > > check
> > > >> >> > > > >> > > > > > > the
> > > >> >> > > > >> > > > > > > > > ode_job table there are some records not
> > > >> getting
> > > >> >> > > > updated.
> > > >> >> > > > >> But
> > > >> >> > > > >> > > > when
> > > >> >> > > > >> > > > > i
> > > >> >> > > > >> > > > > > > > clean
> > > >> >> > > > >> > > > > > > > > ode_job table and create a new instance
> it
> > > >> works
> > > >> >> > fine.
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in
> > flow
> > > ,
> > > >> it
> > > >> >> > takes
> > > >> >> > > > >> large
> > > >> >> > > > >> > > > amount
> > > >> >> > > > >> > > > > > of
> > > >> >> > > > >> > > > > > > > time
> > > >> >> > > > >> > > > > > > > > to release all the tasks.
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > > > Thanks,
> > > >> >> > > > >> > > > > > > > > Gangadhar.
> > > >> >> > > > >> > > > > > > > >
> > > >> >> > > > >> > > > > > > >
> > > >> >> > > > >> > > > > > >
> > > >> >> > > > >> > > > > >
> > > >> >> > > > >> > > > >
> > > >> >> > > > >> > > >
> > > >> >> > > > >> > >
> > > >> >> > > > >> >
> > > >> >> > > > >> >
> > > >> >> > > > >> >
> > > >> >> > > > >>
> > > >> >> > > > >
> > > >> >> > > > >
> > > >> >> > > >
> > > >> >> > >
> > > >> >> >
> > > >> >>
> > > >> >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sathwik , Total 16 activities i have in parallel, I tried with the
workaround you provided. Splitted the 16 invoke activities to 4 Flow
activities, so each flow containing 4 activities. But still i see the same
problem. To get all these activities its taking 1hour. If they are more
activities than 16, it takes 5hours(as it multiples time with 5 everytime).

Regards,
Gangadhar.

On Tue, Jan 2, 2018 at 4:21 PM, Sathwik B P <sa...@gmail.com> wrote:

> Its not configurable.
>
> What are those 8 activities that are running in parallel?
>
> Do you have to run all the 8 activities in parallel?
>
> A warkaround might be to break your 8 activities into 4 different flows
> with 2 activities each. Does that work for you.
>
>
>
> On Tue, Jan 2, 2018 at 3:21 PM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com
> > wrote:
>
> > Sathwik,
> >
> > I am still facing the issue with flow activity if it has more than 8
> tasks
> > in parallel. And also the retry time is getting increased
> > everytime(multipled by 5) . So its a big delay for me to get the
> activity.
> > Is there any config file to change the retry time?
> >
> > Regards,
> > Ganga.
> >
> > On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com> wrote:
> >
> > > Sure Sathwik, let me try on a dedicated database, Thanks a lot for your
> > > help.
> > >
> > > Regards,
> > > Gangadhar.
> > >
> > > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > >> I have taken a specific job's execution time from your logs.
> > >>
> > >> Example:
> > >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
> > >> It could not acquire the instance lock and hence was scheduled for
> 25sec
> > >> later, refer [2]. This is the second retry iteration. The first
> > iteration
> > >> would have been with a 5sec delay, one should have seen this in the
> > logs,
> > >> may be you have truncated that part of the logs.
> > >> When the job got into execution the time should have been sometime
> > >> approximately around 14:01:07 + 25sec = 14:01:32, but its time:
> > 2017-07-11
> > >> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec
> more.
> > >> Due to slow running transactions, the Scheduler will throttle the
> jobs.
> > >>
> > >> To improve the execution times,
> > >> * Put off event generation (http://ode.apache.org/ode-exe
> > >> cution-events.html
> > >> ).
> > >> * Have a dedicated database server with good hardware.
> > >>
> > >> [1]
> > >> 424519845 [ODEServer-513] ERROR
> > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> processing a
> > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07
> EDT
> > >> transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > >> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > >> detailsExt: {})
> > >>
> > >> [2]
> > >> 424519862 [ODEServer-513] ERROR
> > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > >> job, retrying in 25s
> > >>
> > >> [3]
> > >> 424573863 [ODEServer-517] ERROR
> > >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> processing a
> > >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13
> EDT
> > >> transacted: true persisted: true details: JobDetails( instanceId:
> 48210
> > >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > >> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > >> detailsExt: {})
> > >>
> > >> regards,
> > >> sathwik
> > >>
> > >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com>
> > >> wrote:
> > >>
> > >> > What is the setting for the below config parameter in your
> > >> > ode.axis2.properties file
> > >> > ode-axis2.tx.factory.class=
> > >> >
> > >> > Have you configured a Transaction Manager in your tomcat?
> > >> >
> > >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> > >> > gangadhar.ireddy@gmail.com> wrote:
> > >> >
> > >> >> Hi Sathwik,
> > >> >>
> > >> >> Please find the details below:-
> > >> >>
> > >> >> ODE version :- 1.3.5
> > >> >> Server :- Apache tomcat
> > >> >> Database :- Oracle
> > >> >> OpenJPA or Hibernate:- Hibernate
> > >> >>
> > >> >> Regards,
> > >> >> Gangadhar.
> > >> >>
> > >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <
> sathwik.bp@gmail.com>
> > >> >> wrote:
> > >> >>
> > >> >> > Can you provide these info please
> > >> >> > ODE version?
> > >> >> > Server?
> > >> >> > Database?
> > >> >> > OpenJPA or Hibernate?
> > >> >> >
> > >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > >> >> > gangadhar.ireddy@gmail.com> wrote:
> > >> >> >
> > >> >> > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalS
> > >> ervice
> > >> >> -
> > >> >> > > Response:
> > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > >> >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> > >> >> xmlns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > >> >> xmlns:SOAP-ENV="
> > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > >> >> > > humanTaskInvokeResponse
> > >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > >> >> > > xmlns:htds="
> > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> > >> >> > > SubProcess24Task137Output></message>
> > >> >> > > 424519845 [ODEServer-513] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > 14:01:07
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519851 [ODEServer-518] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519854 [ODEServer-508] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519853 [ODEServer-502] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519849 [ODEServer-506] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519852 [ODEServer-504] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519865 [ODEServer-506] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519865 [ODEServer-502] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519866 [ODEServer-508] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519863 [ODEServer-511] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519863 [ODEServer-507] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519862 [ODEServer-519] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519868 [ODEServer-511] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519862 [ODEServer-513] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519868 [ODEServer-507] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519868 [ODEServer-519] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519867 [ODEServer-518] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519866 [ODEServer-504] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424519866 [ODEServer-510] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11
> > 14:01:05
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424519870 [ODEServer-510] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 25s
> > >> >> > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalS
> > >> ervice
> > >> >> -
> > >> >> > > Response:
> > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > >> >> > > <message><SubProcess24Task131Output><SubProcess24Task131Output
> > >> >> xmlns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> > >> >> xmlns:SOAP-ENV="
> > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > >> >> > > humanTaskInvokeResponse
> > >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > >> >> > > xmlns:htds="
> > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> > >> >> > > SubProcess24Task131Output></message>
> > >> >> > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalS
> > >> ervice
> > >> >> -
> > >> >> > > Response:
> > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > >> >> > > <message><SubProcess24Task132Output><SubProcess24Task132Output
> > >> >> xmlns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> > >> >> xmlns:SOAP-ENV="
> > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > >> >> > > humanTaskInvokeResponse
> > >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > >> >> > > xmlns:htds="
> > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> > >> >> > > SubProcess24Task132Output></message>
> > >> >> > > 424573852 [ODEServer-513] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573856 [ODEServer-511] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573863 [ODEServer-504] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573865 [ODEServer-513] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573863 [ODEServer-517] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573863 [ODEServer-514] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573868 [ODEServer-508] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573868 [ODEServer-507] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573869 [ODEServer-517] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573869 [ODEServer-504] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573870 [ODEServer-514] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573870 [ODEServer-511] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573868 [ODEServer-519] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > a
> > >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> > 14:02:13
> > >> >> EDT
> > >> >> > > transacted: true persisted: true details: JobDetails(
> instanceId:
> > >> >> 48210
> > >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> > >> false
> > >> >> > > detailsExt: {})
> > >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > >> >> > > BpelEngineImpl.java:394)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > >> >> > > BpelEngineImpl.java:403)
> > >> >> > > at
> > >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > >> >> > > BpelServerImpl.java:450)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > >> >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:284)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> > >> >> > > SimpleScheduler.java:239)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:512)
> > >> >> > > at
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > >> >> > > call(SimpleScheduler.java:496)
> > >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > at
> > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> >> > > ThreadPoolExecutor.java:617)
> > >> >> > > at java.lang.Thread.run(Thread.java:745)
> > >> >> > > 424573870 [ODEServer-507] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573870 [ODEServer-508] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424573871 [ODEServer-519] ERROR
> > >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> >> > processing
> > >> >> > > job, retrying in 125s
> > >> >> > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalS
> > >> ervice
> > >> >> -
> > >> >> > > Response:
> > >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> > >> >> > > <message><SubProcess24Task135Output><SubProcess24Task135Output
> > >> >> xmlns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> > >> >> xmlns:SOAP-ENV="
> > >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > >> >> > > humanTaskInvokeResponse
> > >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > >> >> > > xmlns:htds="
> > >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> > >> >> > > SubProcess24Task135Output></message>
> > >> >> > >
> > >> >> > >
> > >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <
> > sathwik.bp@gmail.com
> > >> >
> > >> >> > wrote:
> > >> >> > >
> > >> >> > > > Attachment has not come through.
> > >> >> > > >
> > >> >> > > > put it inline
> > >> >> > > >
> > >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> > >> >> gangadhar.ireddy@gmail.com>
> > >> >> > > > wrote:
> > >> >> > > >
> > >> >> > > > > Sathwik,
> > >> >> > > > >
> > >> >> > > > > Please find the attached log.
> > >> >> > > > >
> > >> >> > > > > Regards,
> > >> >> > > > > Gangadhar.
> > >> >> > > > >
> > >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> > >> >> sathwik.bp@gmail.com>
> > >> >> > > > wrote:
> > >> >> > > > >
> > >> >> > > > >> Can you send the complete logs.
> > >> >> > > > >>
> > >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> > >> >> sathwik.bp@gmail.com>
> > >> >> > > > >> wrote:
> > >> >> > > > >>
> > >> >> > > > >> > Usually, the jobs gets executed pretty much quickly.
> > >> >> > > > >> >
> > >> >> > > > >> > Factors that might be delaying the execution of jobs is
> a
> > >> slow
> > >> >> > > > database.
> > >> >> > > > >> >
> > >> >> > > > >> > How many concurrent messages is the process expecting?
> > >> >> > > > >> >
> > >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > >> >> > > gangadhar.ireddy@gmail.com
> > >> >> > > > >
> > >> >> > > > >> > wrote:
> > >> >> > > > >> >
> > >> >> > > > >> > We are waiting for the jobs and it releases many times,
> > but
> > >> few
> > >> >> > > times
> > >> >> > > > it
> > >> >> > > > >> > doesn't release, Is there any limit on the rescheduling?
> > >> >> > > > >> >
> > >> >> > > > >> > Regards,
> > >> >> > > > >> > Gangadhar.
> > >> >> > > > >> >
> > >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > >> >> > sathwik.bp@gmail.com>
> > >> >> > > > >> wrote:
> > >> >> > > > >> >
> > >> >> > > > >> > > This is normal. Concurrent messages are competing for
> > the
> > >> >> > instance
> > >> >> > > > >> lock.
> > >> >> > > > >> > > Job that doesn't get the lock on the instance has to
> > wait
> > >> and
> > >> >> > will
> > >> >> > > > be
> > >> >> > > > >> > > rescheduled.
> > >> >> > > > >> > > You should never clear the job table.
> > >> >> > > > >> > >
> > >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > >> >> > > > gangadhar.ireddy@gmail.com
> > >> >> > > > >> >
> > >> >> > > > >> > > wrote:
> > >> >> > > > >> > >
> > >> >> > > > >> > > Sathwik,
> > >> >> > > > >> > >
> > >> >> > > > >> > > Please find the below log,
> > >> >> > > > >> > >
> > >> >> > > > >> > > <message><SubProcess24Task137O
> > >> utput><SubProcess24Task137Outp
> > >> >> ut
> > >> >> > > > >> > > xmlns="http://www.altair.com/E
> > >> PM/Schema/SubProcess24Task137"
> > >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/
> > envelope/
> > >> "
> > >> >> > > > >> > > xmlns:tns="http://www.altair.c
> > >> om/EPM/Schema/SubProcess24Task
> > >> >> 137
> > >> >> > > "><
> > >> >> > > > >> > > humanTaskInvokeResponse
> > >> >> > > > >> > > xmlns="http://www.altair.com/W
> > >> F/Framework/HumanTaskDataSchem
> > >> >> a"
> > >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > >> >> > > HumanTaskDataSchema
> > >> >> > > > >> > ">true</
> > >> >> > > > >> > > humanTaskInvokeResponse></
> SubProcess24Task137Output></
> > >> >> > > > >> > > SubProcess24Task137Output></message>
> > >> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  -
> > Error
> > >> >> while
> > >> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3
> > >> time:
> > >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted:
> true
> > >> >> > details:
> > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId:
> > null
> > >> >> type:
> > >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > >> >> > correlationKeySet:
> > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$
> > JobProcessorException
> > >> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > >> >> > > > >> lEngineImpl.acquireInstanceLoc
> > >> >> > > > >> > k(
> > >> >> > > > >> > > BpelEngineImpl.java:394)
> > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > >> >> > > > BpelEngineImpl.onScheduledJob(
> > >> >> > > > >> > > BpelEngineImpl.java:403)
> > >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> > >> >> > > > BpelServerImpl.onScheduledJob(
> > >> >> > > > >> > > BpelServerImpl.java:450)
> > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > >> >> > > simple.SimpleScheduler$RunJob$
> > >> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > >> >> > > simple.SimpleScheduler$RunJob$
> > >> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > >> e.SimpleScheduler.
> > >> >> > > > >> > > execTransaction(
> > >> >> > > > >> > > SimpleScheduler.java:284)
> > >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> > >> e.SimpleScheduler.
> > >> >> > > > >> > > execTransaction(
> > >> >> > > > >> > > SimpleScheduler.java:239)
> > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > >> >> > > simple.SimpleScheduler$RunJob.
> > >> >> > > > >> > > call(SimpleScheduler.java:512)
> > >> >> > > > >> > >         at org.apache.ode.scheduler.
> > >> >> > > simple.SimpleScheduler$RunJob.
> > >> >> > > > >> > > call(SimpleScheduler.java:496)
> > >> >> > > > >> > >         at java.util.concurrent.FutureTas
> > >> k.run(FutureTask.
> > >> >> > > java:266)
> > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > >> >> lExecutor.runWorker(
> > >> >> > > > >> > > ThreadPoolExecutor.java:1142)
> > >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> > >> >> lExecutor$Worker.run(
> > >> >> > > > >> > > ThreadPoolExecutor.java:617)
> > >> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > >> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> > >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  -
> > Error
> > >> >> while
> > >> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem
> > >> time:
> > >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted:
> true
> > >> >> > details:
> > >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId:
> > null
> > >> >> type:
> > >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > >> >> > correlationKeySet:
> > >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > >> >> > > > >> > >
> > >> >> > > > >> > >
> > >> >> > > > >> > > Regards,
> > >> >> > > > >> > >
> > >> >> > > > >> > > Gangadhar.
> > >> >> > > > >> > >
> > >> >> > > > >> > >
> > >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > >> >> > > sathwik.bp@gmail.com
> > >> >> > > > >
> > >> >> > > > >> > > wrote:
> > >> >> > > > >> > >
> > >> >> > > > >> > > > There are multiple factors for intermittent issues.
> I
> > >> can
> > >> >> only
> > >> >> > > > >> > speculate
> > >> >> > > > >> > > > here with limited information.
> > >> >> > > > >> > > >
> > >> >> > > > >> > > > Check your logs for failures when it happens and
> share
> > >> it
> > >> >> > here,
> > >> >> > > so
> > >> >> > > > >> that
> > >> >> > > > >> > > we
> > >> >> > > > >> > > > can help you better. If possible put in a sample
> > >> process to
> > >> >> > > > >> reproduce
> > >> >> > > > >> > > your
> > >> >> > > > >> > > > scenario and share here.
> > >> >> > > > >> > > >
> > >> >> > > > >> > > >
> > >> >> > > > >> > > >
> > >> >> > > > >> > > >
> > >> >> > > > >> > > >
> > >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > >> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > >> >> > > > >> > > >
> > >> >> > > > >> > > > > Sometimes the activity gets released, if it is due
> > to
> > >> >> > failures
> > >> >> > > > in
> > >> >> > > > >> the
> > >> >> > > > >> > > > > process, it should fail every time right?
> > >> >> > > > >> > > > >
> > >> >> > > > >> > > > > Regards,
> > >> >> > > > >> > > > > Gangadhar.
> > >> >> > > > >> > > > >
> > >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > >> >> > > > >> sathwik.bp@gmail.com>
> > >> >> > > > >> > > > wrote:
> > >> >> > > > >> > > > >
> > >> >> > > > >> > > > > > Jobs might be getting rescheduled due to
> failures
> > in
> > >> >> the
> > >> >> > > > >> process.
> > >> >> > > > >> > > > > > Check the logs for errors.
> > >> >> > > > >> > > > > >
> > >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar
> > ireddy <
> > >> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > >> >> > > > >> > > > > >
> > >> >> > > > >> > > > > > > Hi Sathwik,
> > >> >> > > > >> > > > > > >
> > >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs
> > >> table,for
> > >> >> > some
> > >> >> > > > >> tasks
> > >> >> > > > >> > it
> > >> >> > > > >> > > > will
> > >> >> > > > >> > > > > > be
> > >> >> > > > >> > > > > > > updated with INVOKE_CHECK from
> INVOKE_RESPONSE.
> > >> >> > Sometimes
> > >> >> > > it
> > >> >> > > > >> > takes
> > >> >> > > > >> > > > more
> > >> >> > > > >> > > > > > > time to release the tasks, sometimes it will
> not
> > >> >> > release.
> > >> >> > > > >> > > > > > >
> > >> >> > > > >> > > > > > > Regards,
> > >> >> > > > >> > > > > > > Ganga.
> > >> >> > > > >> > > > > > >
> > >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> > >> >> > > > >> > sathwik.bp@gmail.com>
> > >> >> > > > >> > > > > > wrote:
> > >> >> > > > >> > > > > > >
> > >> >> > > > >> > > > > > > > What kind of jobs are pending?
> > >> >> > > > >> > > > > > > > What activities do you have within your
> > <flow>?
> > >> >> > > > >> > > > > > > >
> > >> >> > > > >> > > > > > > > regards,
> > >> >> > > > >> > > > > > > > sathwik
> > >> >> > > > >> > > > > > > >
> > >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar
> > >> ireddy <
> > >> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > >> >> > > > >> > > > > > > > > wrote:
> > >> >> > > > >> > > > > > > >
> > >> >> > > > >> > > > > > > > > Hi,
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > > > This is Gangadhar working for Altair,
> > >> currently
> > >> >> we
> > >> >> > are
> > >> >> > > > >> using
> > >> >> > > > >> > > > > > Apache-ode
> > >> >> > > > >> > > > > > > > and
> > >> >> > > > >> > > > > > > > > facing few issues on flow activity.
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will not
> be
> > >> >> released
> > >> >> > > and
> > >> >> > > > >> > when i
> > >> >> > > > >> > > > > check
> > >> >> > > > >> > > > > > > the
> > >> >> > > > >> > > > > > > > > ode_job table there are some records not
> > >> getting
> > >> >> > > > updated.
> > >> >> > > > >> But
> > >> >> > > > >> > > > when
> > >> >> > > > >> > > > > i
> > >> >> > > > >> > > > > > > > clean
> > >> >> > > > >> > > > > > > > > ode_job table and create a new instance it
> > >> works
> > >> >> > fine.
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in
> flow
> > ,
> > >> it
> > >> >> > takes
> > >> >> > > > >> large
> > >> >> > > > >> > > > amount
> > >> >> > > > >> > > > > > of
> > >> >> > > > >> > > > > > > > time
> > >> >> > > > >> > > > > > > > > to release all the tasks.
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > > > Thanks,
> > >> >> > > > >> > > > > > > > > Gangadhar.
> > >> >> > > > >> > > > > > > > >
> > >> >> > > > >> > > > > > > >
> > >> >> > > > >> > > > > > >
> > >> >> > > > >> > > > > >
> > >> >> > > > >> > > > >
> > >> >> > > > >> > > >
> > >> >> > > > >> > >
> > >> >> > > > >> >
> > >> >> > > > >> >
> > >> >> > > > >> >
> > >> >> > > > >>
> > >> >> > > > >
> > >> >> > > > >
> > >> >> > > >
> > >> >> > >
> > >> >> >
> > >> >>
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Its not configurable.

What are those 8 activities that are running in parallel?

Do you have to run all the 8 activities in parallel?

A warkaround might be to break your 8 activities into 4 different flows
with 2 activities each. Does that work for you.



On Tue, Jan 2, 2018 at 3:21 PM, Gangadhar ireddy <gangadhar.ireddy@gmail.com
> wrote:

> Sathwik,
>
> I am still facing the issue with flow activity if it has more than 8 tasks
> in parallel. And also the retry time is getting increased
> everytime(multipled by 5) . So its a big delay for me to get the activity.
> Is there any config file to change the retry time?
>
> Regards,
> Ganga.
>
> On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
> > Sure Sathwik, let me try on a dedicated database, Thanks a lot for your
> > help.
> >
> > Regards,
> > Gangadhar.
> >
> > On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> >> I have taken a specific job's execution time from your logs.
> >>
> >> Example:
> >> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
> >> It could not acquire the instance lock and hence was scheduled for 25sec
> >> later, refer [2]. This is the second retry iteration. The first
> iteration
> >> would have been with a 5sec delay, one should have seen this in the
> logs,
> >> may be you have truncated that part of the logs.
> >> When the job got into execution the time should have been sometime
> >> approximately around 14:01:07 + 25sec = 14:01:32, but its time:
> 2017-07-11
> >> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec more.
> >> Due to slow running transactions, the Scheduler will throttle the jobs.
> >>
> >> To improve the execution times,
> >> * Put off event generation (http://ode.apache.org/ode-exe
> >> cution-events.html
> >> ).
> >> * Have a dedicated database server with good hardware.
> >>
> >> [1]
> >> 424519845 [ODEServer-513] ERROR
> >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> processing a
> >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
> >> transacted: true persisted: true details: JobDetails( instanceId: 48210
> >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> >> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> >> detailsExt: {})
> >>
> >> [2]
> >> 424519862 [ODEServer-513] ERROR
> >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> >> job, retrying in 25s
> >>
> >> [3]
> >> 424573863 [ODEServer-517] ERROR
> >> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> processing a
> >> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
> >> transacted: true persisted: true details: JobDetails( instanceId: 48210
> >> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> >> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> >> detailsExt: {})
> >>
> >> regards,
> >> sathwik
> >>
> >> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com>
> >> wrote:
> >>
> >> > What is the setting for the below config parameter in your
> >> > ode.axis2.properties file
> >> > ode-axis2.tx.factory.class=
> >> >
> >> > Have you configured a Transaction Manager in your tomcat?
> >> >
> >> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> >> > gangadhar.ireddy@gmail.com> wrote:
> >> >
> >> >> Hi Sathwik,
> >> >>
> >> >> Please find the details below:-
> >> >>
> >> >> ODE version :- 1.3.5
> >> >> Server :- Apache tomcat
> >> >> Database :- Oracle
> >> >> OpenJPA or Hibernate:- Hibernate
> >> >>
> >> >> Regards,
> >> >> Gangadhar.
> >> >>
> >> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com>
> >> >> wrote:
> >> >>
> >> >> > Can you provide these info please
> >> >> > ODE version?
> >> >> > Server?
> >> >> > Database?
> >> >> > OpenJPA or Hibernate?
> >> >> >
> >> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> >> >> > gangadhar.ireddy@gmail.com> wrote:
> >> >> >
> >> >> > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalS
> >> ervice
> >> >> -
> >> >> > > Response:
> >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> >> >> xmlns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> >> >> xmlns:SOAP-ENV="
> >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> >> >> > > humanTaskInvokeResponse
> >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> >> > > xmlns:htds="
> >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> >> >> > > SubProcess24Task137Output></message>
> >> >> > > 424519845 [ODEServer-513] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> 14:01:07
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519851 [ODEServer-518] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519854 [ODEServer-508] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519853 [ODEServer-502] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519849 [ODEServer-506] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519852 [ODEServer-504] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519865 [ODEServer-506] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519865 [ODEServer-502] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519866 [ODEServer-508] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519863 [ODEServer-511] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519863 [ODEServer-507] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519862 [ODEServer-519] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519868 [ODEServer-511] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519862 [ODEServer-513] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519868 [ODEServer-507] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519868 [ODEServer-519] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519867 [ODEServer-518] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519866 [ODEServer-504] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424519866 [ODEServer-510] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11
> 14:01:05
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424519870 [ODEServer-510] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 25s
> >> >> > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalS
> >> ervice
> >> >> -
> >> >> > > Response:
> >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> >> > > <message><SubProcess24Task131Output><SubProcess24Task131Output
> >> >> xmlns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> >> >> xmlns:SOAP-ENV="
> >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> >> >> > > humanTaskInvokeResponse
> >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> >> > > xmlns:htds="
> >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> >> >> > > SubProcess24Task131Output></message>
> >> >> > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalS
> >> ervice
> >> >> -
> >> >> > > Response:
> >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> >> > > <message><SubProcess24Task132Output><SubProcess24Task132Output
> >> >> xmlns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> >> >> xmlns:SOAP-ENV="
> >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> >> >> > > humanTaskInvokeResponse
> >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> >> > > xmlns:htds="
> >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> >> >> > > SubProcess24Task132Output></message>
> >> >> > > 424573852 [ODEServer-513] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573856 [ODEServer-511] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573863 [ODEServer-504] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573865 [ODEServer-513] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573863 [ODEServer-517] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573863 [ODEServer-514] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573868 [ODEServer-508] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573868 [ODEServer-507] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573869 [ODEServer-517] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573869 [ODEServer-504] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573870 [ODEServer-514] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573870 [ODEServer-511] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573868 [ODEServer-519] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > a
> >> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11
> 14:02:13
> >> >> EDT
> >> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> >> 48210
> >> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> >> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> >> false
> >> >> > > detailsExt: {})
> >> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> >> > > BpelEngineImpl.java:394)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> >> > > BpelEngineImpl.java:403)
> >> >> > > at
> >> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> >> > > BpelServerImpl.java:450)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:284)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> >> > > SimpleScheduler.java:239)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:512)
> >> >> > > at
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> >> > > call(SimpleScheduler.java:496)
> >> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> >> > > ThreadPoolExecutor.java:1142)
> >> >> > > at
> >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> >> > > ThreadPoolExecutor.java:617)
> >> >> > > at java.lang.Thread.run(Thread.java:745)
> >> >> > > 424573870 [ODEServer-507] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573870 [ODEServer-508] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424573871 [ODEServer-519] ERROR
> >> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> >> > processing
> >> >> > > job, retrying in 125s
> >> >> > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalS
> >> ervice
> >> >> -
> >> >> > > Response:
> >> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> >> > > <message><SubProcess24Task135Output><SubProcess24Task135Output
> >> >> xmlns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> >> >> xmlns:SOAP-ENV="
> >> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> >> >> > > humanTaskInvokeResponse
> >> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> >> > > xmlns:htds="
> >> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> >> >> > > SubProcess24Task135Output></message>
> >> >> > >
> >> >> > >
> >> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <
> sathwik.bp@gmail.com
> >> >
> >> >> > wrote:
> >> >> > >
> >> >> > > > Attachment has not come through.
> >> >> > > >
> >> >> > > > put it inline
> >> >> > > >
> >> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> >> >> gangadhar.ireddy@gmail.com>
> >> >> > > > wrote:
> >> >> > > >
> >> >> > > > > Sathwik,
> >> >> > > > >
> >> >> > > > > Please find the attached log.
> >> >> > > > >
> >> >> > > > > Regards,
> >> >> > > > > Gangadhar.
> >> >> > > > >
> >> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> >> >> sathwik.bp@gmail.com>
> >> >> > > > wrote:
> >> >> > > > >
> >> >> > > > >> Can you send the complete logs.
> >> >> > > > >>
> >> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> >> >> sathwik.bp@gmail.com>
> >> >> > > > >> wrote:
> >> >> > > > >>
> >> >> > > > >> > Usually, the jobs gets executed pretty much quickly.
> >> >> > > > >> >
> >> >> > > > >> > Factors that might be delaying the execution of jobs is a
> >> slow
> >> >> > > > database.
> >> >> > > > >> >
> >> >> > > > >> > How many concurrent messages is the process expecting?
> >> >> > > > >> >
> >> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> >> >> > > gangadhar.ireddy@gmail.com
> >> >> > > > >
> >> >> > > > >> > wrote:
> >> >> > > > >> >
> >> >> > > > >> > We are waiting for the jobs and it releases many times,
> but
> >> few
> >> >> > > times
> >> >> > > > it
> >> >> > > > >> > doesn't release, Is there any limit on the rescheduling?
> >> >> > > > >> >
> >> >> > > > >> > Regards,
> >> >> > > > >> > Gangadhar.
> >> >> > > > >> >
> >> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> >> >> > sathwik.bp@gmail.com>
> >> >> > > > >> wrote:
> >> >> > > > >> >
> >> >> > > > >> > > This is normal. Concurrent messages are competing for
> the
> >> >> > instance
> >> >> > > > >> lock.
> >> >> > > > >> > > Job that doesn't get the lock on the instance has to
> wait
> >> and
> >> >> > will
> >> >> > > > be
> >> >> > > > >> > > rescheduled.
> >> >> > > > >> > > You should never clear the job table.
> >> >> > > > >> > >
> >> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> >> >> > > > gangadhar.ireddy@gmail.com
> >> >> > > > >> >
> >> >> > > > >> > > wrote:
> >> >> > > > >> > >
> >> >> > > > >> > > Sathwik,
> >> >> > > > >> > >
> >> >> > > > >> > > Please find the below log,
> >> >> > > > >> > >
> >> >> > > > >> > > <message><SubProcess24Task137O
> >> utput><SubProcess24Task137Outp
> >> >> ut
> >> >> > > > >> > > xmlns="http://www.altair.com/E
> >> PM/Schema/SubProcess24Task137"
> >> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/
> envelope/
> >> "
> >> >> > > > >> > > xmlns:tns="http://www.altair.c
> >> om/EPM/Schema/SubProcess24Task
> >> >> 137
> >> >> > > "><
> >> >> > > > >> > > humanTaskInvokeResponse
> >> >> > > > >> > > xmlns="http://www.altair.com/W
> >> F/Framework/HumanTaskDataSchem
> >> >> a"
> >> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> >> >> > > HumanTaskDataSchema
> >> >> > > > >> > ">true</
> >> >> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> >> >> > > > >> > > SubProcess24Task137Output></message>
> >> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  -
> Error
> >> >> while
> >> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3
> >> time:
> >> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
> >> >> > details:
> >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId:
> null
> >> >> type:
> >> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> >> >> > correlationKeySet:
> >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> >> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$
> JobProcessorException
> >> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> >> >> > > > >> lEngineImpl.acquireInstanceLoc
> >> >> > > > >> > k(
> >> >> > > > >> > > BpelEngineImpl.java:394)
> >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> >> >> > > > BpelEngineImpl.onScheduledJob(
> >> >> > > > >> > > BpelEngineImpl.java:403)
> >> >> > > > >> > >         at org.apache.ode.bpel.engine.
> >> >> > > > BpelServerImpl.onScheduledJob(
> >> >> > > > >> > > BpelServerImpl.java:450)
> >> >> > > > >> > >         at org.apache.ode.scheduler.
> >> >> > > simple.SimpleScheduler$RunJob$
> >> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> >> >> > > > >> > >         at org.apache.ode.scheduler.
> >> >> > > simple.SimpleScheduler$RunJob$
> >> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> >> e.SimpleScheduler.
> >> >> > > > >> > > execTransaction(
> >> >> > > > >> > > SimpleScheduler.java:284)
> >> >> > > > >> > >         at org.apache.ode.scheduler.simpl
> >> e.SimpleScheduler.
> >> >> > > > >> > > execTransaction(
> >> >> > > > >> > > SimpleScheduler.java:239)
> >> >> > > > >> > >         at org.apache.ode.scheduler.
> >> >> > > simple.SimpleScheduler$RunJob.
> >> >> > > > >> > > call(SimpleScheduler.java:512)
> >> >> > > > >> > >         at org.apache.ode.scheduler.
> >> >> > > simple.SimpleScheduler$RunJob.
> >> >> > > > >> > > call(SimpleScheduler.java:496)
> >> >> > > > >> > >         at java.util.concurrent.FutureTas
> >> k.run(FutureTask.
> >> >> > > java:266)
> >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> >> >> lExecutor.runWorker(
> >> >> > > > >> > > ThreadPoolExecutor.java:1142)
> >> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> >> >> lExecutor$Worker.run(
> >> >> > > > >> > > ThreadPoolExecutor.java:617)
> >> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> >> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> >> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  -
> Error
> >> >> while
> >> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem
> >> time:
> >> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
> >> >> > details:
> >> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId:
> null
> >> >> type:
> >> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> >> >> > correlationKeySet:
> >> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> >> >> > > > >> > >
> >> >> > > > >> > >
> >> >> > > > >> > > Regards,
> >> >> > > > >> > >
> >> >> > > > >> > > Gangadhar.
> >> >> > > > >> > >
> >> >> > > > >> > >
> >> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> >> >> > > sathwik.bp@gmail.com
> >> >> > > > >
> >> >> > > > >> > > wrote:
> >> >> > > > >> > >
> >> >> > > > >> > > > There are multiple factors for intermittent issues. I
> >> can
> >> >> only
> >> >> > > > >> > speculate
> >> >> > > > >> > > > here with limited information.
> >> >> > > > >> > > >
> >> >> > > > >> > > > Check your logs for failures when it happens and share
> >> it
> >> >> > here,
> >> >> > > so
> >> >> > > > >> that
> >> >> > > > >> > > we
> >> >> > > > >> > > > can help you better. If possible put in a sample
> >> process to
> >> >> > > > >> reproduce
> >> >> > > > >> > > your
> >> >> > > > >> > > > scenario and share here.
> >> >> > > > >> > > >
> >> >> > > > >> > > >
> >> >> > > > >> > > >
> >> >> > > > >> > > >
> >> >> > > > >> > > >
> >> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> >> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> >> >> > > > >> > > >
> >> >> > > > >> > > > > Sometimes the activity gets released, if it is due
> to
> >> >> > failures
> >> >> > > > in
> >> >> > > > >> the
> >> >> > > > >> > > > > process, it should fail every time right?
> >> >> > > > >> > > > >
> >> >> > > > >> > > > > Regards,
> >> >> > > > >> > > > > Gangadhar.
> >> >> > > > >> > > > >
> >> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> >> >> > > > >> sathwik.bp@gmail.com>
> >> >> > > > >> > > > wrote:
> >> >> > > > >> > > > >
> >> >> > > > >> > > > > > Jobs might be getting rescheduled due to failures
> in
> >> >> the
> >> >> > > > >> process.
> >> >> > > > >> > > > > > Check the logs for errors.
> >> >> > > > >> > > > > >
> >> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar
> ireddy <
> >> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> >> >> > > > >> > > > > >
> >> >> > > > >> > > > > > > Hi Sathwik,
> >> >> > > > >> > > > > > >
> >> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs
> >> table,for
> >> >> > some
> >> >> > > > >> tasks
> >> >> > > > >> > it
> >> >> > > > >> > > > will
> >> >> > > > >> > > > > > be
> >> >> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
> >> >> > Sometimes
> >> >> > > it
> >> >> > > > >> > takes
> >> >> > > > >> > > > more
> >> >> > > > >> > > > > > > time to release the tasks, sometimes it will not
> >> >> > release.
> >> >> > > > >> > > > > > >
> >> >> > > > >> > > > > > > Regards,
> >> >> > > > >> > > > > > > Ganga.
> >> >> > > > >> > > > > > >
> >> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> >> >> > > > >> > sathwik.bp@gmail.com>
> >> >> > > > >> > > > > > wrote:
> >> >> > > > >> > > > > > >
> >> >> > > > >> > > > > > > > What kind of jobs are pending?
> >> >> > > > >> > > > > > > > What activities do you have within your
> <flow>?
> >> >> > > > >> > > > > > > >
> >> >> > > > >> > > > > > > > regards,
> >> >> > > > >> > > > > > > > sathwik
> >> >> > > > >> > > > > > > >
> >> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar
> >> ireddy <
> >> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> >> >> > > > >> > > > > > > > > wrote:
> >> >> > > > >> > > > > > > >
> >> >> > > > >> > > > > > > > > Hi,
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > > > This is Gangadhar working for Altair,
> >> currently
> >> >> we
> >> >> > are
> >> >> > > > >> using
> >> >> > > > >> > > > > > Apache-ode
> >> >> > > > >> > > > > > > > and
> >> >> > > > >> > > > > > > > > facing few issues on flow activity.
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > > > 1. Sometimes all the activities will not be
> >> >> released
> >> >> > > and
> >> >> > > > >> > when i
> >> >> > > > >> > > > > check
> >> >> > > > >> > > > > > > the
> >> >> > > > >> > > > > > > > > ode_job table there are some records not
> >> getting
> >> >> > > > updated.
> >> >> > > > >> But
> >> >> > > > >> > > > when
> >> >> > > > >> > > > > i
> >> >> > > > >> > > > > > > > clean
> >> >> > > > >> > > > > > > > > ode_job table and create a new instance it
> >> works
> >> >> > fine.
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow
> ,
> >> it
> >> >> > takes
> >> >> > > > >> large
> >> >> > > > >> > > > amount
> >> >> > > > >> > > > > > of
> >> >> > > > >> > > > > > > > time
> >> >> > > > >> > > > > > > > > to release all the tasks.
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > > > Thanks,
> >> >> > > > >> > > > > > > > > Gangadhar.
> >> >> > > > >> > > > > > > > >
> >> >> > > > >> > > > > > > >
> >> >> > > > >> > > > > > >
> >> >> > > > >> > > > > >
> >> >> > > > >> > > > >
> >> >> > > > >> > > >
> >> >> > > > >> > >
> >> >> > > > >> >
> >> >> > > > >> >
> >> >> > > > >> >
> >> >> > > > >>
> >> >> > > > >
> >> >> > > > >
> >> >> > > >
> >> >> > >
> >> >> >
> >> >>
> >> >
> >> >
> >>
> >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sathwik,

I am still facing the issue with flow activity if it has more than 8 tasks
in parallel. And also the retry time is getting increased
everytime(multipled by 5) . So its a big delay for me to get the activity.
Is there any config file to change the retry time?

Regards,
Ganga.

On Fri, Jul 14, 2017 at 12:03 PM, Gangadhar ireddy <
gangadhar.ireddy@gmail.com> wrote:

> Sure Sathwik, let me try on a dedicated database, Thanks a lot for your
> help.
>
> Regards,
> Gangadhar.
>
> On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sa...@gmail.com> wrote:
>
>> I have taken a specific job's execution time from your logs.
>>
>> Example:
>> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
>> It could not acquire the instance lock and hence was scheduled for 25sec
>> later, refer [2]. This is the second retry iteration. The first iteration
>> would have been with a 5sec delay, one should have seen this in the logs,
>> may be you have truncated that part of the logs.
>> When the job got into execution the time should have been sometime
>> approximately around 14:01:07 + 25sec = 14:01:32, but its time: 2017-07-11
>> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec more.
>> Due to slow running transactions, the Scheduler will throttle the jobs.
>>
>> To improve the execution times,
>> * Put off event generation (http://ode.apache.org/ode-exe
>> cution-events.html
>> ).
>> * Have a dedicated database server with good hardware.
>>
>> [1]
>> 424519845 [ODEServer-513] ERROR
>> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> processing a
>> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
>> transacted: true persisted: true details: JobDetails( instanceId: 48210
>> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
>> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> detailsExt: {})
>>
>> [2]
>> 424519862 [ODEServer-513] ERROR
>> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
>> job, retrying in 25s
>>
>> [3]
>> 424573863 [ODEServer-517] ERROR
>> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> processing a
>> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
>> transacted: true persisted: true details: JobDetails( instanceId: 48210
>> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
>> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> detailsExt: {})
>>
>> regards,
>> sathwik
>>
>> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com>
>> wrote:
>>
>> > What is the setting for the below config parameter in your
>> > ode.axis2.properties file
>> > ode-axis2.tx.factory.class=
>> >
>> > Have you configured a Transaction Manager in your tomcat?
>> >
>> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
>> > gangadhar.ireddy@gmail.com> wrote:
>> >
>> >> Hi Sathwik,
>> >>
>> >> Please find the details below:-
>> >>
>> >> ODE version :- 1.3.5
>> >> Server :- Apache tomcat
>> >> Database :- Oracle
>> >> OpenJPA or Hibernate:- Hibernate
>> >>
>> >> Regards,
>> >> Gangadhar.
>> >>
>> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com>
>> >> wrote:
>> >>
>> >> > Can you provide these info please
>> >> > ODE version?
>> >> > Server?
>> >> > Database?
>> >> > OpenJPA or Hibernate?
>> >> >
>> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
>> >> > gangadhar.ireddy@gmail.com> wrote:
>> >> >
>> >> > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalS
>> ervice
>> >> -
>> >> > > Response:
>> >> > > <?xml version="1.0" encoding="UTF-8"?>
>> >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
>> >> xmlns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
>> >> xmlns:SOAP-ENV="
>> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
>> >> > > humanTaskInvokeResponse
>> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> >> > > xmlns:htds="
>> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
>> >> > > SubProcess24Task137Output></message>
>> >> > > 424519845 [ODEServer-513] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519851 [ODEServer-518] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519854 [ODEServer-508] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519853 [ODEServer-502] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519849 [ODEServer-506] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519852 [ODEServer-504] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519865 [ODEServer-506] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519865 [ODEServer-502] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519866 [ODEServer-508] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519863 [ODEServer-511] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519863 [ODEServer-507] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519862 [ODEServer-519] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519868 [ODEServer-511] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519862 [ODEServer-513] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519868 [ODEServer-507] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519868 [ODEServer-519] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519867 [ODEServer-518] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519866 [ODEServer-504] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424519866 [ODEServer-510] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
>> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424519870 [ODEServer-510] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 25s
>> >> > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalS
>> ervice
>> >> -
>> >> > > Response:
>> >> > > <?xml version="1.0" encoding="UTF-8"?>
>> >> > > <message><SubProcess24Task131Output><SubProcess24Task131Output
>> >> xmlns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
>> >> xmlns:SOAP-ENV="
>> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
>> >> > > humanTaskInvokeResponse
>> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> >> > > xmlns:htds="
>> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
>> >> > > SubProcess24Task131Output></message>
>> >> > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalS
>> ervice
>> >> -
>> >> > > Response:
>> >> > > <?xml version="1.0" encoding="UTF-8"?>
>> >> > > <message><SubProcess24Task132Output><SubProcess24Task132Output
>> >> xmlns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
>> >> xmlns:SOAP-ENV="
>> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
>> >> > > humanTaskInvokeResponse
>> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> >> > > xmlns:htds="
>> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
>> >> > > SubProcess24Task132Output></message>
>> >> > > 424573852 [ODEServer-513] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573856 [ODEServer-511] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573863 [ODEServer-504] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573865 [ODEServer-513] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573863 [ODEServer-517] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573863 [ODEServer-514] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573868 [ODEServer-508] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573868 [ODEServer-507] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573869 [ODEServer-517] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573869 [ODEServer-504] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573870 [ODEServer-514] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573870 [ODEServer-511] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573868 [ODEServer-519] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > a
>> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13
>> >> EDT
>> >> > > transacted: true persisted: true details: JobDetails( instanceId:
>> >> 48210
>> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
>> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
>> false
>> >> > > detailsExt: {})
>> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> >> > > BpelEngineImpl.java:394)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> >> > > BpelEngineImpl.java:403)
>> >> > > at
>> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> >> > > BpelServerImpl.java:450)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:518)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> >> > > 1.call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:284)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> >> > > SimpleScheduler.java:239)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:512)
>> >> > > at
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> >> > > call(SimpleScheduler.java:496)
>> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> >> > > ThreadPoolExecutor.java:1142)
>> >> > > at
>> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> >> > > ThreadPoolExecutor.java:617)
>> >> > > at java.lang.Thread.run(Thread.java:745)
>> >> > > 424573870 [ODEServer-507] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573870 [ODEServer-508] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424573871 [ODEServer-519] ERROR
>> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> >> > processing
>> >> > > job, retrying in 125s
>> >> > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalS
>> ervice
>> >> -
>> >> > > Response:
>> >> > > <?xml version="1.0" encoding="UTF-8"?>
>> >> > > <message><SubProcess24Task135Output><SubProcess24Task135Output
>> >> xmlns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
>> >> xmlns:SOAP-ENV="
>> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
>> >> > > humanTaskInvokeResponse
>> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> >> > > xmlns:htds="
>> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
>> >> > > SubProcess24Task135Output></message>
>> >> > >
>> >> > >
>> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sathwik.bp@gmail.com
>> >
>> >> > wrote:
>> >> > >
>> >> > > > Attachment has not come through.
>> >> > > >
>> >> > > > put it inline
>> >> > > >
>> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
>> >> gangadhar.ireddy@gmail.com>
>> >> > > > wrote:
>> >> > > >
>> >> > > > > Sathwik,
>> >> > > > >
>> >> > > > > Please find the attached log.
>> >> > > > >
>> >> > > > > Regards,
>> >> > > > > Gangadhar.
>> >> > > > >
>> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
>> >> sathwik.bp@gmail.com>
>> >> > > > wrote:
>> >> > > > >
>> >> > > > >> Can you send the complete logs.
>> >> > > > >>
>> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
>> >> sathwik.bp@gmail.com>
>> >> > > > >> wrote:
>> >> > > > >>
>> >> > > > >> > Usually, the jobs gets executed pretty much quickly.
>> >> > > > >> >
>> >> > > > >> > Factors that might be delaying the execution of jobs is a
>> slow
>> >> > > > database.
>> >> > > > >> >
>> >> > > > >> > How many concurrent messages is the process expecting?
>> >> > > > >> >
>> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
>> >> > > gangadhar.ireddy@gmail.com
>> >> > > > >
>> >> > > > >> > wrote:
>> >> > > > >> >
>> >> > > > >> > We are waiting for the jobs and it releases many times, but
>> few
>> >> > > times
>> >> > > > it
>> >> > > > >> > doesn't release, Is there any limit on the rescheduling?
>> >> > > > >> >
>> >> > > > >> > Regards,
>> >> > > > >> > Gangadhar.
>> >> > > > >> >
>> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
>> >> > sathwik.bp@gmail.com>
>> >> > > > >> wrote:
>> >> > > > >> >
>> >> > > > >> > > This is normal. Concurrent messages are competing for the
>> >> > instance
>> >> > > > >> lock.
>> >> > > > >> > > Job that doesn't get the lock on the instance has to wait
>> and
>> >> > will
>> >> > > > be
>> >> > > > >> > > rescheduled.
>> >> > > > >> > > You should never clear the job table.
>> >> > > > >> > >
>> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
>> >> > > > gangadhar.ireddy@gmail.com
>> >> > > > >> >
>> >> > > > >> > > wrote:
>> >> > > > >> > >
>> >> > > > >> > > Sathwik,
>> >> > > > >> > >
>> >> > > > >> > > Please find the below log,
>> >> > > > >> > >
>> >> > > > >> > > <message><SubProcess24Task137O
>> utput><SubProcess24Task137Outp
>> >> ut
>> >> > > > >> > > xmlns="http://www.altair.com/E
>> PM/Schema/SubProcess24Task137"
>> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/
>> "
>> >> > > > >> > > xmlns:tns="http://www.altair.c
>> om/EPM/Schema/SubProcess24Task
>> >> 137
>> >> > > "><
>> >> > > > >> > > humanTaskInvokeResponse
>> >> > > > >> > > xmlns="http://www.altair.com/W
>> F/Framework/HumanTaskDataSchem
>> >> a"
>> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
>> >> > > HumanTaskDataSchema
>> >> > > > >> > ">true</
>> >> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
>> >> > > > >> > > SubProcess24Task137Output></message>
>> >> > > > >> > > 424519845 [ODEServer-513] ERROR
>> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
>> >> while
>> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3
>> time:
>> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
>> >> > details:
>> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null
>> >> type:
>> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
>> >> > correlationKeySet:
>> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
>> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
>> >> > > > >> lEngineImpl.acquireInstanceLoc
>> >> > > > >> > k(
>> >> > > > >> > > BpelEngineImpl.java:394)
>> >> > > > >> > >         at org.apache.ode.bpel.engine.
>> >> > > > BpelEngineImpl.onScheduledJob(
>> >> > > > >> > > BpelEngineImpl.java:403)
>> >> > > > >> > >         at org.apache.ode.bpel.engine.
>> >> > > > BpelServerImpl.onScheduledJob(
>> >> > > > >> > > BpelServerImpl.java:450)
>> >> > > > >> > >         at org.apache.ode.scheduler.
>> >> > > simple.SimpleScheduler$RunJob$
>> >> > > > >> > > 1.call(SimpleScheduler.java:518)
>> >> > > > >> > >         at org.apache.ode.scheduler.
>> >> > > simple.SimpleScheduler$RunJob$
>> >> > > > >> > > 1.call(SimpleScheduler.java:512)
>> >> > > > >> > >         at org.apache.ode.scheduler.simpl
>> e.SimpleScheduler.
>> >> > > > >> > > execTransaction(
>> >> > > > >> > > SimpleScheduler.java:284)
>> >> > > > >> > >         at org.apache.ode.scheduler.simpl
>> e.SimpleScheduler.
>> >> > > > >> > > execTransaction(
>> >> > > > >> > > SimpleScheduler.java:239)
>> >> > > > >> > >         at org.apache.ode.scheduler.
>> >> > > simple.SimpleScheduler$RunJob.
>> >> > > > >> > > call(SimpleScheduler.java:512)
>> >> > > > >> > >         at org.apache.ode.scheduler.
>> >> > > simple.SimpleScheduler$RunJob.
>> >> > > > >> > > call(SimpleScheduler.java:496)
>> >> > > > >> > >         at java.util.concurrent.FutureTas
>> k.run(FutureTask.
>> >> > > java:266)
>> >> > > > >> > >         at java.util.concurrent.ThreadPoo
>> >> lExecutor.runWorker(
>> >> > > > >> > > ThreadPoolExecutor.java:1142)
>> >> > > > >> > >         at java.util.concurrent.ThreadPoo
>> >> lExecutor$Worker.run(
>> >> > > > >> > > ThreadPoolExecutor.java:617)
>> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
>> >> > > > >> > > 424519851 [ODEServer-518] ERROR
>> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
>> >> while
>> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem
>> time:
>> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
>> >> > details:
>> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null
>> >> type:
>> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
>> >> > correlationKeySet:
>> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
>> >> > > > >> > >
>> >> > > > >> > >
>> >> > > > >> > > Regards,
>> >> > > > >> > >
>> >> > > > >> > > Gangadhar.
>> >> > > > >> > >
>> >> > > > >> > >
>> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
>> >> > > sathwik.bp@gmail.com
>> >> > > > >
>> >> > > > >> > > wrote:
>> >> > > > >> > >
>> >> > > > >> > > > There are multiple factors for intermittent issues. I
>> can
>> >> only
>> >> > > > >> > speculate
>> >> > > > >> > > > here with limited information.
>> >> > > > >> > > >
>> >> > > > >> > > > Check your logs for failures when it happens and share
>> it
>> >> > here,
>> >> > > so
>> >> > > > >> that
>> >> > > > >> > > we
>> >> > > > >> > > > can help you better. If possible put in a sample
>> process to
>> >> > > > >> reproduce
>> >> > > > >> > > your
>> >> > > > >> > > > scenario and share here.
>> >> > > > >> > > >
>> >> > > > >> > > >
>> >> > > > >> > > >
>> >> > > > >> > > >
>> >> > > > >> > > >
>> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
>> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
>> >> > > > >> > > >
>> >> > > > >> > > > > Sometimes the activity gets released, if it is due to
>> >> > failures
>> >> > > > in
>> >> > > > >> the
>> >> > > > >> > > > > process, it should fail every time right?
>> >> > > > >> > > > >
>> >> > > > >> > > > > Regards,
>> >> > > > >> > > > > Gangadhar.
>> >> > > > >> > > > >
>> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
>> >> > > > >> sathwik.bp@gmail.com>
>> >> > > > >> > > > wrote:
>> >> > > > >> > > > >
>> >> > > > >> > > > > > Jobs might be getting rescheduled due to failures in
>> >> the
>> >> > > > >> process.
>> >> > > > >> > > > > > Check the logs for errors.
>> >> > > > >> > > > > >
>> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
>> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
>> >> > > > >> > > > > >
>> >> > > > >> > > > > > > Hi Sathwik,
>> >> > > > >> > > > > > >
>> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs
>> table,for
>> >> > some
>> >> > > > >> tasks
>> >> > > > >> > it
>> >> > > > >> > > > will
>> >> > > > >> > > > > > be
>> >> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
>> >> > Sometimes
>> >> > > it
>> >> > > > >> > takes
>> >> > > > >> > > > more
>> >> > > > >> > > > > > > time to release the tasks, sometimes it will not
>> >> > release.
>> >> > > > >> > > > > > >
>> >> > > > >> > > > > > > Regards,
>> >> > > > >> > > > > > > Ganga.
>> >> > > > >> > > > > > >
>> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
>> >> > > > >> > sathwik.bp@gmail.com>
>> >> > > > >> > > > > > wrote:
>> >> > > > >> > > > > > >
>> >> > > > >> > > > > > > > What kind of jobs are pending?
>> >> > > > >> > > > > > > > What activities do you have within your <flow>?
>> >> > > > >> > > > > > > >
>> >> > > > >> > > > > > > > regards,
>> >> > > > >> > > > > > > > sathwik
>> >> > > > >> > > > > > > >
>> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar
>> ireddy <
>> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
>> >> > > > >> > > > > > > > > wrote:
>> >> > > > >> > > > > > > >
>> >> > > > >> > > > > > > > > Hi,
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > > > This is Gangadhar working for Altair,
>> currently
>> >> we
>> >> > are
>> >> > > > >> using
>> >> > > > >> > > > > > Apache-ode
>> >> > > > >> > > > > > > > and
>> >> > > > >> > > > > > > > > facing few issues on flow activity.
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > > > 1. Sometimes all the activities will not be
>> >> released
>> >> > > and
>> >> > > > >> > when i
>> >> > > > >> > > > > check
>> >> > > > >> > > > > > > the
>> >> > > > >> > > > > > > > > ode_job table there are some records not
>> getting
>> >> > > > updated.
>> >> > > > >> But
>> >> > > > >> > > > when
>> >> > > > >> > > > > i
>> >> > > > >> > > > > > > > clean
>> >> > > > >> > > > > > > > > ode_job table and create a new instance it
>> works
>> >> > fine.
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow ,
>> it
>> >> > takes
>> >> > > > >> large
>> >> > > > >> > > > amount
>> >> > > > >> > > > > > of
>> >> > > > >> > > > > > > > time
>> >> > > > >> > > > > > > > > to release all the tasks.
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > > > Can you help me to fix these issues.
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > > > Thanks,
>> >> > > > >> > > > > > > > > Gangadhar.
>> >> > > > >> > > > > > > > >
>> >> > > > >> > > > > > > >
>> >> > > > >> > > > > > >
>> >> > > > >> > > > > >
>> >> > > > >> > > > >
>> >> > > > >> > > >
>> >> > > > >> > >
>> >> > > > >> >
>> >> > > > >> >
>> >> > > > >> >
>> >> > > > >>
>> >> > > > >
>> >> > > > >
>> >> > > >
>> >> > >
>> >> >
>> >>
>> >
>> >
>>
>
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sure Sathwik, let me try on a dedicated database, Thanks a lot for your
help.

Regards,
Gangadhar.

On Thu, Jul 13, 2017 at 5:40 PM, Sathwik B P <sa...@gmail.com> wrote:

> I have taken a specific job's execution time from your logs.
>
> Example:
> Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
> It could not acquire the instance lock and hence was scheduled for 25sec
> later, refer [2]. This is the second retry iteration. The first iteration
> would have been with a 5sec delay, one should have seen this in the logs,
> may be you have truncated that part of the logs.
> When the job got into execution the time should have been sometime
> approximately around 14:01:07 + 25sec = 14:01:32, but its time: 2017-07-11
> 14:02:13 EDT refer [3], shows a huge additional delay about 40sec more.
> Due to slow running transactions, the Scheduler will throttle the jobs.
>
> To improve the execution times,
> * Put off event generation (http://ode.apache.org/ode-
> execution-events.html
> ).
> * Have a dedicated database server with good hardware.
>
> [1]
> 424519845 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
>
> [2]
> 424519862 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
>
> [3]
> 424573863 [ODEServer-517] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
>
> regards,
> sathwik
>
> On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > What is the setting for the below config parameter in your
> > ode.axis2.properties file
> > ode-axis2.tx.factory.class=
> >
> > Have you configured a Transaction Manager in your tomcat?
> >
> > On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com> wrote:
> >
> >> Hi Sathwik,
> >>
> >> Please find the details below:-
> >>
> >> ODE version :- 1.3.5
> >> Server :- Apache tomcat
> >> Database :- Oracle
> >> OpenJPA or Hibernate:- Hibernate
> >>
> >> Regards,
> >> Gangadhar.
> >>
> >> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com>
> >> wrote:
> >>
> >> > Can you provide these info please
> >> > ODE version?
> >> > Server?
> >> > Database?
> >> > OpenJPA or Hibernate?
> >> >
> >> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> >> > gangadhar.ireddy@gmail.com> wrote:
> >> >
> >> > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.
> ExternalService
> >> -
> >> > > Response:
> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> >> xmlns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
> >> xmlns:SOAP-ENV="
> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> >> > > humanTaskInvokeResponse
> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> > > xmlns:htds="
> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> >> > > SubProcess24Task137Output></message>
> >> > > 424519845 [ODEServer-513] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519851 [ODEServer-518] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519854 [ODEServer-508] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519853 [ODEServer-502] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519849 [ODEServer-506] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519852 [ODEServer-504] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519865 [ODEServer-506] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519865 [ODEServer-502] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519866 [ODEServer-508] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519863 [ODEServer-511] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519863 [ODEServer-507] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519862 [ODEServer-519] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519868 [ODEServer-511] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519862 [ODEServer-513] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519868 [ODEServer-507] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519868 [ODEServer-519] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519867 [ODEServer-518] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519866 [ODEServer-504] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424519866 [ODEServer-510] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> >> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424519870 [ODEServer-510] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 25s
> >> > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.
> ExternalService
> >> -
> >> > > Response:
> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> > > <message><SubProcess24Task131Output><SubProcess24Task131Output
> >> xmlns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
> >> xmlns:SOAP-ENV="
> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> >> > > humanTaskInvokeResponse
> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> > > xmlns:htds="
> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> >> > > SubProcess24Task131Output></message>
> >> > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.
> ExternalService
> >> -
> >> > > Response:
> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> > > <message><SubProcess24Task132Output><SubProcess24Task132Output
> >> xmlns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
> >> xmlns:SOAP-ENV="
> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> >> > > humanTaskInvokeResponse
> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> > > xmlns:htds="
> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> >> > > SubProcess24Task132Output></message>
> >> > > 424573852 [ODEServer-513] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573856 [ODEServer-511] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573863 [ODEServer-504] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573865 [ODEServer-513] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573863 [ODEServer-517] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573863 [ODEServer-514] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573868 [ODEServer-508] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573868 [ODEServer-507] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573869 [ODEServer-517] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573869 [ODEServer-504] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573870 [ODEServer-514] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573870 [ODEServer-511] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573868 [ODEServer-519] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > a
> >> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13
> >> EDT
> >> > > transacted: true persisted: true details: JobDetails( instanceId:
> >> 48210
> >> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> >> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem:
> false
> >> > > detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> >> > > BpelEngineImpl.java:394)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > > at
> >> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > > at
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > > at
> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > > at java.lang.Thread.run(Thread.java:745)
> >> > > 424573870 [ODEServer-507] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573870 [ODEServer-508] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424573871 [ODEServer-519] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > processing
> >> > > job, retrying in 125s
> >> > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.
> ExternalService
> >> -
> >> > > Response:
> >> > > <?xml version="1.0" encoding="UTF-8"?>
> >> > > <message><SubProcess24Task135Output><SubProcess24Task135Output
> >> xmlns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
> >> xmlns:SOAP-ENV="
> >> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> >> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> >> > > humanTaskInvokeResponse
> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> > > xmlns:htds="
> >> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> >> > > SubProcess24Task135Output></message>
> >> > >
> >> > >
> >> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com>
> >> > wrote:
> >> > >
> >> > > > Attachment has not come through.
> >> > > >
> >> > > > put it inline
> >> > > >
> >> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> >> gangadhar.ireddy@gmail.com>
> >> > > > wrote:
> >> > > >
> >> > > > > Sathwik,
> >> > > > >
> >> > > > > Please find the attached log.
> >> > > > >
> >> > > > > Regards,
> >> > > > > Gangadhar.
> >> > > > >
> >> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
> >> sathwik.bp@gmail.com>
> >> > > > wrote:
> >> > > > >
> >> > > > >> Can you send the complete logs.
> >> > > > >>
> >> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> >> sathwik.bp@gmail.com>
> >> > > > >> wrote:
> >> > > > >>
> >> > > > >> > Usually, the jobs gets executed pretty much quickly.
> >> > > > >> >
> >> > > > >> > Factors that might be delaying the execution of jobs is a
> slow
> >> > > > database.
> >> > > > >> >
> >> > > > >> > How many concurrent messages is the process expecting?
> >> > > > >> >
> >> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> >> > > gangadhar.ireddy@gmail.com
> >> > > > >
> >> > > > >> > wrote:
> >> > > > >> >
> >> > > > >> > We are waiting for the jobs and it releases many times, but
> few
> >> > > times
> >> > > > it
> >> > > > >> > doesn't release, Is there any limit on the rescheduling?
> >> > > > >> >
> >> > > > >> > Regards,
> >> > > > >> > Gangadhar.
> >> > > > >> >
> >> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> >> > sathwik.bp@gmail.com>
> >> > > > >> wrote:
> >> > > > >> >
> >> > > > >> > > This is normal. Concurrent messages are competing for the
> >> > instance
> >> > > > >> lock.
> >> > > > >> > > Job that doesn't get the lock on the instance has to wait
> and
> >> > will
> >> > > > be
> >> > > > >> > > rescheduled.
> >> > > > >> > > You should never clear the job table.
> >> > > > >> > >
> >> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> >> > > > gangadhar.ireddy@gmail.com
> >> > > > >> >
> >> > > > >> > > wrote:
> >> > > > >> > >
> >> > > > >> > > Sathwik,
> >> > > > >> > >
> >> > > > >> > > Please find the below log,
> >> > > > >> > >
> >> > > > >> > > <message><SubProcess24Task137Output><
> SubProcess24Task137Outp
> >> ut
> >> > > > >> > > xmlns="http://www.altair.com/
> EPM/Schema/SubProcess24Task137"
> >> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> >> > > > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/
> SubProcess24Task
> >> 137
> >> > > "><
> >> > > > >> > > humanTaskInvokeResponse
> >> > > > >> > > xmlns="http://www.altair.com/WF/Framework/
> HumanTaskDataSchem
> >> a"
> >> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> >> > > HumanTaskDataSchema
> >> > > > >> > ">true</
> >> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> >> > > > >> > > SubProcess24Task137Output></message>
> >> > > > >> > > 424519845 [ODEServer-513] ERROR
> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> >> while
> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3
> time:
> >> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
> >> > details:
> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null
> >> type:
> >> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> >> > correlationKeySet:
> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> >> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> >> > > > >> lEngineImpl.acquireInstanceLoc
> >> > > > >> > k(
> >> > > > >> > > BpelEngineImpl.java:394)
> >> > > > >> > >         at org.apache.ode.bpel.engine.
> >> > > > BpelEngineImpl.onScheduledJob(
> >> > > > >> > > BpelEngineImpl.java:403)
> >> > > > >> > >         at org.apache.ode.bpel.engine.
> >> > > > BpelServerImpl.onScheduledJob(
> >> > > > >> > > BpelServerImpl.java:450)
> >> > > > >> > >         at org.apache.ode.scheduler.
> >> > > simple.SimpleScheduler$RunJob$
> >> > > > >> > > 1.call(SimpleScheduler.java:518)
> >> > > > >> > >         at org.apache.ode.scheduler.
> >> > > simple.SimpleScheduler$RunJob$
> >> > > > >> > > 1.call(SimpleScheduler.java:512)
> >> > > > >> > >         at org.apache.ode.scheduler.
> simple.SimpleScheduler.
> >> > > > >> > > execTransaction(
> >> > > > >> > > SimpleScheduler.java:284)
> >> > > > >> > >         at org.apache.ode.scheduler.
> simple.SimpleScheduler.
> >> > > > >> > > execTransaction(
> >> > > > >> > > SimpleScheduler.java:239)
> >> > > > >> > >         at org.apache.ode.scheduler.
> >> > > simple.SimpleScheduler$RunJob.
> >> > > > >> > > call(SimpleScheduler.java:512)
> >> > > > >> > >         at org.apache.ode.scheduler.
> >> > > simple.SimpleScheduler$RunJob.
> >> > > > >> > > call(SimpleScheduler.java:496)
> >> > > > >> > >         at java.util.concurrent.FutureTask.run(FutureTask.
> >> > > java:266)
> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> >> lExecutor.runWorker(
> >> > > > >> > > ThreadPoolExecutor.java:1142)
> >> > > > >> > >         at java.util.concurrent.ThreadPoo
> >> lExecutor$Worker.run(
> >> > > > >> > > ThreadPoolExecutor.java:617)
> >> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> >> > > > >> > > 424519851 [ODEServer-518] ERROR
> >> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> >> while
> >> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem
> time:
> >> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
> >> > details:
> >> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null
> >> type:
> >> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> >> > correlationKeySet:
> >> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> >> > > > >> > >
> >> > > > >> > >
> >> > > > >> > > Regards,
> >> > > > >> > >
> >> > > > >> > > Gangadhar.
> >> > > > >> > >
> >> > > > >> > >
> >> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> >> > > sathwik.bp@gmail.com
> >> > > > >
> >> > > > >> > > wrote:
> >> > > > >> > >
> >> > > > >> > > > There are multiple factors for intermittent issues. I can
> >> only
> >> > > > >> > speculate
> >> > > > >> > > > here with limited information.
> >> > > > >> > > >
> >> > > > >> > > > Check your logs for failures when it happens and share it
> >> > here,
> >> > > so
> >> > > > >> that
> >> > > > >> > > we
> >> > > > >> > > > can help you better. If possible put in a sample process
> to
> >> > > > >> reproduce
> >> > > > >> > > your
> >> > > > >> > > > scenario and share here.
> >> > > > >> > > >
> >> > > > >> > > >
> >> > > > >> > > >
> >> > > > >> > > >
> >> > > > >> > > >
> >> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> >> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> >> > > > >> > > >
> >> > > > >> > > > > Sometimes the activity gets released, if it is due to
> >> > failures
> >> > > > in
> >> > > > >> the
> >> > > > >> > > > > process, it should fail every time right?
> >> > > > >> > > > >
> >> > > > >> > > > > Regards,
> >> > > > >> > > > > Gangadhar.
> >> > > > >> > > > >
> >> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> >> > > > >> sathwik.bp@gmail.com>
> >> > > > >> > > > wrote:
> >> > > > >> > > > >
> >> > > > >> > > > > > Jobs might be getting rescheduled due to failures in
> >> the
> >> > > > >> process.
> >> > > > >> > > > > > Check the logs for errors.
> >> > > > >> > > > > >
> >> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> >> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> >> > > > >> > > > > >
> >> > > > >> > > > > > > Hi Sathwik,
> >> > > > >> > > > > > >
> >> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs
> table,for
> >> > some
> >> > > > >> tasks
> >> > > > >> > it
> >> > > > >> > > > will
> >> > > > >> > > > > > be
> >> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
> >> > Sometimes
> >> > > it
> >> > > > >> > takes
> >> > > > >> > > > more
> >> > > > >> > > > > > > time to release the tasks, sometimes it will not
> >> > release.
> >> > > > >> > > > > > >
> >> > > > >> > > > > > > Regards,
> >> > > > >> > > > > > > Ganga.
> >> > > > >> > > > > > >
> >> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> >> > > > >> > sathwik.bp@gmail.com>
> >> > > > >> > > > > > wrote:
> >> > > > >> > > > > > >
> >> > > > >> > > > > > > > What kind of jobs are pending?
> >> > > > >> > > > > > > > What activities do you have within your <flow>?
> >> > > > >> > > > > > > >
> >> > > > >> > > > > > > > regards,
> >> > > > >> > > > > > > > sathwik
> >> > > > >> > > > > > > >
> >> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy
> <
> >> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> >> > > > >> > > > > > > > > wrote:
> >> > > > >> > > > > > > >
> >> > > > >> > > > > > > > > Hi,
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > > > This is Gangadhar working for Altair, currently
> >> we
> >> > are
> >> > > > >> using
> >> > > > >> > > > > > Apache-ode
> >> > > > >> > > > > > > > and
> >> > > > >> > > > > > > > > facing few issues on flow activity.
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > > > 1. Sometimes all the activities will not be
> >> released
> >> > > and
> >> > > > >> > when i
> >> > > > >> > > > > check
> >> > > > >> > > > > > > the
> >> > > > >> > > > > > > > > ode_job table there are some records not
> getting
> >> > > > updated.
> >> > > > >> But
> >> > > > >> > > > when
> >> > > > >> > > > > i
> >> > > > >> > > > > > > > clean
> >> > > > >> > > > > > > > > ode_job table and create a new instance it
> works
> >> > fine.
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow ,
> it
> >> > takes
> >> > > > >> large
> >> > > > >> > > > amount
> >> > > > >> > > > > > of
> >> > > > >> > > > > > > > time
> >> > > > >> > > > > > > > > to release all the tasks.
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > > > Can you help me to fix these issues.
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > > > Thanks,
> >> > > > >> > > > > > > > > Gangadhar.
> >> > > > >> > > > > > > > >
> >> > > > >> > > > > > > >
> >> > > > >> > > > > > >
> >> > > > >> > > > > >
> >> > > > >> > > > >
> >> > > > >> > > >
> >> > > > >> > >
> >> > > > >> >
> >> > > > >> >
> >> > > > >> >
> >> > > > >>
> >> > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >>
> >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

I have taken a specific job's execution time from your logs.

Example:
Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT refer [1]
It could not acquire the instance lock and hence was scheduled for 25sec
later, refer [2]. This is the second retry iteration. The first iteration
would have been with a 5sec delay, one should have seen this in the logs,
may be you have truncated that part of the logs.
When the job got into execution the time should have been sometime
approximately around 14:01:07 + 25sec = 14:01:32, but its time: 2017-07-11
14:02:13 EDT refer [3], shows a huge additional delay about 40sec more.
Due to slow running transactions, the Scheduler will throttle the jobs.

To improve the execution times,
* Put off event generation (http://ode.apache.org/ode-execution-events.html
).
* Have a dedicated database server with good hardware.

[1]
424519845 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})

[2]
424519862 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s

[3]
424573863 [ODEServer-517] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})

regards,
sathwik

On Thu, Jul 13, 2017 at 3:03 PM, Sathwik B P <sa...@gmail.com> wrote:

> What is the setting for the below config parameter in your
> ode.axis2.properties file
> ode-axis2.tx.factory.class=
>
> Have you configured a Transaction Manager in your tomcat?
>
> On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
>> Hi Sathwik,
>>
>> Please find the details below:-
>>
>> ODE version :- 1.3.5
>> Server :- Apache tomcat
>> Database :- Oracle
>> OpenJPA or Hibernate:- Hibernate
>>
>> Regards,
>> Gangadhar.
>>
>> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com>
>> wrote:
>>
>> > Can you provide these info please
>> > ODE version?
>> > Server?
>> > Database?
>> > OpenJPA or Hibernate?
>> >
>> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
>> > gangadhar.ireddy@gmail.com> wrote:
>> >
>> > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalService
>> -
>> > > Response:
>> > > <?xml version="1.0" encoding="UTF-8"?>
>> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
>> xmlns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"
>> xmlns:SOAP-ENV="
>> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
>> > > humanTaskInvokeResponse
>> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> > > xmlns:htds="
>> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
>> > > SubProcess24Task137Output></message>
>> > > 424519845 [ODEServer-513] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519851 [ODEServer-518] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519854 [ODEServer-508] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519853 [ODEServer-502] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519849 [ODEServer-506] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519852 [ODEServer-504] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519865 [ODEServer-506] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519865 [ODEServer-502] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519866 [ODEServer-508] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519863 [ODEServer-511] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519863 [ODEServer-507] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519862 [ODEServer-519] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519868 [ODEServer-511] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519862 [ODEServer-513] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519868 [ODEServer-507] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519868 [ODEServer-519] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519867 [ODEServer-518] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519866 [ODEServer-504] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424519866 [ODEServer-510] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
>> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424519870 [ODEServer-510] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 25s
>> > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService
>> -
>> > > Response:
>> > > <?xml version="1.0" encoding="UTF-8"?>
>> > > <message><SubProcess24Task131Output><SubProcess24Task131Output
>> xmlns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"
>> xmlns:SOAP-ENV="
>> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
>> > > humanTaskInvokeResponse
>> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> > > xmlns:htds="
>> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
>> > > SubProcess24Task131Output></message>
>> > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService
>> -
>> > > Response:
>> > > <?xml version="1.0" encoding="UTF-8"?>
>> > > <message><SubProcess24Task132Output><SubProcess24Task132Output
>> xmlns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"
>> xmlns:SOAP-ENV="
>> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
>> > > humanTaskInvokeResponse
>> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> > > xmlns:htds="
>> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
>> > > SubProcess24Task132Output></message>
>> > > 424573852 [ODEServer-513] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573856 [ODEServer-511] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573863 [ODEServer-504] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573865 [ODEServer-513] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573863 [ODEServer-517] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573863 [ODEServer-514] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573868 [ODEServer-508] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573868 [ODEServer-507] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573869 [ODEServer-517] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573869 [ODEServer-504] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573870 [ODEServer-514] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573870 [ODEServer-511] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573868 [ODEServer-519] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > a
>> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13
>> EDT
>> > > transacted: true persisted: true details: JobDetails( instanceId:
>> 48210
>> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
>> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
>> > > detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
>> > > BpelEngineImpl.java:394)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > > at
>> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:284)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
>> > > SimpleScheduler.java:239)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > > at
>> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > > at
>> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > > at java.lang.Thread.run(Thread.java:745)
>> > > 424573870 [ODEServer-507] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573870 [ODEServer-508] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424573871 [ODEServer-519] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > processing
>> > > job, retrying in 125s
>> > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalService
>> -
>> > > Response:
>> > > <?xml version="1.0" encoding="UTF-8"?>
>> > > <message><SubProcess24Task135Output><SubProcess24Task135Output
>> xmlns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"
>> xmlns:SOAP-ENV="
>> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
>> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
>> > > humanTaskInvokeResponse
>> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> > > xmlns:htds="
>> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
>> > > SubProcess24Task135Output></message>
>> > >
>> > >
>> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com>
>> > wrote:
>> > >
>> > > > Attachment has not come through.
>> > > >
>> > > > put it inline
>> > > >
>> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
>> gangadhar.ireddy@gmail.com>
>> > > > wrote:
>> > > >
>> > > > > Sathwik,
>> > > > >
>> > > > > Please find the attached log.
>> > > > >
>> > > > > Regards,
>> > > > > Gangadhar.
>> > > > >
>> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <
>> sathwik.bp@gmail.com>
>> > > > wrote:
>> > > > >
>> > > > >> Can you send the complete logs.
>> > > > >>
>> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
>> sathwik.bp@gmail.com>
>> > > > >> wrote:
>> > > > >>
>> > > > >> > Usually, the jobs gets executed pretty much quickly.
>> > > > >> >
>> > > > >> > Factors that might be delaying the execution of jobs is a slow
>> > > > database.
>> > > > >> >
>> > > > >> > How many concurrent messages is the process expecting?
>> > > > >> >
>> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
>> > > gangadhar.ireddy@gmail.com
>> > > > >
>> > > > >> > wrote:
>> > > > >> >
>> > > > >> > We are waiting for the jobs and it releases many times, but few
>> > > times
>> > > > it
>> > > > >> > doesn't release, Is there any limit on the rescheduling?
>> > > > >> >
>> > > > >> > Regards,
>> > > > >> > Gangadhar.
>> > > > >> >
>> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
>> > sathwik.bp@gmail.com>
>> > > > >> wrote:
>> > > > >> >
>> > > > >> > > This is normal. Concurrent messages are competing for the
>> > instance
>> > > > >> lock.
>> > > > >> > > Job that doesn't get the lock on the instance has to wait and
>> > will
>> > > > be
>> > > > >> > > rescheduled.
>> > > > >> > > You should never clear the job table.
>> > > > >> > >
>> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
>> > > > gangadhar.ireddy@gmail.com
>> > > > >> >
>> > > > >> > > wrote:
>> > > > >> > >
>> > > > >> > > Sathwik,
>> > > > >> > >
>> > > > >> > > Please find the below log,
>> > > > >> > >
>> > > > >> > > <message><SubProcess24Task137Output><SubProcess24Task137Outp
>> ut
>> > > > >> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
>> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
>> > > > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task
>> 137
>> > > "><
>> > > > >> > > humanTaskInvokeResponse
>> > > > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchem
>> a"
>> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
>> > > HumanTaskDataSchema
>> > > > >> > ">true</
>> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
>> > > > >> > > SubProcess24Task137Output></message>
>> > > > >> > > 424519845 [ODEServer-513] ERROR
>> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
>> while
>> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
>> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
>> > details:
>> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null
>> type:
>> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
>> > correlationKeySet:
>> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
>> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
>> > > > >> lEngineImpl.acquireInstanceLoc
>> > > > >> > k(
>> > > > >> > > BpelEngineImpl.java:394)
>> > > > >> > >         at org.apache.ode.bpel.engine.
>> > > > BpelEngineImpl.onScheduledJob(
>> > > > >> > > BpelEngineImpl.java:403)
>> > > > >> > >         at org.apache.ode.bpel.engine.
>> > > > BpelServerImpl.onScheduledJob(
>> > > > >> > > BpelServerImpl.java:450)
>> > > > >> > >         at org.apache.ode.scheduler.
>> > > simple.SimpleScheduler$RunJob$
>> > > > >> > > 1.call(SimpleScheduler.java:518)
>> > > > >> > >         at org.apache.ode.scheduler.
>> > > simple.SimpleScheduler$RunJob$
>> > > > >> > > 1.call(SimpleScheduler.java:512)
>> > > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
>> > > > >> > > execTransaction(
>> > > > >> > > SimpleScheduler.java:284)
>> > > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
>> > > > >> > > execTransaction(
>> > > > >> > > SimpleScheduler.java:239)
>> > > > >> > >         at org.apache.ode.scheduler.
>> > > simple.SimpleScheduler$RunJob.
>> > > > >> > > call(SimpleScheduler.java:512)
>> > > > >> > >         at org.apache.ode.scheduler.
>> > > simple.SimpleScheduler$RunJob.
>> > > > >> > > call(SimpleScheduler.java:496)
>> > > > >> > >         at java.util.concurrent.FutureTask.run(FutureTask.
>> > > java:266)
>> > > > >> > >         at java.util.concurrent.ThreadPoo
>> lExecutor.runWorker(
>> > > > >> > > ThreadPoolExecutor.java:1142)
>> > > > >> > >         at java.util.concurrent.ThreadPoo
>> lExecutor$Worker.run(
>> > > > >> > > ThreadPoolExecutor.java:617)
>> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
>> > > > >> > > 424519851 [ODEServer-518] ERROR
>> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
>> while
>> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
>> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
>> > details:
>> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null
>> type:
>> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
>> > correlationKeySet:
>> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > Regards,
>> > > > >> > >
>> > > > >> > > Gangadhar.
>> > > > >> > >
>> > > > >> > >
>> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
>> > > sathwik.bp@gmail.com
>> > > > >
>> > > > >> > > wrote:
>> > > > >> > >
>> > > > >> > > > There are multiple factors for intermittent issues. I can
>> only
>> > > > >> > speculate
>> > > > >> > > > here with limited information.
>> > > > >> > > >
>> > > > >> > > > Check your logs for failures when it happens and share it
>> > here,
>> > > so
>> > > > >> that
>> > > > >> > > we
>> > > > >> > > > can help you better. If possible put in a sample process to
>> > > > >> reproduce
>> > > > >> > > your
>> > > > >> > > > scenario and share here.
>> > > > >> > > >
>> > > > >> > > >
>> > > > >> > > >
>> > > > >> > > >
>> > > > >> > > >
>> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
>> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
>> > > > >> > > >
>> > > > >> > > > > Sometimes the activity gets released, if it is due to
>> > failures
>> > > > in
>> > > > >> the
>> > > > >> > > > > process, it should fail every time right?
>> > > > >> > > > >
>> > > > >> > > > > Regards,
>> > > > >> > > > > Gangadhar.
>> > > > >> > > > >
>> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
>> > > > >> sathwik.bp@gmail.com>
>> > > > >> > > > wrote:
>> > > > >> > > > >
>> > > > >> > > > > > Jobs might be getting rescheduled due to failures in
>> the
>> > > > >> process.
>> > > > >> > > > > > Check the logs for errors.
>> > > > >> > > > > >
>> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
>> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
>> > > > >> > > > > >
>> > > > >> > > > > > > Hi Sathwik,
>> > > > >> > > > > > >
>> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for
>> > some
>> > > > >> tasks
>> > > > >> > it
>> > > > >> > > > will
>> > > > >> > > > > > be
>> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
>> > Sometimes
>> > > it
>> > > > >> > takes
>> > > > >> > > > more
>> > > > >> > > > > > > time to release the tasks, sometimes it will not
>> > release.
>> > > > >> > > > > > >
>> > > > >> > > > > > > Regards,
>> > > > >> > > > > > > Ganga.
>> > > > >> > > > > > >
>> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
>> > > > >> > sathwik.bp@gmail.com>
>> > > > >> > > > > > wrote:
>> > > > >> > > > > > >
>> > > > >> > > > > > > > What kind of jobs are pending?
>> > > > >> > > > > > > > What activities do you have within your <flow>?
>> > > > >> > > > > > > >
>> > > > >> > > > > > > > regards,
>> > > > >> > > > > > > > sathwik
>> > > > >> > > > > > > >
>> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
>> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
>> > > > >> > > > > > > > > wrote:
>> > > > >> > > > > > > >
>> > > > >> > > > > > > > > Hi,
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > > > This is Gangadhar working for Altair, currently
>> we
>> > are
>> > > > >> using
>> > > > >> > > > > > Apache-ode
>> > > > >> > > > > > > > and
>> > > > >> > > > > > > > > facing few issues on flow activity.
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > > > 1. Sometimes all the activities will not be
>> released
>> > > and
>> > > > >> > when i
>> > > > >> > > > > check
>> > > > >> > > > > > > the
>> > > > >> > > > > > > > > ode_job table there are some records not getting
>> > > > updated.
>> > > > >> But
>> > > > >> > > > when
>> > > > >> > > > > i
>> > > > >> > > > > > > > clean
>> > > > >> > > > > > > > > ode_job table and create a new instance it works
>> > fine.
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow , it
>> > takes
>> > > > >> large
>> > > > >> > > > amount
>> > > > >> > > > > > of
>> > > > >> > > > > > > > time
>> > > > >> > > > > > > > > to release all the tasks.
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > > > Can you help me to fix these issues.
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > > > Thanks,
>> > > > >> > > > > > > > > Gangadhar.
>> > > > >> > > > > > > > >
>> > > > >> > > > > > > >
>> > > > >> > > > > > >
>> > > > >> > > > > >
>> > > > >> > > > >
>> > > > >> > > >
>> > > > >> > >
>> > > > >> >
>> > > > >> >
>> > > > >> >
>> > > > >>
>> > > > >
>> > > > >
>> > > >
>> > >
>> >
>>
>
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

What is the setting for the below config parameter in your
ode.axis2.properties file
ode-axis2.tx.factory.class=

Have you configured a Transaction Manager in your tomcat?

On Thu, Jul 13, 2017 at 2:23 PM, Gangadhar ireddy <
gangadhar.ireddy@gmail.com> wrote:

> Hi Sathwik,
>
> Please find the details below:-
>
> ODE version :- 1.3.5
> Server :- Apache tomcat
> Database :- Oracle
> OpenJPA or Hibernate:- Hibernate
>
> Regards,
> Gangadhar.
>
> On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com>
> wrote:
>
> > Can you provide these info please
> > ODE version?
> > Server?
> > Database?
> > OpenJPA or Hibernate?
> >
> > On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com> wrote:
> >
> > > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalService
> -
> > > Response:
> > > <?xml version="1.0" encoding="UTF-8"?>
> > > <message><SubProcess24Task137Output><SubProcess24Task137Output xmlns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task137" xmlns:SOAP-ENV="
> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > humanTaskInvokeResponse
> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > xmlns:htds="
> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> > > SubProcess24Task137Output></message>
> > > 424519845 [ODEServer-513] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519851 [ODEServer-518] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519854 [ODEServer-508] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519853 [ODEServer-502] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519849 [ODEServer-506] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519852 [ODEServer-504] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519865 [ODEServer-506] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519865 [ODEServer-502] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519866 [ODEServer-508] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519863 [ODEServer-511] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519863 [ODEServer-507] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519862 [ODEServer-519] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519868 [ODEServer-511] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519862 [ODEServer-513] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519868 [ODEServer-507] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519868 [ODEServer-519] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519867 [ODEServer-518] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519866 [ODEServer-504] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424519866 [ODEServer-510] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> > > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424519870 [ODEServer-510] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 25s
> > > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService
> -
> > > Response:
> > > <?xml version="1.0" encoding="UTF-8"?>
> > > <message><SubProcess24Task131Output><SubProcess24Task131Output xmlns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task131" xmlns:SOAP-ENV="
> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > > humanTaskInvokeResponse
> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > xmlns:htds="
> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> > > SubProcess24Task131Output></message>
> > > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService
> -
> > > Response:
> > > <?xml version="1.0" encoding="UTF-8"?>
> > > <message><SubProcess24Task132Output><SubProcess24Task132Output xmlns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task132" xmlns:SOAP-ENV="
> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > > humanTaskInvokeResponse
> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > xmlns:htds="
> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> > > SubProcess24Task132Output></message>
> > > 424573852 [ODEServer-513] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573856 [ODEServer-511] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573863 [ODEServer-504] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573865 [ODEServer-513] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573863 [ODEServer-517] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573863 [ODEServer-514] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573868 [ODEServer-508] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573868 [ODEServer-507] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573869 [ODEServer-517] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573869 [ODEServer-504] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573870 [ODEServer-514] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573870 [ODEServer-511] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573868 [ODEServer-519] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > a
> > > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13 EDT
> > > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > > detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > > BpelEngineImpl.java:394)
> > > at
> > > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > > at
> > > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:284)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > > SimpleScheduler.java:239)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > > at
> > > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > > at
> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > > at java.lang.Thread.run(Thread.java:745)
> > > 424573870 [ODEServer-507] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573870 [ODEServer-508] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424573871 [ODEServer-519] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing
> > > job, retrying in 125s
> > > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalService
> -
> > > Response:
> > > <?xml version="1.0" encoding="UTF-8"?>
> > > <message><SubProcess24Task135Output><SubProcess24Task135Output xmlns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task135" xmlns:SOAP-ENV="
> > > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > > humanTaskInvokeResponse
> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > xmlns:htds="
> > > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> > > SubProcess24Task135Output></message>
> > >
> > >
> > > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > > > Attachment has not come through.
> > > >
> > > > put it inline
> > > >
> > > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <
> gangadhar.ireddy@gmail.com>
> > > > wrote:
> > > >
> > > > > Sathwik,
> > > > >
> > > > > Please find the attached log.
> > > > >
> > > > > Regards,
> > > > > Gangadhar.
> > > > >
> > > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <sathwik.bp@gmail.com
> >
> > > > wrote:
> > > > >
> > > > >> Can you send the complete logs.
> > > > >>
> > > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <
> sathwik.bp@gmail.com>
> > > > >> wrote:
> > > > >>
> > > > >> > Usually, the jobs gets executed pretty much quickly.
> > > > >> >
> > > > >> > Factors that might be delaying the execution of jobs is a slow
> > > > database.
> > > > >> >
> > > > >> > How many concurrent messages is the process expecting?
> > > > >> >
> > > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > > gangadhar.ireddy@gmail.com
> > > > >
> > > > >> > wrote:
> > > > >> >
> > > > >> > We are waiting for the jobs and it releases many times, but few
> > > times
> > > > it
> > > > >> > doesn't release, Is there any limit on the rescheduling?
> > > > >> >
> > > > >> > Regards,
> > > > >> > Gangadhar.
> > > > >> >
> > > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> > sathwik.bp@gmail.com>
> > > > >> wrote:
> > > > >> >
> > > > >> > > This is normal. Concurrent messages are competing for the
> > instance
> > > > >> lock.
> > > > >> > > Job that doesn't get the lock on the instance has to wait and
> > will
> > > > be
> > > > >> > > rescheduled.
> > > > >> > > You should never clear the job table.
> > > > >> > >
> > > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > > gangadhar.ireddy@gmail.com
> > > > >> >
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > Sathwik,
> > > > >> > >
> > > > >> > > Please find the below log,
> > > > >> > >
> > > > >> > > <message><SubProcess24Task137Output><
> SubProcess24Task137Output
> > > > >> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> > > > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/
> SubProcess24Task137
> > > "><
> > > > >> > > humanTaskInvokeResponse
> > > > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema
> "
> > > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > > HumanTaskDataSchema
> > > > >> > ">true</
> > > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> > > > >> > > SubProcess24Task137Output></message>
> > > > >> > > 424519845 [ODEServer-513] ERROR
> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> > > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
> > details:
> > > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null
> type:
> > > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> > correlationKeySet:
> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > > >> lEngineImpl.acquireInstanceLoc
> > > > >> > k(
> > > > >> > > BpelEngineImpl.java:394)
> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > BpelEngineImpl.onScheduledJob(
> > > > >> > > BpelEngineImpl.java:403)
> > > > >> > >         at org.apache.ode.bpel.engine.
> > > > BpelServerImpl.onScheduledJob(
> > > > >> > > BpelServerImpl.java:450)
> > > > >> > >         at org.apache.ode.scheduler.
> > > simple.SimpleScheduler$RunJob$
> > > > >> > > 1.call(SimpleScheduler.java:518)
> > > > >> > >         at org.apache.ode.scheduler.
> > > simple.SimpleScheduler$RunJob$
> > > > >> > > 1.call(SimpleScheduler.java:512)
> > > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > >> > > execTransaction(
> > > > >> > > SimpleScheduler.java:284)
> > > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > > >> > > execTransaction(
> > > > >> > > SimpleScheduler.java:239)
> > > > >> > >         at org.apache.ode.scheduler.
> > > simple.SimpleScheduler$RunJob.
> > > > >> > > call(SimpleScheduler.java:512)
> > > > >> > >         at org.apache.ode.scheduler.
> > > simple.SimpleScheduler$RunJob.
> > > > >> > > call(SimpleScheduler.java:496)
> > > > >> > >         at java.util.concurrent.FutureTask.run(FutureTask.
> > > java:266)
> > > > >> > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > > >> > > ThreadPoolExecutor.java:1142)
> > > > >> > >         at java.util.concurrent.
> ThreadPoolExecutor$Worker.run(
> > > > >> > > ThreadPoolExecutor.java:617)
> > > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > > > >> > > 424519851 [ODEServer-518] ERROR
> > > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error
> while
> > > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> > > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
> > details:
> > > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null
> type:
> > > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> > correlationKeySet:
> > > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > > >> > >
> > > > >> > >
> > > > >> > > Regards,
> > > > >> > >
> > > > >> > > Gangadhar.
> > > > >> > >
> > > > >> > >
> > > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > > sathwik.bp@gmail.com
> > > > >
> > > > >> > > wrote:
> > > > >> > >
> > > > >> > > > There are multiple factors for intermittent issues. I can
> only
> > > > >> > speculate
> > > > >> > > > here with limited information.
> > > > >> > > >
> > > > >> > > > Check your logs for failures when it happens and share it
> > here,
> > > so
> > > > >> that
> > > > >> > > we
> > > > >> > > > can help you better. If possible put in a sample process to
> > > > >> reproduce
> > > > >> > > your
> > > > >> > > > scenario and share here.
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > >
> > > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >> > > >
> > > > >> > > > > Sometimes the activity gets released, if it is due to
> > failures
> > > > in
> > > > >> the
> > > > >> > > > > process, it should fail every time right?
> > > > >> > > > >
> > > > >> > > > > Regards,
> > > > >> > > > > Gangadhar.
> > > > >> > > > >
> > > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > > > >> sathwik.bp@gmail.com>
> > > > >> > > > wrote:
> > > > >> > > > >
> > > > >> > > > > > Jobs might be getting rescheduled due to failures in the
> > > > >> process.
> > > > >> > > > > > Check the logs for errors.
> > > > >> > > > > >
> > > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >> > > > > >
> > > > >> > > > > > > Hi Sathwik,
> > > > >> > > > > > >
> > > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for
> > some
> > > > >> tasks
> > > > >> > it
> > > > >> > > > will
> > > > >> > > > > > be
> > > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
> > Sometimes
> > > it
> > > > >> > takes
> > > > >> > > > more
> > > > >> > > > > > > time to release the tasks, sometimes it will not
> > release.
> > > > >> > > > > > >
> > > > >> > > > > > > Regards,
> > > > >> > > > > > > Ganga.
> > > > >> > > > > > >
> > > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> > > > >> > sathwik.bp@gmail.com>
> > > > >> > > > > > wrote:
> > > > >> > > > > > >
> > > > >> > > > > > > > What kind of jobs are pending?
> > > > >> > > > > > > > What activities do you have within your <flow>?
> > > > >> > > > > > > >
> > > > >> > > > > > > > regards,
> > > > >> > > > > > > > sathwik
> > > > >> > > > > > > >
> > > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > > >> > > > > > > > > wrote:
> > > > >> > > > > > > >
> > > > >> > > > > > > > > Hi,
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > This is Gangadhar working for Altair, currently we
> > are
> > > > >> using
> > > > >> > > > > > Apache-ode
> > > > >> > > > > > > > and
> > > > >> > > > > > > > > facing few issues on flow activity.
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > 1. Sometimes all the activities will not be
> released
> > > and
> > > > >> > when i
> > > > >> > > > > check
> > > > >> > > > > > > the
> > > > >> > > > > > > > > ode_job table there are some records not getting
> > > > updated.
> > > > >> But
> > > > >> > > > when
> > > > >> > > > > i
> > > > >> > > > > > > > clean
> > > > >> > > > > > > > > ode_job table and create a new instance it works
> > fine.
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > 2. If i have more than 9 activities in flow , it
> > takes
> > > > >> large
> > > > >> > > > amount
> > > > >> > > > > > of
> > > > >> > > > > > > > time
> > > > >> > > > > > > > > to release all the tasks.
> > > > >> > > > > > > > >
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > Can you help me to fix these issues.
> > > > >> > > > > > > > >
> > > > >> > > > > > > > > Thanks,
> > > > >> > > > > > > > > Gangadhar.
> > > > >> > > > > > > > >
> > > > >> > > > > > > >
> > > > >> > > > > > >
> > > > >> > > > > >
> > > > >> > > > >
> > > > >> > > >
> > > > >> > >
> > > > >> >
> > > > >> >
> > > > >> >
> > > > >>
> > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Hi Sathwik,

Please find the details below:-

ODE version :- 1.3.5
Server :- Apache tomcat
Database :- Oracle
OpenJPA or Hibernate:- Hibernate

Regards,
Gangadhar.

On Thu, Jul 13, 2017 at 12:43 PM, Sathwik B P <sa...@gmail.com> wrote:

> Can you provide these info please
> ODE version?
> Server?
> Database?
> OpenJPA or Hibernate?
>
> On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
> > 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalService  -
> > Response:
> > <?xml version="1.0" encoding="UTF-8"?>
> > <message><SubProcess24Task137Output><SubProcess24Task137Output xmlns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task137" xmlns:SOAP-ENV="
> > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > humanTaskInvokeResponse
> > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > xmlns:htds="
> > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> > SubProcess24Task137Output></message>
> > 424519845 [ODEServer-513] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519851 [ODEServer-518] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519854 [ODEServer-508] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519853 [ODEServer-502] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519849 [ODEServer-506] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519852 [ODEServer-504] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519865 [ODEServer-506] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519865 [ODEServer-502] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519866 [ODEServer-508] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519863 [ODEServer-511] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519863 [ODEServer-507] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519862 [ODEServer-519] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519868 [ODEServer-511] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519862 [ODEServer-513] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519868 [ODEServer-507] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519868 [ODEServer-519] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519867 [ODEServer-518] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519866 [ODEServer-504] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424519866 [ODEServer-510] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> > correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424519870 [ODEServer-510] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 25s
> > 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService  -
> > Response:
> > <?xml version="1.0" encoding="UTF-8"?>
> > <message><SubProcess24Task131Output><SubProcess24Task131Output xmlns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task131" xmlns:SOAP-ENV="
> > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> > humanTaskInvokeResponse
> > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > xmlns:htds="
> > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> > SubProcess24Task131Output></message>
> > 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService  -
> > Response:
> > <?xml version="1.0" encoding="UTF-8"?>
> > <message><SubProcess24Task132Output><SubProcess24Task132Output xmlns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task132" xmlns:SOAP-ENV="
> > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> > humanTaskInvokeResponse
> > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > xmlns:htds="
> > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> > SubProcess24Task132Output></message>
> > 424573852 [ODEServer-513] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573856 [ODEServer-511] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573863 [ODEServer-504] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573865 [ODEServer-513] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573863 [ODEServer-517] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573863 [ODEServer-514] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573868 [ODEServer-508] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573868 [ODEServer-507] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573869 [ODEServer-517] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573869 [ODEServer-504] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573870 [ODEServer-514] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573870 [ODEServer-511] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573868 [ODEServer-519] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > a
> > persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13 EDT
> > transacted: true persisted: true details: JobDetails( instanceId: 48210
> > mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> > correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> > detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> > BpelEngineImpl.java:394)
> > at
> > org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> > at
> > org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:284)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> > SimpleScheduler.java:239)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> > at
> > org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> > at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> > at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> > at java.lang.Thread.run(Thread.java:745)
> > 424573870 [ODEServer-507] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573870 [ODEServer-508] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424573871 [ODEServer-519] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing
> > job, retrying in 125s
> > 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalService  -
> > Response:
> > <?xml version="1.0" encoding="UTF-8"?>
> > <message><SubProcess24Task135Output><SubProcess24Task135Output xmlns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task135" xmlns:SOAP-ENV="
> > http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> > http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> > humanTaskInvokeResponse
> > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > xmlns:htds="
> > http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> > SubProcess24Task135Output></message>
> >
> >
> > On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > Attachment has not come through.
> > >
> > > put it inline
> > >
> > > On Jul 12, 2017 18:43, "Gangadhar ireddy" <ga...@gmail.com>
> > > wrote:
> > >
> > > > Sathwik,
> > > >
> > > > Please find the attached log.
> > > >
> > > > Regards,
> > > > Gangadhar.
> > > >
> > > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > > >
> > > >> Can you send the complete logs.
> > > >>
> > > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <sa...@gmail.com>
> > > >> wrote:
> > > >>
> > > >> > Usually, the jobs gets executed pretty much quickly.
> > > >> >
> > > >> > Factors that might be delaying the execution of jobs is a slow
> > > database.
> > > >> >
> > > >> > How many concurrent messages is the process expecting?
> > > >> >
> > > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> > gangadhar.ireddy@gmail.com
> > > >
> > > >> > wrote:
> > > >> >
> > > >> > We are waiting for the jobs and it releases many times, but few
> > times
> > > it
> > > >> > doesn't release, Is there any limit on the rescheduling?
> > > >> >
> > > >> > Regards,
> > > >> > Gangadhar.
> > > >> >
> > > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <
> sathwik.bp@gmail.com>
> > > >> wrote:
> > > >> >
> > > >> > > This is normal. Concurrent messages are competing for the
> instance
> > > >> lock.
> > > >> > > Job that doesn't get the lock on the instance has to wait and
> will
> > > be
> > > >> > > rescheduled.
> > > >> > > You should never clear the job table.
> > > >> > >
> > > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > > gangadhar.ireddy@gmail.com
> > > >> >
> > > >> > > wrote:
> > > >> > >
> > > >> > > Sathwik,
> > > >> > >
> > > >> > > Please find the below log,
> > > >> > >
> > > >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> > > >> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> > > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137
> > "><
> > > >> > > humanTaskInvokeResponse
> > > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> > HumanTaskDataSchema
> > > >> > ">true</
> > > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> > > >> > > SubProcess24Task137Output></message>
> > > >> > > 424519845 [ODEServer-513] ERROR
> > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> > > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true
> details:
> > > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> > > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null
> correlationKeySet:
> > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > > >> > >         at org.apache.ode.bpel.engine.Bpe
> > > >> lEngineImpl.acquireInstanceLoc
> > > >> > k(
> > > >> > > BpelEngineImpl.java:394)
> > > >> > >         at org.apache.ode.bpel.engine.
> > > BpelEngineImpl.onScheduledJob(
> > > >> > > BpelEngineImpl.java:403)
> > > >> > >         at org.apache.ode.bpel.engine.
> > > BpelServerImpl.onScheduledJob(
> > > >> > > BpelServerImpl.java:450)
> > > >> > >         at org.apache.ode.scheduler.
> > simple.SimpleScheduler$RunJob$
> > > >> > > 1.call(SimpleScheduler.java:518)
> > > >> > >         at org.apache.ode.scheduler.
> > simple.SimpleScheduler$RunJob$
> > > >> > > 1.call(SimpleScheduler.java:512)
> > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > >> > > execTransaction(
> > > >> > > SimpleScheduler.java:284)
> > > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > >> > > execTransaction(
> > > >> > > SimpleScheduler.java:239)
> > > >> > >         at org.apache.ode.scheduler.
> > simple.SimpleScheduler$RunJob.
> > > >> > > call(SimpleScheduler.java:512)
> > > >> > >         at org.apache.ode.scheduler.
> > simple.SimpleScheduler$RunJob.
> > > >> > > call(SimpleScheduler.java:496)
> > > >> > >         at java.util.concurrent.FutureTask.run(FutureTask.
> > java:266)
> > > >> > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > >> > > ThreadPoolExecutor.java:1142)
> > > >> > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > >> > > ThreadPoolExecutor.java:617)
> > > >> > >         at java.lang.Thread.run(Thread.java:745)
> > > >> > > 424519851 [ODEServer-518] ERROR
> > > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> > > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true
> details:
> > > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> > > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null
> correlationKeySet:
> > > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > > >> > >
> > > >> > >
> > > >> > > Regards,
> > > >> > >
> > > >> > > Gangadhar.
> > > >> > >
> > > >> > >
> > > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> > sathwik.bp@gmail.com
> > > >
> > > >> > > wrote:
> > > >> > >
> > > >> > > > There are multiple factors for intermittent issues. I can only
> > > >> > speculate
> > > >> > > > here with limited information.
> > > >> > > >
> > > >> > > > Check your logs for failures when it happens and share it
> here,
> > so
> > > >> that
> > > >> > > we
> > > >> > > > can help you better. If possible put in a sample process to
> > > >> reproduce
> > > >> > > your
> > > >> > > > scenario and share here.
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > >
> > > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >> > > >
> > > >> > > > > Sometimes the activity gets released, if it is due to
> failures
> > > in
> > > >> the
> > > >> > > > > process, it should fail every time right?
> > > >> > > > >
> > > >> > > > > Regards,
> > > >> > > > > Gangadhar.
> > > >> > > > >
> > > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > > >> sathwik.bp@gmail.com>
> > > >> > > > wrote:
> > > >> > > > >
> > > >> > > > > > Jobs might be getting rescheduled due to failures in the
> > > >> process.
> > > >> > > > > > Check the logs for errors.
> > > >> > > > > >
> > > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > >> > > > > >
> > > >> > > > > > > Hi Sathwik,
> > > >> > > > > > >
> > > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for
> some
> > > >> tasks
> > > >> > it
> > > >> > > > will
> > > >> > > > > > be
> > > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE.
> Sometimes
> > it
> > > >> > takes
> > > >> > > > more
> > > >> > > > > > > time to release the tasks, sometimes it will not
> release.
> > > >> > > > > > >
> > > >> > > > > > > Regards,
> > > >> > > > > > > Ganga.
> > > >> > > > > > >
> > > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> > > >> > sathwik.bp@gmail.com>
> > > >> > > > > > wrote:
> > > >> > > > > > >
> > > >> > > > > > > > What kind of jobs are pending?
> > > >> > > > > > > > What activities do you have within your <flow>?
> > > >> > > > > > > >
> > > >> > > > > > > > regards,
> > > >> > > > > > > > sathwik
> > > >> > > > > > > >
> > > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > >> > > > > > > > gangadhar.ireddy@gmail.com
> > > >> > > > > > > > > wrote:
> > > >> > > > > > > >
> > > >> > > > > > > > > Hi,
> > > >> > > > > > > > >
> > > >> > > > > > > > > This is Gangadhar working for Altair, currently we
> are
> > > >> using
> > > >> > > > > > Apache-ode
> > > >> > > > > > > > and
> > > >> > > > > > > > > facing few issues on flow activity.
> > > >> > > > > > > > >
> > > >> > > > > > > > > 1. Sometimes all the activities will not be released
> > and
> > > >> > when i
> > > >> > > > > check
> > > >> > > > > > > the
> > > >> > > > > > > > > ode_job table there are some records not getting
> > > updated.
> > > >> But
> > > >> > > > when
> > > >> > > > > i
> > > >> > > > > > > > clean
> > > >> > > > > > > > > ode_job table and create a new instance it works
> fine.
> > > >> > > > > > > > >
> > > >> > > > > > > > > 2. If i have more than 9 activities in flow , it
> takes
> > > >> large
> > > >> > > > amount
> > > >> > > > > > of
> > > >> > > > > > > > time
> > > >> > > > > > > > > to release all the tasks.
> > > >> > > > > > > > >
> > > >> > > > > > > > >
> > > >> > > > > > > > > Can you help me to fix these issues.
> > > >> > > > > > > > >
> > > >> > > > > > > > > Thanks,
> > > >> > > > > > > > > Gangadhar.
> > > >> > > > > > > > >
> > > >> > > > > > > >
> > > >> > > > > > >
> > > >> > > > > >
> > > >> > > > >
> > > >> > > >
> > > >> > >
> > > >> >
> > > >> >
> > > >> >
> > > >>
> > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Can you provide these info please
ODE version?
Server?
Database?
OpenJPA or Hibernate?

On Thu, Jul 13, 2017 at 5:45 AM, Gangadhar ireddy <
gangadhar.ireddy@gmail.com> wrote:

> 424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalService  -
> Response:
> <?xml version="1.0" encoding="UTF-8"?>
> <message><SubProcess24Task137Output><SubProcess24Task137Output xmlns="
> http://www.altair.com/EPM/Schema/SubProcess24Task137" xmlns:SOAP-ENV="
> http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> humanTaskInvokeResponse
> xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> xmlns:htds="
> http://www.altair.com/WF/Framework/HumanTaskDataSchema
> ">true</humanTaskInvokeResponse></SubProcess24Task137Output></
> SubProcess24Task137Output></message>
> 424519845 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519851 [ODEServer-518] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519854 [ODEServer-508] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519853 [ODEServer-502] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519849 [ODEServer-506] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519852 [ODEServer-504] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519865 [ODEServer-506] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519865 [ODEServer-502] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519866 [ODEServer-508] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519863 [ODEServer-511] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519863 [ODEServer-507] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519862 [ODEServer-519] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519868 [ODEServer-511] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519862 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519868 [ODEServer-507] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519868 [ODEServer-519] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519867 [ODEServer-518] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519866 [ODEServer-504] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424519866 [ODEServer-510] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
> correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424519870 [ODEServer-510] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 25s
> 424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService  -
> Response:
> <?xml version="1.0" encoding="UTF-8"?>
> <message><SubProcess24Task131Output><SubProcess24Task131Output xmlns="
> http://www.altair.com/EPM/Schema/SubProcess24Task131" xmlns:SOAP-ENV="
> http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> http://www.altair.com/EPM/Schema/SubProcess24Task131"><
> humanTaskInvokeResponse
> xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> xmlns:htds="
> http://www.altair.com/WF/Framework/HumanTaskDataSchema
> ">true</humanTaskInvokeResponse></SubProcess24Task131Output></
> SubProcess24Task131Output></message>
> 424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService  -
> Response:
> <?xml version="1.0" encoding="UTF-8"?>
> <message><SubProcess24Task132Output><SubProcess24Task132Output xmlns="
> http://www.altair.com/EPM/Schema/SubProcess24Task132" xmlns:SOAP-ENV="
> http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> http://www.altair.com/EPM/Schema/SubProcess24Task132"><
> humanTaskInvokeResponse
> xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> xmlns:htds="
> http://www.altair.com/WF/Framework/HumanTaskDataSchema
> ">true</humanTaskInvokeResponse></SubProcess24Task132Output></
> SubProcess24Task132Output></message>
> 424573852 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573856 [ODEServer-511] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573863 [ODEServer-504] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573865 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573863 [ODEServer-517] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573863 [ODEServer-514] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573868 [ODEServer-508] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573868 [ODEServer-507] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573869 [ODEServer-517] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573869 [ODEServer-504] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573870 [ODEServer-514] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573870 [ODEServer-511] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573868 [ODEServer-519] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> a
> persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13 EDT
> transacted: true persisted: true details: JobDetails( instanceId: 48210
> mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
> correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
> detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
> at
> org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
> at
> org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:284)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
> SimpleScheduler.java:239)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
> at
> org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 424573870 [ODEServer-507] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573870 [ODEServer-508] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424573871 [ODEServer-519] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
> job, retrying in 125s
> 424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalService  -
> Response:
> <?xml version="1.0" encoding="UTF-8"?>
> <message><SubProcess24Task135Output><SubProcess24Task135Output xmlns="
> http://www.altair.com/EPM/Schema/SubProcess24Task135" xmlns:SOAP-ENV="
> http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
> http://www.altair.com/EPM/Schema/SubProcess24Task135"><
> humanTaskInvokeResponse
> xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> xmlns:htds="
> http://www.altair.com/WF/Framework/HumanTaskDataSchema
> ">true</humanTaskInvokeResponse></SubProcess24Task135Output></
> SubProcess24Task135Output></message>
>
>
> On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > Attachment has not come through.
> >
> > put it inline
> >
> > On Jul 12, 2017 18:43, "Gangadhar ireddy" <ga...@gmail.com>
> > wrote:
> >
> > > Sathwik,
> > >
> > > Please find the attached log.
> > >
> > > Regards,
> > > Gangadhar.
> > >
> > > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > >> Can you send the complete logs.
> > >>
> > >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <sa...@gmail.com>
> > >> wrote:
> > >>
> > >> > Usually, the jobs gets executed pretty much quickly.
> > >> >
> > >> > Factors that might be delaying the execution of jobs is a slow
> > database.
> > >> >
> > >> > How many concurrent messages is the process expecting?
> > >> >
> > >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <
> gangadhar.ireddy@gmail.com
> > >
> > >> > wrote:
> > >> >
> > >> > We are waiting for the jobs and it releases many times, but few
> times
> > it
> > >> > doesn't release, Is there any limit on the rescheduling?
> > >> >
> > >> > Regards,
> > >> > Gangadhar.
> > >> >
> > >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com>
> > >> wrote:
> > >> >
> > >> > > This is normal. Concurrent messages are competing for the instance
> > >> lock.
> > >> > > Job that doesn't get the lock on the instance has to wait and will
> > be
> > >> > > rescheduled.
> > >> > > You should never clear the job table.
> > >> > >
> > >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> > gangadhar.ireddy@gmail.com
> > >> >
> > >> > > wrote:
> > >> > >
> > >> > > Sathwik,
> > >> > >
> > >> > > Please find the below log,
> > >> > >
> > >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> > >> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> > >> > > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137
> "><
> > >> > > humanTaskInvokeResponse
> > >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > >> > > xmlns:htds="http://www.altair.com/WF/Framework/
> HumanTaskDataSchema
> > >> > ">true</
> > >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> > >> > > SubProcess24Task137Output></message>
> > >> > > 424519845 [ODEServer-513] ERROR
> > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> > >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
> > >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> > >> > > INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
> > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >> > >         at org.apache.ode.bpel.engine.Bpe
> > >> lEngineImpl.acquireInstanceLoc
> > >> > k(
> > >> > > BpelEngineImpl.java:394)
> > >> > >         at org.apache.ode.bpel.engine.
> > BpelEngineImpl.onScheduledJob(
> > >> > > BpelEngineImpl.java:403)
> > >> > >         at org.apache.ode.bpel.engine.
> > BpelServerImpl.onScheduledJob(
> > >> > > BpelServerImpl.java:450)
> > >> > >         at org.apache.ode.scheduler.
> simple.SimpleScheduler$RunJob$
> > >> > > 1.call(SimpleScheduler.java:518)
> > >> > >         at org.apache.ode.scheduler.
> simple.SimpleScheduler$RunJob$
> > >> > > 1.call(SimpleScheduler.java:512)
> > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > >> > > execTransaction(
> > >> > > SimpleScheduler.java:284)
> > >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > >> > > execTransaction(
> > >> > > SimpleScheduler.java:239)
> > >> > >         at org.apache.ode.scheduler.
> simple.SimpleScheduler$RunJob.
> > >> > > call(SimpleScheduler.java:512)
> > >> > >         at org.apache.ode.scheduler.
> simple.SimpleScheduler$RunJob.
> > >> > > call(SimpleScheduler.java:496)
> > >> > >         at java.util.concurrent.FutureTask.run(FutureTask.
> java:266)
> > >> > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> > >> > > ThreadPoolExecutor.java:1142)
> > >> > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > >> > > ThreadPoolExecutor.java:617)
> > >> > >         at java.lang.Thread.run(Thread.java:745)
> > >> > > 424519851 [ODEServer-518] ERROR
> > >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> > >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
> > >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> > >> > > INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
> > >> > > null retryCount: 1 inMem: false detailsExt: {})
> > >> > >
> > >> > >
> > >> > > Regards,
> > >> > >
> > >> > > Gangadhar.
> > >> > >
> > >> > >
> > >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <
> sathwik.bp@gmail.com
> > >
> > >> > > wrote:
> > >> > >
> > >> > > > There are multiple factors for intermittent issues. I can only
> > >> > speculate
> > >> > > > here with limited information.
> > >> > > >
> > >> > > > Check your logs for failures when it happens and share it here,
> so
> > >> that
> > >> > > we
> > >> > > > can help you better. If possible put in a sample process to
> > >> reproduce
> > >> > > your
> > >> > > > scenario and share here.
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > >
> > >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > >> > > > gangadhar.ireddy@gmail.com> wrote:
> > >> > > >
> > >> > > > > Sometimes the activity gets released, if it is due to failures
> > in
> > >> the
> > >> > > > > process, it should fail every time right?
> > >> > > > >
> > >> > > > > Regards,
> > >> > > > > Gangadhar.
> > >> > > > >
> > >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> > >> sathwik.bp@gmail.com>
> > >> > > > wrote:
> > >> > > > >
> > >> > > > > > Jobs might be getting rescheduled due to failures in the
> > >> process.
> > >> > > > > > Check the logs for errors.
> > >> > > > > >
> > >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > >> > > > > >
> > >> > > > > > > Hi Sathwik,
> > >> > > > > > >
> > >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some
> > >> tasks
> > >> > it
> > >> > > > will
> > >> > > > > > be
> > >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes
> it
> > >> > takes
> > >> > > > more
> > >> > > > > > > time to release the tasks, sometimes it will not release.
> > >> > > > > > >
> > >> > > > > > > Regards,
> > >> > > > > > > Ganga.
> > >> > > > > > >
> > >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> > >> > sathwik.bp@gmail.com>
> > >> > > > > > wrote:
> > >> > > > > > >
> > >> > > > > > > > What kind of jobs are pending?
> > >> > > > > > > > What activities do you have within your <flow>?
> > >> > > > > > > >
> > >> > > > > > > > regards,
> > >> > > > > > > > sathwik
> > >> > > > > > > >
> > >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > >> > > > > > > > gangadhar.ireddy@gmail.com
> > >> > > > > > > > > wrote:
> > >> > > > > > > >
> > >> > > > > > > > > Hi,
> > >> > > > > > > > >
> > >> > > > > > > > > This is Gangadhar working for Altair, currently we are
> > >> using
> > >> > > > > > Apache-ode
> > >> > > > > > > > and
> > >> > > > > > > > > facing few issues on flow activity.
> > >> > > > > > > > >
> > >> > > > > > > > > 1. Sometimes all the activities will not be released
> and
> > >> > when i
> > >> > > > > check
> > >> > > > > > > the
> > >> > > > > > > > > ode_job table there are some records not getting
> > updated.
> > >> But
> > >> > > > when
> > >> > > > > i
> > >> > > > > > > > clean
> > >> > > > > > > > > ode_job table and create a new instance it works fine.
> > >> > > > > > > > >
> > >> > > > > > > > > 2. If i have more than 9 activities in flow , it takes
> > >> large
> > >> > > > amount
> > >> > > > > > of
> > >> > > > > > > > time
> > >> > > > > > > > > to release all the tasks.
> > >> > > > > > > > >
> > >> > > > > > > > >
> > >> > > > > > > > > Can you help me to fix these issues.
> > >> > > > > > > > >
> > >> > > > > > > > > Thanks,
> > >> > > > > > > > > Gangadhar.
> > >> > > > > > > > >
> > >> > > > > > > >
> > >> > > > > > >
> > >> > > > > >
> > >> > > > >
> > >> > > >
> > >> > >
> > >> >
> > >> >
> > >> >
> > >>
> > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

424519400 [ODEServer-505] INFO  org.apache.ode.axis2.ExternalService  -
Response:
<?xml version="1.0" encoding="UTF-8"?>
<message><SubProcess24Task137Output><SubProcess24Task137Output xmlns="
http://www.altair.com/EPM/Schema/SubProcess24Task137" xmlns:SOAP-ENV="
http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
http://www.altair.com/EPM/Schema/SubProcess24Task137"><humanTaskInvokeResponse
xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema" xmlns:htds="
http://www.altair.com/WF/Framework/HumanTaskDataSchema
">true</humanTaskInvokeResponse></SubProcess24Task137Output></SubProcess24Task137Output></message>
424519845 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:01:07 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519851 [ODEServer-518] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519854 [ODEServer-508] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xheq time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50964 processId: null type: INVOKE_RESPONSE channel: 378
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519853 [ODEServer-502] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519849 [ODEServer-506] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519852 [ODEServer-504] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519865 [ODEServer-506] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519865 [ODEServer-502] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519866 [ODEServer-508] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519863 [ODEServer-511] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519863 [ODEServer-507] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519862 [ODEServer-519] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519868 [ODEServer-511] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519862 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519868 [ODEServer-507] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519868 [ODEServer-519] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519867 [ODEServer-518] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519866 [ODEServer-504] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424519866 [ODEServer-510] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xher time: 2017-07-11 14:01:05 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50957 processId: null type: INVOKE_RESPONSE channel: 295
correlatorId: null correlationKeySet: null retryCount: 1 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424519870 [ODEServer-510] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 25s
424522517 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService  -
Response:
<?xml version="1.0" encoding="UTF-8"?>
<message><SubProcess24Task131Output><SubProcess24Task131Output xmlns="
http://www.altair.com/EPM/Schema/SubProcess24Task131" xmlns:SOAP-ENV="
http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
http://www.altair.com/EPM/Schema/SubProcess24Task131"><humanTaskInvokeResponse
xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema" xmlns:htds="
http://www.altair.com/WF/Framework/HumanTaskDataSchema
">true</humanTaskInvokeResponse></SubProcess24Task131Output></SubProcess24Task131Output></message>
424573639 [ODEServer-510] INFO  org.apache.ode.axis2.ExternalService  -
Response:
<?xml version="1.0" encoding="UTF-8"?>
<message><SubProcess24Task132Output><SubProcess24Task132Output xmlns="
http://www.altair.com/EPM/Schema/SubProcess24Task132" xmlns:SOAP-ENV="
http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
http://www.altair.com/EPM/Schema/SubProcess24Task132"><humanTaskInvokeResponse
xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema" xmlns:htds="
http://www.altair.com/WF/Framework/HumanTaskDataSchema
">true</humanTaskInvokeResponse></SubProcess24Task132Output></SubProcess24Task132Output></message>
424573852 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhev time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50965 processId: null type: INVOKE_RESPONSE channel: 383
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573856 [ODEServer-511] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhel time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50963 processId: null type: INVOKE_RESPONSE channel: 365
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573863 [ODEServer-504] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhes time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50956 processId: null type: INVOKE_RESPONSE channel: 282
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573865 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573863 [ODEServer-517] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhf3 time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50968 processId: null type: INVOKE_RESPONSE channel: 423
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573863 [ODEServer-514] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhem time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50955 processId: null type: INVOKE_RESPONSE channel: 269
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573868 [ODEServer-508] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhep time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50953 processId: null type: INVOKE_RESPONSE channel: 226
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573868 [ODEServer-507] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xheu time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50966 processId: null type: INVOKE_RESPONSE channel: 401
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573869 [ODEServer-517] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573869 [ODEServer-504] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573870 [ODEServer-514] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573870 [ODEServer-511] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573868 [ODEServer-519] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing a
persisted job: Job hqejbhcnphrcfcpvi9xhen time: 2017-07-11 14:02:13 EDT
transacted: true persisted: true details: JobDetails( instanceId: 48210
mexId: 50959 processId: null type: INVOKE_RESPONSE channel: 316
correlatorId: null correlationKeySet: null retryCount: 2 inMem: false
detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
at
org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
at
org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
at
org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
at
org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
at
org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
424573870 [ODEServer-507] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573870 [ODEServer-508] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424573871 [ODEServer-519] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while processing
job, retrying in 125s
424575807 [ODEServer-511] INFO  org.apache.ode.axis2.ExternalService  -
Response:
<?xml version="1.0" encoding="UTF-8"?>
<message><SubProcess24Task135Output><SubProcess24Task135Output xmlns="
http://www.altair.com/EPM/Schema/SubProcess24Task135" xmlns:SOAP-ENV="
http://schemas.xmlsoap.org/soap/envelope/" xmlns:tns="
http://www.altair.com/EPM/Schema/SubProcess24Task135"><humanTaskInvokeResponse
xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema" xmlns:htds="
http://www.altair.com/WF/Framework/HumanTaskDataSchema
">true</humanTaskInvokeResponse></SubProcess24Task135Output></SubProcess24Task135Output></message>


On Wed, Jul 12, 2017 at 7:12 PM, Sathwik B P <sa...@gmail.com> wrote:

> Attachment has not come through.
>
> put it inline
>
> On Jul 12, 2017 18:43, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> > Sathwik,
> >
> > Please find the attached log.
> >
> > Regards,
> > Gangadhar.
> >
> > On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> >> Can you send the complete logs.
> >>
> >> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <sa...@gmail.com>
> >> wrote:
> >>
> >> > Usually, the jobs gets executed pretty much quickly.
> >> >
> >> > Factors that might be delaying the execution of jobs is a slow
> database.
> >> >
> >> > How many concurrent messages is the process expecting?
> >> >
> >> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <gangadhar.ireddy@gmail.com
> >
> >> > wrote:
> >> >
> >> > We are waiting for the jobs and it releases many times, but few times
> it
> >> > doesn't release, Is there any limit on the rescheduling?
> >> >
> >> > Regards,
> >> > Gangadhar.
> >> >
> >> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com>
> >> wrote:
> >> >
> >> > > This is normal. Concurrent messages are competing for the instance
> >> lock.
> >> > > Job that doesn't get the lock on the instance has to wait and will
> be
> >> > > rescheduled.
> >> > > You should never clear the job table.
> >> > >
> >> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <
> gangadhar.ireddy@gmail.com
> >> >
> >> > > wrote:
> >> > >
> >> > > Sathwik,
> >> > >
> >> > > Please find the below log,
> >> > >
> >> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> >> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> >> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> >> > > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> >> > > humanTaskInvokeResponse
> >> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> >> > > xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema
> >> > ">true</
> >> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> >> > > SubProcess24Task137Output></message>
> >> > > 424519845 [ODEServer-513] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> >> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
> >> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> >> > > INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
> >> > > null retryCount: 1 inMem: false detailsExt: {})
> >> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >> > >         at org.apache.ode.bpel.engine.Bpe
> >> lEngineImpl.acquireInstanceLoc
> >> > k(
> >> > > BpelEngineImpl.java:394)
> >> > >         at org.apache.ode.bpel.engine.
> BpelEngineImpl.onScheduledJob(
> >> > > BpelEngineImpl.java:403)
> >> > >         at org.apache.ode.bpel.engine.
> BpelServerImpl.onScheduledJob(
> >> > > BpelServerImpl.java:450)
> >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:518)
> >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> >> > > 1.call(SimpleScheduler.java:512)
> >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> >> > > execTransaction(
> >> > > SimpleScheduler.java:284)
> >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> >> > > execTransaction(
> >> > > SimpleScheduler.java:239)
> >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:512)
> >> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> >> > > call(SimpleScheduler.java:496)
> >> > >         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >> > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> >> > > ThreadPoolExecutor.java:1142)
> >> > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> >> > > ThreadPoolExecutor.java:617)
> >> > >         at java.lang.Thread.run(Thread.java:745)
> >> > > 424519851 [ODEServer-518] ERROR
> >> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> >> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> >> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
> >> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> >> > > INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
> >> > > null retryCount: 1 inMem: false detailsExt: {})
> >> > >
> >> > >
> >> > > Regards,
> >> > >
> >> > > Gangadhar.
> >> > >
> >> > >
> >> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sathwik.bp@gmail.com
> >
> >> > > wrote:
> >> > >
> >> > > > There are multiple factors for intermittent issues. I can only
> >> > speculate
> >> > > > here with limited information.
> >> > > >
> >> > > > Check your logs for failures when it happens and share it here, so
> >> that
> >> > > we
> >> > > > can help you better. If possible put in a sample process to
> >> reproduce
> >> > > your
> >> > > > scenario and share here.
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > >
> >> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> >> > > > gangadhar.ireddy@gmail.com> wrote:
> >> > > >
> >> > > > > Sometimes the activity gets released, if it is due to failures
> in
> >> the
> >> > > > > process, it should fail every time right?
> >> > > > >
> >> > > > > Regards,
> >> > > > > Gangadhar.
> >> > > > >
> >> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
> >> sathwik.bp@gmail.com>
> >> > > > wrote:
> >> > > > >
> >> > > > > > Jobs might be getting rescheduled due to failures in the
> >> process.
> >> > > > > > Check the logs for errors.
> >> > > > > >
> >> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> >> > > > > > gangadhar.ireddy@gmail.com> wrote:
> >> > > > > >
> >> > > > > > > Hi Sathwik,
> >> > > > > > >
> >> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some
> >> tasks
> >> > it
> >> > > > will
> >> > > > > > be
> >> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it
> >> > takes
> >> > > > more
> >> > > > > > > time to release the tasks, sometimes it will not release.
> >> > > > > > >
> >> > > > > > > Regards,
> >> > > > > > > Ganga.
> >> > > > > > >
> >> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> >> > sathwik.bp@gmail.com>
> >> > > > > > wrote:
> >> > > > > > >
> >> > > > > > > > What kind of jobs are pending?
> >> > > > > > > > What activities do you have within your <flow>?
> >> > > > > > > >
> >> > > > > > > > regards,
> >> > > > > > > > sathwik
> >> > > > > > > >
> >> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> >> > > > > > > > gangadhar.ireddy@gmail.com
> >> > > > > > > > > wrote:
> >> > > > > > > >
> >> > > > > > > > > Hi,
> >> > > > > > > > >
> >> > > > > > > > > This is Gangadhar working for Altair, currently we are
> >> using
> >> > > > > > Apache-ode
> >> > > > > > > > and
> >> > > > > > > > > facing few issues on flow activity.
> >> > > > > > > > >
> >> > > > > > > > > 1. Sometimes all the activities will not be released and
> >> > when i
> >> > > > > check
> >> > > > > > > the
> >> > > > > > > > > ode_job table there are some records not getting
> updated.
> >> But
> >> > > > when
> >> > > > > i
> >> > > > > > > > clean
> >> > > > > > > > > ode_job table and create a new instance it works fine.
> >> > > > > > > > >
> >> > > > > > > > > 2. If i have more than 9 activities in flow , it takes
> >> large
> >> > > > amount
> >> > > > > > of
> >> > > > > > > > time
> >> > > > > > > > > to release all the tasks.
> >> > > > > > > > >
> >> > > > > > > > >
> >> > > > > > > > > Can you help me to fix these issues.
> >> > > > > > > > >
> >> > > > > > > > > Thanks,
> >> > > > > > > > > Gangadhar.
> >> > > > > > > > >
> >> > > > > > > >
> >> > > > > > >
> >> > > > > >
> >> > > > >
> >> > > >
> >> > >
> >> >
> >> >
> >> >
> >>
> >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Attachment has not come through.

put it inline

On Jul 12, 2017 18:43, "Gangadhar ireddy" <ga...@gmail.com>
wrote:

> Sathwik,
>
> Please find the attached log.
>
> Regards,
> Gangadhar.
>
> On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <sa...@gmail.com> wrote:
>
>> Can you send the complete logs.
>>
>> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <sa...@gmail.com>
>> wrote:
>>
>> > Usually, the jobs gets executed pretty much quickly.
>> >
>> > Factors that might be delaying the execution of jobs is a slow database.
>> >
>> > How many concurrent messages is the process expecting?
>> >
>> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <ga...@gmail.com>
>> > wrote:
>> >
>> > We are waiting for the jobs and it releases many times, but few times it
>> > doesn't release, Is there any limit on the rescheduling?
>> >
>> > Regards,
>> > Gangadhar.
>> >
>> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com>
>> wrote:
>> >
>> > > This is normal. Concurrent messages are competing for the instance
>> lock.
>> > > Job that doesn't get the lock on the instance has to wait and will be
>> > > rescheduled.
>> > > You should never clear the job table.
>> > >
>> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <gangadhar.ireddy@gmail.com
>> >
>> > > wrote:
>> > >
>> > > Sathwik,
>> > >
>> > > Please find the below log,
>> > >
>> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
>> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
>> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
>> > > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
>> > > humanTaskInvokeResponse
>> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
>> > > xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema
>> > ">true</
>> > > humanTaskInvokeResponse></SubProcess24Task137Output></
>> > > SubProcess24Task137Output></message>
>> > > 424519845 [ODEServer-513] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
>> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
>> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
>> > > INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
>> > > null retryCount: 1 inMem: false detailsExt: {})
>> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>> > >         at org.apache.ode.bpel.engine.Bpe
>> lEngineImpl.acquireInstanceLoc
>> > k(
>> > > BpelEngineImpl.java:394)
>> > >         at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
>> > > BpelEngineImpl.java:403)
>> > >         at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
>> > > BpelServerImpl.java:450)
>> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:518)
>> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
>> > > 1.call(SimpleScheduler.java:512)
>> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
>> > > execTransaction(
>> > > SimpleScheduler.java:284)
>> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
>> > > execTransaction(
>> > > SimpleScheduler.java:239)
>> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:512)
>> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
>> > > call(SimpleScheduler.java:496)
>> > >         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>> > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
>> > > ThreadPoolExecutor.java:1142)
>> > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
>> > > ThreadPoolExecutor.java:617)
>> > >         at java.lang.Thread.run(Thread.java:745)
>> > > 424519851 [ODEServer-518] ERROR
>> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
>> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
>> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
>> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
>> > > INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
>> > > null retryCount: 1 inMem: false detailsExt: {})
>> > >
>> > >
>> > > Regards,
>> > >
>> > > Gangadhar.
>> > >
>> > >
>> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com>
>> > > wrote:
>> > >
>> > > > There are multiple factors for intermittent issues. I can only
>> > speculate
>> > > > here with limited information.
>> > > >
>> > > > Check your logs for failures when it happens and share it here, so
>> that
>> > > we
>> > > > can help you better. If possible put in a sample process to
>> reproduce
>> > > your
>> > > > scenario and share here.
>> > > >
>> > > >
>> > > >
>> > > >
>> > > >
>> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
>> > > > gangadhar.ireddy@gmail.com> wrote:
>> > > >
>> > > > > Sometimes the activity gets released, if it is due to failures in
>> the
>> > > > > process, it should fail every time right?
>> > > > >
>> > > > > Regards,
>> > > > > Gangadhar.
>> > > > >
>> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <
>> sathwik.bp@gmail.com>
>> > > > wrote:
>> > > > >
>> > > > > > Jobs might be getting rescheduled due to failures in the
>> process.
>> > > > > > Check the logs for errors.
>> > > > > >
>> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
>> > > > > > gangadhar.ireddy@gmail.com> wrote:
>> > > > > >
>> > > > > > > Hi Sathwik,
>> > > > > > >
>> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some
>> tasks
>> > it
>> > > > will
>> > > > > > be
>> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it
>> > takes
>> > > > more
>> > > > > > > time to release the tasks, sometimes it will not release.
>> > > > > > >
>> > > > > > > Regards,
>> > > > > > > Ganga.
>> > > > > > >
>> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
>> > sathwik.bp@gmail.com>
>> > > > > > wrote:
>> > > > > > >
>> > > > > > > > What kind of jobs are pending?
>> > > > > > > > What activities do you have within your <flow>?
>> > > > > > > >
>> > > > > > > > regards,
>> > > > > > > > sathwik
>> > > > > > > >
>> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
>> > > > > > > > gangadhar.ireddy@gmail.com
>> > > > > > > > > wrote:
>> > > > > > > >
>> > > > > > > > > Hi,
>> > > > > > > > >
>> > > > > > > > > This is Gangadhar working for Altair, currently we are
>> using
>> > > > > > Apache-ode
>> > > > > > > > and
>> > > > > > > > > facing few issues on flow activity.
>> > > > > > > > >
>> > > > > > > > > 1. Sometimes all the activities will not be released and
>> > when i
>> > > > > check
>> > > > > > > the
>> > > > > > > > > ode_job table there are some records not getting updated.
>> But
>> > > > when
>> > > > > i
>> > > > > > > > clean
>> > > > > > > > > ode_job table and create a new instance it works fine.
>> > > > > > > > >
>> > > > > > > > > 2. If i have more than 9 activities in flow , it takes
>> large
>> > > > amount
>> > > > > > of
>> > > > > > > > time
>> > > > > > > > > to release all the tasks.
>> > > > > > > > >
>> > > > > > > > >
>> > > > > > > > > Can you help me to fix these issues.
>> > > > > > > > >
>> > > > > > > > > Thanks,
>> > > > > > > > > Gangadhar.
>> > > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>> >
>> >
>>
>
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sathwik,

Please find the attached log.

Regards,
Gangadhar.

On Wed, Jul 12, 2017 at 3:40 PM, Sathwik B P <sa...@gmail.com> wrote:

> Can you send the complete logs.
>
> On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > Usually, the jobs gets executed pretty much quickly.
> >
> > Factors that might be delaying the execution of jobs is a slow database.
> >
> > How many concurrent messages is the process expecting?
> >
> > On Jul 12, 2017 13:38, "Gangadhar ireddy" <ga...@gmail.com>
> > wrote:
> >
> > We are waiting for the jobs and it releases many times, but few times it
> > doesn't release, Is there any limit on the rescheduling?
> >
> > Regards,
> > Gangadhar.
> >
> > On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > This is normal. Concurrent messages are competing for the instance
> lock.
> > > Job that doesn't get the lock on the instance has to wait and will be
> > > rescheduled.
> > > You should never clear the job table.
> > >
> > > On Jul 12, 2017 12:08, "Gangadhar ireddy" <ga...@gmail.com>
> > > wrote:
> > >
> > > Sathwik,
> > >
> > > Please find the below log,
> > >
> > > <message><SubProcess24Task137Output><SubProcess24Task137Output
> > > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> > > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > > humanTaskInvokeResponse
> > > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > > xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema
> > ">true</
> > > humanTaskInvokeResponse></SubProcess24Task137Output></
> > > SubProcess24Task137Output></message>
> > > 424519845 [ODEServer-513] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> > > 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
> > > JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> > > INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
> > > null retryCount: 1 inMem: false detailsExt: {})
> > > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> > >         at org.apache.ode.bpel.engine.BpelEngineImpl.
> acquireInstanceLoc
> > k(
> > > BpelEngineImpl.java:394)
> > >         at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > > BpelEngineImpl.java:403)
> > >         at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > > BpelServerImpl.java:450)
> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:518)
> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > > 1.call(SimpleScheduler.java:512)
> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > SimpleScheduler.java:284)
> > >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > > execTransaction(
> > > SimpleScheduler.java:239)
> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:512)
> > >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > > call(SimpleScheduler.java:496)
> > >         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> > >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> > > ThreadPoolExecutor.java:1142)
> > >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > > ThreadPoolExecutor.java:617)
> > >         at java.lang.Thread.run(Thread.java:745)
> > > 424519851 [ODEServer-518] ERROR
> > > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> > > 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
> > > JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> > > INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
> > > null retryCount: 1 inMem: false detailsExt: {})
> > >
> > >
> > > Regards,
> > >
> > > Gangadhar.
> > >
> > >
> > > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > >
> > > > There are multiple factors for intermittent issues. I can only
> > speculate
> > > > here with limited information.
> > > >
> > > > Check your logs for failures when it happens and share it here, so
> that
> > > we
> > > > can help you better. If possible put in a sample process to reproduce
> > > your
> > > > scenario and share here.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >
> > > > > Sometimes the activity gets released, if it is due to failures in
> the
> > > > > process, it should fail every time right?
> > > > >
> > > > > Regards,
> > > > > Gangadhar.
> > > > >
> > > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sathwik.bp@gmail.com
> >
> > > > wrote:
> > > > >
> > > > > > Jobs might be getting rescheduled due to failures in the process.
> > > > > > Check the logs for errors.
> > > > > >
> > > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > > >
> > > > > > > Hi Sathwik,
> > > > > > >
> > > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks
> > it
> > > > will
> > > > > > be
> > > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it
> > takes
> > > > more
> > > > > > > time to release the tasks, sometimes it will not release.
> > > > > > >
> > > > > > > Regards,
> > > > > > > Ganga.
> > > > > > >
> > > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> > sathwik.bp@gmail.com>
> > > > > > wrote:
> > > > > > >
> > > > > > > > What kind of jobs are pending?
> > > > > > > > What activities do you have within your <flow>?
> > > > > > > >
> > > > > > > > regards,
> > > > > > > > sathwik
> > > > > > > >
> > > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > > > > gangadhar.ireddy@gmail.com
> > > > > > > > > wrote:
> > > > > > > >
> > > > > > > > > Hi,
> > > > > > > > >
> > > > > > > > > This is Gangadhar working for Altair, currently we are
> using
> > > > > > Apache-ode
> > > > > > > > and
> > > > > > > > > facing few issues on flow activity.
> > > > > > > > >
> > > > > > > > > 1. Sometimes all the activities will not be released and
> > when i
> > > > > check
> > > > > > > the
> > > > > > > > > ode_job table there are some records not getting updated.
> But
> > > > when
> > > > > i
> > > > > > > > clean
> > > > > > > > > ode_job table and create a new instance it works fine.
> > > > > > > > >
> > > > > > > > > 2. If i have more than 9 activities in flow , it takes
> large
> > > > amount
> > > > > > of
> > > > > > > > time
> > > > > > > > > to release all the tasks.
> > > > > > > > >
> > > > > > > > >
> > > > > > > > > Can you help me to fix these issues.
> > > > > > > > >
> > > > > > > > > Thanks,
> > > > > > > > > Gangadhar.
> > > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Can you send the complete logs.

On Wed, Jul 12, 2017 at 2:32 PM, Sathwik B P <sa...@gmail.com> wrote:

> Usually, the jobs gets executed pretty much quickly.
>
> Factors that might be delaying the execution of jobs is a slow database.
>
> How many concurrent messages is the process expecting?
>
> On Jul 12, 2017 13:38, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> We are waiting for the jobs and it releases many times, but few times it
> doesn't release, Is there any limit on the rescheduling?
>
> Regards,
> Gangadhar.
>
> On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > This is normal. Concurrent messages are competing for the instance lock.
> > Job that doesn't get the lock on the instance has to wait and will be
> > rescheduled.
> > You should never clear the job table.
> >
> > On Jul 12, 2017 12:08, "Gangadhar ireddy" <ga...@gmail.com>
> > wrote:
> >
> > Sathwik,
> >
> > Please find the below log,
> >
> > <message><SubProcess24Task137Output><SubProcess24Task137Output
> > xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> > xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> > xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> > humanTaskInvokeResponse
> > xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> > xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema
> ">true</
> > humanTaskInvokeResponse></SubProcess24Task137Output></
> > SubProcess24Task137Output></message>
> > 424519845 [ODEServer-513] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> > 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
> > JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> > INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
> > null retryCount: 1 inMem: false detailsExt: {})
> > org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
> >         at org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLoc
> k(
> > BpelEngineImpl.java:394)
> >         at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> > BpelEngineImpl.java:403)
> >         at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> > BpelServerImpl.java:450)
> >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:518)
> >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> > 1.call(SimpleScheduler.java:512)
> >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > SimpleScheduler.java:284)
> >         at org.apache.ode.scheduler.simple.SimpleScheduler.
> > execTransaction(
> > SimpleScheduler.java:239)
> >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:512)
> >         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> > call(SimpleScheduler.java:496)
> >         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> >         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> > ThreadPoolExecutor.java:1142)
> >         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> > ThreadPoolExecutor.java:617)
> >         at java.lang.Thread.run(Thread.java:745)
> > 424519851 [ODEServer-518] ERROR
> > org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> > processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> > 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
> > JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> > INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
> > null retryCount: 1 inMem: false detailsExt: {})
> >
> >
> > Regards,
> >
> > Gangadhar.
> >
> >
> > On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> >
> > > There are multiple factors for intermittent issues. I can only
> speculate
> > > here with limited information.
> > >
> > > Check your logs for failures when it happens and share it here, so that
> > we
> > > can help you better. If possible put in a sample process to reproduce
> > your
> > > scenario and share here.
> > >
> > >
> > >
> > >
> > >
> > > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com> wrote:
> > >
> > > > Sometimes the activity gets released, if it is due to failures in the
> > > > process, it should fail every time right?
> > > >
> > > > Regards,
> > > > Gangadhar.
> > > >
> > > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > > >
> > > > > Jobs might be getting rescheduled due to failures in the process.
> > > > > Check the logs for errors.
> > > > >
> > > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > > > gangadhar.ireddy@gmail.com> wrote:
> > > > >
> > > > > > Hi Sathwik,
> > > > > >
> > > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks
> it
> > > will
> > > > > be
> > > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it
> takes
> > > more
> > > > > > time to release the tasks, sometimes it will not release.
> > > > > >
> > > > > > Regards,
> > > > > > Ganga.
> > > > > >
> > > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <
> sathwik.bp@gmail.com>
> > > > > wrote:
> > > > > >
> > > > > > > What kind of jobs are pending?
> > > > > > > What activities do you have within your <flow>?
> > > > > > >
> > > > > > > regards,
> > > > > > > sathwik
> > > > > > >
> > > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > > > gangadhar.ireddy@gmail.com
> > > > > > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > This is Gangadhar working for Altair, currently we are using
> > > > > Apache-ode
> > > > > > > and
> > > > > > > > facing few issues on flow activity.
> > > > > > > >
> > > > > > > > 1. Sometimes all the activities will not be released and
> when i
> > > > check
> > > > > > the
> > > > > > > > ode_job table there are some records not getting updated. But
> > > when
> > > > i
> > > > > > > clean
> > > > > > > > ode_job table and create a new instance it works fine.
> > > > > > > >
> > > > > > > > 2. If i have more than 9 activities in flow , it takes large
> > > amount
> > > > > of
> > > > > > > time
> > > > > > > > to release all the tasks.
> > > > > > > >
> > > > > > > >
> > > > > > > > Can you help me to fix these issues.
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > > Gangadhar.
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>
>
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Usually, the jobs gets executed pretty much quickly.

Factors that might be delaying the execution of jobs is a slow database.

How many concurrent messages is the process expecting?

On Jul 12, 2017 13:38, "Gangadhar ireddy" <ga...@gmail.com>
wrote:

We are waiting for the jobs and it releases many times, but few times it
doesn't release, Is there any limit on the rescheduling?

Regards,
Gangadhar.

On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com> wrote:

> This is normal. Concurrent messages are competing for the instance lock.
> Job that doesn't get the lock on the instance has to wait and will be
> rescheduled.
> You should never clear the job table.
>
> On Jul 12, 2017 12:08, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> Sathwik,
>
> Please find the below log,
>
> <message><SubProcess24Task137Output><SubProcess24Task137Output
> xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> humanTaskInvokeResponse
> xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema">true</
> humanTaskInvokeResponse></SubProcess24Task137Output></
> SubProcess24Task137Output></message>
> 424519845 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
> JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
> null retryCount: 1 inMem: false detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>         at org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
>         at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
>         at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
>         at org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> SimpleScheduler.java:284)
>         at org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> SimpleScheduler.java:239)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> 424519851 [ODEServer-518] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
> JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
> null retryCount: 1 inMem: false detailsExt: {})
>
>
> Regards,
>
> Gangadhar.
>
>
> On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com>
> wrote:
>
> > There are multiple factors for intermittent issues. I can only speculate
> > here with limited information.
> >
> > Check your logs for failures when it happens and share it here, so that
> we
> > can help you better. If possible put in a sample process to reproduce
> your
> > scenario and share here.
> >
> >
> >
> >
> >
> > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com> wrote:
> >
> > > Sometimes the activity gets released, if it is due to failures in the
> > > process, it should fail every time right?
> > >
> > > Regards,
> > > Gangadhar.
> > >
> > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > > > Jobs might be getting rescheduled due to failures in the process.
> > > > Check the logs for errors.
> > > >
> > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >
> > > > > Hi Sathwik,
> > > > >
> > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it
> > will
> > > > be
> > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes
> > more
> > > > > time to release the tasks, sometimes it will not release.
> > > > >
> > > > > Regards,
> > > > > Ganga.
> > > > >
> > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com>
> > > > wrote:
> > > > >
> > > > > > What kind of jobs are pending?
> > > > > > What activities do you have within your <flow>?
> > > > > >
> > > > > > regards,
> > > > > > sathwik
> > > > > >
> > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > > gangadhar.ireddy@gmail.com
> > > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > This is Gangadhar working for Altair, currently we are using
> > > > Apache-ode
> > > > > > and
> > > > > > > facing few issues on flow activity.
> > > > > > >
> > > > > > > 1. Sometimes all the activities will not be released and when
i
> > > check
> > > > > the
> > > > > > > ode_job table there are some records not getting updated. But
> > when
> > > i
> > > > > > clean
> > > > > > > ode_job table and create a new instance it works fine.
> > > > > > >
> > > > > > > 2. If i have more than 9 activities in flow , it takes large
> > amount
> > > > of
> > > > > > time
> > > > > > > to release all the tasks.
> > > > > > >
> > > > > > >
> > > > > > > Can you help me to fix these issues.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Gangadhar.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

We are waiting for the jobs and it releases many times, but few times it
doesn't release, Is there any limit on the rescheduling?

Regards,
Gangadhar.

On Wed, Jul 12, 2017 at 1:14 PM, Sathwik B P <sa...@gmail.com> wrote:

> This is normal. Concurrent messages are competing for the instance lock.
> Job that doesn't get the lock on the instance has to wait and will be
> rescheduled.
> You should never clear the job table.
>
> On Jul 12, 2017 12:08, "Gangadhar ireddy" <ga...@gmail.com>
> wrote:
>
> Sathwik,
>
> Please find the below log,
>
> <message><SubProcess24Task137Output><SubProcess24Task137Output
> xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
> xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
> xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
> humanTaskInvokeResponse
> xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
> xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema">true</
> humanTaskInvokeResponse></SubProcess24Task137Output></
> SubProcess24Task137Output></message>
> 424519845 [ODEServer-513] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
> 2017-07-11 14:01:07 EDT transacted: true persisted: true details:
> JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
> INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
> null retryCount: 1 inMem: false detailsExt: {})
> org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
>         at org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
> BpelEngineImpl.java:394)
>         at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
> BpelEngineImpl.java:403)
>         at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
> BpelServerImpl.java:450)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:518)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
> 1.call(SimpleScheduler.java:512)
>         at org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> SimpleScheduler.java:284)
>         at org.apache.ode.scheduler.simple.SimpleScheduler.
> execTransaction(
> SimpleScheduler.java:239)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:512)
>         at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
> call(SimpleScheduler.java:496)
>         at java.util.concurrent.FutureTask.run(FutureTask.java:266)
>         at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>         at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>         at java.lang.Thread.run(Thread.java:745)
> 424519851 [ODEServer-518] ERROR
> org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
> processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
> 2017-07-11 14:01:05 EDT transacted: true persisted: true details:
> JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
> INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
> null retryCount: 1 inMem: false detailsExt: {})
>
>
> Regards,
>
> Gangadhar.
>
>
> On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com>
> wrote:
>
> > There are multiple factors for intermittent issues. I can only speculate
> > here with limited information.
> >
> > Check your logs for failures when it happens and share it here, so that
> we
> > can help you better. If possible put in a sample process to reproduce
> your
> > scenario and share here.
> >
> >
> >
> >
> >
> > On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com> wrote:
> >
> > > Sometimes the activity gets released, if it is due to failures in the
> > > process, it should fail every time right?
> > >
> > > Regards,
> > > Gangadhar.
> > >
> > > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > > > Jobs might be getting rescheduled due to failures in the process.
> > > > Check the logs for errors.
> > > >
> > > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com> wrote:
> > > >
> > > > > Hi Sathwik,
> > > > >
> > > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it
> > will
> > > > be
> > > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes
> > more
> > > > > time to release the tasks, sometimes it will not release.
> > > > >
> > > > > Regards,
> > > > > Ganga.
> > > > >
> > > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com>
> > > > wrote:
> > > > >
> > > > > > What kind of jobs are pending?
> > > > > > What activities do you have within your <flow>?
> > > > > >
> > > > > > regards,
> > > > > > sathwik
> > > > > >
> > > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > > gangadhar.ireddy@gmail.com
> > > > > > > wrote:
> > > > > >
> > > > > > > Hi,
> > > > > > >
> > > > > > > This is Gangadhar working for Altair, currently we are using
> > > > Apache-ode
> > > > > > and
> > > > > > > facing few issues on flow activity.
> > > > > > >
> > > > > > > 1. Sometimes all the activities will not be released and when i
> > > check
> > > > > the
> > > > > > > ode_job table there are some records not getting updated. But
> > when
> > > i
> > > > > > clean
> > > > > > > ode_job table and create a new instance it works fine.
> > > > > > >
> > > > > > > 2. If i have more than 9 activities in flow , it takes large
> > amount
> > > > of
> > > > > > time
> > > > > > > to release all the tasks.
> > > > > > >
> > > > > > >
> > > > > > > Can you help me to fix these issues.
> > > > > > >
> > > > > > > Thanks,
> > > > > > > Gangadhar.
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

This is normal. Concurrent messages are competing for the instance lock.
Job that doesn't get the lock on the instance has to wait and will be
rescheduled.
You should never clear the job table.

On Jul 12, 2017 12:08, "Gangadhar ireddy" <ga...@gmail.com>
wrote:

Sathwik,

Please find the below log,

<message><SubProcess24Task137Output><SubProcess24Task137Output
xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><
humanTaskInvokeResponse
xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema">true</
humanTaskInvokeResponse></SubProcess24Task137Output></
SubProcess24Task137Output></message>
424519845 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
2017-07-11 14:01:07 EDT transacted: true persisted: true details:
JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
null retryCount: 1 inMem: false detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
        at org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(
BpelEngineImpl.java:394)
        at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(
BpelEngineImpl.java:403)
        at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(
BpelServerImpl.java:450)
        at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
1.call(SimpleScheduler.java:518)
        at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$
1.call(SimpleScheduler.java:512)
        at org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
SimpleScheduler.java:284)
        at org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(
SimpleScheduler.java:239)
        at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
call(SimpleScheduler.java:512)
        at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.
call(SimpleScheduler.java:496)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(
ThreadPoolExecutor.java:1142)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(
ThreadPoolExecutor.java:617)
        at java.lang.Thread.run(Thread.java:745)
424519851 [ODEServer-518] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
2017-07-11 14:01:05 EDT transacted: true persisted: true details:
JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
null retryCount: 1 inMem: false detailsExt: {})


Regards,

Gangadhar.


On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com> wrote:

> There are multiple factors for intermittent issues. I can only speculate
> here with limited information.
>
> Check your logs for failures when it happens and share it here, so that we
> can help you better. If possible put in a sample process to reproduce your
> scenario and share here.
>
>
>
>
>
> On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
> > Sometimes the activity gets released, if it is due to failures in the
> > process, it should fail every time right?
> >
> > Regards,
> > Gangadhar.
> >
> > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > Jobs might be getting rescheduled due to failures in the process.
> > > Check the logs for errors.
> > >
> > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com> wrote:
> > >
> > > > Hi Sathwik,
> > > >
> > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it
> will
> > > be
> > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes
> more
> > > > time to release the tasks, sometimes it will not release.
> > > >
> > > > Regards,
> > > > Ganga.
> > > >
> > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > > >
> > > > > What kind of jobs are pending?
> > > > > What activities do you have within your <flow>?
> > > > >
> > > > > regards,
> > > > > sathwik
> > > > >
> > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > gangadhar.ireddy@gmail.com
> > > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > This is Gangadhar working for Altair, currently we are using
> > > Apache-ode
> > > > > and
> > > > > > facing few issues on flow activity.
> > > > > >
> > > > > > 1. Sometimes all the activities will not be released and when i
> > check
> > > > the
> > > > > > ode_job table there are some records not getting updated. But
> when
> > i
> > > > > clean
> > > > > > ode_job table and create a new instance it works fine.
> > > > > >
> > > > > > 2. If i have more than 9 activities in flow , it takes large
> amount
> > > of
> > > > > time
> > > > > > to release all the tasks.
> > > > > >
> > > > > >
> > > > > > Can you help me to fix these issues.
> > > > > >
> > > > > > Thanks,
> > > > > > Gangadhar.
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sathwik,

Please find the below log,

<message><SubProcess24Task137Output><SubProcess24Task137Output
xmlns="http://www.altair.com/EPM/Schema/SubProcess24Task137"
xmlns:SOAP-ENV="http://schemas.xmlsoap.org/soap/envelope/"
xmlns:tns="http://www.altair.com/EPM/Schema/SubProcess24Task137"><humanTaskInvokeResponse
xmlns="http://www.altair.com/WF/Framework/HumanTaskDataSchema"
xmlns:htds="http://www.altair.com/WF/Framework/HumanTaskDataSchema">true</humanTaskInvokeResponse></SubProcess24Task137Output></SubProcess24Task137Output></message>
424519845 [ODEServer-513] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
processing a persisted job: Job hqejbhcnphrcfcpvi9xhf3 time:
2017-07-11 14:01:07 EDT transacted: true persisted: true details:
JobDetails( instanceId: 48210 mexId: 50968 processId: null type:
INVOKE_RESPONSE channel: 423 correlatorId: null correlationKeySet:
null retryCount: 1 inMem: false detailsExt: {})
org.apache.ode.bpel.iapi.Scheduler$JobProcessorException
	at org.apache.ode.bpel.engine.BpelEngineImpl.acquireInstanceLock(BpelEngineImpl.java:394)
	at org.apache.ode.bpel.engine.BpelEngineImpl.onScheduledJob(BpelEngineImpl.java:403)
	at org.apache.ode.bpel.engine.BpelServerImpl.onScheduledJob(BpelServerImpl.java:450)
	at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:518)
	at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob$1.call(SimpleScheduler.java:512)
	at org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:284)
	at org.apache.ode.scheduler.simple.SimpleScheduler.execTransaction(SimpleScheduler.java:239)
	at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:512)
	at org.apache.ode.scheduler.simple.SimpleScheduler$RunJob.call(SimpleScheduler.java:496)
	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
	at java.lang.Thread.run(Thread.java:745)
424519851 [ODEServer-518] ERROR
org.apache.ode.scheduler.simple.SimpleScheduler  - Error while
processing a persisted job: Job hqejbhcnphrcfcpvi9xhem time:
2017-07-11 14:01:05 EDT transacted: true persisted: true details:
JobDetails( instanceId: 48210 mexId: 50955 processId: null type:
INVOKE_RESPONSE channel: 269 correlatorId: null correlationKeySet:
null retryCount: 1 inMem: false detailsExt: {})


Regards,

Gangadhar.


On Tue, Jul 11, 2017 at 12:08 PM, Sathwik B P <sa...@gmail.com> wrote:

> There are multiple factors for intermittent issues. I can only speculate
> here with limited information.
>
> Check your logs for failures when it happens and share it here, so that we
> can help you better. If possible put in a sample process to reproduce your
> scenario and share here.
>
>
>
>
>
> On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
> > Sometimes the activity gets released, if it is due to failures in the
> > process, it should fail every time right?
> >
> > Regards,
> > Gangadhar.
> >
> > On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > Jobs might be getting rescheduled due to failures in the process.
> > > Check the logs for errors.
> > >
> > > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com> wrote:
> > >
> > > > Hi Sathwik,
> > > >
> > > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it
> will
> > > be
> > > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes
> more
> > > > time to release the tasks, sometimes it will not release.
> > > >
> > > > Regards,
> > > > Ganga.
> > > >
> > > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com>
> > > wrote:
> > > >
> > > > > What kind of jobs are pending?
> > > > > What activities do you have within your <flow>?
> > > > >
> > > > > regards,
> > > > > sathwik
> > > > >
> > > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > > gangadhar.ireddy@gmail.com
> > > > > > wrote:
> > > > >
> > > > > > Hi,
> > > > > >
> > > > > > This is Gangadhar working for Altair, currently we are using
> > > Apache-ode
> > > > > and
> > > > > > facing few issues on flow activity.
> > > > > >
> > > > > > 1. Sometimes all the activities will not be released and when i
> > check
> > > > the
> > > > > > ode_job table there are some records not getting updated. But
> when
> > i
> > > > > clean
> > > > > > ode_job table and create a new instance it works fine.
> > > > > >
> > > > > > 2. If i have more than 9 activities in flow , it takes large
> amount
> > > of
> > > > > time
> > > > > > to release all the tasks.
> > > > > >
> > > > > >
> > > > > > Can you help me to fix these issues.
> > > > > >
> > > > > > Thanks,
> > > > > > Gangadhar.
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

There are multiple factors for intermittent issues. I can only speculate
here with limited information.

Check your logs for failures when it happens and share it here, so that we
can help you better. If possible put in a sample process to reproduce your
scenario and share here.





On Tue, Jul 11, 2017 at 9:55 AM, Gangadhar ireddy <
gangadhar.ireddy@gmail.com> wrote:

> Sometimes the activity gets released, if it is due to failures in the
> process, it should fail every time right?
>
> Regards,
> Gangadhar.
>
> On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > Jobs might be getting rescheduled due to failures in the process.
> > Check the logs for errors.
> >
> > On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com> wrote:
> >
> > > Hi Sathwik,
> > >
> > > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it will
> > be
> > > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes more
> > > time to release the tasks, sometimes it will not release.
> > >
> > > Regards,
> > > Ganga.
> > >
> > > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com>
> > wrote:
> > >
> > > > What kind of jobs are pending?
> > > > What activities do you have within your <flow>?
> > > >
> > > > regards,
> > > > sathwik
> > > >
> > > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > > gangadhar.ireddy@gmail.com
> > > > > wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > This is Gangadhar working for Altair, currently we are using
> > Apache-ode
> > > > and
> > > > > facing few issues on flow activity.
> > > > >
> > > > > 1. Sometimes all the activities will not be released and when i
> check
> > > the
> > > > > ode_job table there are some records not getting updated. But when
> i
> > > > clean
> > > > > ode_job table and create a new instance it works fine.
> > > > >
> > > > > 2. If i have more than 9 activities in flow , it takes large amount
> > of
> > > > time
> > > > > to release all the tasks.
> > > > >
> > > > >
> > > > > Can you help me to fix these issues.
> > > > >
> > > > > Thanks,
> > > > > Gangadhar.
> > > > >
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Sometimes the activity gets released, if it is due to failures in the
process, it should fail every time right?

Regards,
Gangadhar.

On Mon, Jul 10, 2017 at 7:06 PM, Sathwik B P <sa...@gmail.com> wrote:

> Jobs might be getting rescheduled due to failures in the process.
> Check the logs for errors.
>
> On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com> wrote:
>
> > Hi Sathwik,
> >
> > I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it will
> be
> > updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes more
> > time to release the tasks, sometimes it will not release.
> >
> > Regards,
> > Ganga.
> >
> > On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com>
> wrote:
> >
> > > What kind of jobs are pending?
> > > What activities do you have within your <flow>?
> > >
> > > regards,
> > > sathwik
> > >
> > > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > > gangadhar.ireddy@gmail.com
> > > > wrote:
> > >
> > > > Hi,
> > > >
> > > > This is Gangadhar working for Altair, currently we are using
> Apache-ode
> > > and
> > > > facing few issues on flow activity.
> > > >
> > > > 1. Sometimes all the activities will not be released and when i check
> > the
> > > > ode_job table there are some records not getting updated. But when i
> > > clean
> > > > ode_job table and create a new instance it works fine.
> > > >
> > > > 2. If i have more than 9 activities in flow , it takes large amount
> of
> > > time
> > > > to release all the tasks.
> > > >
> > > >
> > > > Can you help me to fix these issues.
> > > >
> > > > Thanks,
> > > > Gangadhar.
> > > >
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

Jobs might be getting rescheduled due to failures in the process.
Check the logs for errors.

On Mon, Jul 10, 2017 at 10:12 AM, Gangadhar ireddy <
gangadhar.ireddy@gmail.com> wrote:

> Hi Sathwik,
>
> I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it will be
> updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes more
> time to release the tasks, sometimes it will not release.
>
> Regards,
> Ganga.
>
> On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com> wrote:
>
> > What kind of jobs are pending?
> > What activities do you have within your <flow>?
> >
> > regards,
> > sathwik
> >
> > On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> > gangadhar.ireddy@gmail.com
> > > wrote:
> >
> > > Hi,
> > >
> > > This is Gangadhar working for Altair, currently we are using Apache-ode
> > and
> > > facing few issues on flow activity.
> > >
> > > 1. Sometimes all the activities will not be released and when i check
> the
> > > ode_job table there are some records not getting updated. But when i
> > clean
> > > ode_job table and create a new instance it works fine.
> > >
> > > 2. If i have more than 9 activities in flow , it takes large amount of
> > time
> > > to release all the tasks.
> > >
> > >
> > > Can you help me to fix these issues.
> > >
> > > Thanks,
> > > Gangadhar.
> > >
> >
>

Re: Flow activity issues on apache ode

Posted by Gangadhar ireddy <ga...@gmail.com>.

Hi Sathwik,

I can see INVOKE_RESPONSE type in ode_jobs table,for some tasks it will be
updated with INVOKE_CHECK from INVOKE_RESPONSE. Sometimes it takes more
time to release the tasks, sometimes it will not release.

Regards,
Ganga.

On Fri, Jul 7, 2017 at 5:04 PM, Sathwik B P <sa...@gmail.com> wrote:

> What kind of jobs are pending?
> What activities do you have within your <flow>?
>
> regards,
> sathwik
>
> On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <
> gangadhar.ireddy@gmail.com
> > wrote:
>
> > Hi,
> >
> > This is Gangadhar working for Altair, currently we are using Apache-ode
> and
> > facing few issues on flow activity.
> >
> > 1. Sometimes all the activities will not be released and when i check the
> > ode_job table there are some records not getting updated. But when i
> clean
> > ode_job table and create a new instance it works fine.
> >
> > 2. If i have more than 9 activities in flow , it takes large amount of
> time
> > to release all the tasks.
> >
> >
> > Can you help me to fix these issues.
> >
> > Thanks,
> > Gangadhar.
> >
>

Re: Flow activity issues on apache ode

Posted by Sathwik B P <sa...@gmail.com>.

What kind of jobs are pending?
What activities do you have within your <flow>?

regards,
sathwik

On Fri, Jul 7, 2017 at 2:13 PM, Gangadhar ireddy <gangadhar.ireddy@gmail.com
> wrote:

> Hi,
>
> This is Gangadhar working for Altair, currently we are using Apache-ode and
> facing few issues on flow activity.
>
> 1. Sometimes all the activities will not be released and when i check the
> ode_job table there are some records not getting updated. But when i clean
> ode_job table and create a new instance it works fine.
>
> 2. If i have more than 9 activities in flow , it takes large amount of time
> to release all the tasks.
>
>
> Can you help me to fix these issues.
>
> Thanks,
> Gangadhar.
>