You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Gopi Krishnan Nambiar (JIRA)" <ji...@apache.org> on 2016/12/21 19:21:58 UTC

[jira] [Created] (OOZIE-2762) Oozie workflow stuck in RUNNING state and does not progress to next action due to unique contraint violation exception for "wf_actions_pkey"

Gopi Krishnan Nambiar created OOZIE-2762:
--------------------------------------------

             Summary: Oozie workflow stuck in RUNNING state and does not progress to next action due to unique contraint violation exception for "wf_actions_pkey"
                 Key: OOZIE-2762
                 URL: https://issues.apache.org/jira/browse/OOZIE-2762
             Project: Oozie
          Issue Type: Bug
    Affects Versions: 4.0.1
            Reporter: Gopi Krishnan Nambiar


-bash-4.1$ oozie job -oozie http://localhost:11000/oozie --info  0000141-161216105202698-oozie-oozi-C
Job ID : 0000141-161216105202698-oozie-oozi-C
------------------------------------------------------------------------------------------------------------------------------------
Job Name    : coord
App Path    : hdfs://URL/user/oozie/examples/apps/applog/coordinator.xml
Status      : RUNNING
Start Time  : 2016-10-05 00:00 GMT
End Time    : 2016-10-05 23:59 GMT
Pause Time  : -
Concurrency : 2
------------------------------------------------------------------------------------------------------------------------------------
ID                                         Status    Ext ID                               Err Code  Created              Nominal Time         
0000141-161216105202698-oozie-oozi-C@1     RUNNING   0000142-161216105202698-oozie-oozi-W -         2016-12-21 18:08 GMT 2016-10-05 00:00 GMT 
------------------------------------------------------------------------------------------------------------------------------------


-bash-4.1$ oozie job -oozie http://localhost:11000/oozie --info 0000142-161216105202698-oozie-oozi-W
Job ID : 0000142-161216105202698-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : conversion-wf
App Path      : hdfs://URL/user/oozie/examples/apps/applog
Status        : RUNNING
Run           : 0
User          : sfdc
Group         : -
Created       : 2016-12-21 18:08 GMT
Started       : 2016-12-21 18:08 GMT
Last Modified : 2016-12-21 18:39 GMT
Ended         : -
CoordAction ID: 0000141-161216105202698-oozie-oozi-C@1

Actions
------------------------------------------------------------------------------------------------------------------------------------
ID                                                                            Status    Ext ID                 Ext Status Err Code  
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@:start:                                  OK        -                      OK         -         
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@decisionNode                             OK        -                      conversionJob-         
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@conversionJob                            OK        job_1481654882437_6310 SUCCEEDED  -         
------------------------------------------------------------------------------------------------------------------------------------
0000142-161216105202698-oozie-oozi-W@findHivePartitions               OK        job_1481654882437_6325 SUCCEEDED  -         
------------------------------------------------------------------------------------------------------------------------------------








Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: ERROR: duplicate key value violates unique constraint "wf_actions_pkey"
  Detail: Key (id)=(0000142-161216105202698-oozie-oozi-W@findHiveInstancePartitions) already exists. {prepstmnt 67637986 INSERT INTO WF_ACTIONS (id, conf, console_url, cred, data, error_code, error_message, external_child_ids, external_id, external_status, name, retries, stats, tracker_uri, transition, type, user_retry_count, user_retry_interval, user_retry_max, bean_type, end_time, execution_path, last_check_time, log_token, pending, pending_age, signal_value, sla_xml, start_time, status, wf_id) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)} [code=0, state=23505]
	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:219)
	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:195)
	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:59)
	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1134)
	at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:275)
	at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:275)
	at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1792)
	at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:268)
	at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:119)
	... 28 more
2016-12-21 18:53:18,548 ERROR SignalXCommand:536 - USER[sfdc] GROUP[-] TOKEN[] APP[parquetconversion-wf] JOB[0000142-161216105202698-oozie-oozi-W] ACTION[0000142-161216105202698-oozie-oozi-W@conversionJob] XException, 
org.apache.oozie.command.CommandException: E0603: SQL error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:336)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:64)
	at org.apache.oozie.command.XCommand.call(XCommand.java:280)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.oozie.executor.jpa.JPAExecutorException: E0603: SQL error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
	at org.apache.oozie.service.JPAService.execute(JPAService.java:228)
	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:330)
	... 8 more
Caused by: <openjpa-2.2.2-r422266:1468616 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
	at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
	at org.apache.oozie.service.JPAService.execute(JPAService.java:223)
	... 9 more
Caused by: <openjpa-2.2.2-r422266:1468616 fatal general error> org.apache.openjpa.persistence.PersistenceException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
	at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2347)
	at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2184)
	at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2082)
	at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:2000)
	at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
	at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1524)
	at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
	at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
	... 10 more



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)