You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Gopi Krishnan Nambiar (JIRA)" <ji...@apache.org> on 2017/03/22 23:05:41 UTC

[jira] [Commented] (OOZIE-2762) Oozie workflow stuck in RUNNING state and does not progress to next action due to unique contraint violation exception for "wf_actions_pkey"

    [ https://issues.apache.org/jira/browse/OOZIE-2762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15937333#comment-15937333 ] 

Gopi Krishnan Nambiar commented on OOZIE-2762:
----------------------------------------------

Related to oozie HA. Non HA versions deployed on multiple hosts caused the issue. Hence closing this.

> Oozie workflow stuck in RUNNING state and does not progress to next action due to unique contraint violation exception for "wf_actions_pkey"
> --------------------------------------------------------------------------------------------------------------------------------------------
>
>                 Key: OOZIE-2762
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2762
>             Project: Oozie
>          Issue Type: Bug
>    Affects Versions: 4.0.1
>            Reporter: Gopi Krishnan Nambiar
>
> -bash-4.1$ oozie job -oozie http://localhost:11000/oozie --info  0000141-161216105202698-oozie-oozi-C
> Job ID : 0000141-161216105202698-oozie-oozi-C
> ------------------------------------------------------------------------------------------------------------------------------------
> Job Name    : coord
> App Path    : hdfs://URL/user/oozie/examples/apps/applog/coordinator.xml
> Status      : RUNNING
> Start Time  : 2016-10-05 00:00 GMT
> End Time    : 2016-10-05 23:59 GMT
> Pause Time  : -
> Concurrency : 2
> ------------------------------------------------------------------------------------------------------------------------------------
> ID                                         Status    Ext ID                               Err Code  Created              Nominal Time         
> 0000141-161216105202698-oozie-oozi-C@1     RUNNING   0000142-161216105202698-oozie-oozi-W -         2016-12-21 18:08 GMT 2016-10-05 00:00 GMT 
> ------------------------------------------------------------------------------------------------------------------------------------
> -bash-4.1$ oozie job -oozie http://localhost:11000/oozie --info 0000142-161216105202698-oozie-oozi-W
> Job ID : 0000142-161216105202698-oozie-oozi-W
> ------------------------------------------------------------------------------------------------------------------------------------
> Workflow Name : conversion-wf
> App Path      : hdfs://URL/user/oozie/examples/apps/applog
> Status        : RUNNING
> Run           : 0
> User          : sfdc
> Group         : -
> Created       : 2016-12-21 18:08 GMT
> Started       : 2016-12-21 18:08 GMT
> Last Modified : 2016-12-21 18:39 GMT
> Ended         : -
> CoordAction ID: 0000141-161216105202698-oozie-oozi-C@1
> Actions
> ------------------------------------------------------------------------------------------------------------------------------------
> ID                                                                            Status    Ext ID                 Ext Status Err Code  
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000142-161216105202698-oozie-oozi-W@:start:                                  OK        -                      OK         -         
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000142-161216105202698-oozie-oozi-W@decisionNode                             OK        -                      conversionJob-         
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000142-161216105202698-oozie-oozi-W@conversionJob                            OK        job_1481654882437_6310 SUCCEEDED  -         
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000142-161216105202698-oozie-oozi-W@findHivePartitions               OK        job_1481654882437_6325 SUCCEEDED  -         
> ------------------------------------------------------------------------------------------------------------------------------------
> Exception:
> {noformat}
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: ERROR: duplicate key value violates unique constraint "wf_actions_pkey"
>   Detail: Key (id)=(0000142-161216105202698-oozie-oozi-W@findHiveInstancePartitions) already exists. {prepstmnt 67637986 INSERT INTO WF_ACTIONS (id, conf, console_url, cred, data, error_code, error_message, external_child_ids, external_id, external_status, name, retries, stats, tracker_uri, transition, type, user_retry_count, user_retry_interval, user_retry_max, bean_type, end_time, execution_path, last_check_time, log_token, pending, pending_age, signal_value, sla_xml, start_time, status, wf_id) VALUES (?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?, ?)} [code=0, state=23505]
> 	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:219)
> 	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:195)
> 	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:59)
> 	at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1134)
> 	at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:275)
> 	at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:275)
> 	at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1792)
> 	at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:268)
> 	at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:119)
> 	... 28 more
> 2016-12-21 18:53:18,548 ERROR SignalXCommand:536 - USER[sfdc] GROUP[-] TOKEN[] APP[parquetconversion-wf] JOB[0000142-161216105202698-oozie-oozi-W] ACTION[0000142-161216105202698-oozie-oozi-W@conversionJob] XException, 
> org.apache.oozie.command.CommandException: E0603: SQL error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
> FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
> 	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:336)
> 	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:64)
> 	at org.apache.oozie.command.XCommand.call(XCommand.java:280)
> 	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:326)
> 	at org.apache.oozie.service.CallableQueueService$CompositeCallable.call(CallableQueueService.java:255)
> 	at org.apache.oozie.service.CallableQueueService$CallableWrapper.run(CallableQueueService.java:175)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> 	at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.oozie.executor.jpa.JPAExecutorException: E0603: SQL error in operation, <openjpa-2.2.2-r422266:1468616 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
> FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
> 	at org.apache.oozie.service.JPAService.execute(JPAService.java:228)
> 	at org.apache.oozie.command.wf.SignalXCommand.execute(SignalXCommand.java:330)
> 	... 8 more
> Caused by: <openjpa-2.2.2-r422266:1468616 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
> FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
> 	at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
> 	at org.apache.oozie.service.JPAService.execute(JPAService.java:223)
> 	... 9 more
> Caused by: <openjpa-2.2.2-r422266:1468616 fatal general error> org.apache.openjpa.persistence.PersistenceException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.
> FailedObject: org.apache.oozie.WorkflowActionBean@53b0cdd4
> 	at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2347)
> 	at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2184)
> 	at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2082)
> 	at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:2000)
> 	at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
> 	at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1524)
> 	at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
> 	at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
> 	... 10 more
> {noformat}



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)