You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@airavata.apache.org by DImuthu Upeksha <di...@gmail.com> on 2015/08/17 12:54:47 UTC

Permission error at submitting Gaussian jobs to Airavata

Hi all,

$subject please. What could be the reason for this? Hope the issue is with
this

org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
output : sbatch: error: bank_limit plugin: expired user, can't submit job

Here is the full log
--------------------

2015-08-17 06:48:07,601 [Thread-9] INFO
org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:17,602 [Thread-9] INFO
org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:27,603 [Thread-9] INFO
org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:37,603 [Thread-9] INFO
org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:43,612 [pool-3-thread-3] INFO
org.apache.airavata.gfac.core.utils.GFacUtils  - This is a new Job, so
creating all the experiment docs from the scratch

2015-08-17 06:48:43,679 [pool-3-thread-3] INFO
org.apache.airavata.gfac.core.utils.GFacUtils  - Created the node:
/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/state
successfully !

2015-08-17 06:48:43,692 [pool-3-thread-3] INFO
org.apache.airavata.gfac.server.GfacServerHandler  -
-----------------------------------------------------92-----------------------------------------------------

2015-08-17 06:48:43,692 [pool-3-thread-3] INFO
org.apache.airavata.gfac.server.GfacServerHandler  -
Id:dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 : GFac
Received submit job request for the Experiment:
dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 TaskId:
tempNode_56f41083-10be-4161-8803-ee1106bd3f54

2015-08-17 06:48:44,595 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
at this point

2015-08-17 06:48:44,599 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
internal state changed to: ACCEPTED

2015-08-17 06:48:44,790 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
at this point

2015-08-17 06:48:44,790 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
internal state changed to: INHANDLERSINVOKING

2015-08-17 06:48:44,882 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Invoking
ApplicationDescriptorCheckHandler ...

2015-08-17 06:48:44,905 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  -
Recoverable data is saving to zk:
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr

2015-08-17 06:48:45,216 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Listing
directory: comet.sdsc.edu:~/

2015-08-17 06:48:45,424 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Re-using the same
connection used with the connection string:scigapcomet.sdsc.edu22

2015-08-17 06:48:45,424 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Setup SSH
job directorties

2015-08-17 06:48:45,441 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  -
Successfully retrieved the Security Context

2015-08-17 06:48:45,441 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Creating
directory: comet.sdsc.edu:
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:45,924 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.ssh.handler.AdvancedSCPInputHandler  - Previously
stored data  is wrong so we continue the operations

2015-08-17 06:48:46,251 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
from:localhost:/home/airavata/oodt/archive/ghqcgrdl57hmhbhd37p11qqjnl/c4b4nhtwbs3.inp
To:file://home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54

2015-08-17 06:48:47,604 [Thread-9] INFO
org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:48,263 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Successfully
retrieved the Security Context

2015-08-17 06:48:48,265 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Invoking
SCPInputHandler

2015-08-17 06:48:48,333 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
file:////home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54/c4b4nhtwbs3.inp
To:comet.sdsc.edu:
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/c4b4nhtwbs3.inp

2015-08-17 06:48:49,125 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
at this point

2015-08-17 06:48:49,125 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
internal state changed to: INHANDLERSINVOKED

2015-08-17 06:48:49,199 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
at this point

2015-08-17 06:48:49,200 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
internal state changed to: PROVIDERINVOKING

2015-08-17 06:48:49,299 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Successfully
retrieved the Security Context

2015-08-17 06:48:49,346 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Email list:
gw77jobs@scigap.org,jobnotif@scigap.org

2015-08-17 06:48:49,363 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - <ns:JobDescriptor
xmlns:ns="http://airavata.apache.org/gsi/ssh/2012/12
"><ns:userName>scigap</ns:userName><ns:shellName>/bin/bash</ns:shellName><ns:queueName>compute</ns:queueName><ns:jobName>A516147113</ns:jobName><ns:allEnvExport>true</ns:allEnvExport><ns:mailOptions>abe</ns:mailOptions><ns:mailAddress>
gw77jobs@scigap.org,jobnotif@scigap.org</ns:mailAddress><ns:acountString>sds128</ns:acountString><ns:maxWallTime>00:30:00</ns:maxWallTime><ns:standardOutFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout</ns:standardOutFile><ns:standardErrorFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr</ns:standardErrorFile><ns:outputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:outputDirectory><ns:inputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:inputDirectory><ns:nodes>1</ns:nodes><ns:processesPerNode>16</ns:processesPerNode><ns:cpuCount>16</ns:cpuCount><ns:workingDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:workingDirectory><ns:executablePath>/opt/gaussian/g09/g09</ns:executablePath><ns:inputs><ns:input>gaussian.out</ns:input></ns:inputs><ns:owner>scigap</ns:owner><ns:usedMem>100</ns:usedMem><ns:moduleLoadCommands><ns:command>module
load
gaussian</ns:command></ns:moduleLoadCommands><ns:callBackIp>149.165.228.42</ns:callBackIp><ns:callBackPort>8950</ns:callBackPort></ns:JobDescriptor>

2015-08-17 06:48:49,443 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
To:comet.sdsc.edu:
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:49,897 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
RawCommand : /usr/bin/sbatch
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:48:50,195 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
Returned:

2015-08-17 06:48:50,196 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:48:50,196 [pool-8-thread-56] ERROR
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:48:55,197 [pool-8-thread-56] ERROR
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured
during job submission but doing a retry

2015-08-17 06:48:55,197 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
To:comet.sdsc.edu:
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:55,641 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
RawCommand : /usr/bin/sbatch
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:48:55,905 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
Returned:

2015-08-17 06:48:55,905 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:48:55,905 [pool-8-thread-56] ERROR
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:48:57,612 [Thread-9] INFO
org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
Monitor Map is empty, no need to retrieve emails

2015-08-17 06:49:00,906 [pool-8-thread-56] ERROR
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured
during job submission but doing a retry

2015-08-17 06:49:00,906 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
To:comet.sdsc.edu:
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,321 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
RawCommand : /usr/bin/sbatch
/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:49:01,587 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
Returned:

2015-08-17 06:49:01,587 [pool-8-thread-56] INFO
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:49:01,587 [pool-8-thread-56] ERROR
org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:49:01,588 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Error submitting
the job to host comet.sdsc.edu message: Error reading output of job
submission

 StandardOutput:

 StandardError: sbatch: error: bank_limit plugin: expired user, can't
submit job

sbatch: error: Batch job submission failed: Invalid account or
account/partition combination specified


2015-08-17 06:49:01,660 [pool-8-thread-56] ERROR
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource  -
The transaction has been rolled back.  See the nested exceptions for
details on the errors that occurred.

<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,664 [pool-8-thread-56] ERROR
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  -
Error while adding job details...

org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,666 [pool-8-thread-56] ERROR
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl  - Error
while adding JOB_DETAIL

org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:181)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,690 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.GFacException  - Error persisting job statusError
while adding JOB_DETAIL

org.apache.airavata.registry.cpi.RegistryException: Error while adding
JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,691 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Saving data for
future recovery:

2015-08-17 06:49:01,691 [pool-8-thread-56] INFO
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  -

2015-08-17 06:49:01,721 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.provider.GFacProviderException  - Error
persisting job statusError while adding JOB_DETAIL

org.apache.airavata.gfac.GFacException: Error persisting job statusError
while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,723 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.GFacException  - Error while executing provider
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

org.apache.airavata.gfac.core.provider.GFacProviderException: Error
persisting job statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,724 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
at this point

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
internal state changed to: FAILED

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
Experiment Failed, So removing the ZK entry for the
experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
Zookeeper experiment Path:
/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,725 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error occured during
updating the statuses of Experiments,tasks or Job statuses to failed,
NullPointerException occurred because at this point there might not have
Job Created

org.apache.airavata.gfac.GFacException: Error while executing provider
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
Error persisting job statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,726 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  -
expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:
Updating workflow node status for
tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED

2015-08-17 06:49:02,129 [pool-8-thread-56] INFO
org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
Publishing status to rabbitmq...

2015-08-17 06:49:03,300 [pool-8-thread-56] INFO
org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
Updating the experiment status of experiment:
dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED

2015-08-17 06:49:03,368 [pool-8-thread-56] INFO
org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
Publishing status to rabbitmq...

2015-08-17 06:49:03,376 [pool-8-thread-56] INFO
org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
Clean up task - Acknowledging delivery Tag - 93

2015-08-17 06:49:03,611 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.GFacException  - Error while executing provider
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

org.apache.airavata.gfac.GFacException: Error while executing provider
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
Error persisting job statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.GFacException  - Error launching the Job

org.apache.airavata.gfac.GFacException: Error while executing provider
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error while executing
provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
Error persisting job statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error inovoking the job
with experiment ID:
dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:Error
launching the Job

2015-08-17 06:49:03,761 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
at this point

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
internal state changed to: FAILED

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
Experiment Failed, So removing the ZK entry for the
experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
Zookeeper experiment Path:
/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:04,152 [pool-8-thread-56] INFO
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  -
Id:tempNode_56f41083-10be-4161-8803-ee1106bd3f54 : Updated task
tempNode_56f41083-10be-4161-8803-ee1106bd3f54 status to
TaskStatus(executionState:FAILED, timeOfStateChange:1439808544014).

2015-08-17 06:49:04,153 [pool-8-thread-56] INFO
org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
Publishing status to rabbitmq...

2015-08-17 06:49:04,154 [pool-8-thread-56] INFO
org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  -
expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:
Updating workflow node status for
tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED

2015-08-17 06:49:04,620 [pool-8-thread-56] INFO
org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
Publishing status to rabbitmq...

2015-08-17 06:49:05,901 [pool-8-thread-56] INFO
org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
Updating the experiment status of experiment:
dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED

2015-08-17 06:49:05,991 [pool-8-thread-56] INFO
org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
Publishing status to rabbitmq...

2015-08-17 06:49:05,995 [pool-8-thread-56] ERROR
org.apache.airavata.common.utils.AiravataZKUtils  - Cannot find delivery
Tag in
path:/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08-deliveryTag
for this experiment

2015-08-17 06:49:05,997 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.GFacException  - Error launching the Job

org.apache.airavata.gfac.GFacException: Error launching the Job

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error while executing
provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

... 5 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing
provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
Error persisting job statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:05,998 [pool-8-thread-56] ERROR
org.apache.airavata.gfac.core.utils.InputHandlerWorker  -
org.apache.airavata.gfac.GFacException: Error launching the Job

org.apache.airavata.gfac.GFacException:
org.apache.airavata.gfac.GFacException: Error launching the Job

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:200)

at
org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error launching the Job

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

... 4 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing
provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

... 5 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing
provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
functionality.

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
Error persisting job statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at
org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
statusError while adding JOB_DETAIL

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at
org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
adding JOB_DETAIL

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at
org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at
org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException:
<openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at
org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.RollbackException: The transaction has been
rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at
org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: The transaction has
been rolled back.  See the nested exceptions for details on the errors that
occurred.

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at
org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at
org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at
org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at
org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at
org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
org.apache.openjpa.persistence.EntityExistsException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

FailedObject:
org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at
org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at
org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at
org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at
org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at
org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at
org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at
org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String)
tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
[code=1048, state=23000]

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at
org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at
org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at
org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at
org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
... 31 more

Thanks
Dimuthu

-- 
Regards

W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering

University of Moratuwa, Sri Lanka

Re: Permission error at submitting Gaussian jobs to Airavata

Posted by Suresh Marru <sm...@apache.org>.
Hi Sudhakar,

Both PGA and command line invocation should use same account. But you are
right that scigap account is not added, I will get that fixed now.

Suresh

On Mon, Aug 17, 2015 at 8:48 AM Pamidighantam, Sudhakar V <
spamidig@illinois.edu> wrote:

> From PGA it may be going to ogce login on Comet and I noticed here it is
> using scigap login which does not appear to be in gaussian user group.
>
> Sudhakar.
>
> On Aug 17, 2015, at 6:41 AM, DImuthu Upeksha <di...@gmail.com>
> wrote:
>
> Hi Sudhakar,
>
> I'm using my user 'dimuthu' to submit the job. However from PGA I was able
> to submit using same user.
>
> On Mon, Aug 17, 2015 at 4:34 PM, Pamidighantam, Sudhakar V <
> spamidig@illinois.edu> wrote:
>
>> Dimuthu:
>> Are you using ind123 for the account to submit the job on comet. Also
>> scigap user need to be added to gaussian group on comet for this gaussian
>> job to execute.
>>
>> Thanks,
>> Sudhakar.
>> On Aug 17, 2015, at 5:54 AM, DImuthu Upeksha <di...@gmail.com>
>> wrote:
>>
>> Hi all,
>>
>> $subject please. What could be the reason for this? Hope the issue is
>> with this
>>
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
>> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> Here is the full log
>> --------------------
>>
>> 2015-08-17 06:48:07,601 [Thread-9] INFO
>> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
>> Monitor Map is empty, no need to retrieve emails
>>
>> 2015-08-17 06:48:17,602 [Thread-9] INFO
>> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
>> Monitor Map is empty, no need to retrieve emails
>>
>> 2015-08-17 06:48:27,603 [Thread-9] INFO
>> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
>> Monitor Map is empty, no need to retrieve emails
>>
>> 2015-08-17 06:48:37,603 [Thread-9] INFO
>> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
>> Monitor Map is empty, no need to retrieve emails
>>
>> 2015-08-17 06:48:43,612 [pool-3-thread-3] INFO
>> org.apache.airavata.gfac.core.utils.GFacUtils  - This is a new Job, so
>> creating all the experiment docs from the scratch
>>
>> 2015-08-17 06:48:43,679 [pool-3-thread-3] INFO
>> org.apache.airavata.gfac.core.utils.GFacUtils  - Created the node:
>> /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/state
>> successfully !
>>
>> 2015-08-17 06:48:43,692 [pool-3-thread-3] INFO
>> org.apache.airavata.gfac.server.GfacServerHandler  -
>> -----------------------------------------------------92-----------------------------------------------------
>>
>> 2015-08-17 06:48:43,692 [pool-3-thread-3] INFO
>> org.apache.airavata.gfac.server.GfacServerHandler  -
>> Id:dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 : GFac
>> Received submit job request for the Experiment:
>> dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 TaskId:
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54
>>
>> 2015-08-17 06:48:44,595 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
>> at this point
>>
>> 2015-08-17 06:48:44,599 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
>> internal state changed to: ACCEPTED
>>
>> 2015-08-17 06:48:44,790 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
>> at this point
>>
>> 2015-08-17 06:48:44,790 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
>> internal state changed to: INHANDLERSINVOKING
>>
>> 2015-08-17 06:48:44,882 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Invoking
>> ApplicationDescriptorCheckHandler ...
>>
>> 2015-08-17 06:48:44,905 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  -
>> Recoverable data is saving to zk:
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr
>>
>> 2015-08-17 06:48:45,216 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Listing
>> directory: comet.sdsc.edu
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=FGL6ZmI_OkpYj1Eni_XxKlZi1e5pQjBPe9kPjA2WSZg&s=545Z-EukzmpIvn6p78NWm6KsDNSiogQ7fygwv1S2Kn0&e=>
>> :~/
>>
>> 2015-08-17 06:48:45,424 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Re-using the same
>> connection used with the connection string:scigapcomet.sdsc.edu22
>>
>> 2015-08-17 06:48:45,424 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Setup SSH
>> job directorties
>>
>> 2015-08-17 06:48:45,441 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  -
>> Successfully retrieved the Security Context
>>
>> 2015-08-17 06:48:45,441 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Creating
>> directory: comet.sdsc.edu
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=FGL6ZmI_OkpYj1Eni_XxKlZi1e5pQjBPe9kPjA2WSZg&s=545Z-EukzmpIvn6p78NWm6KsDNSiogQ7fygwv1S2Kn0&e=>
>> :/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>>
>> 2015-08-17 06:48:45,924 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.ssh.handler.AdvancedSCPInputHandler  - Previously
>> stored data  is wrong so we continue the operations
>>
>> 2015-08-17 06:48:46,251 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
>> from:localhost:/home/airavata/oodt/archive/ghqcgrdl57hmhbhd37p11qqjnl/c4b4nhtwbs3.inp
>> To:file://home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54
>>
>> 2015-08-17 06:48:47,604 [Thread-9] INFO
>> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
>> Monitor Map is empty, no need to retrieve emails
>>
>> 2015-08-17 06:48:48,263 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Successfully
>> retrieved the Security Context
>>
>> 2015-08-17 06:48:48,265 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Invoking
>> SCPInputHandler
>>
>> 2015-08-17 06:48:48,333 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
>> file:////home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54/c4b4nhtwbs3.inp
>> To:comet.sdsc.edu:
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/c4b4nhtwbs3.inp
>>
>> 2015-08-17 06:48:49,125 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
>> at this point
>>
>> 2015-08-17 06:48:49,125 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
>> internal state changed to: INHANDLERSINVOKED
>>
>> 2015-08-17 06:48:49,199 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
>> at this point
>>
>> 2015-08-17 06:48:49,200 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
>> internal state changed to: PROVIDERINVOKING
>>
>> 2015-08-17 06:48:49,299 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Successfully
>> retrieved the Security Context
>>
>> 2015-08-17 06:48:49,346 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Email list:
>> gw77jobs@scigap.org,jobnotif@scigap.org
>>
>> 2015-08-17 06:48:49,363 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - <ns:JobDescriptor
>> xmlns:ns="http://airavata.apache.org/gsi/ssh/2012/12
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__airavata.apache.org_gsi_ssh_2012_12&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=rr-z-ofxHOEMNG0MplQ8-M4XnN4pik8WDj_QJtcJ1U4&s=-aj1AS2SM5acUrfV-jrQm_cHOdFuAZPHPxrR8EvElg8&e=>
>> "><ns:userName>scigap</ns:userName><ns:shellName>/bin/bash</ns:shellName><ns:queueName>compute</ns:queueName><ns:jobName>A516147113</ns:jobName><ns:allEnvExport>true</ns:allEnvExport><ns:mailOptions>abe</ns:mailOptions><ns:mailAddress>
>> gw77jobs@scigap.org,jobnotif@scigap.org</ns:mailAddress><ns:acountString>sds128</ns:acountString><ns:maxWallTime>00:30:00</ns:maxWallTime><ns:standardOutFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout</ns:standardOutFile><ns:standardErrorFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr</ns:standardErrorFile><ns:outputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:outputDirectory><ns:inputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:inputDirectory><ns:nodes>1</ns:nodes><ns:processesPerNode>16</ns:processesPerNode><ns:cpuCount>16</ns:cpuCount><ns:workingDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:workingDirectory><ns:executablePath>/opt/gaussian/g09/g09</ns:executablePath><ns:inputs><ns:input>gaussian.out</ns:input></ns:inputs><ns:owner>scigap</ns:owner><ns:usedMem>100</ns:usedMem><ns:moduleLoadCommands><ns:command>module
>> load
>> gaussian</ns:command></ns:moduleLoadCommands><ns:callBackIp>149.165.228.42</ns:callBackIp><ns:callBackPort>8950</ns:callBackPort></ns:JobDescriptor>
>>
>> 2015-08-17 06:48:49,443 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
>> file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
>> To:comet.sdsc.edu:
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>>
>> 2015-08-17 06:48:49,897 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
>> RawCommand : /usr/bin/sbatch
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm
>>
>> 2015-08-17 06:48:50,195 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
>> Returned:
>>
>> 2015-08-17 06:48:50,196 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
>> Returned:sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:48:50,196 [pool-8-thread-56] ERROR
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
>> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:48:55,197 [pool-8-thread-56] ERROR
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured
>> during job submission but doing a retry
>>
>> 2015-08-17 06:48:55,197 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
>> file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
>> To:comet.sdsc.edu:
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>>
>> 2015-08-17 06:48:55,641 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
>> RawCommand : /usr/bin/sbatch
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm
>>
>> 2015-08-17 06:48:55,905 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
>> Returned:
>>
>> 2015-08-17 06:48:55,905 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
>> Returned:sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:48:55,905 [pool-8-thread-56] ERROR
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
>> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:48:57,612 [Thread-9] INFO
>> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
>> Monitor Map is empty, no need to retrieve emails
>>
>> 2015-08-17 06:49:00,906 [pool-8-thread-56] ERROR
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured
>> during job submission but doing a retry
>>
>> 2015-08-17 06:49:00,906 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
>> file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
>> To:comet.sdsc.edu:
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>>
>> 2015-08-17 06:49:01,321 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
>> RawCommand : /usr/bin/sbatch
>> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm
>>
>> 2015-08-17 06:49:01,587 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
>> Returned:
>>
>> 2015-08-17 06:49:01,587 [pool-8-thread-56] INFO
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
>> Returned:sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:49:01,587 [pool-8-thread-56] ERROR
>> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
>> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:49:01,588 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Error submitting
>> the job to host comet.sdsc.edu
>> <https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=rr-z-ofxHOEMNG0MplQ8-M4XnN4pik8WDj_QJtcJ1U4&s=65JBaWpTv_6htucIuDqljdmiFGZnXKM4TYs8aVWQ9hM&e=>
>> message: Error reading output of job submission
>>
>>  StandardOutput:
>>
>>  StandardError: sbatch: error: bank_limit plugin: expired user, can't
>> submit job
>>
>> sbatch: error: Batch job submission failed: Invalid account or
>> account/partition combination specified
>>
>>
>> 2015-08-17 06:49:01,660 [pool-8-thread-56] ERROR
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource  -
>> The transaction has been rolled back.  See the nested exceptions for
>> details on the errors that occurred.
>>
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,664 [pool-8-thread-56] ERROR
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  -
>> Error while adding job details...
>>
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,666 [pool-8-thread-56] ERROR
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl  - Error
>> while adding JOB_DETAIL
>>
>> org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:181)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> ... 11 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> ... 12 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,690 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.GFacException  - Error persisting job statusError
>> while adding JOB_DETAIL
>>
>> org.apache.airavata.registry.cpi.RegistryException: Error while adding
>> JOB_DETAIL
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> ... 11 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> ... 12 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,691 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Saving data for
>> future recovery:
>>
>> 2015-08-17 06:49:01,691 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  -
>>
>> 2015-08-17 06:49:01,721 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.provider.GFacProviderException  - Error
>> persisting job statusError while adding JOB_DETAIL
>>
>> org.apache.airavata.gfac.GFacException: Error persisting job statusError
>> while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error
>> while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> ... 10 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> ... 11 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> ... 12 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,723 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.GFacException  - Error while executing provider
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>>
>> org.apache.airavata.gfac.core.provider.GFacProviderException: Error
>> persisting job statusError while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
>> statusError while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> ... 9 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error
>> while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> ... 10 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> ... 11 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> ... 12 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,724 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
>> at this point
>>
>> 2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
>> internal state changed to: FAILED
>>
>> 2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
>> Experiment Failed, So removing the ZK entry for the
>> experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>>
>> 2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
>> Zookeeper experiment Path:
>> /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>>
>> 2015-08-17 06:49:01,725 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error occured during
>> updating the statuses of Experiments,tasks or Job statuses to failed,
>> NullPointerException occurred because at this point there might not have
>> Job Created
>>
>> org.apache.airavata.gfac.GFacException: Error while executing provider
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
>> Error persisting job statusError while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> ... 8 more
>>
>> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
>> statusError while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> ... 9 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error
>> while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> ... 10 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> ... 11 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> ... 12 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:01,726 [pool-8-thread-56] INFO
>> org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  -
>> expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:
>> Updating workflow node status for
>> tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED
>>
>> 2015-08-17 06:49:02,129 [pool-8-thread-56] INFO
>> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
>> Publishing status to rabbitmq...
>>
>> 2015-08-17 06:49:03,300 [pool-8-thread-56] INFO
>> org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
>> Updating the experiment status of experiment:
>> dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED
>>
>> 2015-08-17 06:49:03,368 [pool-8-thread-56] INFO
>> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
>> Publishing status to rabbitmq...
>>
>> 2015-08-17 06:49:03,376 [pool-8-thread-56] INFO
>> org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
>> Clean up task - Acknowledging delivery Tag - 93
>>
>> 2015-08-17 06:49:03,611 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.GFacException  - Error while executing provider
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>>
>> org.apache.airavata.gfac.GFacException: Error while executing provider
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>> at
>> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>>
>> at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
>> Error persisting job statusError while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>>
>> ... 8 more
>>
>> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
>> statusError while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>>
>> at
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>>
>> ... 9 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error
>> while adding JOB_DETAIL
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>>
>> at
>> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>>
>> ... 10 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>>
>> ... 11 more
>>
>> Caused by: org.apache.airavata.registry.cpi.RegistryException:
>> <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>>
>> ... 12 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.RollbackException: The transaction has been
>> rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>>
>> at
>> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>>
>> ... 13 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: The transaction has
>> been rolled back.  See the nested exceptions for details on the errors that
>> occurred.
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>>
>> at
>> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>>
>> at
>> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>>
>> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>>
>> at
>> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>>
>> ... 14 more
>>
>> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
>> org.apache.openjpa.persistence.EntityExistsException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> FailedObject:
>> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>>
>> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>>
>> at
>> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>>
>> at
>> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>>
>> at
>> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>>
>> ... 21 more
>>
>> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
>> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>>
>> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>>
>>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>>
>>     VALUES (?, ?, ?, ?, ?, ?, ?)
>>
>> [params=(String) none, (String)
>> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
>> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
>> [code=1048, state=23000]
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>>
>> at
>> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>>
>> at
>> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>>
>> at
>> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>>
>> ... 31 more
>>
>> 2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR
>> org.apache.airavata.gfac.GFacException  - Error launching the Job
>>
>> org.apache.airavata.gfac.GFacException: Error while executing provider
>> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>>
>> at
>> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>>
>>

Re: Permission error at submitting Gaussian jobs to Airavata

Posted by "Pamidighantam, Sudhakar V" <sp...@illinois.edu>.
>From PGA it may be going to ogce login on Comet and I noticed here it is using scigap login which does not appear to be in gaussian user group.

Sudhakar.
On Aug 17, 2015, at 6:41 AM, DImuthu Upeksha <di...@gmail.com>> wrote:

Hi Sudhakar,

I'm using my user 'dimuthu' to submit the job. However from PGA I was able to submit using same user.

On Mon, Aug 17, 2015 at 4:34 PM, Pamidighantam, Sudhakar V <sp...@illinois.edu>> wrote:
Dimuthu:
Are you using ind123 for the account to submit the job on comet. Also scigap user need to be added to gaussian group on comet for this gaussian job to execute.

Thanks,
Sudhakar.
On Aug 17, 2015, at 5:54 AM, DImuthu Upeksha <di...@gmail.com>> wrote:

Hi all,

$subject please. What could be the reason for this? Hope the issue is with this

org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

Here is the full log
--------------------


2015-08-17 06:48:07,601 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:17,602 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:27,603 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:37,603 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:43,612 [pool-3-thread-3] INFO  org.apache.airavata.gfac.core.utils.GFacUtils  - This is a new Job, so creating all the experiment docs from the scratch

2015-08-17 06:48:43,679 [pool-3-thread-3] INFO  org.apache.airavata.gfac.core.utils.GFacUtils  - Created the node: /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/state successfully !

2015-08-17 06:48:43,692 [pool-3-thread-3] INFO  org.apache.airavata.gfac.server.GfacServerHandler  - -----------------------------------------------------92-----------------------------------------------------

2015-08-17 06:48:43,692 [pool-3-thread-3] INFO  org.apache.airavata.gfac.server.GfacServerHandler  - Id:dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 : GFac Received submit job request for the Experiment: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 TaskId: tempNode_56f41083-10be-4161-8803-ee1106bd3f54

2015-08-17 06:48:44,595 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:44,599 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: ACCEPTED

2015-08-17 06:48:44,790 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:44,790 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: INHANDLERSINVOKING

2015-08-17 06:48:44,882 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Invoking ApplicationDescriptorCheckHandler ...

2015-08-17 06:48:44,905 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Recoverable data is saving to zk: /oasis/scratch/comet/scigap/temp_project/airavata-workdirs,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr

2015-08-17 06:48:45,216 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Listing directory: comet.sdsc.edu<https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=FGL6ZmI_OkpYj1Eni_XxKlZi1e5pQjBPe9kPjA2WSZg&s=545Z-EukzmpIvn6p78NWm6KsDNSiogQ7fygwv1S2Kn0&e=>:~/

2015-08-17 06:48:45,424 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Re-using the same connection used with the connection string:scigapcomet.sdsc.edu22

2015-08-17 06:48:45,424 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Setup SSH job directorties

2015-08-17 06:48:45,441 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Successfully retrieved the Security Context

2015-08-17 06:48:45,441 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Creating directory: comet.sdsc.edu<https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=FGL6ZmI_OkpYj1Eni_XxKlZi1e5pQjBPe9kPjA2WSZg&s=545Z-EukzmpIvn6p78NWm6KsDNSiogQ7fygwv1S2Kn0&e=>:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:45,924 [pool-8-thread-56] ERROR org.apache.airavata.gfac.ssh.handler.AdvancedSCPInputHandler  - Previously stored data  is wrong so we continue the operations

2015-08-17 06:48:46,251 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering from:localhost:/home/airavata/oodt/archive/ghqcgrdl57hmhbhd37p11qqjnl/c4b4nhtwbs3.inp To:file://home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54

2015-08-17 06:48:47,604 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:48,263 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Successfully retrieved the Security Context

2015-08-17 06:48:48,265 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Invoking SCPInputHandler

2015-08-17 06:48:48,333 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file:////home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54/c4b4nhtwbs3.inp To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/c4b4nhtwbs3.inp

2015-08-17 06:48:49,125 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:49,125 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: INHANDLERSINVOKED

2015-08-17 06:48:49,199 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:49,200 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: PROVIDERINVOKING

2015-08-17 06:48:49,299 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Successfully retrieved the Security Context

2015-08-17 06:48:49,346 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Email list: gw77jobs@scigap.org<ma...@scigap.org>

2015-08-17 06:48:49,363 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - <ns:JobDescriptor xmlns:ns="http://airavata.apache.org/gsi/ssh/2012/12<ht...@scigap.org></ns:mailAddress><ns:acountString>sds128</ns:acountString><ns:maxWallTime>00:30:00</ns:maxWallTime><ns:standardOutFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout</ns:standardOutFile><ns:standardErrorFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr</ns:standardErrorFile><ns:outputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:outputDirectory><ns:inputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:inputDirectory><ns:nodes>1</ns:nodes><ns:processesPerNode>16</ns:processesPerNode><ns:cpuCount>16</ns:cpuCount><ns:workingDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:workingDirectory><ns:executablePath>/opt/gaussian/g09/g09</ns:executablePath><ns:inputs><ns:input>gaussian.out</ns:input></ns:inputs><ns:owner>scigap</ns:owner><ns:usedMem>100</ns:usedMem><ns:moduleLoadCommands><ns:command>module load gaussian</ns:command></ns:moduleLoadCommands><ns:callBackIp>149.165.228.42</ns:callBackIp><ns:callBackPort>8950</ns:callBackPort></ns:JobDescriptor>

2015-08-17 06:48:49,443 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:49,897 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing RawCommand : /usr/bin/sbatch /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:48:50,195 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput Returned:

2015-08-17 06:48:50,196 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError  Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:50,196 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:55,197 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured during job submission but doing a retry

2015-08-17 06:48:55,197 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:55,641 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing RawCommand : /usr/bin/sbatch /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:48:55,905 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput Returned:

2015-08-17 06:48:55,905 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError  Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:55,905 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:57,612 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:49:00,906 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured during job submission but doing a retry

2015-08-17 06:49:00,906 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,321 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing RawCommand : /usr/bin/sbatch /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:49:01,587 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput Returned:

2015-08-17 06:49:01,587 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError  Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:49:01,587 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:49:01,588 [pool-8-thread-56] ERROR org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Error submitting the job to host comet.sdsc.edu<https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=rr-z-ofxHOEMNG0MplQ8-M4XnN4pik8WDj_QJtcJ1U4&s=65JBaWpTv_6htucIuDqljdmiFGZnXKM4TYs8aVWQ9hM&e=> message: Error reading output of job submission

 StandardOutput:

 StandardError: sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:49:01,660 [pool-8-thread-56] ERROR org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource  - The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

<openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,664 [pool-8-thread-56] ERROR org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  - Error while adding job details...

org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,666 [pool-8-thread-56] ERROR org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl  - Error while adding JOB_DETAIL

org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:181)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,690 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error persisting job statusError while adding JOB_DETAIL

org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,691 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Saving data for future recovery:

2015-08-17 06:49:01,691 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  -

2015-08-17 06:49:01,721 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.provider.GFacProviderException  - Error persisting job statusError while adding JOB_DETAIL

org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,723 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,724 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: FAILED

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Experiment Failed, So removing the ZK entry for the experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Zookeeper experiment Path: /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,725 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error occured during updating the statuses of Experiments,tasks or Job statuses to failed, NullPointerException occurred because at this point there might not have Job Created

org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,726 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  - expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08: Updating workflow node status for tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED

2015-08-17 06:49:02,129 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:03,300 [pool-8-thread-56] INFO  org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  - Updating the experiment status of experiment: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED

2015-08-17 06:49:03,368 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:03,376 [pool-8-thread-56] INFO  org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  - Clean up task - Acknowledging delivery Tag - 93

2015-08-17 06:49:03,611 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error launching the Job

org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error inovoking the job with experiment ID: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:Error launching the Job

2015-08-17 06:49:03,761 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: FAILED

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Experiment Failed, So removing the ZK entry for the experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Zookeeper experiment Path: /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:04,152 [pool-8-thread-56] INFO  org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  - Id:tempNode_56f41083-10be-4161-8803-ee1106bd3f54 : Updated task tempNode_56f41083-10be-4161-8803-ee1106bd3f54 status to TaskStatus(executionState:FAILED, timeOfStateChange:1439808544014).

2015-08-17 06:49:04,153 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:04,154 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  - expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08: Updating workflow node status for tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED

2015-08-17 06:49:04,620 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:05,901 [pool-8-thread-56] INFO  org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  - Updating the experiment status of experiment: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED

2015-08-17 06:49:05,991 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:05,995 [pool-8-thread-56] ERROR org.apache.airavata.common.utils.AiravataZKUtils  - Cannot find delivery Tag in path:/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08-deliveryTag for this experiment

2015-08-17 06:49:05,997 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error launching the Job

org.apache.airavata.gfac.GFacException: Error launching the Job

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

... 5 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:05,998 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.utils.InputHandlerWorker  - org.apache.airavata.gfac.GFacException: Error launching the Job

org.apache.airavata.gfac.GFacException: org.apache.airavata.gfac.GFacException: Error launching the Job

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:200)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error launching the Job

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

... 4 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

... 5 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

Thanks
Dimuthu

--
Regards
W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering
University of Moratuwa, Sri Lanka




--
Regards
W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering
University of Moratuwa, Sri Lanka


Re: Permission error at submitting Gaussian jobs to Airavata

Posted by DImuthu Upeksha <di...@gmail.com>.
Hi Sudhakar,

I'm using my user 'dimuthu' to submit the job. However from PGA I was able
to submit using same user.

On Mon, Aug 17, 2015 at 4:34 PM, Pamidighantam, Sudhakar V <
spamidig@illinois.edu> wrote:

> Dimuthu:
> Are you using ind123 for the account to submit the job on comet. Also
> scigap user need to be added to gaussian group on comet for this gaussian
> job to execute.
>
> Thanks,
> Sudhakar.
> On Aug 17, 2015, at 5:54 AM, DImuthu Upeksha <di...@gmail.com>
> wrote:
>
> Hi all,
>
> $subject please. What could be the reason for this? Hope the issue is with
> this
>
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>
> Here is the full log
> --------------------
>
> 2015-08-17 06:48:07,601 [Thread-9] INFO
> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
> Monitor Map is empty, no need to retrieve emails
>
> 2015-08-17 06:48:17,602 [Thread-9] INFO
> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
> Monitor Map is empty, no need to retrieve emails
>
> 2015-08-17 06:48:27,603 [Thread-9] INFO
> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
> Monitor Map is empty, no need to retrieve emails
>
> 2015-08-17 06:48:37,603 [Thread-9] INFO
> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
> Monitor Map is empty, no need to retrieve emails
>
> 2015-08-17 06:48:43,612 [pool-3-thread-3] INFO
> org.apache.airavata.gfac.core.utils.GFacUtils  - This is a new Job, so
> creating all the experiment docs from the scratch
>
> 2015-08-17 06:48:43,679 [pool-3-thread-3] INFO
> org.apache.airavata.gfac.core.utils.GFacUtils  - Created the node:
> /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/state
> successfully !
>
> 2015-08-17 06:48:43,692 [pool-3-thread-3] INFO
> org.apache.airavata.gfac.server.GfacServerHandler  -
> -----------------------------------------------------92-----------------------------------------------------
>
> 2015-08-17 06:48:43,692 [pool-3-thread-3] INFO
> org.apache.airavata.gfac.server.GfacServerHandler  -
> Id:dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 : GFac
> Received submit job request for the Experiment:
> dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 TaskId:
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54
>
> 2015-08-17 06:48:44,595 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
> at this point
>
> 2015-08-17 06:48:44,599 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
> internal state changed to: ACCEPTED
>
> 2015-08-17 06:48:44,790 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
> at this point
>
> 2015-08-17 06:48:44,790 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
> internal state changed to: INHANDLERSINVOKING
>
> 2015-08-17 06:48:44,882 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Invoking
> ApplicationDescriptorCheckHandler ...
>
> 2015-08-17 06:48:44,905 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  -
> Recoverable data is saving to zk:
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr
>
> 2015-08-17 06:48:45,216 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Listing
> directory: comet.sdsc.edu:~/
>
> 2015-08-17 06:48:45,424 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Re-using the same
> connection used with the connection string:scigapcomet.sdsc.edu22
>
> 2015-08-17 06:48:45,424 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Setup SSH
> job directorties
>
> 2015-08-17 06:48:45,441 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  -
> Successfully retrieved the Security Context
>
> 2015-08-17 06:48:45,441 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Creating
> directory: comet.sdsc.edu
> :/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:48:45,924 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.ssh.handler.AdvancedSCPInputHandler  - Previously
> stored data  is wrong so we continue the operations
>
> 2015-08-17 06:48:46,251 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
> from:localhost:/home/airavata/oodt/archive/ghqcgrdl57hmhbhd37p11qqjnl/c4b4nhtwbs3.inp
> To:file://home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54
>
> 2015-08-17 06:48:47,604 [Thread-9] INFO
> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
> Monitor Map is empty, no need to retrieve emails
>
> 2015-08-17 06:48:48,263 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Successfully
> retrieved the Security Context
>
> 2015-08-17 06:48:48,265 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Invoking
> SCPInputHandler
>
> 2015-08-17 06:48:48,333 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
> file:////home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54/c4b4nhtwbs3.inp
> To:comet.sdsc.edu:
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/c4b4nhtwbs3.inp
>
> 2015-08-17 06:48:49,125 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
> at this point
>
> 2015-08-17 06:48:49,125 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
> internal state changed to: INHANDLERSINVOKED
>
> 2015-08-17 06:48:49,199 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
> at this point
>
> 2015-08-17 06:48:49,200 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
> internal state changed to: PROVIDERINVOKING
>
> 2015-08-17 06:48:49,299 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Successfully
> retrieved the Security Context
>
> 2015-08-17 06:48:49,346 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Email list:
> gw77jobs@scigap.org,jobnotif@scigap.org
>
> 2015-08-17 06:48:49,363 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - <ns:JobDescriptor
> xmlns:ns="http://airavata.apache.org/gsi/ssh/2012/12
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__airavata.apache.org_gsi_ssh_2012_12&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=rr-z-ofxHOEMNG0MplQ8-M4XnN4pik8WDj_QJtcJ1U4&s=-aj1AS2SM5acUrfV-jrQm_cHOdFuAZPHPxrR8EvElg8&e=>
> "><ns:userName>scigap</ns:userName><ns:shellName>/bin/bash</ns:shellName><ns:queueName>compute</ns:queueName><ns:jobName>A516147113</ns:jobName><ns:allEnvExport>true</ns:allEnvExport><ns:mailOptions>abe</ns:mailOptions><ns:mailAddress>
> gw77jobs@scigap.org,jobnotif@scigap.org</ns:mailAddress><ns:acountString>sds128</ns:acountString><ns:maxWallTime>00:30:00</ns:maxWallTime><ns:standardOutFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout</ns:standardOutFile><ns:standardErrorFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr</ns:standardErrorFile><ns:outputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:outputDirectory><ns:inputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:inputDirectory><ns:nodes>1</ns:nodes><ns:processesPerNode>16</ns:processesPerNode><ns:cpuCount>16</ns:cpuCount><ns:workingDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:workingDirectory><ns:executablePath>/opt/gaussian/g09/g09</ns:executablePath><ns:inputs><ns:input>gaussian.out</ns:input></ns:inputs><ns:owner>scigap</ns:owner><ns:usedMem>100</ns:usedMem><ns:moduleLoadCommands><ns:command>module
> load
> gaussian</ns:command></ns:moduleLoadCommands><ns:callBackIp>149.165.228.42</ns:callBackIp><ns:callBackPort>8950</ns:callBackPort></ns:JobDescriptor>
>
> 2015-08-17 06:48:49,443 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
> file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
> To:comet.sdsc.edu:
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:48:49,897 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
> RawCommand : /usr/bin/sbatch
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm
>
> 2015-08-17 06:48:50,195 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
> Returned:
>
> 2015-08-17 06:48:50,196 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
> Returned:sbatch: error: bank_limit plugin: expired user, can't submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:48:50,196 [pool-8-thread-56] ERROR
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:48:55,197 [pool-8-thread-56] ERROR
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured
> during job submission but doing a retry
>
> 2015-08-17 06:48:55,197 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
> file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
> To:comet.sdsc.edu:
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:48:55,641 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
> RawCommand : /usr/bin/sbatch
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm
>
> 2015-08-17 06:48:55,905 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
> Returned:
>
> 2015-08-17 06:48:55,905 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
> Returned:sbatch: error: bank_limit plugin: expired user, can't submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:48:55,905 [pool-8-thread-56] ERROR
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:48:57,612 [Thread-9] INFO
> org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job
> Monitor Map is empty, no need to retrieve emails
>
> 2015-08-17 06:49:00,906 [pool-8-thread-56] ERROR
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured
> during job submission but doing a retry
>
> 2015-08-17 06:49:00,906 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering
> file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm
> To:comet.sdsc.edu:
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:49:01,321 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing
> RawCommand : /usr/bin/sbatch
> /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm
>
> 2015-08-17 06:49:01,587 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput
> Returned:
>
> 2015-08-17 06:49:01,587 [pool-8-thread-56] INFO
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError
> Returned:sbatch: error: bank_limit plugin: expired user, can't submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:49:01,587 [pool-8-thread-56] ERROR
> org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error
> output : sbatch: error: bank_limit plugin: expired user, can't submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:49:01,588 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Error submitting
> the job to host comet.sdsc.edu
> <https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=rr-z-ofxHOEMNG0MplQ8-M4XnN4pik8WDj_QJtcJ1U4&s=65JBaWpTv_6htucIuDqljdmiFGZnXKM4TYs8aVWQ9hM&e=>
> message: Error reading output of job submission
>
>  StandardOutput:
>
>  StandardError: sbatch: error: bank_limit plugin: expired user, can't
> submit job
>
> sbatch: error: Batch job submission failed: Invalid account or
> account/partition combination specified
>
>
> 2015-08-17 06:49:01,660 [pool-8-thread-56] ERROR
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource  -
> The transaction has been rolled back.  See the nested exceptions for
> details on the errors that occurred.
>
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,664 [pool-8-thread-56] ERROR
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  -
> Error while adding job details...
>
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,666 [pool-8-thread-56] ERROR
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl  - Error
> while adding JOB_DETAIL
>
> org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:181)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,690 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.GFacException  - Error persisting job statusError
> while adding JOB_DETAIL
>
> org.apache.airavata.registry.cpi.RegistryException: Error while adding
> JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,691 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Saving data for
> future recovery:
>
> 2015-08-17 06:49:01,691 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  -
>
> 2015-08-17 06:49:01,721 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.provider.GFacProviderException  - Error
> persisting job statusError while adding JOB_DETAIL
>
> org.apache.airavata.gfac.GFacException: Error persisting job statusError
> while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,723 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.GFacException  - Error while executing provider
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>
> org.apache.airavata.gfac.core.provider.GFacProviderException: Error
> persisting job statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
> statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> ... 9 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,724 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
> at this point
>
> 2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
> internal state changed to: FAILED
>
> 2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
> Experiment Failed, So removing the ZK entry for the
> experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:49:01,724 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
> Zookeeper experiment Path:
> /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:49:01,725 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error occured during
> updating the statuses of Experiments,tasks or Job statuses to failed,
> NullPointerException occurred because at this point there might not have
> Job Created
>
> org.apache.airavata.gfac.GFacException: Error while executing provider
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
> Error persisting job statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> ... 8 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
> statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> ... 9 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:01,726 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  -
> expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:
> Updating workflow node status for
> tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED
>
> 2015-08-17 06:49:02,129 [pool-8-thread-56] INFO
> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
> Publishing status to rabbitmq...
>
> 2015-08-17 06:49:03,300 [pool-8-thread-56] INFO
> org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
> Updating the experiment status of experiment:
> dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED
>
> 2015-08-17 06:49:03,368 [pool-8-thread-56] INFO
> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
> Publishing status to rabbitmq...
>
> 2015-08-17 06:49:03,376 [pool-8-thread-56] INFO
> org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
> Clean up task - Acknowledging delivery Tag - 93
>
> 2015-08-17 06:49:03,611 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.GFacException  - Error while executing provider
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>
> org.apache.airavata.gfac.GFacException: Error while executing provider
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
> Error persisting job statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> ... 8 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
> statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> ... 9 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.GFacException  - Error launching the Job
>
> org.apache.airavata.gfac.GFacException: Error while executing provider
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.gfac.GFacException: Error while executing
> provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
> functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> ... 6 more
>
> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
> Error persisting job statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> ... 8 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
> statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> ... 9 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error inovoking the job
> with experiment ID:
> dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:Error
> launching the Job
>
> 2015-08-17 06:49:03,761 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created
> at this point
>
> 2015-08-17 06:49:03,761 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac
> internal state changed to: FAILED
>
> 2015-08-17 06:49:03,761 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
> Experiment Failed, So removing the ZK entry for the
> experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:49:03,761 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  -
> Zookeeper experiment Path:
> /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08
>
> 2015-08-17 06:49:04,152 [pool-8-thread-56] INFO
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  -
> Id:tempNode_56f41083-10be-4161-8803-ee1106bd3f54 : Updated task
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54 status to
> TaskStatus(executionState:FAILED, timeOfStateChange:1439808544014).
>
> 2015-08-17 06:49:04,153 [pool-8-thread-56] INFO
> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
> Publishing status to rabbitmq...
>
> 2015-08-17 06:49:04,154 [pool-8-thread-56] INFO
> org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  -
> expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:
> Updating workflow node status for
> tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED
>
> 2015-08-17 06:49:04,620 [pool-8-thread-56] INFO
> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
> Publishing status to rabbitmq...
>
> 2015-08-17 06:49:05,901 [pool-8-thread-56] INFO
> org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  -
> Updating the experiment status of experiment:
> dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED
>
> 2015-08-17 06:49:05,991 [pool-8-thread-56] INFO
> org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  -
> Publishing status to rabbitmq...
>
> 2015-08-17 06:49:05,995 [pool-8-thread-56] ERROR
> org.apache.airavata.common.utils.AiravataZKUtils  - Cannot find delivery
> Tag in
> path:/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08-deliveryTag
> for this experiment
>
> 2015-08-17 06:49:05,997 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.GFacException  - Error launching the Job
>
> org.apache.airavata.gfac.GFacException: Error launching the Job
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.gfac.GFacException: Error while executing
> provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
> functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> ... 5 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error while executing
> provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
> functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> ... 6 more
>
> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
> Error persisting job statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> ... 8 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
> statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> ... 9 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
>
> ... 31 more
>
> 2015-08-17 06:49:05,998 [pool-8-thread-56] ERROR
> org.apache.airavata.gfac.core.utils.InputHandlerWorker  -
> org.apache.airavata.gfac.GFacException: Error launching the Job
>
> org.apache.airavata.gfac.GFacException:
> org.apache.airavata.gfac.GFacException: Error launching the Job
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:200)
>
> at
> org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)
>
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
>
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Caused by: org.apache.airavata.gfac.GFacException: Error launching the Job
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)
>
> ... 4 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error while executing
> provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
> functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)
>
> ... 5 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error while executing
> provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider
> functionality.
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)
>
> ... 6 more
>
> Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException:
> Error persisting job statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)
>
> at
> org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)
>
> ... 8 more
>
> Caused by: org.apache.airavata.gfac.GFacException: Error persisting job
> statusError while adding JOB_DETAIL
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)
>
> at
> org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)
>
> ... 9 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while
> adding JOB_DETAIL
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)
>
> at
> org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)
>
> ... 10 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)
>
> ... 11 more
>
> Caused by: org.apache.airavata.registry.cpi.RegistryException:
> <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)
>
> at
> org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)
>
> ... 12 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.RollbackException: The transaction has been
> rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)
>
> at
> org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)
>
> ... 13 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: The transaction has
> been rolled back.  See the nested exceptions for details on the errors that
> occurred.
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at
> org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)
>
> at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)
>
> at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)
>
> at
> org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)
>
> at
> org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)
>
> at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)
>
> at
> org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)
>
> at
> org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)
>
> ... 14 more
>
> Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error>
> org.apache.openjpa.persistence.EntityExistsException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> FailedObject:
> org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff
>
> at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)
>
> at
> org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)
>
> at
> org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)
>
> at
> org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)
>
> at
> org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)
>
> at
> org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)
>
> at
> org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)
>
> ... 21 more
>
> Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column
> 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295
>
> INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,
>
>         CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)
>
>     VALUES (?, ?, ?, ?, ?, ?, ?)
>
> [params=(String) none, (String)
> tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp)
> 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]}
> [code=1048, state=23000]
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)
>
> at
> org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)
>
> at
> org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)
>
> at
> org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)
>
> at
> org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)
> ... 31 more
>
> Thanks
> Dimuthu
>
> --
> Regards
> W.Dimuthu Upeksha
> Undergraduate
> Department of Computer Science And Engineering
> University of Moratuwa, Sri Lanka
>
>
>


-- 
Regards

W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering

University of Moratuwa, Sri Lanka

Re: Permission error at submitting Gaussian jobs to Airavata

Posted by "Pamidighantam, Sudhakar V" <sp...@illinois.edu>.
Dimuthu:
Are you using ind123 for the account to submit the job on comet. Also scigap user need to be added to gaussian group on comet for this gaussian job to execute.

Thanks,
Sudhakar.
On Aug 17, 2015, at 5:54 AM, DImuthu Upeksha <di...@gmail.com>> wrote:

Hi all,

$subject please. What could be the reason for this? Hope the issue is with this

org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

Here is the full log
--------------------


2015-08-17 06:48:07,601 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:17,602 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:27,603 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:37,603 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:43,612 [pool-3-thread-3] INFO  org.apache.airavata.gfac.core.utils.GFacUtils  - This is a new Job, so creating all the experiment docs from the scratch

2015-08-17 06:48:43,679 [pool-3-thread-3] INFO  org.apache.airavata.gfac.core.utils.GFacUtils  - Created the node: /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/state successfully !

2015-08-17 06:48:43,692 [pool-3-thread-3] INFO  org.apache.airavata.gfac.server.GfacServerHandler  - -----------------------------------------------------92-----------------------------------------------------

2015-08-17 06:48:43,692 [pool-3-thread-3] INFO  org.apache.airavata.gfac.server.GfacServerHandler  - Id:dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 : GFac Received submit job request for the Experiment: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 TaskId: tempNode_56f41083-10be-4161-8803-ee1106bd3f54

2015-08-17 06:48:44,595 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:44,599 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: ACCEPTED

2015-08-17 06:48:44,790 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:44,790 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: INHANDLERSINVOKING

2015-08-17 06:48:44,882 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Invoking ApplicationDescriptorCheckHandler ...

2015-08-17 06:48:44,905 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.handler.AppDescriptorCheckHandler  - Recoverable data is saving to zk: /oasis/scratch/comet/scigap/temp_project/airavata-workdirs,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout,/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr

2015-08-17 06:48:45,216 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Listing directory: comet.sdsc.edu<http://comet.sdsc.edu>:~/

2015-08-17 06:48:45,424 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Re-using the same connection used with the connection string:scigapcomet.sdsc.edu22

2015-08-17 06:48:45,424 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Setup SSH job directorties

2015-08-17 06:48:45,441 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHDirectorySetupHandler  - Successfully retrieved the Security Context

2015-08-17 06:48:45,441 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Creating directory: comet.sdsc.edu<http://comet.sdsc.edu>:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:45,924 [pool-8-thread-56] ERROR org.apache.airavata.gfac.ssh.handler.AdvancedSCPInputHandler  - Previously stored data  is wrong so we continue the operations

2015-08-17 06:48:46,251 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering from:localhost:/home/airavata/oodt/archive/ghqcgrdl57hmhbhd37p11qqjnl/c4b4nhtwbs3.inp To:file://home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54

2015-08-17 06:48:47,604 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:48:48,263 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Successfully retrieved the Security Context

2015-08-17 06:48:48,265 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.handler.SSHInputHandler  - Invoking SCPInputHandler

2015-08-17 06:48:48,333 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file:////home/airavata/inputData/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/tempNode_56f41083-10be-4161-8803-ee1106bd3f54/c4b4nhtwbs3.inp To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/c4b4nhtwbs3.inp

2015-08-17 06:48:49,125 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:49,125 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: INHANDLERSINVOKED

2015-08-17 06:48:49,199 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:48:49,200 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: PROVIDERINVOKING

2015-08-17 06:48:49,299 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Successfully retrieved the Security Context

2015-08-17 06:48:49,346 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.util.GFACSSHUtils  - Email list: gw77jobs@scigap.org<ma...@scigap.org>

2015-08-17 06:48:49,363 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - <ns:JobDescriptor xmlns:ns="http://airavata.apache.org/gsi/ssh/2012/12<ht...@scigap.org></ns:mailAddress><ns:acountString>sds128</ns:acountString><ns:maxWallTime>00:30:00</ns:maxWallTime><ns:standardOutFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stdout</ns:standardOutFile><ns:standardErrorFile>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/Gaussian.stderr</ns:standardErrorFile><ns:outputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:outputDirectory><ns:inputDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:inputDirectory><ns:nodes>1</ns:nodes><ns:processesPerNode>16</ns:processesPerNode><ns:cpuCount>16</ns:cpuCount><ns:workingDirectory>/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08</ns:workingDirectory><ns:executablePath>/opt/gaussian/g09/g09</ns:executablePath><ns:inputs><ns:input>gaussian.out</ns:input></ns:inputs><ns:owner>scigap</ns:owner><ns:usedMem>100</ns:usedMem><ns:moduleLoadCommands><ns:command>module load gaussian</ns:command></ns:moduleLoadCommands><ns:callBackIp>149.165.228.42</ns:callBackIp><ns:callBackPort>8950</ns:callBackPort></ns:JobDescriptor>

2015-08-17 06:48:49,443 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm<file:///home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm> To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:49,897 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing RawCommand : /usr/bin/sbatch /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:48:50,195 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput Returned:

2015-08-17 06:48:50,196 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError  Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:50,196 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:55,197 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured during job submission but doing a retry

2015-08-17 06:48:55,197 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm<file:///home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm> To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:48:55,641 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing RawCommand : /usr/bin/sbatch /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:48:55,905 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput Returned:

2015-08-17 06:48:55,905 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError  Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:55,905 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:48:57,612 [Thread-9] INFO  org.apache.airavata.gfac.monitor.email.EmailBasedMonitor  - [EJM]: Job Monitor Map is empty, no need to retrieve emails

2015-08-17 06:49:00,906 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Error occured during job submission but doing a retry

2015-08-17 06:49:00,906 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Transfering file://home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm<file:///home/airavata/production-deployment/gfac-instance1/apache-airavata-server-0.15-SNAPSHOT/bin/1029102677.slurm> To:comet.sdsc.edu:/oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,321 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Executing RawCommand : /usr/bin/sbatch /oasis/scratch/comet/scigap/temp_project/airavata-workdirs/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08/1029102677.slurm

2015-08-17 06:49:01,587 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardOutput Returned:

2015-08-17 06:49:01,587 [pool-8-thread-56] INFO  org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - StandardError  Returned:sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:49:01,587 [pool-8-thread-56] ERROR org.apache.airavata.gsi.ssh.impl.GSISSHAbstractCluster  - Standard Error output : sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:49:01,588 [pool-8-thread-56] ERROR org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Error submitting the job to host comet.sdsc.edu<https://urldefense.proofpoint.com/v2/url?u=http-3A__comet.sdsc.edu&d=AwMFaQ&c=8hUWFZcy2Z-Za5rBPlktOQ&r=7_-LbDwTKOoIiO4P4OLfUTX6lSdjys9jh2AJ7sBl9ag&m=rr-z-ofxHOEMNG0MplQ8-M4XnN4pik8WDj_QJtcJ1U4&s=65JBaWpTv_6htucIuDqljdmiFGZnXKM4TYs8aVWQ9hM&e=> message: Error reading output of job submission

 StandardOutput:

 StandardError: sbatch: error: bank_limit plugin: expired user, can't submit job

sbatch: error: Batch job submission failed: Invalid account or account/partition combination specified


2015-08-17 06:49:01,660 [pool-8-thread-56] ERROR org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource  - The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

<openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,664 [pool-8-thread-56] ERROR org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  - Error while adding job details...

org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,666 [pool-8-thread-56] ERROR org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl  - Error while adding JOB_DETAIL

org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:181)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,690 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error persisting job statusError while adding JOB_DETAIL

org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,691 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  - Saving data for future recovery:

2015-08-17 06:49:01,691 [pool-8-thread-56] INFO  org.apache.airavata.gfac.ssh.provider.impl.SSHProvider  -

2015-08-17 06:49:01,721 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.provider.GFacProviderException  - Error persisting job statusError while adding JOB_DETAIL

org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,723 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,724 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: FAILED

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Experiment Failed, So removing the ZK entry for the experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,724 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Zookeeper experiment Path: /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:01,725 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error occured during updating the statuses of Experiments,tasks or Job statuses to failed, NullPointerException occurred because at this point there might not have Job Created

org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:01,726 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  - expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08: Updating workflow node status for tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED

2015-08-17 06:49:02,129 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:03,300 [pool-8-thread-56] INFO  org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  - Updating the experiment status of experiment: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED

2015-08-17 06:49:03,368 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:03,376 [pool-8-thread-56] INFO  org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  - Clean up task - Acknowledging delivery Tag - 93

2015-08-17 06:49:03,611 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error launching the Job

org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:03,692 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.cpi.BetterGfacImpl  - Error inovoking the job with experiment ID: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08:Error launching the Job

2015-08-17 06:49:03,761 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.monitor.MonitorID  - There is not job created at this point

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Gfac internal state changed to: FAILED

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Experiment Failed, So removing the ZK entry for the experimentdimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:03,761 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.GfacInternalStatusUpdator  - Zookeeper experiment Path: /gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08

2015-08-17 06:49:04,152 [pool-8-thread-56] INFO  org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry  - Id:tempNode_56f41083-10be-4161-8803-ee1106bd3f54 : Updated task tempNode_56f41083-10be-4161-8803-ee1106bd3f54 status to TaskStatus(executionState:FAILED, timeOfStateChange:1439808544014).

2015-08-17 06:49:04,153 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:04,154 [pool-8-thread-56] INFO  org.apache.airavata.gfac.core.monitor.AiravataWorkflowNodeStatusUpdator  - expId - dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08: Updating workflow node status for tempNode_20c62522-62c4-4342-81d8-9541dbf13862:FAILED

2015-08-17 06:49:04,620 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:05,901 [pool-8-thread-56] INFO  org.apache.airavata.api.server.listener.AiravataExperimentStatusUpdator  - Updating the experiment status of experiment: dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08 to FAILED

2015-08-17 06:49:05,991 [pool-8-thread-56] INFO  org.apache.airavata.messaging.core.impl.RabbitMQStatusPublisher  - Publishing status to rabbitmq...

2015-08-17 06:49:05,995 [pool-8-thread-56] ERROR org.apache.airavata.common.utils.AiravataZKUtils  - Cannot find delivery Tag in path:/gfac-experiments/gfac-node0/dimuthu_experiment_gau_11_6e6ffc70-5dd2-4a9f-94b6-8cd6e672ec08-deliveryTag for this experiment

2015-08-17 06:49:05,997 [pool-8-thread-56] ERROR org.apache.airavata.gfac.GFacException  - Error launching the Job

org.apache.airavata.gfac.GFacException: Error launching the Job

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

... 5 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

2015-08-17 06:49:05,998 [pool-8-thread-56] ERROR org.apache.airavata.gfac.core.utils.InputHandlerWorker  - org.apache.airavata.gfac.GFacException: Error launching the Job

org.apache.airavata.gfac.GFacException: org.apache.airavata.gfac.GFacException: Error launching the Job

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:200)

at org.apache.airavata.gfac.core.utils.InputHandlerWorker.run(InputHandlerWorker.java:47)

at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)

at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)

at java.lang.Thread.run(Thread.java:745)

Caused by: org.apache.airavata.gfac.GFacException: Error launching the Job

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:505)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:183)

... 4 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:743)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.submitJob(BetterGfacImpl.java:492)

... 5 more

Caused by: org.apache.airavata.gfac.GFacException: Error while executing provider org.apache.airavata.gfac.ssh.provider.impl.SSHProvider functionality.

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:844)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.invokeProviderExecute(BetterGfacImpl.java:753)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.launch(BetterGfacImpl.java:703)

... 6 more

Caused by: org.apache.airavata.gfac.core.provider.GFacProviderException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:231)

at org.apache.airavata.gfac.core.cpi.BetterGfacImpl.executeProvider(BetterGfacImpl.java:842)

... 8 more

Caused by: org.apache.airavata.gfac.GFacException: Error persisting job statusError while adding JOB_DETAIL

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:242)

at org.apache.airavata.gfac.ssh.provider.impl.SSHProvider.execute(SSHProvider.java:215)

... 9 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: Error while adding JOB_DETAIL

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:182)

at org.apache.airavata.gfac.core.utils.GFacUtils.saveJobStatus(GFacUtils.java:232)

... 10 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1231)

at org.apache.airavata.persistance.registry.jpa.impl.RegistryImpl.add(RegistryImpl.java:157)

... 11 more

Caused by: org.apache.airavata.registry.cpi.RegistryException: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:312)

at org.apache.airavata.persistance.registry.jpa.impl.ExperimentRegistry.addJobDetails(ExperimentRegistry.java:1203)

... 12 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.RollbackException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:594)

at org.apache.airavata.persistance.registry.jpa.resources.JobDetailResource.save(JobDetailResource.java:308)

... 13 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: The transaction has been rolled back.  See the nested exceptions for details on the errors that occurred.

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.kernel.BrokerImpl.newFlushException(BrokerImpl.java:2337)

at org.apache.openjpa.kernel.BrokerImpl.flush(BrokerImpl.java:2174)

at org.apache.openjpa.kernel.BrokerImpl.flushSafe(BrokerImpl.java:2072)

at org.apache.openjpa.kernel.BrokerImpl.beforeCompletion(BrokerImpl.java:1990)

at org.apache.openjpa.kernel.LocalManagedRuntime.commit(LocalManagedRuntime.java:81)

at org.apache.openjpa.kernel.BrokerImpl.commit(BrokerImpl.java:1514)

at org.apache.openjpa.kernel.DelegatingBroker.commit(DelegatingBroker.java:933)

at org.apache.openjpa.persistence.EntityManagerImpl.commit(EntityManagerImpl.java:570)

... 14 more

Caused by: <openjpa-2.2.0-r422266:1244990 fatal store error> org.apache.openjpa.persistence.EntityExistsException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

FailedObject: org.apache.airavata.persistance.registry.jpa.model.JobDetail@6f1d32ff

at org.apache.openjpa.jdbc.sql.DBDictionary.narrow(DBDictionary.java:4903)

at org.apache.openjpa.jdbc.sql.DBDictionary.newStoreException(DBDictionary.java:4878)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:136)

at org.apache.openjpa.jdbc.sql.SQLExceptions.getStore(SQLExceptions.java:78)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:143)

at org.apache.openjpa.jdbc.kernel.BatchingPreparedStatementManagerImpl.flushAndUpdate(BatchingPreparedStatementManagerImpl.java:79)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushInternal(PreparedStatementManagerImpl.java:99)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flush(PreparedStatementManagerImpl.java:87)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:550)

at org.apache.openjpa.jdbc.kernel.ConstraintUpdateManager.flush(ConstraintUpdateManager.java:106)

at org.apache.openjpa.jdbc.kernel.BatchingConstraintUpdateManager.flush(BatchingConstraintUpdateManager.java:59)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:103)

at org.apache.openjpa.jdbc.kernel.AbstractUpdateManager.flush(AbstractUpdateManager.java:76)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager.flush(JDBCStoreManager.java:713)

at org.apache.openjpa.kernel.DelegatingStoreManager.flush(DelegatingStoreManager.java:131)

... 21 more

Caused by: org.apache.openjpa.lib.jdbc.ReportingSQLException: Column 'JOB_DESCRIPTION' cannot be null {prepstmnt 1744538295

INSERT INTO JOB_DETAIL (JOB_ID, TASK_ID, COMPUTE_RESOURCE_CONSUMED,

        CREATION_TIME, JOB_DESCRIPTION, JOBNAME, WORKING_DIR)

    VALUES (?, ?, ?, ?, ?, ?, ?)

[params=(String) none, (String) tempNode_56f41083-10be-4161-8803-ee1106bd3f54, (null) null, (Timestamp) 2015-08-17 06:49:01.613, (null) null, (String) A516147113, (null) null]} [code=1048, state=23000]

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:247)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.wrap(LoggingConnectionDecorator.java:223)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator.access$1000(LoggingConnectionDecorator.java:72)

at org.apache.openjpa.lib.jdbc.LoggingConnectionDecorator$LoggingConnection$LoggingPreparedStatement.executeUpdate(LoggingConnectionDecorator.java:1162)

at org.apache.openjpa.lib.jdbc.DelegatingPreparedStatement.executeUpdate(DelegatingPreparedStatement.java:272)

at org.apache.openjpa.jdbc.kernel.JDBCStoreManager$CancelPreparedStatement.executeUpdate(JDBCStoreManager.java:1741)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.executeUpdate(PreparedStatementManagerImpl.java:267)

at org.apache.openjpa.jdbc.kernel.PreparedStatementManagerImpl.flushAndUpdate(PreparedStatementManagerImpl.java:118)

... 31 more

Thanks
Dimuthu

--
Regards
W.Dimuthu Upeksha
Undergraduate
Department of Computer Science And Engineering
University of Moratuwa, Sri Lanka