You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@airavata.apache.org by "Marcus Christie (JIRA)" <ji...@apache.org> on 2019/05/31 19:55:00 UTC
[jira] [Comment Edited] (AIRAVATA-3051) Output files configured
with wildcard is not brought back and displayed in the Django summary page.
[ https://issues.apache.org/jira/browse/AIRAVATA-3051?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16853372#comment-16853372 ]
Marcus Christie edited comment on AIRAVATA-3051 at 5/31/19 7:54 PM:
--------------------------------------------------------------------
I think Helix OutputDataStagingTask is setting the name to the full path instead of just the filename: https://github.com/apache/airavata/blob/develop/modules/airavata-helix/helix-spectator/src/main/java/org/apache/airavata/helix/impl/task/staging/OutputDataStagingTask.java#L148
And perhaps the transfer is failing?
I'm seeing this in the participant log
{noformat}
2019-05-30 07:13:11,779 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1f
c1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019
_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Loading context for task TASK_ad827006-d695-4284-a8d9-
ac4d8d93f7ff
2019-05-30 07:13:12,438 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1f
c1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019
_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task Workflow_of_process_PROCESS_c1fc1629-7bd5-41b9-8c
d0-dec05603c81a-POST-94c2c504-5cb2-452e-b4f7-e3bff0b56e7a_TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff_0 initialized
2019-05-30 07:13:12,471 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCES
S_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,
_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Starting output data staging task TASK_ad827006-d
695-4284-a8d9-ac4d8d93f7ff in experiment eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1
2019-05-30 07:13:12,472 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.impl.task.TaskContext process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_
1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - expId: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-
427c-9fb3-ccde9facd8f1, processId: PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a :- Process status changed STARTED -> OU
TPUT_DATA_STAGING
2019-05-30 07:13:12,734 [TaskStateModelFactory-task_thread-22] INFO n.s.s.transport.TransportImpl process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Client identity string: SSH-2.0-SSHJ_0.23.0
2019-05-30 07:13:12,776 [TaskStateModelFactory-task_thread-22] INFO n.s.s.transport.TransportImpl process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Server identity string: SSH-2.0-OpenSSH_5.3
2019-05-30 07:13:13,449 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.a.PoolingSSHJClient process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Fetching max sessions for the connection of mike.hpc.lsu.edu
2019-05-30 07:13:13,487 [TaskStateModelFactory-task_thread-22] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:13,885 [TaskStateModelFactory-task_thread-22] WARN o.a.a.h.a.PoolingSSHJClient process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Failed to fetch max session count for mike.hpc.lsu.edu. Continuing with default value 1. Permission denied
2019-05-30 07:13:13,923 [TaskStateModelFactory-task_thread-22] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:14,299 [TaskStateModelFactory-task_thread-22] WARN o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Ignoring the file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite.stderr transfer as it is not available
2019-05-30 07:13:14,299 [TaskStateModelFactory-task_thread-22] WARN o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - File eFindSite.stderr did not transfer
2019-05-30 07:13:14,299 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output data staging task TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff successfully completed
2019-05-30 07:13:14,338 [TaskStateModelFactory-task_thread-22] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting task specific monitoring nodes
2019-05-30 07:13:14,341 [TaskStateModelFactory-task_thread-22] INFO o.a.a.helix.core.AbstractTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff completed. Message : Output data staging task TASK_ad827006-d695-4284-a8d9-ac4d8d93f7ff successfully completed
2019-05-30 07:13:14,723 [TaskStateModelFactory-task_thread-11] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Loading context for task TASK_2a82e522-d19f-46f7-92ea-dc25f409f933
2019-05-30 07:13:15,340 [TaskStateModelFactory-task_thread-11] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task Workflow_of_process_PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a-POST-94c2c504-5cb2-452e-b4f7-e3bff0b56e7a_TASK_2a82e522-d19f-46f7-92ea-dc25f409f933_0 initialized
2019-05-30 07:13:15,365 [TaskStateModelFactory-task_thread-11] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Starting output data staging task TASK_2a82e522-d19f-46f7-92ea-dc25f409f933 in experiment eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1
2019-05-30 07:13:15,365 [TaskStateModelFactory-task_thread-11] INFO o.a.a.h.impl.task.TaskContext process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - expId: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, processId: PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a :- Process status changed STARTED -> OUTPUT_DATA_STAGING
2019-05-30 07:13:15,427 [TaskStateModelFactory-task_thread-11] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:15,802 [TaskStateModelFactory-task_thread-11] WARN o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Ignoring the file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite.stdout transfer as it is not available
2019-05-30 07:13:15,802 [TaskStateModelFactory-task_thread-11] WARN o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - File eFindSite.stdout did not transfer
2019-05-30 07:13:15,802 [TaskStateModelFactory-task_thread-11] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output data staging task TASK_2a82e522-d19f-46f7-92ea-dc25f409f933 successfully completed
2019-05-30 07:13:15,827 [TaskStateModelFactory-task_thread-11] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting task specific monitoring nodes
2019-05-30 07:13:15,829 [TaskStateModelFactory-task_thread-11] INFO o.a.a.helix.core.AbstractTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_2a82e522-d19f-46f7-92ea-dc25f409f933, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task TASK_2a82e522-d19f-46f7-92ea-dc25f409f933 completed. Message : Output data staging task TASK_2a82e522-d19f-46f7-92ea-dc25f409f933 successfully completed
2019-05-30 07:13:16,215 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Loading context for task TASK_0dc12ddc-1096-4202-8a87-a343e13adee6
2019-05-30 07:13:16,895 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task Workflow_of_process_PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a-POST-94c2c504-5cb2-452e-b4f7-e3bff0b56e7a_TASK_0dc12ddc-1096-4202-8a87-a343e13adee6_0 initialized
2019-05-30 07:13:16,920 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Starting output data staging task TASK_0dc12ddc-1096-4202-8a87-a343e13adee6 in experiment eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1
2019-05-30 07:13:16,920 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.impl.task.TaskContext process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - expId: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, processId: PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a :- Process status changed STARTED -> OUTPUT_DATA_STAGING
2019-05-30 07:13:16,982 [TaskStateModelFactory-task_thread-23] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:17,362 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Downloading output file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite.tar.gz to the local path /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite.tar.gz
2019-05-30 07:13:17,861 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output file downloaded to /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite.tar.gz
2019-05-30 07:13:17,862 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Uploading the output file to /var/www/portals/gateway-user-data/django-csbglsu/eabeysiniu.edu/Default_Project/eFindSite_on_May_30_2019_138_AM/eFindSite.tar.gz from local path /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite.tar.gz
2019-05-30 07:13:17,875 [TaskStateModelFactory-task_thread-23] INFO n.s.s.transport.TransportImpl process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Client identity string: SSH-2.0-SSHJ_0.23.0
2019-05-30 07:13:17,898 [TaskStateModelFactory-task_thread-23] INFO n.s.s.transport.TransportImpl process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Server identity string: SSH-2.0-OpenSSH_6.6.1
2019-05-30 07:13:18,028 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.a.PoolingSSHJClient process=PROCESS_c1fc16
29-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:
38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Fetching max sessions for the connection of pgadev.scigap
.org
2019-05-30 07:13:18,223 [TaskStateModelFactory-task_thread-23] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc162
9-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_1:3
8_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:18,292 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_
1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output file uploaded to /var/www/portals/gateway-user-d
ata/django-csbglsu/eabeysiniu.edu/Default_Project/eFindSite_on_May_30_2019_138_AM/eFindSite.tar.gz
2019-05-30 07:13:18,292 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_
1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting temporary file /tmp/PROCESS_c1fc1629-7bd5-41b9
-8cd0-dec05603c81a/temp_inputs/eFindSite.tar.gz
2019-05-30 07:13:18,671 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1f
c1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019
_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output data staging task TASK_0dc12ddc-1096-4202-8a87-
a343e13adee6 successfully completed
2019-05-30 07:13:18,694 [TaskStateModelFactory-task_thread-23] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1f
c1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019
_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting task specific monitoring nodes
2019-05-30 07:13:18,696 [TaskStateModelFactory-task_thread-23] INFO o.a.a.helix.core.AbstractTask process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_0dc12ddc-1096-4202-8a87-a343e13adee6, experiment=eFindSite_on_May_30,_2019_
1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task TASK_0dc12ddc-1096-4202-8a87-a343e13adee6 complete
d. Message : Output data staging task TASK_0dc12ddc-1096-4202-8a87-a343e13adee6 successfully completed
2019-05-30 07:13:19,175 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_
1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Loading context for task TASK_6e4300d5-9692-4b24-b692-5
248bbd8a9c5
2019-05-30 07:13:19,803 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc
1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_
1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task Workflow_of_process_PROCESS_c1fc1629-7bd5-41b9-8cd
0-dec05603c81a-POST-94c2c504-5cb2-452e-b4f7-e3bff0b56e7a_TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5_0 initialized
2019-05-30 07:13:19,857 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS
_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_
2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Starting output data staging task TASK_6e4300d5-96
92-4b24-b692-5248bbd8a9c5 in experiment eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1
2019-05-30 07:13:19,857 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.impl.task.TaskContext process=PROCESS_c1fc1
629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1
:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - expId: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-4
27c-9fb3-ccde9facd8f1, processId: PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a :- Process status changed STARTED -> OUT
PUT_DATA_STAGING
2019-05-30 07:13:19,881 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS
_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_
2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Handling output files with *.tar.gz extension for
task TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5
2019-05-30 07:13:19,920 [TaskStateModelFactory-task_thread-2] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629
-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38
_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:20,573 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS
_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_
2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Transferring file /scratch/michal/airavata-workdir
s/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite-screen.tar.gz
2019-05-30 07:13:20,611 [TaskStateModelFactory-task_thread-2] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629
-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38
_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:20,988 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1
629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1
:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Ignoring the file /scratch/michal/airavata-workdirs/PROC
ESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a//scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a
/eFindSite-screen.tar.gz transfer as it is not available
2019-05-30 07:13:20,989 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - File /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite-screen.tar.gz did not transfer
2019-05-30 07:13:21,111 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS
_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_
2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Transferring file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite.tar.gz
2019-05-30 07:13:21,149 [TaskStateModelFactory-task_thread-2] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:21,526 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Ignoring the file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a//scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite.tar.gz transfer as it is not available
2019-05-30 07:13:21,527 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - File /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite.tar.gz did not transfer
2019-05-30 07:13:21,585 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Transferring file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite-visual.tar.gz
2019-05-30 07:13:21,623 [TaskStateModelFactory-task_thread-2] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:21,999 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Ignoring the file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a//scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite-visual.tar.gz transfer as it is not available
2019-05-30 07:13:22,000 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - File /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite-visual.tar.gz did not transfer
2019-05-30 07:13:22,045 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Transferring file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/A1249910229.tar.gz
2019-05-30 07:13:22,083 [TaskStateModelFactory-task_thread-2] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:22,457 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Ignoring the file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a//scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/A1249910229.tar.gz transfer as it is not available
2019-05-30 07:13:22,457 [TaskStateModelFactory-task_thread-2] WARN o.a.a.h.i.t.s.OutputDataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - File /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/A1249910229.tar.gz did not transfer
2019-05-30 07:13:22,457 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output data staging task TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5 successfully completed
2019-05-30 07:13:22,496 [TaskStateModelFactory-task_thread-2] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting task specific monitoring nodes
2019-05-30 07:13:22,498 [TaskStateModelFactory-task_thread-2] INFO o.a.a.helix.core.AbstractTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5 completed. Message : Output data staging task TASK_6e4300d5-9692-4b24-b692-5248bbd8a9c5 successfully completed
2019-05-30 07:13:22,913 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Loading context for task TASK_df9bc726-8877-4c1e-a624-6e2521b99a61
2019-05-30 07:13:23,545 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task Workflow_of_process_PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a-POST-94c2c504-5cb2-452e-b4f7-e3bff0b56e7a_TASK_df9bc726-8877-4c1e-a624-6e2521b99a61_0 initialized
2019-05-30 07:13:23,597 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.impl.task.TaskContext process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - expId: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, processId: PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a :- Process status changed STARTED -> OUTPUT_DATA_STAGING
2019-05-30 07:13:23,660 [TaskStateModelFactory-task_thread-24] INFO n.s.s.c.c.d.SessionChannel process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Will request `sftp` subsystem
2019-05-30 07:13:24,057 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Downloading output file /scratch/michal/airavata-workdirs/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/eFindSite-visual.tar.gz to the local path /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite-visual.tar.gz
2019-05-30 07:13:24,662 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output file downloaded to /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite-visual.tar.gz
2019-05-30 07:13:24,662 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Uploading the output file to /var/www/portals/gateway-user-data/django-csbglsu/eabeysiniu.edu/Default_Project/eFindSite_on_May_30_2019_138_AM/eFindSite-visual.tar.gz from local path /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite-visual.tar.gz
2019-05-30 07:13:24,708 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output file uploaded to /var/www/portals/gateway-user-data/django-csbglsu/eabeysiniu.edu/Default_Project/eFindSite_on_May_30_2019_138_AM/eFindSite-visual.tar.gz
2019-05-30 07:13:24,708 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.i.t.s.DataStagingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting temporary file /tmp/PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a/temp_inputs/eFindSite-visual.tar.gz
2019-05-30 07:13:25,162 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Output data staging task TASK_df9bc726-8877-4c1e-a624-6e2521b99a61 successfully completed
2019-05-30 07:13:25,186 [TaskStateModelFactory-task_thread-24] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting task specific monitoring nodes
2019-05-30 07:13:25,188 [TaskStateModelFactory-task_thread-24] INFO o.a.a.helix.core.AbstractTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=TASK_df9bc726-8877-4c1e-a624-6e2521b99a61, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task TASK_df9bc726-8877-4c1e-a624-6e2521b99a61 completed. Message : Output data staging task TASK_df9bc726-8877-4c1e-a624-6e2521b99a61 successfully completed
2019-05-30 07:13:25,622 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Loading context for task Completing-Task
2019-05-30 07:13:26,305 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.impl.task.AiravataTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Task Workflow_of_process_PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a-POST-94c2c504-5cb2-452e-b4f7-e3bff0b56e7a_Completing-Task_0 initialized
2019-05-30 07:13:26,305 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.i.t.c.CompletingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Starting completing task for task Completing-Task, experiment id eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1
2019-05-30 07:13:26,305 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.i.t.c.CompletingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Process PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a successfully completed
2019-05-30 07:13:26,305 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.impl.task.TaskContext process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - expId: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, processId: PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a :- Process status changed STARTED -> COMPLETED
2019-05-30 07:13:26,336 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.i.t.c.CompletingTask process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting process level monitoring nodes
2019-05-30 07:13:26,340 [TaskStateModelFactory-task_thread-12] INFO o.a.a.h.c.util.MonitoringUtil process=PROCESS_c1fc1629-7bd5-41b9-8cd0-dec05603c81a, task=Completing-Task, experiment=eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1, gateway=csbglsu - Deleting zookeeper paths in job monitoring for job id : 1014680.mike3
...
{noformat}
was (Author: marcuschristie):
I think Helix OutputDataStagingTask is setting the name to the full path instead of just the filename: https://github.com/apache/airavata/blob/develop/modules/airavata-helix/helix-spectator/src/main/java/org/apache/airavata/helix/impl/task/staging/OutputDataStagingTask.java#L148
And perhaps the transfer is failing?
> Output files configured with wildcard is not brought back and displayed in the Django summary page.
> ---------------------------------------------------------------------------------------------------
>
> Key: AIRAVATA-3051
> URL: https://issues.apache.org/jira/browse/AIRAVATA-3051
> Project: Airavata
> Issue Type: Sub-task
> Components: Django Portal
> Affects Versions: 0.18
> Environment: https://beta-sciencegateway.brylinski.org
> Reporter: Eroma
> Assignee: Marcus Christie
> Priority: Major
> Attachments: Screen Shot 2019-05-30 at 8.40.01 AM.png, Screen Shot 2019-05-30 at 8.40.08 AM.png, Screen Shot 2019-05-30 at 8.42.46 AM.png
>
>
> # Submitted a job with an application where there are 5 output files.
> # The defined outputs are STDERR. STDOUT and two specifically defined (full output file name given) tar files and another tar file defined with wildcard (*.tar)
> # The job was successfully completed and all the files are available in the working directory.
> # In the PGA storage only the files which the defined with the complete name was brought back.
> # STDOUT, STDERR and the wild card output file is not in the storage.
> # Hence they are not displayed and downloadable in the summary page.
> # Apart from this in output section of the summary page there are paths given to all the .tar files as a string.
> # Please see all the images attached to this.
> # exp ID: eFindSite_on_May_30,_2019_1:38_AM_85ab2ab9-a1c0-427c-9fb3-ccde9facd8f1
> h5. TODO
> * [ ] Don't display an experiment output entry when the type if URI but the value is not a data product URI
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)