You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airavata.apache.org by ma...@apache.org on 2022/03/21 13:35:48 UTC
[airavata] branch master updated (e278f82 -> b89f62b)
This is an automated email from the ASF dual-hosted git repository.
machristie pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/airavata.git.
from e278f82 Ansible: update/downgrade zabbix agent to 4.0.x
add 8682af7 AIRAVATA-3549 Thrift stubs generated for fetchExperimentOutputs
add cef65af Supporting intermediate transfers at helix level
add 5ef1a8a AIRAVATA-3549 Initial API/Orch changes for fetching intermediate outputs
add 88cb8a9 Fixing the bug in deserializing intermediate output event
add 41b67ac Making task context load on demand
add 75393b3 Adding a parent process id field to fetch intermediate outputs as they are bound to parent process data path
add feb31ac Fine grained state publish mechanism for helix tasks
add e66474b Minor enhancement
add 4a1cf0d AIRAVATA-3549 Regenerated thrift stubs - removing parentProcessId
add d469bf2 AIRAVATA-3549 Derive the parent process for intermediate output fetching process
add f8cf01d AIRAVATA-3549 API validation that experiment is executing and there aren't already executing intermediate output tasks
add c33e041 AIRAVATA-3549 Orch: update intermediate output fetching process to FAILED if fails to launch
add 1dea824 AIRAVATA-3549 Add method to check on status of intermediate output fetching
add 139d5e4 Fixing the issue of standard out and error files are not getting registered
add 7d9f844 AIRAVATA-3549 Add intermediate output methods for all users
add dc032bd AIRAVATA-3549 When fetching intermediate URI_COLLECTION, update process output with data product URIs
add 04a480c AIRAVATA-3549 Add CompletingTask to get COMPLETED status on intermediate output fetching process
add d716ad9 AIRAVATA-3549 code simplification, relying on final COMPLETED process status
add d406823 AIRAVATA-3549 Allow users with READ access to get intermediate output status
add 10156e6 AIRAVATA-3549 Only allow fetching intermediate outputs when job itself is ACTIVE
new b89f62b Merge pull request #276 from apache/AIRAVATA-3549
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../api/server/handler/AiravataServerHandler.java | 152 +
.../java/org/apache/airavata/api/Airavata.java | 9875 +++++++++++++-------
...ava => ExperimentIntermediateOutputsEvent.java} | 331 +-
.../model/messaging/event/MessageType.java | 5 +-
.../service/security/KeyCloakSecurityManager.java | 5 +-
.../airavata/helix/impl/task/AiravataTask.java | 127 +-
.../airavata/helix/impl/task/TaskContext.java | 385 +-
.../helix/impl/task/staging/DataStagingTask.java | 30 +-
.../impl/task/staging/OutputDataStagingTask.java | 2 +
.../task/submission/DefaultJobSubmissionTask.java | 6 +-
.../task/submission/config/GroovyMapBuilder.java | 5 +-
.../helix/impl/workflow/PostWorkflowManager.java | 6 +-
.../helix/impl/workflow/PreWorkflowManager.java | 38 +-
.../apache/airavata/common/utils/ThriftUtils.java | 1 +
.../messaging/core/impl/ExperimentConsumer.java | 33 +-
.../cpi/impl/SimpleOrchestratorImpl.java | 94 +-
.../server/OrchestratorServerHandler.java | 126 +-
.../orchestrator/util/OrchestratorUtils.java | 33 +-
.../airavata-apis/airavata_api.thrift | 42 +
.../airavata-apis/messaging_events.thrift | 9 +-
20 files changed, 7635 insertions(+), 3670 deletions(-)
copy airavata-api/airavata-data-models/src/main/java/org/apache/airavata/model/messaging/event/{ExperimentStatusChangeEvent.java => ExperimentIntermediateOutputsEvent.java} (66%)
[airavata] 01/01: Merge pull request #276 from apache/AIRAVATA-3549
Posted by ma...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
machristie pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airavata.git
commit b89f62b017203aa7057a1b57ea1ad3d03002449c
Merge: e278f82 10156e6
Author: Marcus Christie <ma...@apache.org>
AuthorDate: Mon Mar 21 09:35:43 2022 -0400
Merge pull request #276 from apache/AIRAVATA-3549
Fetching intermediate outputs for an running experiment
.../api/server/handler/AiravataServerHandler.java | 152 +
.../java/org/apache/airavata/api/Airavata.java | 9875 +++++++++++++-------
.../event/ExperimentIntermediateOutputsEvent.java | 629 ++
.../model/messaging/event/MessageType.java | 5 +-
.../service/security/KeyCloakSecurityManager.java | 5 +-
.../airavata/helix/impl/task/AiravataTask.java | 127 +-
.../airavata/helix/impl/task/TaskContext.java | 385 +-
.../helix/impl/task/staging/DataStagingTask.java | 30 +-
.../impl/task/staging/OutputDataStagingTask.java | 2 +
.../task/submission/DefaultJobSubmissionTask.java | 6 +-
.../task/submission/config/GroovyMapBuilder.java | 5 +-
.../helix/impl/workflow/PostWorkflowManager.java | 6 +-
.../helix/impl/workflow/PreWorkflowManager.java | 38 +-
.../apache/airavata/common/utils/ThriftUtils.java | 1 +
.../messaging/core/impl/ExperimentConsumer.java | 33 +-
.../cpi/impl/SimpleOrchestratorImpl.java | 94 +-
.../server/OrchestratorServerHandler.java | 126 +-
.../orchestrator/util/OrchestratorUtils.java | 33 +-
.../airavata-apis/airavata_api.thrift | 42 +
.../airavata-apis/messaging_events.thrift | 9 +-
20 files changed, 8080 insertions(+), 3523 deletions(-)