You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amaterasu.apache.org by ey...@apache.org on 2018/01/25 10:22:22 UTC
[incubator-amaterasu] branch master updated (0f0b0ae -> 2fb1762)
This is an automated email from the ASF dual-hosted git repository.
eyalb pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git.
from 0f0b0ae Merge pull request #2 from kirupagaran/AMATERASU-13
add 6b9cd28 dynamically resolving spark driver host
add 0699a60 framework files are distributed to containers
add 98f31e4 fixed container resources
add 9fc6574 fixed spark.yarn.jars
add 394d079 framework files are distributed to containers
add b27ec27 fixed container resources
add 7ef35e4 fixed spark.yarn.jars
add 42b4e01 Merge branch 'AMATERASU-17' of github.com:roadan/incubator-amaterasu into AMATERASU-17
new 2fb1762 Merge pull request #5 from roadan/AMATERASU-17
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../common/configuration/ClusterConfig.scala | 4 +-
.../apache/amaterasu/common/utils/FileUtils.scala | 12 ++++++
.../common/executors/ProvidersFactory.scala | 5 ++-
.../runners/spark/SparkRunnersProvider.scala | 5 ++-
.../executor/mesos/executors/ActionsExecutor.scala | 5 ++-
.../executor/yarn/executors/ActionsExecutor.scala | 7 +++-
.../runners/spark/SparkRunnerHelper.scala | 19 +++++----
leader/build.gradle | 8 +++-
.../org/apache/amaterasu/leader/yarn/Client.java | 27 ++++++++++++-
.../apache/amaterasu/leader/dsl/JobParser.scala | 13 ++++++-
.../amaterasu/leader/execution/JobManager.scala | 38 +++++-------------
.../frameworks/FrameworkProvidersFactory.scala | 45 ++++++++++++++++++++++
.../frameworks/spark/SparkSetupProvider.scala | 35 +++++++++++++++++
.../amaterasu/leader/yarn/ApplicationMaster.scala | 45 +++++++++++++++++-----
leader/src/main/scripts/ama-start-yarn.sh | 6 +--
leader/src/main/scripts/log4j.properties | 4 +-
.../amaterasu/sdk/FrameworkSetupProvider.java | 17 ++++++++
.../org/apache/amaterasu/sdk/RunnersProvider.java | 3 +-
18 files changed, 234 insertions(+), 64 deletions(-)
create mode 100644 common/src/main/scala/org/apache/amaterasu/common/utils/FileUtils.scala
create mode 100644 leader/src/main/scala/org/apache/amaterasu/leader/execution/frameworks/FrameworkProvidersFactory.scala
create mode 100644 leader/src/main/scala/org/apache/amaterasu/leader/frameworks/spark/SparkSetupProvider.scala
create mode 100644 sdk/src/main/java/org/apache/amaterasu/sdk/FrameworkSetupProvider.java
--
To stop receiving notification emails like this one, please contact
eyalb@apache.org.
[incubator-amaterasu] 01/01: Merge pull request #5 from
roadan/AMATERASU-17
Posted by ey...@apache.org.
This is an automated email from the ASF dual-hosted git repository.
eyalb pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/incubator-amaterasu.git
commit 2fb176204fb6d5e3a561c3412252b1874d72347d
Merge: 0f0b0ae 42b4e01
Author: Eyal Ben Ivri <ey...@gmail.com>
AuthorDate: Thu Jan 25 11:22:20 2018 +0100
Merge pull request #5 from roadan/AMATERASU-17
Amaterasu 17
.../common/configuration/ClusterConfig.scala | 4 +-
.../apache/amaterasu/common/utils/FileUtils.scala | 12 ++++++
.../common/executors/ProvidersFactory.scala | 5 ++-
.../runners/spark/SparkRunnersProvider.scala | 5 ++-
.../executor/mesos/executors/ActionsExecutor.scala | 5 ++-
.../executor/yarn/executors/ActionsExecutor.scala | 7 +++-
.../runners/spark/SparkRunnerHelper.scala | 19 +++++----
leader/build.gradle | 8 +++-
.../org/apache/amaterasu/leader/yarn/Client.java | 27 ++++++++++++-
.../apache/amaterasu/leader/dsl/JobParser.scala | 13 ++++++-
.../amaterasu/leader/execution/JobManager.scala | 38 +++++-------------
.../frameworks/FrameworkProvidersFactory.scala | 45 ++++++++++++++++++++++
.../frameworks/spark/SparkSetupProvider.scala | 35 +++++++++++++++++
.../amaterasu/leader/yarn/ApplicationMaster.scala | 45 +++++++++++++++++-----
leader/src/main/scripts/ama-start-yarn.sh | 6 +--
leader/src/main/scripts/log4j.properties | 4 +-
.../amaterasu/sdk/FrameworkSetupProvider.java | 17 ++++++++
.../org/apache/amaterasu/sdk/RunnersProvider.java | 3 +-
18 files changed, 234 insertions(+), 64 deletions(-)
--
To stop receiving notification emails like this one, please contact
eyalb@apache.org.