You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Yesha Vora (JIRA)" <ji...@apache.org> on 2018/10/18 21:46:00 UTC
[jira] [Created] (YARN-8913) Add helper scripts to launch MaWo App
to run Hadoop unit tests on Hadoop Cluster
Yesha Vora created YARN-8913:
--------------------------------
Summary: Add helper scripts to launch MaWo App to run Hadoop unit tests on Hadoop Cluster
Key: YARN-8913
URL: https://issues.apache.org/jira/browse/YARN-8913
Project: Hadoop YARN
Issue Type: Sub-task
Reporter: Yesha Vora
MaWo application can be used to run Hadoop UT faster in a Hadoop cluster.
Develop helper scripts to orchestrate end-to-end workflow for running Hadoop UT using MaWo app.
Pre-requisite:
* A Hadoop Cluster with HDFS and YARN installed
* Enable Docker on YARN feature
Helper-scripts
* MaWo_Driver
** create a docker image with latest hadoop source code
** create payload to MaWo app (This is input to mawo app where Each MaWo Task = UT execution of each Hadoop Module)
** Upload payload file to HDFS
** Update MaWo-Launch.json to resolve RM_HOST / Docker Image etc dynamically
** Launch MaWo app in Hadoop cluster
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org