[jira] [Created] (BIGTOP-2454) hadoop-client role requires common_yarn

["Kevin W Monroe (JIRA)" <ji...@apache.org>]

Kevin W Monroe created BIGTOP-2454:
--------------------------------------

             Summary: hadoop-client role requires common_yarn
                 Key: BIGTOP-2454
                 URL: https://issues.apache.org/jira/browse/BIGTOP-2454
             Project: Bigtop
          Issue Type: Bug
          Components: deployment
    Affects Versions: 1.1.0
            Reporter: Kevin W Monroe
            Priority: Minor


When deploying a standalone hadoop-client role, yarn-site.xml needs to be populated to support submitting jobs to yarn.  Configure site.yaml like this:

'bigtop::roles_enabled': true
'bigtop::roles': hadoop-client

Trigger a puppet apply, and notice the empty yarn-site.xml:

http://paste.ubuntu.com/16640333/

When you try to run a sample job, e.g. teragen, it will fail like this:

hdfs@machine-5:~$ hadoop jar ${HADOOP_MAPRED_HOME}/hadoop-mapreduce-examples-*.jar teragen 1000 /tmp/ass
16/05/23 18:28:46 INFO client.RMProxy: Connecting to ResourceManager at /0.0.0.0:8032
16/05/23 18:28:48 INFO ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8032. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=10, sleepTime=1000 MILLISECONDS)

A simple solution is to add common_yarn to the client class so that /etc/hadoop/conf/yarn-site.xml is populated with yarn details.  I'll submit a patch for this soon.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)