[jira] Resolved: (HBASE-2009) [EC2] support mapreduce subsystem

["Andrew Purtell (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HBASE-2009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Andrew Purtell resolved HBASE-2009.
-----------------------------------

    Resolution: Fixed

Committed to trunk and 0.20 branch. Changes:

* Add master and region server opts independently to hbase-env.sh
** Modify GC flags to Ryan's recommendations
** Enable GC logging

* Split Hadoop config into core, hdfs, and mapred-site.xml

* Configure mapreduce and start jobtracker and tasktrackers

* Silence sysctl warning

* Add hbase jars and conf dir to Hadoop classpath

* Use port 8020 for HDFS and 8021 for jobtracker



> [EC2] support mapreduce subsystem
> ---------------------------------
>
>                 Key: HBASE-2009
>                 URL: https://issues.apache.org/jira/browse/HBASE-2009
>             Project: Hadoop HBase
>          Issue Type: Sub-task
>            Reporter: Andrew Purtell
>            Assignee: Andrew Purtell
>            Priority: Minor
>             Fix For: 0.20.3, 0.21.0
>
>         Attachments: HBASE-2009.patch
>
>
> Feedback up on hbase-user@ from Naresh Rapolu:
> {quote}
>     Your scripts are working fine. We restarted everything and tested, and they are working fine. A few issues though :
>         * While starting, launch-hbase-cluster gives the following error.
>           error: "fs.epoll.max_user_instance" is an unknown key. It occurs during starting zookeeper instances.
>         * We needed MapReduce along with HBase. The note on the JIRA page that you only need to add only two lines in hbase-ec2-env.sh is insufficient.
>           The following changes need to be made.
>           1. hbase-ec2-env.sh should write mapred.job.tracker property into hadoop-site.xml ( Also shouldnt you be having core-site.xml and hdfs-site.xml as it is hadoop-0.20.1 ??? Infact because of this , there are warning messages all over the place when you are using hdfs through command line ).
>           2. HADOOP_CLASSPATH in hadoop/conf/hadoop-env.sh needs to be changed in the underlying AMI, to include hbase, zookeeper jars and conf directory. Probably you can modify the public AMI, and recreate the bundle as the paths to these are known apriori. 3. For other users, the following three lines should be added in hbase-ec2-env.sh
>           For master:
>           "$HADOOP_HOME"/bin/hadoop-daemon.sh start jobtracker
>           "$HADOOP_HOME"/bin/hadoop-daemon.sh start tasktracker
>           For slave:
>           "$HADOOP_HOME"/bin/hadoop-daemon.sh start tasktracker.
> {quote}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.