You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@trafodion.apache.org by db...@apache.org on 2017/03/23 21:31:26 UTC
[44/51] [partial] incubator-trafodion-site git commit:
[TRAFODION-2398] PR 1021 Fix messages 1111-1145
http://git-wip-us.apache.org/repos/asf/incubator-trafodion-site/blob/4306be5d/docs/2.1.0/provisioning_guide/index.html
----------------------------------------------------------------------
diff --git a/docs/2.1.0/provisioning_guide/index.html b/docs/2.1.0/provisioning_guide/index.html
index a5bbfa9..ba0ad17 100644
--- a/docs/2.1.0/provisioning_guide/index.html
+++ b/docs/2.1.0/provisioning_guide/index.html
@@ -553,12 +553,14 @@ table.CodeRay td.code>pre{padding:0}
<li><a href="#quickstart">2. Quick Start</a>
<ul class="sectlevel2">
<li><a href="#_download_binaries">2.1. Download Binaries</a></li>
-<li><a href="#quickstart-unpack-installer">2.2. Unpack Installer and Server package</a></li>
+<li><a href="#quickstart-unpack-installer">2.2. Unpack Installer</a></li>
<li><a href="#quickstart-collect-information">2.3. Collect Information</a>
<ul class="sectlevel3">
-<li><a href="#_java_location">2.3.1. Java Location</a></li>
-<li><a href="#_data_nodes">2.3.2. Data Nodes</a></li>
-<li><a href="#_distribution_manager_url">2.3.3. Distribution Manager URL</a></li>
+<li><a href="#_location_of_trafodion_server_side_binary">2.3.1. Location of Trafodion Server-Side Binary</a></li>
+<li><a href="#_java_location">2.3.2. Java Location</a></li>
+<li><a href="#_data_nodes">2.3.3. Data Nodes</a></li>
+<li><a href="#_trafodion_runtime_user_home_directory">2.3.4. Trafodion Runtime User Home Directory</a></li>
+<li><a href="#_distribution_manager_url">2.3.5. Distribution Manager URL</a></li>
</ul>
</li>
<li><a href="#quickstart-run-installer">2.4. Run Installer</a></li>
@@ -602,11 +604,19 @@ table.CodeRay td.code>pre{padding:0}
<li><a href="#requirements-trafodion-provisioning-user">4.3.2. Trafodion Provisioning User</a></li>
</ul>
</li>
-<li><a href="#_recommended_configuration_changes">4.4. Recommended Configuration Changes</a>
+<li><a href="#requirements-required-configuration-changes">4.4. Required Configuration Changes</a>
<ul class="sectlevel3">
-<li><a href="#requirements-recommended-security-changes">4.4.1. Recommended Security Changes</a></li>
-<li><a href="#requirements-recommended-hdfs-configuration-changes">4.4.2. Recommended HDFS Configuration Changes</a></li>
-<li><a href="#requirements-recommended-hbase-configuration-changes">4.4.3. Recommended HBase Configuration Changes</a></li>
+<li><a href="#requirements-operating-system-changes">4.4.1. Operating System Changes</a></li>
+<li><a href="#requirements-zookeeper-changes">4.4.2. ZooKeeper Changes</a></li>
+<li><a href="#requirements-hdfs-changes">4.4.3. HDFS Changes</a></li>
+<li><a href="#requirements-hbase-changes">4.4.4. HBase Changes</a></li>
+</ul>
+</li>
+<li><a href="#requirements-recommended-configuration-changes">4.5. Recommended Configuration Changes</a>
+<ul class="sectlevel3">
+<li><a href="#requirements-recommended-security-changes">4.5.1. Recommended Security Changes</a></li>
+<li><a href="#requirements-recommended-hdfs-configuration-changes">4.5.2. Recommended HDFS Configuration Changes</a></li>
+<li><a href="#requirements-recommended-hbase-configuration-changes">4.5.3. Recommended HBase Configuration Changes</a></li>
</ul>
</li>
</ul>
@@ -626,75 +636,72 @@ table.CodeRay td.code>pre{padding:0}
</ul>
</li>
<li><a href="#prepare-download-trafodion-binaries">5.9. Download Trafodion Binaries</a></li>
-</ul>
-</li>
-<li><a href="#install-ambari">6. Install with Ambari</a>
-<ul class="sectlevel2">
-<li><a href="#_local_repository">6.1. Local Repository</a></li>
-<li><a href="#_install_ambari_management_pack_for_trafodion">6.2. Install Ambari Management Pack for Trafodion</a></li>
-<li><a href="#_install_trafodion">6.3. Install Trafodion</a>
+<li><a href="#prepare-preparation-for-recipe-based-provisioning">5.10. Preparation for Recipe-Based Provisioning</a>
<ul class="sectlevel3">
-<li><a href="#_initial_cluster_creation">6.3.1. Initial Cluster Creation</a></li>
-<li><a href="#_existing_cluster">6.3.2. Existing Cluster</a></li>
+<li><a href="#prepare-modify-os-settings">5.10.1. Modify OS Settings</a></li>
+<li><a href="#prepare-modify-zookeeper-configuration">5.10.2. Modify ZooKeeper Configuration</a></li>
+<li><a href="#prepare-modify-hdfs-configuration">5.10.3. Modify HDFS Configuration</a></li>
+<li><a href="#prepare-modify-hbase-configuration">5.10.4. Modify HBase Configuration</a></li>
</ul>
</li>
-<li><a href="#_initialize_meta_data">6.4. Initialize Meta-Data</a></li>
</ul>
</li>
-<li><a href="#install">7. Install</a>
+<li><a href="#install">6. Install</a>
<ul class="sectlevel2">
-<li><a href="#install-unpack-installer">7.1. Unpack Installer</a></li>
-<li><a href="#install-guided-install">7.2. Guided Install</a></li>
-<li><a href="#install-automated-install">7.3. Automated Install</a></li>
+<li><a href="#install-unpack-installer">6.1. Unpack Installer</a></li>
+<li><a href="#install-guided-install">6.2. Guided Install</a></li>
+<li><a href="#install-automated-install">6.3. Automated Install</a></li>
</ul>
</li>
-<li><a href="#upgrade">8. Upgrade</a>
+<li><a href="#upgrade">7. Upgrade</a>
<ul class="sectlevel2">
-<li><a href="#upgraded-download-updated-trafodion-binaries">8.1. Download Updated Trafodion Binaries</a></li>
-<li><a href="#upgrade-unpack-installer">8.2. Unpack Installer</a></li>
-<li><a href="#upgrade-stop-tradodion">8.3. Stop Trafodion</a></li>
-<li><a href="#upgrade-guided-upgrade">8.4. Guided Upgrade</a></li>
-<li><a href="#upgrade-automated-upgrade">8.5. Automated Upgrade</a></li>
+<li><a href="#upgraded-download-updated-trafodion-binaries">7.1. Download Updated Trafodion Binaries</a></li>
+<li><a href="#upgrade-unpack-installer">7.2. Unpack Installer</a></li>
+<li><a href="#upgrade-stop-tradodion">7.3. Stop Trafodion</a></li>
+<li><a href="#upgrade-guided-upgrade">7.4. Guided Upgrade</a></li>
+<li><a href="#upgrade-automated-upgrade">7.5. Automated Upgrade</a></li>
</ul>
</li>
-<li><a href="#activate">9. Activate</a>
+<li><a href="#activate">8. Activate</a>
<ul class="sectlevel2">
-<li><a href="#activate-manage-trafodion">9.1. Manage Trafodion</a></li>
-<li><a href="#activate-validate-trafodion-installation">9.2. Validate Trafodion Installation</a>
+<li><a href="#activate-manage-trafodion">8.1. Manage Trafodion</a></li>
+<li><a href="#activate-validate-trafodion-installation">8.2. Validate Trafodion Installation</a>
<ul class="sectlevel3">
-<li><a href="#_smoke_test">9.2.1. Smoke Test</a></li>
+<li><a href="#_smoke_test">8.2.1. Smoke Test</a></li>
</ul>
</li>
-<li><a href="#activate-troubleshooting-tips">9.3. Troubleshooting Tips</a></li>
+<li><a href="#activate-troubleshooting-tips">8.3. Troubleshooting Tips</a></li>
</ul>
</li>
-<li><a href="#remove">10. Remove</a>
+<li><a href="#remove">9. Remove</a>
<ul class="sectlevel2">
-<li><a href="#_stop_trafodion">10.1. Stop Trafodion</a></li>
-<li><a href="#_run_code_db_uninstall_py_code">10.2. Run <code>db_uninstall.py</code></a></li>
+<li><a href="#_stop_trafodion">9.1. Stop Trafodion</a></li>
+<li><a href="#_run_code_trafodion_uninstaller_code">9.2. Run <code>trafodion_uninstaller</code></a></li>
</ul>
</li>
-<li><a href="#enable-security">11. Enable Security</a>
+<li><a href="#enable-security">10. Enable Security</a>
<ul class="sectlevel2">
-<li><a href="#enable-security-kerberos">11.1. Configuring Trafodion for Kerberos</a>
+<li><a href="#enable-security-kerberos">10.1. Configuring Trafodion for Kerberos</a>
<ul class="sectlevel3">
-<li><a href="#_kerberos_configuration_file">11.1.1. Kerberos configuration file</a></li>
-<li><a href="#_ticket_management">11.1.2. Ticket Management</a></li>
-<li><a href="#_kerberos_installation">11.1.3. Kerberos installation</a></li>
+<li><a href="#_kerberos_configuration_file">10.1.1. Kerberos configuration file</a></li>
+<li><a href="#_ticket_management">10.1.2. Ticket Management</a></li>
+<li><a href="#_kerberos_installation">10.1.3. Kerberos installation</a></li>
</ul>
</li>
-<li><a href="#enable-security-ldap">11.2. Configuring LDAP</a>
+<li><a href="#enable-security-ldap">10.2. Configuring LDAP</a>
<ul class="sectlevel3">
-<li><a href="#enable-security-configuring-ldap-servers">11.2.1. Configuring LDAP Servers</a></li>
-<li><a href="#enable-security-generate-trafodion-certificate">11.2.2. Generate Trafodion Certificate</a></li>
-<li><a href="#enable-security-traf-authentication-config">11.2.3. Creating the LDAP configuration file</a></li>
-<li><a href="#enable-security-ldapcheck">11.2.4. Verifying configuration and users through ldapcheck</a></li>
-<li><a href="#enable-security-ldapconfigcheck">11.2.5. Verifying contents of configuration file through ldapconfigcheck</a></li>
+<li><a href="#enable-security-configuring-ldap-servers">10.2.1. Configuring LDAP Servers</a></li>
+<li><a href="#enable-security-generate-trafodion-certificate">10.2.2. Generate Trafodion Certificate</a></li>
+<li><a href="#enable-security-traf-authentication-config">10.2.3. Creating the LDAP configuration file</a></li>
+<li><a href="#enable-security-ldapcheck">10.2.4. Verifying configuration and users through ldapcheck</a></li>
+<li><a href="#enable-security-ldapconfigcheck">10.2.5. Verifying contents of configuration file through ldapconfigcheck</a></li>
</ul>
</li>
-<li><a href="#enable-security-manage-users">11.3. Manage Users</a></li>
+<li><a href="#enable-security-manage-users">10.3. Manage Users</a></li>
</ul>
</li>
+<li><a href="#install-recipe">11. Install Recipe</a></li>
+<li><a href="#upgrade-recipe">12. Upgrade Recipe</a></li>
</ul>
</div>
</div>
@@ -835,7 +842,7 @@ regardless of platform type.
<div class="sect2">
<h3 id="_new_and_changed_information">1.2. New and Changed Information</h3>
<div class="paragraph">
-<p>This guide has been updated to include Ambari installation.</p>
+<p>This guide has been updated to include provisioning for LDAP and Kerberos.</p>
</div>
<div style="page-break-after: always;"></div>
</div>
@@ -1036,8 +1043,7 @@ needs. Send any errors found, suggestions for improvement, or compliments to <a
<h2 id="quickstart">2. Quick Start</h2>
<div class="sectionbody">
<div class="paragraph">
-<p>This chapter provides a quick start for how to use the command-line Trafodion Installer to install Trafodion.
-<strong>If you prefer to intall on HDP distribution using Ambari, refer to the <a href="#install-ambari">Ambari Install</a> section.</strong></p>
+<p>This chapter provides a quick start for how to use the Trafodion Installer to install Trafodion.</p>
</div>
<div class="paragraph">
<p>You need the following before using the information herein:</p>
@@ -1097,48 +1103,50 @@ You can download and install the Trafodion Clients once you’ve installed a
<div class="paragraph">
<p><strong>Example</strong></p>
</div>
-<div class="paragraph">
-<p>Download the Trafodion Installer and Server binaries:</p>
-</div>
<div class="listingblock">
<div class="content">
<pre class="CodeRay highlight"><code data-lang="text">$ mkdir $HOME/trafodion-download
$ cd $HOME/trafodion-download
$ # Download the Trafodion Installer binaries
-$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-2.1.0.incubating/apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz
+$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-1.3.0.incubating/apache-trafodion-installer-1.3.0-incubating-bin.tar.gz
Resolving http://apache.cs.utah.edu... 192.168.1.56
Connecting to http://apache.cs.utah.edu|192.168.1.56|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 68813 (67K) [application/x-gzip]
-Saving to: "apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz"
+Saving to: "apache-trafodion-installer-1.3.0-incubating-bin.tar.gz"
100%[=====================================================================================================================>] 68,813 124K/s in 0.5s
-2016-02-14 04:19:42 (124 KB/s) - "apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz" saved [68813/68813]
-
-$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-2.1.0.incubating/apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz
+2016-02-14 04:19:42 (124 KB/s) - "apache-trafodion-installer-1.3.0-incubating-bin.tar.gz" saved [68813/68813]</code></pre>
+</div>
+</div>
+<div style="page-break-after: always;"></div>
+<div class="listingblock">
+<div class="content">
+<pre class="CodeRay highlight"><code data-lang="text">$ # Download the Trafodion Server binaries
+$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-1.3.0.incubating/apache-trafodion-1.3.0-incubating-bin.tar.gz
Resolving http://apache.cs.utah.edu... 192.168.1.56
Connecting to http://apache.cs.utah.edu|192.168.1.56|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 214508243 (205M) [application/x-gzip]
-Saving to: "apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz"
+Saving to: "apache-trafodion-1.3.0-incubating-bin.tar.gz"
100%[=====================================================================================================================>] 214,508,243 3.90M/s in 55s
-2016-02-14 04:22:14 (3.72 MB/s) - "apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz" saved [214508243/214508243]
+2016-02-14 04:22:14 (3.72 MB/s) - "apache-trafodion-1.3.0-incubating-bin.tar.gz" saved [214508243/214508243]
$ ls -l
--rw-rw-r--. 1 centos centos 74237 Feb 13 14:53 apache-trafodion_pyinstaller-2.1.0-incubating.tar.gz
--rw-rw-r--. 1 centos centos 183114066 Feb 10 22:34 apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz
+total 209552
+-rw-rw-r-- 1 centos centos 214508243 Jan 12 20:10 apache-trafodion-1.3.0-incubating-bin.tar.gz
+-rw-rw-r-- 1 centos centos 68813 Jan 12 20:10 apache-trafodion-installer-1.3.0-incubating-bin.tar.gz
$</code></pre>
</div>
</div>
</div>
<div class="sect2">
-<h3 id="quickstart-unpack-installer">2.2. Unpack Installer and Server package</h3>
+<h3 id="quickstart-unpack-installer">2.2. Unpack Installer</h3>
<div class="paragraph">
-<p>The first step in the installation process is to unpack the Trafodion Installer tar file.
-Trafodion server package tar file can be auto detected by installer if put it in installer’s folder.</p>
+<p>The first step in the installation process is to unpack the Trafodion Installer tar file.</p>
</div>
<div class="paragraph">
<p><strong>Example</strong></p>
@@ -1147,11 +1155,13 @@ Trafodion server package tar file can be auto detected by installer if put it in
<div class="content">
<pre class="CodeRay highlight"><code data-lang="text">$ mkdir $HOME/trafodion-installer
$ cd $HOME/trafodion-downloads
-$ tar -zxf apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz -C $HOME/trafodion-installer
-$ cp -f apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz $HOME/trafodion-installer
-$ ls $HOME/trafodion-installer/python-installer
-apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz db_install.py DISCLAIMER LICENSE prettytable.py scripts
-configs db_uninstall.py discovery.py NOTICE README.md
+$ tar -zxf apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -C $HOME/trafodion-installer
+$ ls $HOME/trafodion-installer/installer
+bashrc_default tools traf_config_check trafodion_apache_hadoop_install traf_package_setup
+build-version-1.3.0.txt traf_add_user traf_config_setup trafodion_config_default traf_setup
+dcs_installer traf_apache_hadoop_config_setup traf_create_systemdefaults trafodion_install traf_sqconfig
+rest_installer traf_authentication_conf_default traf_getHadoopNodes trafodion_license traf_start
+setup_known_hosts.exp traf_cloudera_mods98 traf_hortonworks_mods98 trafodion_uninstaller
$</code></pre>
</div>
</div>
@@ -1162,22 +1172,23 @@ $</code></pre>
<p>Collect/decide the following information:</p>
</div>
<div class="sect3">
-<h4 id="_java_location">2.3.1. Java Location</h4>
+<h4 id="_location_of_trafodion_server_side_binary">2.3.1. Location of Trafodion Server-Side Binary</h4>
<div class="paragraph">
-<p>Java location can be automatically detected by installer. You need to provide the java location only if installer cannot detect it.</p>
+<p>You need the fully-qualified name of the Trafodion server-side binary.</p>
</div>
<div class="paragraph">
-<p>How to detect java location manually:</p>
+<p><strong>Example</strong></p>
</div>
-<div class="olist arabic">
-<ol class="arabic">
-<li>
-<p>Login to trafodion' node</p>
-</li>
-<li>
-<p>Use <code>ps -ef | grep java | grep hadoop | grep hbase</code> to determine what version HBase is running.</p>
-</li>
-</ol>
+<div class="listingblock">
+<div class="content">
+<pre class="CodeRay highlight"><code data-lang="text">/home/trafodion-downloads/apache-trafodion-installer-1.3.0-incubating-bin.tar.gz</code></pre>
+</div>
+</div>
+</div>
+<div class="sect3">
+<h4 id="_java_location">2.3.2. Java Location</h4>
+<div class="paragraph">
+<p>You need to record the location of the Java. For example, use <code>ps -ef | grep java | grep hadoop | grep hbase</code> to determine what version HBase is running.</p>
</div>
<div class="paragraph">
<p><strong>Example</strong></p>
@@ -1194,12 +1205,9 @@ hbase 17302 17288 1 20:35 ? 00:00:10 /usr/jdk64/jdk1.7.0_67/bin/jav
<div style="page-break-after: always;"></div>
</div>
<div class="sect3">
-<h4 id="_data_nodes">2.3.2. Data Nodes</h4>
-<div class="paragraph">
-<p>Trafodion is installed on all data nodes in your Hadoop cluster. Data nodes can be automatically detected by installer while installing on a HDP/CDH cluster.</p>
-</div>
+<h4 id="_data_nodes">2.3.3. Data Nodes</h4>
<div class="paragraph">
-<p>You need to record hostname for each node when you install Trafodion on Apache Hadoop.
+<p>{projet-name} is installed on all data nodes in your Hadoop cluster. You need to record the fully-qualified domain name node for each node.
For example, refer to <code>/etc/hosts</code>.</p>
</div>
<div class="paragraph">
@@ -1211,16 +1219,34 @@ For example, refer to <code>/etc/hosts</code>.</p>
127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
-172.31.56.238 node-1.internal node-1
-172.31.61.110 node-2.internal node-2</code></pre>
+172.31.56.238 ip-172-31-56-238.ec2.internal node01
+172.31.61.110 ip-172-31-61-110.ec2.internal node02
+172.31.57.143 ip-172-31-57-143.ec2.internal node03</code></pre>
</div>
</div>
<div class="paragraph">
-<p>Record the node names in a comma-separated list <code>node-1, node-2</code> or in regular expression mode <code>node-[1-2]</code></p>
+<p>Record the node names in a space-separated list.</p>
+</div>
+<div class="paragraph">
+<p><strong>Example</strong></p>
+</div>
+<div class="listingblock">
+<div class="content">
+<pre class="CodeRay highlight"><code data-lang="text">ip-172-31-56-238.ec2.internal ip-172-31-61-110.ec2.internal ip-172-31-57-143.ec2.internal</code></pre>
+</div>
+</div>
+</div>
+<div class="sect3">
+<h4 id="_trafodion_runtime_user_home_directory">2.3.4. Trafodion Runtime User Home Directory</h4>
+<div class="paragraph">
+<p>The Installer creates the <code>trafodion</code> user ID. You need to decide the home directory for this user.</p>
+</div>
+<div class="paragraph">
+<p>The default is: <code>/home</code></p>
</div>
</div>
<div class="sect3">
-<h4 id="_distribution_manager_url">2.3.3. Distribution Manager URL</h4>
+<h4 id="_distribution_manager_url">2.3.5. Distribution Manager URL</h4>
<div class="paragraph">
<p>The Installer interacts with the Distribution Manager (for example, Apache Ambari or Cloudera Manager) to modify the
Hadoop configuration.</p>
@@ -1246,7 +1272,431 @@ Hadoop configuration.</p>
<a href="#quickstart-collect-information">Collect Information</a> above.</p>
</div>
<div class="paragraph">
-<p>Please refer to <a href="#install-guided-install">Guided Install</a> for the <strong>example</strong> of installing Trafodion on a two-node Cloudera Hadoop cluster.</p>
+<p>The following example shows a guided install of Trafodion on a three-node Hortonworks Hadoop cluster.</p>
+</div>
+<div class="admonitionblock note">
+<table>
+<tr>
+<td class="icon">
+<i class="fa icon-note" title="Note"></i>
+</td>
+<td class="content">
+By default, the Trafodion Installer invokes <code>sqlci</code> so that you can enter the <code>initialize trafodion;</code> command.
+This is shown in the example below.
+</td>
+</tr>
+</table>
+</div>
+<div class="paragraph">
+<p><strong>Example</strong></p>
+</div>
+<div class="olist arabic">
+<ol class="arabic">
+<li>
+<p>Run the Trafodion Installer in guided mode.</p>
+<div class="listingblock">
+<div class="content">
+<pre class="CodeRay highlight"><code data-lang="text">$ cd $HOME/trafodion-installer/installer
+$ ./trafodion_install 2>&1 | tee install.log
+******************************
+ TRAFODION INSTALLATION START
+******************************
+
+***INFO: testing sudo access
+***INFO: Log file located at /var/log/trafodion/trafodion_install_2016-06-30-21-02-38.log
+***INFO: Config directory: /etc/trafodion
+***INFO: Working directory: /usr/lib/trafodion
+
+************************************
+ Trafodion Configuration File Setup
+************************************
+
+***INFO: Please press [Enter] to select defaults.
+
+Is this a cloud environment (Y/N), default is [N]: N
+Enter trafodion password, default is [traf123]:
+Enter list of data nodes (blank separated), default []: ip-172-31-56-238.ec2.internal ip-172-31-61-110.ec2.internal ip-172-31-57-143.ec2.internal
+Do you h ave a set of management nodes (Y/N), default is N: N
+Enter Trafodion userid's home directory prefix, default is [/home]: /opt
+Specify location of Java 1.7.0_65 or higher (JDK), default is []: /usr/jdk64/jdk1.7.0_67
+Enter full path (including .tar or .tar.gz) of trafodion tar file []: /home/trafodion-downloads/apache-trafodion_server-2.0.1-incubating.tar.gz
+Enter Backup/Restore username (can be Trafodion), default is [trafodion]:
+Specify the Hadoop distribut ion installed (1: Cloudera, 2: Hortonworks, 3: Other): 2
+Enter Hadoop admin username, default is [admin]: Enter Hadoop admin pas sword, default is [admin]:
+Enter full Hadoop external network URL:port (include 'http://' or 'https://), default is []: http://ip-172-31-56-238.ec2.internal:8080
+Enter HDFS username or username running HDFS, default is [hdfs]:
+Enter HBase username or username running HBase, default is [hbase]:
+Enter HBase group, default is [hbase]:
+Enter Zookeeper username or username running Zookeeper, default is [zookeeper]:
+Enter directory to install trafodion to, default is [/opt/trafodion/apache-trafodion_server-2.0.1-incubating]:
+Start Trafodion after install (Y/N), default is Y:
+Total number of client connections per cluster, default [24]: 96
+Enter the node of primary DcsMaste r, default [ip-172-31-56-238.ec2.internal]:
+Enable High Availability (Y/N), default is N:
+Enable simple LDAP security (Y/N), d efault is N:
+***INFO: Trafodion configuration setup complete
+***INFO: Trafodion Configuration File Check
+***INFO: Testing sudo access on node ip-172-31-56-238
+***INFO: Testing sudo access on node ip-172-31-61-110
+***INFO: Testing sudo access on node ip-172-31-57-143
+***INFO: Testing ssh on ip-172-31-56-238
+***INFO: Testing ssh on ip-172-31-61-110
+***INFO: Testing ssh on ip-172-31-57-143
+#!/bin/bash
+#
+# @@@ START COPYRIGHT @@@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+.
+.
+.
+9. Accepting Warranty or Additional Liability. While redistributing
+the Work or Derivative Works thereof, You may choose to offer, and
+charge a fee for, acceptance of support, warranty, indemnity, or
+other liability obligations and/or rights consistent with this
+License. However, in accepting such obligations, You may act only
+on Your own behalf and on Your sole responsibility, not on behalf
+of any other Contributor, and only if You agree to indemnify, defend,
+and hold each Contributor harmless for any liability incurred by,
+or claims asserted against, such Contributor by reason of your
+accepting any such warranty or additional liability.
+
+END OF TERMS AND CONDITIONS
+
+BY TYPING "ACCEPT" YOU AGREE TO THE TERMS OF THIS AGREEMENT: ***INFO: testing sudo access
+***INFO: Starting Trafodion Package Setup (2016-06-30-21-06-40)
+***INFO: Installing required packages
+***INFO: Log file located in /var/log/trafodion
+***INFO: ... pdsh on node ip-172-31-56-238
+***INFO: ... pdsh on node ip-172-31-61-110
+***INFO: ... pdsh on node ip-172-31-57-143
+***INFO: Checking if apr is installed ...
+***INFO: Checking if apr-util is installed ...
+***INFO: Checking if sqlite is installed ...
+***INFO: Checking if expect is installed ...
+***INFO: Checking if perl-DBD-SQLite* is installed ...
+***INFO: Checking if protobuf is installed ...
+***INFO: Checking if xerces-c is installed ...
+***INFO: Checking if perl-Params-Validate is installed ...
+***INFO: Checking if perl-Time-HiRes is installed ...
+***INFO: Checking if gzip is installed ...
+***INFO: Checking if lzo is installed ...
+***INFO: Checking if lzop is installed ...
+***INFO: Checking if unzip is installed ...
+***INFO: modifying limits in /usr/lib/trafodion/trafodion.conf on all nodes
+***INFO: create Trafodion userid "trafodion"
+***INFO: Trafodion userid's (trafodion) home directory: /opt/trafodion
+***INFO: testing sudo access
+Generating public/private rsa key pair.
+Created directory '/opt/trafodion/.ssh'.
+Your identification has been saved in /opt/trafodion/.ssh/id_rsa.
+Your public key has been saved in /opt/trafodion/.ssh/id_rsa.pub.
+The key fingerprint is:
+12:59:ab:d7:59:a2:0e:e8:38:1c:e9:e1:86:f6:18:23 trafodion@ip-172-31-56-238
+The key's randomart image is:
++--[ RSA 2048]----+
+| . |
+| o . |
+| o . . . |
+| . . o o + |
+| + . + S o |
+| = = = |
+|E+B . . |
+|o.=. |
+| . . |
++-----------------+
+***INFO: creating .bashrc file
+***INFO: Setting up userid trafodion on all other nodes in cluster
+***INFO: Creating known_hosts file for all nodes
+ip-172-31-56-238
+ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143
+ip-172-31-61-110
+ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143
+ip-172-31-57-143
+ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143
+***INFO: trafodion user added successfully
+***INFO: Trafodion environment setup completed
+***INFO: creating sqconfig file
+***INFO: Reserving DCS ports
+
+***INFO: Creating trafodion sudo access file
+
+
+******************************
+ TRAFODION MODS
+******************************
+
+***INFO: Hortonworks installed will run traf_hortonworks_mods
+***INFO: copying hbase-trx-hdp2_3-*.jar to all nodes
+***INFO: hbase-trx-hdp2_3-*.jar copied correctly! Huzzah.
+USERID=admin
+PASSWORD=admin
+PORT=:8080
+{
+ "resources" : [
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/configurations/service_config_versions?ser
+vice_name=HBASE&service_config_version=2",
+.
+.
+.
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/128",
+ "Tasks" : {
+ "cluster_name" : "trafodion",
+ "id" : 128,
+ "request_id" : 12,
+ "stage_id" : 2
+ }
+ },
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/129",
+ "Tasks" : {
+ "cluster_name" : "trafodion",
+ "id" : 129,
+ "request_id" : 12,
+ "stage_id" : 2
+ }
+ },
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/130",
+ "Tasks" : {
+ "cluster_name" : "trafodion",
+ "id" : 130,
+ "request_id" : 12,
+ "stage_id" : 2
+ }
+ }
+ ],
+ "stages" : [
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/0",
+ "Stage" : {
+ "cluster_name" : "trafodion",
+ "request_id" : 12,
+ "stage_id" : 0
+ }
+ },
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/1",
+ "Stage" : {
+ "cluster_name" : "trafodion",
+ "request_id" : 12,
+ "stage_id" : 1
+ }
+ },
+ {
+ "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/2",
+ "Stage" : {
+ "cluster_name" : "trafodion",
+ "request_id" : 12,
+ "stage_id" : 2
+ }
+ }
+ ]
+}***INFO: ...polling every 30 seconds until HBase start is completed.
+***INFO: HBase restart completed
+***INFO: Setting HDFS ACLs for snapshot scan support
+cp: `trafodion_config' and `/home/trafinstall/trafodion-2.0.1/installer/trafodion_config' are the same file
+***INFO: Trafodion Mods ran successfully.
+
+******************************
+ TRAFODION CONFIGURATION
+******************************
+
+/usr/lib/trafodion/installer/..
+/opt/trafodion/apache-trafodion_server-2.0.1-incubating
+***INFO: untarring file to /opt/trafodion/apache-trafodion_server-2.0.1-incubating
+***INFO: modifying .bashrc to set Trafodion environment variables
+***INFO: copying .bashrc file to all nodes
+***INFO: copying sqconfig file (/opt/trafodion/sqconfig) to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/sql/script
+s/sqconfig
+***INFO: Creating /opt/trafodion/apache-trafodion_server-2.0.1-incubating directory on all nodes
+***INFO: Start of DCS install
+***INFO: DCS Install Directory: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1
+***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/dcs-env.sh
+***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/dcs-site.xml
+***INFO: creating /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/servers file
+***INFO: End of DCS install.
+***INFO: Start of REST Server install
+***INFO: Rest Install Directory: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1
+***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1/conf/rest-site.xml
+***INFO: End of REST Server install.
+***INFO: starting sqgen
+ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110
+
+Creating directories on cluster nodes
+/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
+fodion/apache-trafodion_server-2.0.1-incubating/etc
+/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
+fodion/apache-trafodion_server-2.0.1-incubating/logs
+/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
+fodion/apache-trafodion_server-2.0.1-incubating/tmp
+/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra
+fodion/apache-trafodion_server-2.0.1-incubating/sql/scripts
+
+Generating SQ environment variable file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/etc/ms.env
+
+Note: Using cluster.conf format type 2.
+
+Generating SeaMonster environment variable file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/etc/seamonster.env
+
+
+Generated SQ startup script file: ./gomon.cold
+Generated SQ startup script file: ./gomon.warm
+Generated SQ cluster config file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/tmp/cluster.conf
+Generated SQ Shell file: sqshell
+Generated RMS Startup file: rmsstart
+Generated RMS Stop file: rmsstop
+Generated RMS Check file: rmscheck.sql
+Generated SSMP Startup file: ssmpstart
+Generated SSMP Stop file: ssmpstop
+Generated SSCP Startup file: sscpstart
+Generated SSCP Stop file: sscpstop
+
+
+Copying the generated files to all the nodes in the cluster
+.
+.
+.
+SQ Startup script (/opt/trafodion/apache-trafodion_server-2.0.1-incubating/sql/scripts/gomon.cold) ran successfully. Performin
+g further checks...
+Checking if processes are up.
+Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
+
+The SQ environment is up!
+
+
+Process Configured Actual Down
+------- ---------- ------ ----
+DTM 3 3
+RMS 6 6
+DcsMaster 1 0 1
+DcsServer 3 0 3
+mxosrvr 96 0 96
+
+Thu Jun 30 21:15:29 UTC 2016
+Checking if processes are up.
+Checking attempt: 1; user specified max: 1. Execution time in seconds: 0.
+
+The SQ environment is up!
+
+
+Process Configured Actual Down
+------- ---------- ------ ----
+DTM 3 3
+RMS 6 6
+DcsMaster 1 0 1
+DcsServer 3 0 3
+mxosrvr 96 0 96
+
+Starting the DCS environment now
+starting master, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dcs-trafodion-1-mast
+er-ip-172-31-56-238.out
+ip-172-31-56-238: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc
+s-trafodion-1-server-ip-172-31-56-238.out
+ip-172-31-57-143: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc
+s-trafodion-3-server-ip-172-31-57-143.out
+ip-172-31-61-110: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc
+s-trafodion-2-server-ip-172-31-61-110.out
+Checking if processes are up.
+Checking attempt: 1; user specified max: 2. Execution time in seconds: 1.
+
+The SQ environment is up!
+
+
+Process Configured Actual Down
+------- ---------- ------ ----
+DTM 3 3
+RMS 6 6
+DcsMaster 1 1
+DcsServer 3 3
+mxosrvr 96 7 89
+
+Starting the REST environment now
+starting rest, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1/bin/../logs/rest-trafodion-1-rest
+-ip-172-31-56-238.out
+
+
+
+Zookeeper listen port: 2181
+DcsMaster listen port: 23400
+
+Configured Primary DcsMaster: "ip-172-31-56-238.ec2.internal"
+Active DcsMaster : "ip-172-31-56-238"
+
+Process Configured Actual Down
+--------- ---------- ------ ----
+DcsMaster 1 1
+DcsServer 3 3
+mxosrvr 96 94 2
+
+
+You can monitor the SQ shell log file : /opt/trafodion/apache-trafodion_server-2.0.1-incubating/logs/sqmon.log
+
+
+Startup time 0 hour(s) 2 minute(s) 19 second(s)
+Apache Trafodion Conversational Interface 2.0.1
+Copyright (c) 2015-2016 Apache Software Foundation
+>>
+--- SQL operation complete.
+>>
+
+End of MXCI Session
+
+***INFO: Installation setup completed successfully.
+
+******************************
+ TRAFODION INSTALLATION END
+******************************</code></pre>
+</div>
+</div>
+</li>
+<li>
+<p>Switch to the Trafodion Runtime User and check the status of Trafodion.</p>
+<div class="listingblock">
+<div class="content">
+<pre class="CodeRay highlight"><code data-lang="text">$ sudo su - trafodion
+$ sqcheck
+Checking if processes are up.
+Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
+
+The SQ environment is up!
+
+
+Process Configured Actual Down
+------- ---------- ------ ----
+DTM 3 3
+RMS 6 6
+DcsMaster 1 1
+DcsServer 3 3
+mxosrvr 96 96
+$</code></pre>
+</div>
+</div>
+</li>
+</ol>
+</div>
+<div class="paragraph">
+<p>Trafodion is now running on your Hadoop cluster. Please refer to the <a href="#activate">Activate</a> chapter for
+basic instructions on how to verify the Trafodion management and how to perform basic management
+operations.</p>
</div>
</div>
</div>
@@ -1285,9 +1735,9 @@ respective environment’s configuration settings per Trafodion requirements
about the requirements and usage associated with this user ID.</p>
</li>
<li>
-<p><strong>Runtime User</strong>: A Linux-level user under which the Trafodion software runs, default name is <code>trafodion</code>. This user ID must be registered
-as a user in the Hadoop Distributed File System (HDFS) to store and access objects in HDFS, HBase, and Hive.
-In addition, this user ID requires passwordless access among the nodes where Trafodion is installed.
+<p><strong>Runtime User</strong>: A Linux-level user under which the Trafodion software runs. This user ID must be registered
+as a user in the Hadoop Distributed File System (HDFS) to store and access objects in HDFS, HBase, and Hive.
+In addition, this user ID requires passwordless access among the nodes where Trafodion is installed.
Refer to <a href="#requirements-trafodion-runtime-user">Trafodion Runtime User</a> for more information about this user ID.</p>
</li>
<li>
@@ -1336,28 +1786,40 @@ such as LDAP search. Refer to
<div class="sect2">
<h3 id="introduction-provisioning-options">3.2. Provisioning Options</h3>
<div class="paragraph">
-<p>Trafodion includes two options for installation: a plug-in integration with Apache Ambari and command-line installation scripts.</p>
+<p>Trafodion ships with a set of scripts that takes care of many of the installation and upgrade
+tasks associated with the Trafodion software and its requirements. The main features include:</p>
</div>
-<div class="paragraph">
-<p>The Ambari integration provides support for Hortonworks Hadoop distributions, while the command-line Trafodion Installer
-supports Cloudera and Hortonworks Hadoop distributions, and for select vanilla Hadoop installations.</p>
+<div class="ulist">
+<ul>
+<li>
+<p><strong>Trafodion installer</strong>: Performs installation and upgrade for Trafodion</p>
+</li>
+<li>
+<p><strong>Trafodion uninstaller</strong>: Uninstalls Trafodion</p>
+</li>
+<li>
+<p><strong>Trafodion security installer</strong>: Enables security features including Kerberos and LDAP for an existing Trafodion installation</p>
+</li>
+</ul>
</div>
<div class="paragraph">
-<p>The Trafodion Installer supports Linux distributions SUSE and RedHat/CentOS. There are, however, some differences.
-Prerequisite software packages are not installed automatically on SUSE.</p>
+<p>Currently, the Trafodion Installer is able to install Trafodion on select Cloudera and Hortonworks Hadoop distributions, and for select vanilla Hadoop installations.
+The Trafodion Installer limitations are noted as they apply in the different chapters below. For example, the Trafodion Installer
+is less capable on SUSE than it is on RedHat/CentOS; you have to install the prerequisite software packages outside the Trafodion Installer.</p>
</div>
<div class="paragraph">
-<p>The Trafodion Installer automates many of the tasks required to install/upgrade Trafodion, from downloading and
-installing required software packages and making required configuration changes to your Hadoop environment via creating
+<p>The Trafodion Installer automates many of the tasks required to install/upgrade Trafodion, spanning from downloading and
+installing required software packages and making required changes to your Hadoop environment via creating
the Trafodion runtime user ID to installing and starting Trafodion. It is, therefore, highly recommend that
you use the Trafodion Installer for initial installation and upgrades of Trafodion. These steps are referred to as
"Script-Based Provisioning" in this guide. Refer to <a href="#introduction-trafodion-installer">Trafodion Installer</a> that provides
usage information.</p>
</div>
<div class="paragraph">
-<p>The command-line installer has been replaced for the 2.1.0 release. Written in python, it replaces the legacy bash-script installer.
-The bash command-line installer is deprecated as of 2.1.0, but is still provided, just in case you experience any problems with
-the new installer. If so, please report those problems to the project team, since the legacy installer will soon be obsoleted.</p>
+<p>If, for any reason, you choose not to use the Trafodion Installer, then separate chapters provide
+step-by-step recipes for the tasks required to install/upgrade Trafodion. These steps are referred to as
+<strong>Recipe-Based Provisioning</strong> in this guide. It is assumed that you are well-versed in Linux and Hadoop
+administrative tasks if using Recipe-Based Provisioning.</p>
</div>
</div>
<div class="sect2">
@@ -1400,7 +1862,7 @@ include basic management tasks such as starting and checking the status of the T
<li>
<p><strong><a href="#enable-security">Enable Security</a></strong>: Activities related to enabling security features on an already installed
Trafodion installation. These activities include tasks such as adding Kerberos principals and keytabs,
-and setting up the LDAP configuration files. <strong>Only support in bash installer for now</strong></p>
+and setting up the LDAP configuration files.</p>
</li>
</ul>
</div>
@@ -1408,9 +1870,9 @@ and setting up the LDAP configuration files. <strong>Only support in bash instal
<div class="sect2">
<h3 id="introduction-provisioning-master-node">3.4. Provisioning Master Node</h3>
<div class="paragraph">
-<p>All provisioning tasks are performed from a single node in the cluster, which can be any node
-as long as it has access to the Hadoop environment you’re adding Trafodion to.
-This node is referred to as the "<strong>Provisioning Master Node</strong>" in this guide.</p>
+<p>All provisioning tasks are performed from a single node in the cluster, which must be part
+of the Hadoop environment you’re adding Trafodion to. This node is referred to as the
+"<strong>Provisioning Master Node</strong>" in this guide.</p>
</div>
<div class="paragraph">
<p>The Trafodion Provisioning User must have access to all other nodes from the Provisioning
@@ -1431,7 +1893,7 @@ Next, you unpack the tar file.</p>
<div class="content">
<pre class="CodeRay highlight"><code data-lang="text">$ mkdir $HOME/trafodion-installer
$ cd $HOME/trafodion-downloads
-$ tar -zxf apache-trafodion-pyinstaller-2.1.0-incubating.tar.gz -C $HOME/trafodion-installer
+$ tar -zxf apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -C $HOME/trafodion-installer
$</code></pre>
</div>
</div>
@@ -1445,16 +1907,17 @@ $</code></pre>
<p><strong>Guided Setup</strong>: Prompts for information as it works through the installation/upgrade process. This mode is recommended for new users.</p>
</li>
<li>
-<p><strong>Automated Setup</strong>: Required information is provided in a pre-formatted ini configuration file, which is provided
-via a command argument when running the Trafodion Installer thereby suppressing all prompts. This ini configuration file only exists
-on the <strong>Provisioning Master Node</strong>, please secure this file or delete it after you installed Trafodion successfully.</p>
+<p><strong>Automated Setup</strong>: Required information is provided in a pre-formatted bash-script configuration file, which is provided
+via a command argument when running the Trafodion Installer thereby suppressing all prompts. There is one exception,
+if Kerberos is enabled on the cluster, then you will always be prompted for the KDC admin password. We do not store the
+KDC admin password as part of installation anywhere.</p>
<div class="paragraph">
-<p>A template of the configuration file is available here within the installer directory: <code>configs/db_config_default.ini</code>.
+<p>A template of the configuration file is available here within the installer directory: <code>trafodion_config_default</code>.
Make a copy of the file in your directory and populate the needed information.</p>
</div>
<div class="paragraph">
<p>Automated Setup is recommended since it allows you to record the required provisioning information ahead of time.
-Refer to <a href="#introduction-trafodion-installer-automated-setup">Automated Setup</a> for information about how to
+Refer to <a href="#introduction-trafodion-automated-setup">Automated Setup</a> for information about how to
populate this file.</p>
</div>
</li>
@@ -1467,30 +1930,21 @@ populate this file.</p>
</div>
<div class="listingblock">
<div class="content">
-<pre class="CodeRay highlight"><code data-lang="text">$ ./db_install.py -h
-**********************************
- Trafodion Installation ToolKit
-**********************************
-Usage: db_install.py [options]
- Trafodion install main script.
+<pre class="CodeRay highlight"><code data-lang="text">./trafodion_install --help
+
+This script will install Trafodion. It will create a configuration
+file (if one has not been created), setup of the environment needed
+for Trafodion, configure HBase with Hbase-trx and co-processors needed,
+and install a specified Trafodion build.
Options:
- -h, --help show this help message and exit
- -c FILE, --config-file=FILE
- Json format file. If provided, all install prompts
- will be taken from this file and not prompted for.
- -u USER, --remote-user=USER
- Specify ssh login user for remote server,
- if not provided, use current login user as default.
- -v, --verbose Verbose mode, will print commands.
- --silent Do not ask user to confirm configuration result
- --enable-pwd Prompt SSH login password for remote hosts.
- If set, 'sshpass' tool is required.
- --build Build the config file in guided mode only.
- --reinstall Reinstall Trafodion without restarting Hadoop.
- --apache-hadoop Install Trafodion on top of Apache Hadoop.
- --offline Enable local repository for offline installing
- Trafodion.</code></pre>
+ --help Print this message and exit
+ --accept_license If provided, the user agrees to accept all the
+ provisions in the Trafodion license. This allows
+ for automation by skipping the display and prompt of
+ the Trafodion license.
+ --config_file If provided, all install prompts will be
+ taken from this file and not prompted for.</code></pre>
</div>
</div>
<div style="page-break-after: always;"></div>
@@ -1509,10 +1963,6 @@ or an upgrade by looking for the Trafodion Runtime User in the <code>/etc/passwd
<li>
<p>If the user ID exists, then the Trafodion Installer runs in upgrade mode.</p>
</li>
-<li>
-<p>If <code>--reinstall</code> option is specified, then the Trafodion Installer will not restart Hadoop. It’s only available when
-you reinstall the same release version, otherwise an error will be reported during installation.</p>
-</li>
</ul>
</div>
</div>
@@ -1539,7 +1989,7 @@ that it prompts you for information during the install/upgrade process.</p>
<div class="sect3">
<h4 id="introduction-trafodion-installer-automated-setup">3.5.4. Automated Setup</h4>
<div class="paragraph">
-<p>The <code>--config-file</code> option runs the Trafodion in Automated Setup mode.</p>
+<p>The <code>--config_file</code> option runs the Trafodion in Automated Setup mode.</p>
</div>
<div class="paragraph">
<p>Before running the Trafodion Installer with this option, you do the following:</p>
@@ -1547,13 +1997,13 @@ that it prompts you for information during the install/upgrade process.</p>
<div class="olist arabic">
<ol class="arabic">
<li>
-<p>Copy the <code>db_config_default.ini</code> file.</p>
+<p>Copy the <code>trafodion_config_default</code> file.</p>
<div class="paragraph">
<p><strong>Example</strong></p>
</div>
<div class="listingblock">
<div class="content">
-<pre class="CodeRay highlight"><code data-lang="text">cp configs/db_config_default.ini my_config</code></pre>
+<pre class="CodeRay highlight"><code data-lang="text">cp trafodion_config_default my_config</code></pre>
</div>
</div>
</li>
@@ -1569,7 +2019,7 @@ section in the <a href="#prepare">Prepare</a> chapter.</p>
</div>
<div class="listingblock">
<div class="content">
-<pre class="CodeRay highlight"><code data-lang="text">./db_install.py --config-file my_config</code></pre>
+<pre class="CodeRay highlight"><code data-lang="text">./trafodion_installer --config_file my_config</code></pre>
</div>
</div>
</li>
@@ -1589,227 +2039,558 @@ that matches the security policies of your organization.
</tr>
</table>
</div>
-<div class="sect4">
-<h5 id="_example_quick_start_using_a_trafodion_configuration_file">Example: Quick start using a Trafodion Configuration File</h5>
-<div class="paragraph">
-<p>The Trafodion Installer supports a minimum configuration to quick start your installation in two steps.
-1. Copy Trafodion server binary file to your installer directory.</p>
-</div>
-<div class="listingblock">
-<div class="content">
-<pre class="CodeRay highlight"><code data-lang="text">cp /path/to/apache-trafodion_server-2.1.0-RH-x86_64-incubating.tar.gz python-installer/</code></pre>
-</div>
-</div>
-<div class="olist arabic">
-<ol class="arabic">
-<li>
-<p>Modify configuration file <code>my_config</code>, add the Hadoop Distribution Manager URL in <code>mgr_url</code>.</p>
-</li>
-</ol>
-</div>
-<div class="listingblock">
-<div class="content">
-<pre class="CodeRay highlight"><code data-lang="text">mgr_url = 192.168.0.1:8080</code></pre>
-</div>
-</div>
-<div class="paragraph">
-<p>Once completed, run the Trafodion Installer with the --config-file option.</p>
-</div>
+<div class="admonitionblock note">
+<table>
+<tr>
+<td class="icon">
+<i class="fa icon-note" title="Note"></i>
+</td>
+<td class="content">
+If you are installing Trafodion on a version of Hadoop that has been instrumented with Kerberos,
+you will be asked for a password associated with a Kerberos administrator.
+</td>
+</tr>
+</table>
</div>
<div class="sect4">
<h5 id="_example_creating_a_trafodion_configuration_file">Example: Creating a Trafodion Configuration File</h5>
<div class="paragraph">
<p>Using the instructions in <a href="#prepare-gather-configuration-information">Gather Configuration Information</a>
-in the <a href="#prepare">Prepare</a> chapter, record the information and edit <code>my_config</code> to contain the following:</p>
-</div>
-<div class="listingblock">
-<div class="content">
-<pre class="CodeRay highlight"><code data-lang="text">[dbconfigs]
-# NOTICE: if you are using CDH/HDP hadoop distro,
-# you can only specifiy management url address for a quick install
-
-##################################
-# Common Settings
-##################################
-
-# trafodion username and password
-traf_user = trafodion
-traf_pwd = traf123
-# trafodion user's home directory
-home_dir = /home
-# the directory location of trafodion binary
-# if not provided, the default value will be {package_name}-{version}
-traf_dirname =
-
-# trafodion used java(JDK) path on trafodion nodes
-# if not provided, installer will auto detect installed JDK
-java_home =
-
-# cloudera/ambari management url(i.e. http://192.168.0.1:7180 or just 192.168.0.1)
-# if 'http' or 'https' prefix is not provided, the default one is 'http'
-# if port is not provided, the default port is cloudera port '7180'
-mgr_url = 192.168.0.1:8080
-# user name for cloudera/ambari management url
-mgr_user = admin
-# password for cloudera/ambari management url
-mgr_pwd = admin
-# set the cluster number if multiple clusters managed by one Cloudera manager
-# ignore it if only one cluster being managed
-cluster_no = 1
-
-# trafodion tar package file location
-# no need to provide it if the package can be found in current installer's directory
-traf_package =
-# the number of dcs servers on each node
-dcs_cnt_per_node = 4
-
-# scratch file location, seperated by comma if more than one
-scratch_locs = $TRAF_HOME/tmp
-
-# start trafodion instance after installation completed
-traf_start = Y
-
-##################################
-# DCS HA configuration
-##################################
-
-# set it to 'Y' if enable DCS HA
-dcs_ha = N
-# if HA is enabled, provide floating ip, network interface and the hostname of backup dcs master nodes
-dcs_floating_ip =
-# network interface that dcs used
-dcs_interface =
-# backup dcs master nodes, seperated by comma if more than one
-dcs_backup_nodes =
-
-##################################
-# Offline installation setting
-##################################
-
-# set offline mode to Y if no internet connection
-offline_mode = N
-# if offline mode is set, you must provide a local repository directory with all needed RPMs
-local_repo_dir =
-
-##################################
-# LDAP security configuration
-##################################
-
-# set it to 'Y' if enable LDAP security
-ldap_security = N
-# LDAP user name and password to be assigned as DB admin privilege
-db_admin_user = admin
-db_admin_pwd = traf123
-# LDAP user to be assigned DB root privileges (DB__ROOT)
-db_root_user = trafodion
-# if LDAP security is enabled, provide the following items
-ldap_hosts =
-# 389 for no encryption or TLS, 636 for SSL
-ldap_port = 389
-ldap_identifiers =
-ldap_encrypt = 0
-ldap_certpath =
-
-# set to Y if user info is needed
-ldap_userinfo = N
-# provide if ldap_userinfo = Y
-ladp_user =
-ladp_pwd =
-
-##################################
-# Kerberos security configuration
-##################################
-# if kerberos is enabled in your hadoop system, provide below info
-
-# KDC server address
-kdc_server =
-# include realm, i.e. admin/admin@EXAMPLE.COM
-admin_principal =
-# admin password for admin principal, it is used to create trafodion user's principal and keytab
-kdcadmin_pwd =</code></pre>
-</div>
-</div>
-<div class="paragraph">
-<p>Once completed, run the Trafodion Installer with the <code>--config-file</code> option.</p>
-</div>
-<div class="paragraph">
-<p>Refer to the following sections for examples:</p>
-</div>
-<div class="ulist">
-<ul>
-<li>
-<p><a href="#install-automated-install">Automated Install</a></p>
-</li>
-<li>
-<p><a href="#upgrade-automated-upgrade">Automated Upgrade</a></p>
-</li>
-</ul>
-</div>
-</div>
-</div>
-</div>
-<div class="sect2">
-<h3 id="introduction-trafodion-provisioning-directories">3.6. Trafodion Provisioning Directories</h3>
-<div class="paragraph">
-<p>Trafodion stores its provisioning information in the following directories on each node in the cluster:</p>
-</div>
-<div class="ulist">
-<ul>
-<li>
-<p><code>/etc/trafodion</code>: Configuration information.</p>
-</li>
-</ul>
-</div>
-</div>
-</div>
-</div>
-<div class="sect1">
-<h2 id="requirements">4. Requirements</h2>
-<div class="sectionbody">
-<div class="paragraph">
-<p>Trafodion requires an x86 version of Linux.</p>
-</div>
-<div class="paragraph">
-<p>The current release of Trafodion has been tested with:</p>
-</div>
-<div class="ulist">
-<ul>
-<li>
-<p>64-bit Red Hat Enterprise Linux (RHEL) or CentOS 6.5 - 6.8</p>
-</li>
-<li>
-<p>Cloudera CDH 5.4 - 5.7</p>
-</li>
-<li>
-<p>Hortonworks HDP 2.3 - 2.4</p>
-</li>
-</ul>
-</div>
-<div class="paragraph">
-<p>Other OS releases may work, too. The Trafodion project is currently working on better support for more distribution and non-distribution versions of Hadoop.</p>
-</div>
-<div class="sect2">
-<h3 id="requirements-general-cluster-and-os-requirements-and-recommendations">4.1. General Cluster and OS Requirements and Recommendations</h3>
-<div class="paragraph">
-<p>64-bit x86 instruction set running a Linux distribution is required. Further, Trafodion assumes an environment
-based on the requirements of the tested Hadoop distributions/services.</p>
+in the <a href="#prepare">Prepare</a> chapter, you record the following information.</p>
</div>
-<div class="sect3">
-<h4 id="requirements-cluster-requirements-and-recommendations">4.1.1. Hardware Requirements and Recommendations</h4>
-<div class="sect4">
-<h5 id="requirements-single-node-cluster">Single-Node Cluster</h5>
-<div class="paragraph">
-<p>It is possible to run Trafodion on a single-node sandbox environment. Typically, any sandbox running a Hadoop distribution
-can be used. A typical single-node configuration uses 4-8 cores with 16 GB of memory, and 20 GB free disk space.</p>
-</div>
-</div>
-<div class="sect4">
-<h5 id="requirements-multi-node-cluster">Multi-Node Cluster</h5>
-<div class="paragraph">
-<p>For multi-node end-user clusters, your typical HBase environment should suffice for Trafodion.
-Typically, memory configuration range between 64-128 GB per node with minimum requirement of 16 GB.
-The cluster size can span from 1 to <em>n</em> nodes; a minimum of two nodes is recommended.
-A minimum of two cores is required regardless of whether you’re deploying Trafodion on a bare-metal or virtual environment.</p>
+<table class="tableblock frame-all grid-all spread">
+<colgroup>
+<col style="width: 30%;">
+<col style="width: 50%;">
+<col style="width: 20%;">
+</colgroup>
+<thead>
+<tr>
+<th class="tableblock halign-left valign-top">ID</th>
+<th class="tableblock halign-left valign-top">Information</th>
+<th class="tableblock halign-left valign-top">Setting</th>
+</tr>
+</thead>
+<tbody>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>ADMIN</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Administrator user name for Apache Ambari or Cloudera Manager.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">admin</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>ADMIN_PRINCIPAL</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos principal for the KDC admin user including the realm.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>BACKUP_DCS_NODES</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">List of nodes where to start the backup DCS Master components.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>CLOUD_CONFIG</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether you’re installing Trafodion on a cloud environment.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">N</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>CLOUD_TYPE</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">What type of cloud environment you’re installing Trafodion on.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>CLUSTER_NAME</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The name of the Hadoop Cluster.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Cluster 1</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>DB_ROOT_NAME</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">LDAP name used to connect as database root user</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">trafodion</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>DCS_BUILD</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Tar file containing the DCS component.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>DCS_PRIMARY_MASTER_NODE</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The node where the primary DCS should run.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>DCS_SERVER_PARM</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Number of concurrent client sessions per node.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">8</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>ENABLE_HA</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether to run DCS in high-availability (HA) mode.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">N</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>EPEL_RPM</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Location of EPEL RPM. Specify if you don’t have access to the Internet.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>FLOATING_IP</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">IP address if running DCS in HA mode.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HADOOP_TYPE</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The type of Hadoop distribution you’re installing Trafodion on.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">cloudera</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HBASE_GROUP</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Linux group name for the HBASE administrative user.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">hbase</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HBASE_KEYTAB</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos service keytab for HBase admin principal.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Default based on distribution</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HBASE_USER</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Linux user name for the HBASE administrative user.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">hbase</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HDFS_KEYTAB</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos service keytab for HDFS admin principal.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Default based on distribution</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HDFS_USER</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Linux user name for the HDFS administrative user.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">hdfs</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>HOME_DIR</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Root directory under which the <code>trafodion</code> home directory should be created.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">/home</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>INIT_TRAFODION</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether to automatically initialize the Trafodion database.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Y</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>INTERFACE</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Interface type used for $FLOATING_IP.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>JAVA_HOME</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Location of Java 1.7.0_65 or higher (JDK).</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">/usr/java/jdk1.7.0_67-cloudera</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>KDC_SERVER</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Location of Kerberos server for admin access</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_CERT</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Full path to TLS certificate.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_HOSTS</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">List of nodes where LDAP Identity Store servers are running.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_ID</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">List of LDAP unique identifiers.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_LEVEL</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">LDAP Encryption Level.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_PASSWORD</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Password for LDAP_USER.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_PORT</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Port used to communicate with LDAP Identity Store.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_SECURITY</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether to enable LDAP authentication.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">N</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_USER</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">LDAP Search user name.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>LOCAL_WORKDIR</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The directory where the Trafodion Installer is located.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">/home/centos/trafodion-installer/installer</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>MANAGEMENT_ENABLED</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether your installation uses separate management nodes.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">N</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>MANAGEMENT_NODES</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The FQDN names of management nodes, if any.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>MAX_LIFETIME</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos ticket lifetime for Trafodion principal</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">24hours</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>NODE_LIST</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The FQDN names of the nodes where Trafodion will be installed.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">trafodion-1 trafodion-2</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>PASSWORD</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Administrator password for Apache Ambari or Cloudera Manager.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">admin</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>RENEW_LIFETIME</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos ticket renewal lifetime for Trafodion principal</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">7days</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>REST_BUILD</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Tar file containing the REST component.</p></td>
+<td class="tableblock halign-left valign-top"></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>SECURE_HADOOP</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Indicates whether Hadoop has Kerberos enabled</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Based on whether Kerberos is enabled for your Hadoop installation</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_HOME</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Target directory for the Trafodion software.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">/home/trafodion/apache-trafodion-1.3.0-incubating-bin</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>START</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether to start Trafodion after install/upgrade.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Y</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>SUSE_LINUX</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Whether your installing Trafodion on SUSE Linux.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">false</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_PACKAGE</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The location of the Trafodion installation package tar file or core installation tar file.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">/home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_KEYTAB</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos keytab for <code>trafodion</code> principal.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Default keytab based on distribution</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_KEYTAB_DIR</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Location of Kerberos keytab for the <code>trafodion</code> principal.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Default location based on distribution</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_USER</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The Trafodion runtime user ID. Must be <code>trafodion</code> in this release.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">trafodion</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_USER_PASSWORD</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">The password used for the <code>trafodion:trafodion</code> user ID.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">traf123</p></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>URL</pre></div></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">FQDN and port for the Distribution Manager’s REST API.</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">trafodion-1.apache.org:7180</p></td>
+</tr>
+</tbody>
+</table>
+<div class="paragraph">
+<p>Next, you edit <code>my_config</code> to contain the following:</p>
+</div>
+<div class="listingblock">
+<div class="content">
+<pre class="CodeRay highlight"><code data-lang="text">#!/bin/bash
+# @@@ START COPYRIGHT @@@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+# @@@ END COPYRIGHT @@@
+
+#====================================================
+# Trafodion Configuration File
+# This file contains default values for the installer.
+
+# Users can also edit this file and provide values for all parameters
+# and then specify this file on the run line of trafodion_install.
+# Example:
+# ./trafodion_install --config_file <Trafodion-config-file>
+# WARNING: This mode is for advanced users!
+#
+#=====================================================
+
+
+#=====================================================
+#Must be set to 'true' if on a SUSE linux system. If on another type of system
+#this must be set to false.
+
+export SUSE_LINUX="false"
+
+# The working directory where Trafodion installer untars files, etc.
+# do not change this unless you really know what you are doing
+export TRAF_WORKDIR="/usr/lib/trafodion"
+
+# This is the directory where the installer scripts were untarred to
+export LOCAL_WORKDIR="/home/centos/trafodion-installer/installer"
+
+# The maximum number of dcs servers, i.e. client connections
+export DCS_SERVERS_PARM="8"
+
+# "true" if this is an upgrade
+export UPGRADE_TRAF="false"
+
+# Trafodion userid, This is the userid the Trafodion instance will run under
+export TRAF_USER="trafodion"
+
+# Trafodion userid's password
+export TRAF_USER_PASSWORD="traf123"
+
+# a blank separated list of nodes in your cluster
+# node names should include full domain names
+#This can not be left blank!
+export NODE_LIST="trafodion-1 trafodion-2"
+
+# count of nodes in node list
+export node_count="2"
+
+# another list of the same nodes in NODE_LIST but specified in a pdsh usable format
+# i.e. "-w centos-cdh[1-6]" or "-w node1 -w node2 -w node3"
+export MY_NODES="-w trafodion-[1-2]"
+
+# the directory prefix for the trafodion userid's $HOME directory
+# i.e. /opt/home, not /opt/home/trafodion
+export HOME_DIR="/home"
+
+#JAVA HOME must be a JDK. Must include FULL Path. Must be 1.7.0_65 or higher.
+
+export JAVA_HOME="/usr/java/jdk1.7.0_67-cloudera"
+
+# If your machine doesn't have external internet access then you must
+# specify the location of the EPEL rpm, otherwise leave blank and it
+# will be installed from the internet
+export EPEL_RPM=""
+
+# full path of the Trafodion package tar file
+export TRAF_PACKAGE="/home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz"
+
+# if TRAF_PACKAGE wasn't specified then these two values must be specified
+# TRAF_BUILD is the trafodion_server tar file
+# DCS_BUILD is the DCS tar file
+# REST_BUILD is the REST tar file
+export TRAF_BUILD=""
+export DCS_BUILD=""
+export REST_BUILD=""
+# Either "cloudera" or "hortonworks" (all lowercase)
+export HADOOP_TYPE="cloudera"
+
+# The URL for Cloudera/Hortonworks REST API (i.e. node1.host.com:8080)
+export URL="trafodion-1.apache.org:7180"
+
+# Cloudera/Hortonworks UI admin's userid and password
+export ADMIN="admin"
+export PASSWORD="admin"
+
+# hadoop cluster name
+export CLUSTER_NAME=""
+
+# the Hadoop HDFS userid
+export HDFS_USER="hdfs"
+
+# the Hadoop HBase userid and group
+export HBASE_USER="hbase"
+export HBASE_GROUP="hbase"
+
+# The hadoop HBase service name
+export HBASE="hbase"
+
+# full path of where to install Trafodion to
+# Example is used below. If $HOME_DIR or $TRAF_USER have been changed
+# then this will need to be changed.
+# On an upgrade, it is recommend to choose a different directory.
+# First time install : /home/trafodion/traf
+# On Upgrade: /home/trafodion/traf_<date>
+# By doing this the previous version will remain and allow for an easier rollback.
+export TRAF_HOME="/home/trafodion/apache-trafodion-1.3.0-incubating-bin"
+
+# Start Trafodion after install completes
+export START="Y"
+
+# initialize trafodion after starting
+export INIT_TRAFODION="Y"
+
+# full path to the sqconfig file
+# Default is to leave as is and this file will be created.
+export SQCONFIG=""
+
+#----------------- security configuration information -----------------
+#Enter in Kerberos details if Kerberos is enabled on your cluster
+
+#Indicate Kerberos is enabled
+export SECURE_HADOOP="N"
+
+#Location of Kerberos server for admin access
+export KDC_SERVER=""
+
+#Kerberos Admin principal used to create Trafodion principals and keytabs
+#Please include realm, for example: trafadmin/admin@MYREALM.COM
+export ADMIN_PRINCIPAL=""
+
+#Keytab for HBase admin user, used to grant Trafodion user CRWE privilege
+export HBASE_KEYTAB=""
+
+#Keytab for HDFS admin user, used to create data directories for Trafodion
+export HDFS_KEYTAB=""
+
+#Kerberos ticket defaults for the Trafodion user
+export MAX_LIFETIME="24hours"
+export RENEW_LIFETIME="7days"
+
+#Trafodion keytab information
+export TRAF_KEYTAB=""
+export TRAF_KEYTAB_DIR=""
+
+#Enter in LDAP configuration information
+#Turn on authentication - MUST have existing LDAP configured.
+export LDAP_SECURITY="Y"
+
+#Name of LDAP Config file
+export LDAP_AUTH_FILE="traf_authentication_config_`hostname -s`"
+
+#LDAP name to map to database user DB__ROOT
+DB_ROOT_NAME="trafodion"
+#----------------- end security configuration -----------------
+
+export CONFIG_COMPLETE="true"</code></pre>
+</div>
+</div>
+<div class="paragraph">
+<p>Once completed, run the Trafodion Installer with the <code>--config_file</code> option.</p>
+</div>
+<div class="paragraph">
+<p>Refer to the following sections for examples:</p>
+</div>
+<div class="ulist">
+<ul>
+<li>
+<p><a href="#install-automated-install">Automated Install</a></p>
+</li>
+<li>
+<p><a href="#upgrade-automated-upgrade">Automated Upgrade</a></p>
+</li>
+</ul>
+</div>
+</div>
+</div>
+</div>
+<div class="sect2">
+<h3 id="introduction-trafodion-provisioning-directories">3.6. Trafodion Provisioning Directories</h3>
+<div class="paragraph">
+<p>Trafodion stores its provisioning information in the following directories on each node in the cluster:</p>
+</div>
+<div class="ulist">
+<ul>
+<li>
+<p><code>/etc/trafodion</code>: Configuration information.</p>
+</li>
+<li>
+<p><code>/usr/lib/trafodion</code>: Copies of the files required by the installer.</p>
+</li>
+</ul>
+</div>
+</div>
+</div>
+</div>
+<div class="sect1">
+<h2 id="requirements">4. Requirements</h2>
+<div class="sectionbody">
+<div class="paragraph">
+<p>Trafodion requires an x86 version of Linux.</p>
+</div>
+<div class="paragraph">
+<p>The current release of Trafodion has been tested with:</p>
+</div>
+<div class="ulist">
+<ul>
+<li>
+<p>64-bit Red Hat Enterprise Linux (RHEL) or CentOS 6.5, 6.6, and 6.7</p>
+</li>
+<li>
+<p>Cloudera CDH 5.4</p>
+</li>
+<li>
+<p>Hortonworks HDP 2.3</p>
+</li>
+</ul>
+</div>
+<div class="paragraph">
+<p>Other OS releases may work, too. The Trafodion project is currently working on better support for more distribution and non-distribution versions of Hadoop.</p>
+</div>
+<div class="sect2">
+<h3 id="requirements-general-cluster-and-os-requirements-and-recommendations">4.1. General Cluster and OS Requirements and Recommendations</h3>
+<div class="paragraph">
+<p>64-bit x86 instruction set running a Linux distribution is required. Further, Trafodion assumes an environment
+based on the requirements of the tested Hadoop distributions/services.</p>
+</div>
+<div class="sect3">
+<h4 id="requirements-cluster-requirements-and-recommendations">4.1.1. Hardware Requirements and Recommendations</h4>
+<div class="sect4">
+<h5 id="requirements-single-node-cluster">Single-Node Cluster</h5>
+<div class="paragraph">
+<p>It is possible to run Trafodion on a single-node sandbox environment. Typically, any sandbox running a Hadoop distribution
+can be used. A typical single-node configuration uses 4-8 cores with 16 GB of memory, and 20 GB free disk space.</p>
+</div>
+</div>
+<div class="sect4">
+<h5 id="requirements-multi-node-cluster">Multi-Node Cluster</h5>
+<div class="paragraph">
+<p>For multi-node end-user clusters, your typical HBase environment should suffice for Trafodion.
+Typically, memory configuration range between 64-128 GB per node with minimum requirement of 16 GB.
+The cluster size can span from 1 to <em>n</em> nodes; a minimum of two nodes is recommended.
+A minimum of two cores is required regardless of whether you’re deploying Trafodion on a bare-metal or virtual environment.</p>
</div>
<div style="page-break-after: always;"></div>
<div class="paragraph">
@@ -1879,11 +2660,9 @@ A minimum of two cores is required regardless of whether you’re deploying
<p>Linux</p>
</div></div></td>
<td class="tableblock halign-left valign-top"><div><div class="paragraph">
-<p>64-bit version of Red Hat(RHEL) or CentOS 6.5 -6.8</p>
-</div></div></td>
-<td class="tableblock halign-left valign-top"><div><div class="paragraph">
-<p><code>cat /etc/redhat-release</code></p>
+<p>64-bit version of Red Hat 6.5 or later, or SUSE SLES 11.3 or later.</p>
</div></div></td>
+<td class="tableblock halign-left valign-top"><div></div></td>
</tr>
<tr>
<td class="tableblock halign-left valign-top"><div><div class="paragraph">
@@ -2036,6 +2815,50 @@ the port is <strong>not</strong> open.</p>
<p><code>scp --help</code></p>
</div></div></td>
</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>curl</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>Available to transfer data with URL syntax.</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p><code>curl --version</code></p>
+</div></div></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>wget</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>Available to download files from the Web.</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p><code>wget --version</code></p>
+</div></div></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>pdsh</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>Available to run shell commands in parallel.</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p><code>pdsh -V</code></p>
+</div></div></td>
+</tr>
+<tr>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>pdcp</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p>Available to copy files among nodes in parallel. part of the <code>pdsh</code> package.</p>
+</div></div></td>
+<td class="tableblock halign-left valign-top"><div><div class="paragraph">
+<p><code>pdcp -V</code></p>
+</div></div></td>
+</tr>
</tbody>
</table>
</div>
@@ -2308,7 +3131,7 @@ tools that are not typically packaged as part of the core Linux distribution.</p
<td class="content">
For RedHat/CentOS, the Trafodion Installer automatically attempts get a subset of these packages over the Internet.
If the cluster’s access to the Internet is disabled, then you need to manually download the packages and make them available
-for installation.
+for installation. You need to build and install <code>log4c++</code> manually.
</td>
</tr>
</table>
@@ -2339,6 +3162,11 @@ for installation.
<td class="tableblock halign-left valign-top"><div class="literal"><pre>yum install pdsh</pre></div></td>
</tr>
<tr>
+<td class="tableblock halign-left valign-top"><p class="tableblock">log4cxx</p></td>
+<td class="tableblock halign-left valign-top"><p class="tableblock">Message logging.</p></td>
+<td class="tableblock halign-left valign-top"><div class="literal"><pre>Manual process<sup>1</sup></pre></div></td>
+</tr>
+<tr>
<td class="tableblock halign-left valign-top"><p class="tableblock">sqlite</p></td>
<td class="tableblock halign-left valign-top"><p class="tableblock">Internal configurat
<TRUNCATED>