You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@trafodion.apache.org by db...@apache.org on 2016/02/18 17:14:55 UTC
[04/13] incubator-trafodion git commit: Backup checkin of changes to
the Provisioning Guide.
Backup checkin of changes to the Provisioning Guide.
Project: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/commit/72a90762
Tree: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/tree/72a90762
Diff: http://git-wip-us.apache.org/repos/asf/incubator-trafodion/diff/72a90762
Branch: refs/heads/master
Commit: 72a907620b8dedbe9fc9a1db8b8cfccb7e49cd13
Parents: b763c5f
Author: Gunnar Tapper <gt...@esgyn.local>
Authored: Mon Feb 15 01:09:03 2016 -0700
Committer: Gunnar Tapper <gt...@esgyn.local>
Committed: Mon Feb 15 01:09:03 2016 -0700
----------------------------------------------------------------------
.../src/asciidoc/_chapters/activate.adoc | 119 +++-
.../src/asciidoc/_chapters/install.adoc | 610 ++++++++++++++++++-
.../src/asciidoc/_chapters/introduction.adoc | 1 +
.../src/asciidoc/_chapters/prepare.adoc | 52 +-
.../src/asciidoc/_chapters/remove.adoc | 112 ++++
docs/provisioning_guide/src/asciidoc/index.adoc | 1 +
pom.xml | 4 +-
7 files changed, 879 insertions(+), 20 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/docs/provisioning_guide/src/asciidoc/_chapters/activate.adoc
----------------------------------------------------------------------
diff --git a/docs/provisioning_guide/src/asciidoc/_chapters/activate.adoc b/docs/provisioning_guide/src/asciidoc/_chapters/activate.adoc
index c52da33..0bedc5d 100644
--- a/docs/provisioning_guide/src/asciidoc/_chapters/activate.adoc
+++ b/docs/provisioning_guide/src/asciidoc/_chapters/activate.adoc
@@ -25,4 +25,121 @@
[[activate]]
= Activate
-To be written.
+
+[[activate-manage-trafodion]]
+== Manage Trafodion
+
+You use the Trafodion runtime user ID to perform Trafodion management operations.
+
+The following table provides an overview of the different Trafodion management scripts.
+
+[cols="40%,20%l,20%l,20%l",options="header"]
+|===
+| Component | Start | Stop | Status
+| *All of Trafodion* | sqstart | sqstop | sqcheck
+| *RMS Server* | rmsstart | rmsstop | rmscheck
+| *REST Server* | reststart | reststop | -
+| *LOB Server* | lobstart | lobstop | -
+| *DCS (Database Connectivity Services)* | dcsstart | dcsstop | dcscheck
+|===
+
+*Example: Start Trafodion*
+
+```
+cd $MY_SQROOT/sql/scripts
+sqstart
+sqcheck
+```
+
+[[activate-validate-trafodion-installation]]
+== Validate Trafodion Installation
+
+You can use sqlci (part of the base product) or trafci (requires separate install; see the
+http://trafodion.apache.org/docs/client_install/index.html[Trafodion Client Installation Guide]) to validate your installation.
+
+=== Smoke Test
+A simple smoke test to validate that Trafodion is function.
+
+```
+get schemas;
+create table table1 (a int);
+invoke table1;
+insert into table1 values (1), (2), (3), (4);
+select * from table1;
+drop table table1;
+exit;
+```
+
+*Example*
+
+```
+$ sqlci
+Apache Trafodion Conversational Interface 1.3.0
+Copyright (c) 2015 Apache Software Foundation
+>>get schemas;
+
+Schemas in Catalog TRAFODION
+============================
+
+SEABASE
+_MD_
+_REPOS_
+
+--- SQL operation complete.
+>>create table table1 (a int);
+
+--- SQL operation complete.
+>>invoke table1;
+
+-- Definition of Trafodion table TRAFODION.SEABASE.TABLE1
+-- Definition current Mon Feb 15 07:42:02 2016
+
+ (
+ SYSKEY LARGEINT NO DEFAULT NOT NULL NOT DROPPABLE
+ NOT SERIALIZED
+ , A INT DEFAULT NULL SERIALIZED
+ )
+
+--- SQL operation complete.
+>>insert into table1 values (1), (2), (3), (4);
+
+--- 4 row(s) inserted.
+>>select * from table1;
+
+A
+-----------
+
+ 1
+ 2
+ 3
+ 4
+
+--- 4 row(s) selected.
+>>drop table table1;
+
+--- SQL operation complete.
+>>exit;
+$
+```
+
+Assuming no errors, your installation has been successful. Next, do the following:
+
+* Install the Trafodion client software. Refer to the http://trafodion.apache.org/docs/client_install/index.html[Trafodion Client Installation Guide].
+* Use Trafodion. Refer to the http://trafodion.apache.org/docs/sql_reference/index.html[Trafodion SQL Reference Manual.]
+* Review other Trafodion documentation. Refer to the http://trafodion.apache.org/documentation.html[Trafodion documentation].
+
+[[activate-troubleshooting-tips]]
+== Troubleshooting Tips
+
+If you are not able to start up the environment or if there are problems running sqlci or trafci, then verify that the all the processes are up and running.
+
+* `sqcheck` should indicate all processes are running.
+
+If processes are not running as expected, then:
+
+* `sqstop` to shut down Trafodion. If some Trafodion processes do not terminate cleanly, then run `ckillall`.
+* `sqstart` to restart Trafodion.
+
+If problems persist please review logs:
+
+* `$MY_SQROOT/logs`: Trafodion logs.
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/docs/provisioning_guide/src/asciidoc/_chapters/install.adoc
----------------------------------------------------------------------
diff --git a/docs/provisioning_guide/src/asciidoc/_chapters/install.adoc b/docs/provisioning_guide/src/asciidoc/_chapters/install.adoc
index 839384b..08bcb4a 100644
--- a/docs/provisioning_guide/src/asciidoc/_chapters/install.adoc
+++ b/docs/provisioning_guide/src/asciidoc/_chapters/install.adoc
@@ -75,6 +75,10 @@ $
[[install-trafodion-installer]]
== Trafodion Installer
+NOTE: You *must* install log4c++ on all nodes in the cluster prior to running the Trafodion Installer. Refer
+to <<prepare-build-and-install-log4cplusplus,Build and Install log4c++>> for instructions.
+
+
The Trafodion Installer automates most of the tasks requires to install Trafodion. First, unpack the installation tar file.
*Example*
@@ -105,7 +109,6 @@ Expert Setup is recommended for the expert user and/or for unattended installs.
Refer to <<install-trafodion-expert-setup,Trafodion Installer: Expert Setup>> for information about how to
populate this file.
-
[[install-trafodion-installer-usage]]
=== Trafodion Installer: Usage
@@ -139,9 +142,614 @@ The Guided Setup prompts you for the information you collected in the
The following example shows how to install Trafodion a two-node Cloudera Hadoop cluster using Guided Setup.
+NOTE: By default, the Trafodion Installer invokes `sqlci` so that you can enter the `initialize tradodion;` command.
+This is shown in the example below.
+
+```
+$ cd $HOME/trafodion-installer/installer
+$ ./trafodion_install
+
+******************************
+ TRAFODION INSTALLATION START
+******************************
+
+***INFO: testing sudo access
+***INFO: Log file located at /var/log/trafodion/trafodion_install_2016-02-15-04-45-30.log
+***INFO: Config directory: /etc/trafodion
+***INFO: Working directory: /usr/lib/trafodion
+
+*******************************
+ Trafodion Configuration Setup
+*******************************
+
+***INFO: Please press [Enter] to select defaults.
+
+Enter trafodion password, default is [traf123]: traf123
+Enter list of nodes (blank separated), default []: trafodion-1 trafodion-2
+Enter Trafodion userid's home directory prefix, default is [/home]: /home
+Specify full path to EPEL RPM (including .rpm), default is None:
+***INFO: Will attempt to download RPM if EPEL is not installed on all nodes.
+Specify location of Java 1.7.0_65 or higher (JDK), default is []: /usr/java/jdk1.7.0_67-cloudera
+Enter full path (including .tar or .tar.gz) of trafodion tar file []: /home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz
+Enter Hadoop admin username, default is [admin]:
+Enter Hadoop admin password, default is [admin]:
+Enter Hadoop external network URL:port (no 'http://' needed), default is []: trafodion-1.apache.org:7180
+Enter HDFS username, default is [hdfs]:
+Enter HBase username, default is [hbase]:
+Enter HBase group, default is [hbase]:
+Enter directory to install trafodion to, default is [/home/trafodion/apache-trafodion-1.3.0-incubating-bin]:
+Total number of client connections per node, default [16]: 8
+Enable simple LDAP security (Y/N), default is N: N
+***INFO: Configuration file: /etc/trafodion/trafodion_config
+***INFO: Trafodion configuration setup complete
+
+************************************
+ Trafodion Configuration File Check
+************************************
+
+
+The authenticity of host 'trafodion-1 (10.1.30.71)' can't be established.
+RSA key fingerprint is 83:96:d4:5e:c1:b8:b1:62:8d:c6:78:a7:7f:1f:6a:d7.
+Are you sure you want to continue connecting (yes/no)? yes
+***INFO: Testing sudo access on node trafodion-1
+***INFO: Testing sudo access on node trafodion-2
+***INFO: Testing ssh on trafodion-1
+***INFO: Testing ssh on trafodion-2
+***INFO: Getting list of all cloudera nodes
+***INFO: Getting list of all cloudera nodes
+***INFO: cloudera list of nodes: trafodion-1 trafodion-2
+***INFO: Testing ssh on trafodion-1
+***INFO: Testing ssh on trafodion-2
+***INFO: Testing sudo access on trafodion-1
+***INFO: Testing sudo access on trafodion-2
+***DEBUG: trafodionFullName=trafodion_server-1.3.0.tgz
+***INFO: Trafodion version = 1.3.0
+***DEBUG: HBase's java_exec=/usr/java/jdk1.7.0_67-cloudera/bin/java
+
+******************************
+ TRAFODION SETUP
+******************************
+
+***INFO: Starting Trafodion environment setup (2016-02-15-07-09-58)
+=== 2016-02-15-07-09-58 ===
+# @@@ START COPYRIGHT @@@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+.
+.
+.
+and hold each Contributor harmless for any liability incurred by,
+or claims asserted against, such Contributor by reason of your
+accepting any such warranty or additional liability.
+
+END OF TERMS AND CONDITIONS
+
+BY TYPING "ACCEPT" YOU AGREE TO THE TERMS OF THIS AGREEMENT:ACCEPT
+***INFO: testing sudo access
+***INFO: Checking all nodes in specified node list
+trafodion-1
+trafodion-2
+***INFO: Total number of nodes = 2
+***INFO: Starting Trafodion Package Setup (2016-02-15-07-11-09)
+***INFO: Installing required packages
+***INFO: Log file located in /var/log/trafodion
+***INFO: ... pdsh on node trafodion-1
+***INFO: ... pdsh on node trafodion-2
+***INFO: Checking if log4cxx is installed ...
+***INFO: Checking if sqlite is installed ...
+***INFO: Checking if expect is installed ...
+***INFO: Installing expect on all nodes
+.
+.
+.
+***INFO: modifying limits in /usr/lib/trafodion/trafodion.conf on all nodes
+***INFO: create Trafodion userid "trafodion"
+***INFO: Trafodion userid's (trafodion) home directory: /home/trafodion
+***INFO: testing sudo access
+Generating public/private rsa key pair.
+Created directory '/home/trafodion/.ssh'.
+Your identification has been saved in /home/trafodion/.ssh/id_rsa.
+Your public key has been saved in /home/trafodion/.ssh/id_rsa.pub.
+The key fingerprint is:
+4b:b3:60:38:c9:9d:19:f8:cd:b1:c8:cd:2a:6e:4e:d0 trafodion@trafodion-1
+The key's randomart image is:
++--[ RSA 2048]----+
+| |
+| . |
+| . . . |
+| o * X o |
+| . E X S |
+| . o + + |
+| o . o |
+| o.. |
+| oo |
++-----------------+
+***INFO: creating .bashrc file
+***INFO: Setting up userid trafodion on all other nodes in cluster
+***INFO: Creating known_hosts file for all nodes
+trafodion-1
+trafodion-2
+***INFO: trafodion user added successfully
+***INFO: Trafodion environment setup completed
+***INFO: creating sqconfig file
+***INFO: Reserving DCS ports
+
+******************************
+ TRAFODION MODS
+******************************
+
+***INFO: Cloudera installed will run traf_cloudera_mods98
+***INFO: Detected JAVA version 1.7
+***INFO: copying hbase-trx-cdh5_3-1.3.0.jar to all nodes
+***INFO: Cloudera Manager is on trafodion-1
+***INFO: Detected JAVA version 1.7
+***INFO: copying hbase-trx-cdh5_3-1.3.0.jar to all nodes
+***INFO: Cloudera Manager is on trafodion-1
+ % Total % Received % Xferd Average Speed Time Time Time Current
+.
+.
+.
+{
+ "id" : 76,
+ "name" : "Restart",
+ "startTime" : "2016-02-15T07:12:48.511Z",
+ "active" : true,
+ "children" : {
+ "items" : [ {
+ "id" : 77,
+ "name" : "Stop",
+ "startTime" : "2016-02-15T07:12:48.575Z",
+ "endTime" : "2016-02-15T07:13:17.139Z",
+ "active" : false,
+ "success" : true,
+ "resultMessage" : "All services successfully stopped."
+ }, {
+ "id" : 100,
+ "name" : "Start",
+ "startTime" : "2016-02-15T07:13:17.157Z",
+ "active" : true
+ } ]
+ }
+}***INFO: ...polling every 30 seconds until restart is completed.
+ "resultMessage" : "All services successfully started."
+ } ]
+ }
+}***INFO: ...polling every 30 seconds until restart is completed.
+***INFO: Hadoop restart completed successfully
+***INFO: waiting for HDFS to exit safemode
+Safe mode is OFF
+***INFO: Setting HDFS ACLs for snapshot scan support
+***INFO: Trafodion Mods ran successfully.
+
+******************************
+ TRAFODION START
+******************************
+
+/usr/lib/trafodion/installer/..
+***INFO: Log file location /var/log/trafodion/trafodion_install_2016-02-15-07-08-07.log
+***INFO: traf_start
+******************************************
+******************************************
+******************************************
+******************************************
+/home/trafodion/apache-trafodion-1.3.0-incubating-bin
+***INFO: untarring build file /usr/lib/trafodion/apache-trafodion-1.3.0-incubating-bin/trafodion_server-1.3.0.tgz to /home/trafodion/apache-trafodion-1.3.0-incubating-bin
+.
+.
+.
+******* Generate public/private certificates *******
+
+ Cluster Name : Cluster%201
+Generating Self Signed Certificate....
+***********************************************************
+ Certificate file :server.crt
+ Private key file :server.key
+ Certificate/Private key created in directory :/home/trafodion/sqcert
+***********************************************************
+
+***********************************************************
+ Updating Authentication Configuration
+***********************************************************
+Creating folders for storing certificates
+
+***INFO: copying /home/trafodion/sqcert directory to all nodes
+***INFO: copying install to all nodes
+***INFO: starting Trafodion instance
+Checking orphan processes.
+Removing old mpijob* files from /home/trafodion/apache-trafodion-1.3.0-incubating-bin/tmp
+
+Removing old monitor.port* files from /home/trafodion/apache-trafodion-1.3.0-incubating-bin/tmp
+
+Executing sqipcrm (output to sqipcrm.out)
+Starting the SQ Environment (Executing /home/trafodion/apache-trafodion-1.3.0-incubating-bin/sql/scripts/gomon.cold)
+Background SQ Startup job (pid: 7276)
+.
+.
+.
+Zookeeper is listening on port 2181
+DcsMaster is listening on port 23400
+
+Process Configured Actual Down
+--------- ---------- ------ ----
+DcsMaster 1 1
+DcsServer 2 2
+mxosrvr 8 8
+
+
+You can monitor the SQ shell log file : /home/trafodion/apache-trafodion-1.3.0-incubating-bin/logs/sqmon.log
+
+
+Startup time 0 hour(s) 1 minute(s) 9 second(s)
+Apache Trafodion Conversational Interface 1.3.0
+Copyright (c) 2015 Apache Software Foundation
+>> initialize trafodion;
+--- SQL operation complete.
+>>
+
+End of MXCI Session
+
+***INFO: Installation completed successfully.
+
+*********************************
+ TRAFODION INSTALLATION COMPLETE
+*********************************
+```
+
+Next, switch to the Trafodion Runtime User and check the status of Trafodion.
+
+*Example*
+
+```
+$ sudo su - trafodion
+$ sqcheck
+Checking if processes are up.
+Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
+
+The SQ environment is up!
+
+
+Process Configured Actual Down
+------- ---------- ------ ----
+DTM 2 2
+RMS 4 4
+MXOSRVR 8 8
+
+$
+```
+
+Trafodion is now running on your Hadoop cluster. Please refer to the <<activate,Activate>> chapter for
+basic instructions on how to verify the Trafodion management and how to perform basic management
+operations.
+
+[[install-trafodion-installer-expert-setup]]
+=== Trafodion Installer: Expert Setup
+
+The `--config_file` option runs the Trafodion in Expert Setup mode.
+
+Before running the Trafodion Installer with this option, you do the following:
+
+1. Copy the `trafodion_config_default` file.
++
+*Example*
++
+```
+cp trafodion_config_default my_config
+```
+
+2. Edit the new file using the information you collected in the
+<<prepare-gather-configuration-information,Gather Configuration Information>>
+
+3. Run the Trafodion Installer in Expert Setup Mode
++
+*Example*
++
+```
+./trafodion_installer --config_file my_config
+```
+
+==== Example: Creating a Trafodion Configuration File
+
+Using the instructions in <<prepare-gather-configuration-information,Gather Configuration Information>>,
+you recorded the following information.
+
+[cols="15%l,50%,35%",options="header"]
+|===
+| ID | Information | Setting
+| ADMIN | Administrator user name for Apache Ambari or Cloudera Manager. | admin
+| BACKUP_DCS_NODES | List of nodes where to start the backup DCS Master components. |
+| CLOUD_CONFIG | Whether you're installing Trafodion on a cloud environment. | N
+| CLOUD_TYPE | What type of cloud environment you're installing Trafodion on. |
+| CLUSTER_NAME | The name of the Hadoop Cluster. | Cluster 1
+| DCS_BUILD | Tar file containing the DCS component. |
+| DCS_PRIMARY_MASTER_NODE | The node where the primary DCS should run. |
+| DCS_SERVER_PARM | Number of concurrent client sessions per node. | 8
+| ENABLE_HA | Whether to run DCS in high-availability (HA) mode. | N
+| EPEL_RPM | Location of EPEL RPM. Specify if you don't have access to the Internet. |
+| FLOATING_IP | IP address if running DCS in HA mode. |
+| HADOOP_TYPE | The type of Hadoop distribution you're installing Trafodion on. | cloudera
+| HBASE_GROUP | Linux group name for the HBASE administative user. | hbase
+| HBASE_USER | Linux user name for the HBASE administative user. | hbase
+| HDFS_USER | Linux user name for the HDFS administative user. | hdfs
+| HOME_DIR | Root directory under which the `trafodion` home directory should be created. | /home
+| INIT_TRAFODION | Whether to automatically initialize the Trafodion database. | Y
+| INTERFACE | Interface type used for $FLOATING_IP. |
+| JAVA_HOME | Location of Java 1.7.0_65 or higher (JDK). | /usr/java/jdk1.7.0_67-cloudera
+| LDAP_CERT | Full path to TLS certificate. |
+| LDAP_HOSTS | List of nodes where LDAP Identity Store servers are running. |
+| LDAP_ID | List of LDAP unique identifiers. |
+| LDAP_LEVEL | LDAP Encryption Level. |
+| LDAP_PASSWORD | Password for LDAP_USER. |
+| LDAP_PORT | Port used to communicate with LDAP Identity Store. |
+| LDAP_SECURITY | Whether to enable simple LDAP authentification. | N
+| LDAP_USER | LDAP Search user name. |
+| LOCAL_WORKDIR | The directory where the Trafodion Installer is located. | /home/centos/trafodion-installer/installer
+| MANAGEMENT_ENABLED | Whether your installation uses separate management nodes. | N
+| MANAGEMENT_NODES | The FQDN names of management nodes, if any. |
+| NODE_LIST | The FQDN names of the nodes where Trafodion will be installed. | trafodion-1 trafodion-2
+| PASSWORD | Administrator password for Apache Ambari or Cloudera Manager. | admin
+| REST_BUILD | Tar file containing the REST component. |
+| SQ_ROOT | Target directory for the Trafodion software. | /home/trafodion/apache-trafodion-1.3.0-incubating-bin
+| START | Whether to start Trafodion after install/upgrade. | Y
+| SUSE_LINUX | Whether your installing Trafodion on SUSE Linux. | false
+| TRAF_PACKAGE | The location of the Trafodion installation package tar file or core installation tar file. | /home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz
+| TRAF_USER | The Trafodion runtim user ID. Must be `trafodion` in this release. | trafodion
+| TRAF_USER_PASSWORD | The password used for the `trafodion:trafodion` user ID. | traf123
+| URL | FQDN and port for the Distribution Manager's REST API. | trafodion-1.apache.org:7180
+|===
+
+Using the information above, you edit `my_config` to contain the following:
+
```
+#!/bin/bash
+# @@@ START COPYRIGHT @@@
+#
+# Licensed to the Apache Software Foundation (ASF) under one
+# or more contributor license agreements. See the NOTICE file
+# distributed with this work for additional information
+# regarding copyright ownership. The ASF licenses this file
+# to you under the Apache License, Version 2.0 (the
+# "License"); you may not use this file except in compliance
+# with the License. You may obtain a copy of the License at
+#
+# http://www.apache.org/licenses/LICENSE-2.0
+#
+# Unless required by applicable law or agreed to in writing,
+# software distributed under the License is distributed on an
+# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+# KIND, either express or implied. See the License for the
+# specific language governing permissions and limitations
+# under the License.
+#
+# @@@ END COPYRIGHT @@@
+
+#====================================================
+# Trafodion Configuration File
+# This file contains default values for the installer.
+
+# Users can also edit this file and provide values for all parameters
+# and then specify this file on the run line of trafodion_install.
+# Example:
+# ./trafodion_install --config_file <Trafodion-config-file>
+# WARNING: This mode is for advanced users!
+#
+#=====================================================
+
+
+#=====================================================
+#Must be set to 'true' if on a SUSE linux system. If on another type of system
+#this must be set to false.
+
+export SUSE_LINUX="false"
+
+# The working directory where Trafodion installer untars files, etc.
+# do not change this unless you really know what you are doing
+export TRAF_WORKDIR="/usr/lib/trafodion"
+
+# This is the directory where the installer scripts were untarred to
+export LOCAL_WORKDIR="/home/centos/trafodion-installer/installer"
+
+# The maximum number of dcs servers, i.e. client connections
+export DCS_SERVERS_PARM="8"
+
+# "true" if this is an upgrade
+export UPGRADE_TRAF="false"
+
+# Trafodion userid, This is the userid the Trafodion instance will run under
+export TRAF_USER="trafodion"
+
+# Trafodion userid's password
+export TRAF_USER_PASSWORD="traf123"
+
+# a blank separated list of nodes in your cluster
+# node names should include full domain names
+#This can not be left blank!
+export NODE_LIST="trafodion-1 trafodion-2"
+
+# count of nodes in node list
+export node_count="2"
+
+# another list of the same nodes in NODE_LIST but specified in a pdsh usable format
+# i.e. "-w centos-cdh[1-6]" or "-w node1 -w node2 -w node3"
+export MY_NODES="-w trafodion-[1-2]"
+
+# the directory prefix for the trafodion userid's $HOME directory
+# i.e. /opt/home, not /opt/home/trafodion
+export HOME_DIR="/home"
+
+#JAVA HOME must be a JDK. Must include FULL Path. Must be 1.7.0_65 or higher.
+
+export JAVA_HOME="/usr/java/jdk1.7.0_67-cloudera"
+
+# If your machine doesn't have external internet access then you must
+# specify the location of the EPEL rpm, otherwise leave blank and it
+# will be installed from the internet
+export EPEL_RPM=""
+
+# full path of the Trafodion package tar file
+export TRAF_PACKAGE="/home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz"
+
+# if TRAF_PACKAGE wasn't specified then these two values must be specified
+# TRAF_BUILD is the trafodion_server tar file
+# DCS_BUILD is the DCS tar file
+# REST_BUILD is the REST tar file
+export TRAF_BUILD=""
+export DCS_BUILD=""
+export REST_BUILD=""
+# Either "cloudera" or "hortonworks" (all lowercase)
+export HADOOP_TYPE="cloudera"
+
+# The URL for Cloudera/Hortonworks REST API (i.e. node1.hp.com:8080)
+export URL="trafodion-1.apache.org:7180"
+
+# Cloudera/Hortonworks UI admin's userid and password
+export ADMIN="admin"
+export PASSWORD="admin"
+
+# hadoop cluster name
+export CLUSTER_NAME=""
+
+# the Hadoop HDFS userid
+export HDFS_USER="hdfs"
+
+# the Hadoop HBase userid and group
+export HBASE_USER="hbase"
+export HBASE_GROUP="hbase"
+
+# The hadoop HBase service name
+export HBASE="hbase"
+
+# full path of where to install Trafodion to
+# Example is used below. If $HOME_DIR or $TRAF_USER have been changed
+# then this will need to be changed.
+# On an upgrade, it is recommend to choose a different directory.
+# First time install : /home/trafodion/traf
+# On Upgrade: /home/trafodion/traf_<date>
+# By doing this the previous version will remain and allow for an easier rollback.
+export SQ_ROOT="/home/trafodion/apache-trafodion-1.3.0-incubating-bin"
+
+# Start Trafodion after install completes
+export START="Y"
+
+# initialize trafodion after starting
+export INIT_TRAFODION="Y"
+
+# full path to the sqconfig file
+# Default is to leave as is and this file will be created.
+export SQCONFIG=""
+
+export CONFIG_COMPLETE="true"
+
+#Turn on simple security. MUST have existing LDAP configured.
+export LDAP_SECURITY="N"
+
+#Name of LDAP Config file
+export LDAP_AUTH_FILE="traf_authentication_config_${HOSTNAME}"
+```
+
+Once completed, run the Trafodion Installer with the `--config_file` option.
+
+*Example*
+
+```
+$ ./trafodion_installer --config_file my_config
+******************************
+ TRAFODION INSTALLATION START
+******************************
+
+***INFO: testing sudo access
+***INFO: Log file located at /var/log/trafodion/trafodion_install_2016-02-15-08-00-59.log
+***INFO: Config directory: /etc/trafodion
+***INFO: Working directory: /usr/lib/trafodion
+
+************************************
+ Trafodion Configuration File Check
+************************************
+
+
+***INFO: Testing sudo access on node trafodion-1
+***INFO: Testing sudo access on node trafodion-2
+***INFO: Testing ssh on trafodion-1
+***INFO: Testing ssh on trafodion-2
+.
+.
+.
+9. Accepting Warranty or Additional Liability. While redistributing
+the Work or Derivative Works thereof, You may choose to offer, and
+charge a fee for, acceptance of support, warranty, indemnity, or
+other liability obligations and/or rights consistent with this
+License. However, in accepting such obligations, You may act only
+on Your own behalf and on Your sole responsibility, not on behalf
+of any other Contributor, and only if You agree to indemnify, defend,
+and hold each Contributor harmless for any liability incurred by,
+or claims asserted against, such Contributor by reason of your
+accepting any such warranty or additional liability.
+
+END OF TERMS AND CONDITIONS
+
+BY TYPING "ACCEPT" YOU AGREE TO THE TERMS OF THIS AGREEMENT:ACCEPT
+***INFO: testing sudo access
+***INFO: Checking all nodes in specified node list
+trafodion-1
+trafodion-2
+***INFO: Total number of nodes = 2
+***INFO: Starting Trafodion Package Setup (2016-02-15-08-02-42)
+***INFO: Installing required packages
+***INFO: Log file located in /var/log/trafodion
+***INFO: ... pdsh on node trafodion-1
+***INFO: ... pdsh on node trafodion-2
+***INFO: Checking if log4cxx is installed ...
+.
+.
+.
+Version Check: done
+
+Metadata Upgrade: done
+
+
+--- SQL operation complete.
+>>
+
+End of MXCI Session
+
+***INFO: Installation completed successfully.
+
+*********************************
+ TRAFODION INSTALLATION COMPLETE
+*********************************
+$
+```
+Next, switch to the Trafodion Runtime User and check the status of Trafodion.
+
+*Example*
+
+```
+$ sudo su - trafodion
+$ sqcheck
+Checking if processes are up.
+Checking attempt: 1; user specified max: 2. Execution time in seconds: 0.
+
+The SQ environment is up!
+
+
+Process Configured Actual Down
+------- ---------- ------ ----
+DTM 2 2
+RMS 4 4
+MXOSRVR 8 8
+
+$
```
+Trafodion is now running on your Hadoop cluster. Please refer to the <<activate,Activate>> chapter for
+basic instructions on how to verify the Trafodion management and how to perform basic management
+operations.
[[install-recipe-based-provisioning]]
== Recipe-Based Provisioning
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/docs/provisioning_guide/src/asciidoc/_chapters/introduction.adoc
----------------------------------------------------------------------
diff --git a/docs/provisioning_guide/src/asciidoc/_chapters/introduction.adoc b/docs/provisioning_guide/src/asciidoc/_chapters/introduction.adoc
index e48e329..01c3672 100644
--- a/docs/provisioning_guide/src/asciidoc/_chapters/introduction.adoc
+++ b/docs/provisioning_guide/src/asciidoc/_chapters/introduction.adoc
@@ -109,6 +109,7 @@ Trafodion. For example, an upgrade may or may not include an upgrade of the Traf
* *<<activate,Activate>>*: Activities related to starting the Trafodion software. These actives
include basic management tasks such as starting and checking the status of the Trafodion components,
performing basic smoke tests, and so forth.
+* *<<remove,Remove>>*: Activities related to removing Trafodion from your Hadoop cluster.
[[provisioning-master-node]]
== Provisioning Master Node
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/docs/provisioning_guide/src/asciidoc/_chapters/prepare.adoc
----------------------------------------------------------------------
diff --git a/docs/provisioning_guide/src/asciidoc/_chapters/prepare.adoc b/docs/provisioning_guide/src/asciidoc/_chapters/prepare.adoc
index 66ea9d5..ffdc725 100644
--- a/docs/provisioning_guide/src/asciidoc/_chapters/prepare.adoc
+++ b/docs/provisioning_guide/src/asciidoc/_chapters/prepare.adoc
@@ -117,21 +117,25 @@ distribution manager's REST API.
| BACKUP_DCS_NODES | List of nodes where to start the backup DCS Master components. | None | Blank separated FQDN list. Not needed if $ENABLE_HA = N.
| CLOUD_CONFIG | Whether you're installing Trafodion on a cloud environment. | N | N = bare-metal or VM installation.
| CLOUD_TYPE | What type of cloud environment you're installing Trafodion on. | None | { AWS \| OpenStack \| Other }. Not applicable for bare-metal or VM installation.
+| CLUSTER_NAME | The name of the Hadoop Cluster. | None | From Apache Ambari or Cloudera Manager.
| DCS_BUILD | Tar file containing the DCS component. | None | Not needed if using a Trafodion package installation tar file.
| DCS_PRIMARY_MASTER_NODE | The node where the primary DCS should run. | None | The DCS Master handles JDBC and ODBC connection requests.
-| DCS_SERVER_FARM | Number of concurrent client sessions per node. | 8 | This number specifies the concurrent sessions per node to be supported. Each session could require up to 1GB of physical memory. The number can be changed post-installation. For more information,
+| DCS_SERVER_PARM | Number of concurrent client sessions per node. | 16 | This number specifies the concurrent sessions per node to be supported. Each session could require up to 1GB of physical memory. The number can be changed post-installation. For more information,
refer to the http://trafodion.apache.org/docs/client_install/index.html[Trafodion Client Installation Guide].
| ENABLE_HA | Whether to run DCS in high-availability (HA) mode. | N | You need the floating IP address, the interface, and the backup nodes for DCS Master if enabling this feature.
+| EPEL_RPM | Location of EPEL RPM. | None | Specify if you don't have access to the Internet.
+Downloaded automatically by the Trafodion Installer.
| FLOATING_IP | IP address if running DCS in HA mode. | None | Not needed if $ENABLE_HA = N. An FQDN name or IP address.
+| HADOOP_TYPE | The type of Hadoop distribution you're installing Trafodion on. | None | Lowercase. cloudera or hadoop.
| HBASE_GROUP | Linux group name for the HBASE administative user. | hbase | Required in order to provide access to select HDFS directories to this user ID.
| HBASE_USER | Linux user name for the HBASE administative user. | hbase | Required in order to provide access to select HDFS directories to this user ID.
| HDFS_USER | Linux user name for the HDFS administative user. | hdfs | The Trafodion Installer uses `sudo su` to make HDFS
configuration changes under this user.
-| HOME_DIR | Root directory under which the `trafodion` home directory should be created. | \home | *Example* +
+| HOME_DIR | Root directory under which the `trafodion` home directory should be created. | /home | *Example* +
+
If the home directory of the `trafodion` user is
`/opt/home/trafodion`, then specify the root directory as `/opt/home`.
-| INIT_TRAFODION | Whether to start Trafodion after install/upgrade. | N | Does not apply to Recipe-Based Provisioning.
+| INIT_TRAFODION | Whether to automatically initialize the Trafodion database. | N | Does not apply to Recipe-Based Provisioning. Applies if $START=Y only.
| INTERFACE | Interface type used for $FLOATING_IP. | None | Not needed if $ENABLE_HA = N.
| JAVA_HOME | Location of Java 1.7.0_65 or higher (JDK). | $JAVA_HOME setting | Fully qualified path of the JDK. For example:
`/usr/java/jdk1.7.0_67-cloudera`
@@ -143,6 +147,7 @@ If the home directory of the `trafodion` user is
| LDAP_PORT^2^ | Port used to communicate with LDAP Identity Store. | None | Examples: 389 for no encryption or TLS, 636 for SSL.
| LDAP_SECURITY^2^ | Whether to enable simple LDAP authentification. | N | If Y, then you need to provide LDAP_HOSTS.
| LDAP_USER^2^ | LDAP Search user name. | None | If required. If so, must provide LDAP_PASSWORD, too.
+| LOCAL_WORKDIR | The directory where the Trafodion Installer is located. | None | Full path, no environmental variables.
| MANAGEMENT_ENABLED | Whether your installation uses separate management nodes. | N | Y if using separate management nodes for Apache Ambari or Cloudera Manager.
| MANAGEMENT_NODES | The FQDN names of management nodes, if any. | None | Provide a blank-separated list of node names.
| NODE_LIST | The FQDN names of the nodes where Trafodion will be installed. | None | Provide a blank-separated list of node names. The Trafodion
@@ -150,10 +155,13 @@ Provisioning ID must have passwordless and `sudo` access to these nodes.
| PASSWORD | Administrator password for Apache Ambari or Cloudera Manager. | admin | A user that can change configuration and restart services via the
distribution manager's REST API.
| REST_BUILD | Tar file containing the REST component. | None | Not needed if using a Trafodion package installation tar file.
-| SQ_ROOT | Directory where Trafodion is installed. | $HOME_DIR/trafodion | Trafodion is installed in this directory on all nodes in `$NODE_LIST`.
+| SQ_ROOT | Target directory for the Trafodion software. | $HOME_DIR/trafodion | Trafodion is installed in this directory on all nodes in `$NODE_LIST`.
+| START | Whether to start Trafodion after install/upgrade. | N | Does not apply to Recipe-Based Provisioning.
+| SUSE_LINUX | Whether your installing Trafodion on SUSE Linux. | false | Autodetected by the Trafodion Installer.
| TRAF_PACKAGE | The location of the Trafodion installation package tar file or core installation tar file. | None | The package file contains the Trafodion server,
DCS, and REST software while the core installation file contains the Trafodion server software only. If you're using a core installation file, then you need to
record the location of the DCS and REST installation tar files, too. Normally, you perform Trafodion provisioning using a Trafodion package installation tar file.
+| TRAF_USER | The Trafodion runtim user ID. | trafodion | Must be `trafodion` in this release.
| TRAF_USER_PASSWORD | The password used for the `trafodion:trafodion` user ID. | traf123 | Must be 6-8 characters long.
| URL | FQDN and port for the Distribution Manager's REST API. | None | Include `http://` or `https://` as applicable. Specify in the form:
`<IP-address>:<port>` or `<node name>:<port>` Example: `https://susevm-1.yourcompany.local:8080`
@@ -194,21 +202,25 @@ This step is required regardless of the <<introduction-provisioning-options,Prov
+
```
# Download required packages
-sudo yum install rpm-build
-sudo yum install apr-devel
-sudo yum install apr-util-devel
-sudo yum install doxygen
-sudo yum install gcc
-sudo yum install gcc-c++
-
-# Install the log4c++ source package
+sudo yum -y install rpm-build apr-devel apr-util-devel doxygen gcc gcc-c++
+
+# Download the log4c++ source rpm
+wget ftp://ftp.rpmfind.net/linux/fedora-secondary/development/rawhide/source/SRPMS/l/log4cxx-0.10.0-13.fc18.src.rpm
+
+# Install the log4c++ source rpm
sudo rpm -ivv log4cxx-0.10.0-13.fc18.src.rpm
-# Build the log4c++ RPM package
+# Build the log4c++ rpm
sudo rpmbuild -ba /root/rpmbuild/SPECS/log4cxx.spec
-# Install the log4++ package
-sudo rpm -U /root/rpmbuild/RPMS/x86_64/log4cxx<tab>
+# Install the log4c++ rpm
+sudo rpm -U /root/rpmbuild/RPMS/x86_64/log4cxx-0.10.0-13.el6.x86_64.rpm
+
+# Copy the log4c++ rpm to the local directory
+sudo cp /root/rpmbuild/RPMS/x86_64/log4cxx-0.10.0-13.el6.x86_64.rpm .
+
+# Change owner of the local log4c++ rpm
+sudo chown <your-id> log4cxx-0.10.0-13.el6.x86_64.rpm
```
2. Copy and Install the log4c++ RPM on All Nodes
@@ -218,7 +230,13 @@ Use either `rpm -U` or `yum install`.
*Example*
+
```
-yum install BLAH
+# Repeat for all nodes in the cluster from the Provisioning Master Node
+scp log4cxx-0.10.0-13.el6.x86_64.rpm <other-node>:$PWD
+
+ssh <other-node>
+sudo yum -y install log4cxx-0.10.0-13.el6.x86_64.rpm
+exit
+
```
3. Verify RPM Installation on Every Node
@@ -226,7 +244,9 @@ yum install BLAH
Use the following command to verify that `log4c++` has been installed on every node in the cluster.
+
```
+# Repeat for all nodes in the cluster
sudo rpm -qa | grep log4cxx
+log4cxx-0.10.0-13.el6.x86_64
```
[[prepare-perform-recipe-based-provisioning-tasks]]
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/docs/provisioning_guide/src/asciidoc/_chapters/remove.adoc
----------------------------------------------------------------------
diff --git a/docs/provisioning_guide/src/asciidoc/_chapters/remove.adoc b/docs/provisioning_guide/src/asciidoc/_chapters/remove.adoc
new file mode 100644
index 0000000..71b4d24
--- /dev/null
+++ b/docs/provisioning_guide/src/asciidoc/_chapters/remove.adoc
@@ -0,0 +1,112 @@
+////
+/**
+* @@@ START COPYRIGHT @@@
+*
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing,
+* software distributed under the License is distributed on an
+* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
+* KIND, either express or implied. See the License for the
+* specific language governing permissions and limitations
+* under the License.
+*
+* @@@ END COPYRIGHT @@@
+ */
+////
+
+[[remove]]
+= Remove
+You use the Trafodion Provisioning User for these instructions.
+
+NOTE: You do not need to use the `trafodion_uninstaller` script if upgrading Trafodion. Instead, use the `trafodion_install` script,
+which automatically upgrades the version of Trafodion. Please refer to the <<installl,Install>> chapter for further instructions.
+
+Run the commands from the first node of the cluster. Do not run them from a machine that is not part of the Trafodion cluster.
+
+1. Stop Trafodion
++
+Do the following:
++
+```
+su trafodion
+cd $MY_SQROOT/sql/scripts or cds
+sqstop
+exit
+```
++
+*Example*
++
+```
+[admin@trafodion-1 ~]$ su trafodion
+[trafodion@trafodion-1 scripts]$ cds
+[trafodion@trafodion-1 scripts]$ sqstop
+Shutting down the REST environment now
+stopping rest.
+Shutting down the DCS environment now
+stopping master.
+trafodion-1: stopping server.
+trafodion-2: stopping server.
+stopped $zlobsrv0
+stopped $zlobsrv1
+Shutting down (normal) the SQ environment!
+Mon Feb 15 07:49:18 UTC 2016
+Processing cluster.conf on local host trafodion-1
+.
+.
+.
+[$Z000HDS] 001,00024772 001 GEN ES--A-- $Z010K7S NONE mxosrvr
+[$Z000HDS] 001,00024782 001 GEN ES--U-- $ZLOBSRV1 NONE mxlobsrvr
+shutdown
+[$Z000HDS] %shutdown
+exit
+Issued a 'shutdown normal' request
+
+Shutdown in progress
+
+# of SQ processes: 0
+SQ Shutdown (normal) from /home/trafodion/apache-trafodion-1.3.0-incubating-bin/sql/scripts Successful
+Mon Feb 15 07:49:26 UTC 2016
+[trafodion@trafodion-1 scripts]$ exit
+[admin@trafodion-1 ~]$
+```
+
+2. Run `trafodion_uninstaller`
++
+The `trafodion_uninstaller` completely removes Trafodion.
+*Example*
++
+```
+[admin@trafodion-1 ~]$ cd $HOME/trafodion-installer/installer
+[admin@trafodion-1 installer]$ ./trafodion_uninstaller
+Do you want to uninstall Trafodion (Everything will be removed)? (Y/N) y
+***INFO: testing sudo access
+***INFO: NOTE, rpms that were installed will not be removed.
+***INFO: stopping Trafodion instance
+SQ environment is not up.
+Going to execute ckillall
+
+Can't find file /home/trafodion/.vnc/trafodion-1:1.pid
+You'll have to kill the Xvnc process manually
+
+***INFO: restoring linux system files that were changed
+***INFO: removing hbase-trx* from Hadoop directories
+pdsh@trafodion-1: trafodion-1: ssh exited with exit code 1
+pdsh@trafodion-1: trafodion-2: ssh exited with exit code 1
+pdsh@trafodion-1: trafodion-1: ssh exited with exit code 1
+pdsh@trafodion-1: trafodion-2: ssh exited with exit code 1
+***INFO remove the Trafodion userid and group
+***INFO: removing all files from /home/trafodion/apache-trafodion-1.3.0-incubating-bin
+***INFO: removing all files from /usr/lib/trafodion and /var/log/trafodion
+***INFO: removing all files from /etc/trafodion
+***INFO: Trafodion uninstall complete.
+[admin@trafodion-1 installer]$
+```
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/docs/provisioning_guide/src/asciidoc/index.adoc
----------------------------------------------------------------------
diff --git a/docs/provisioning_guide/src/asciidoc/index.adoc b/docs/provisioning_guide/src/asciidoc/index.adoc
index 0d63536..56d4331 100644
--- a/docs/provisioning_guide/src/asciidoc/index.adoc
+++ b/docs/provisioning_guide/src/asciidoc/index.adoc
@@ -64,6 +64,7 @@ include::asciidoc/_chapters/prepare.adoc[]
include::asciidoc/_chapters/install.adoc[]
include::asciidoc/_chapters/upgrade.adoc[]
include::asciidoc/_chapters/activate.adoc[]
+include::asciidoc/_chapters/remove.adoc[]
include::asciidoc/_chapters/enable_security.adoc[]
http://git-wip-us.apache.org/repos/asf/incubator-trafodion/blob/72a90762/pom.xml
----------------------------------------------------------------------
diff --git a/pom.xml b/pom.xml
index 9d64d32..f723602 100644
--- a/pom.xml
+++ b/pom.xml
@@ -132,14 +132,14 @@
</properties>
<modules>
- <!--module>docs/client_install</module>
+ <module>docs/client_install</module>
<module>dcs</module>
<module>core/rest</module>
<module>docs/command_interface</module>
<module>docs/provisioning_guide</module>
<module>docs/messages_guide</module>
<module>docs/odb_user</module>
- <module>docs/sql_reference</module-->
+ <module>docs/sql_reference</module>
</modules>
<build>