You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@slider.apache.org by st...@apache.org on 2014/11/26 19:35:33 UTC
svn commit: r1641881 - in /incubator/slider/site/trunk/content/developing:
building.md functional_tests.md testing.md
Author: stevel
Date: Wed Nov 26 18:35:33 2014
New Revision: 1641881
URL: http://svn.apache.org/r1641881
Log:
SLIDER-656 remove hbase/accumulo provider test constants
Modified:
incubator/slider/site/trunk/content/developing/building.md
incubator/slider/site/trunk/content/developing/functional_tests.md
incubator/slider/site/trunk/content/developing/testing.md
Modified: incubator/slider/site/trunk/content/developing/building.md
URL: http://svn.apache.org/viewvc/incubator/slider/site/trunk/content/developing/building.md?rev=1641881&r1=1641880&r2=1641881&view=diff
==============================================================================
--- incubator/slider/site/trunk/content/developing/building.md (original)
+++ incubator/slider/site/trunk/content/developing/building.md Wed Nov 26 18:35:33 2014
@@ -338,53 +338,6 @@ will need to be defined.
## Testing
-### Configuring Slider to locate the relevant artifacts
-
-You must have the file `src/test/resources/slider-test.xml` (this
-is ignored by git), declaring where HBase, accumulo, Hadoop and zookeeper are:
-
- <configuration>
-
- <property>
- <name>slider.test.hbase.home</name>
- <value>/home/slider/hbase/hbase-assembly/target/hbase-0.98.0-SNAPSHOT</value>
- <description>HBASE Home</description>
- </property>
-
- <property>
- <name>slider.test.hbase.tar</name>
- <value>/home/slider/hbase/hbase-assembly/target/hbase-0.98.0-SNAPSHOT-bin.tar.gz</value>
- <description>HBASE archive URI</description>
- </property>
-
- <property>
- <name>slider.test.accumulo.home</name>
- <value>/home/slider/accumulo/assemble/target/accumulo-1.6.1/</value>
- <description>Accumulo Home</description>
- </property>
-
- <property>
- <name>slider.test.accumulo.tar</name>
- <value>/home/slider/accumulo/assemble/target/accumulo-1.6.1-bin.tar.gz</value>
- <description>Accumulo archive URI</description>
- </property>
-
- <property>
- <name>zk.home</name>
- <value>
- /home/slider/Apps/zookeeper</value>
- <description>Zookeeper home dir on target systems</description>
- </property>
-
- <property>
- <name>hadoop.home</name>
- <value>
- /home/slider/hadoop-common/hadoop-dist/target/hadoop-2.3.0</value>
- <description>Hadoop home dir on target systems</description>
- </property>
-
- </configuration>
-
## Debugging a failing test
Modified: incubator/slider/site/trunk/content/developing/functional_tests.md
URL: http://svn.apache.org/viewvc/incubator/slider/site/trunk/content/developing/functional_tests.md?rev=1641881&r1=1641880&r2=1641881&view=diff
==============================================================================
--- incubator/slider/site/trunk/content/developing/functional_tests.md (original)
+++ incubator/slider/site/trunk/content/developing/functional_tests.md Wed Nov 26 18:35:33 2014
@@ -282,35 +282,10 @@ the tests appear to hang
mvn clean verify -Dit.test=BuildSetupIT
-### Using relative paths in test configurations
-
-When you are sharing configurations across machines via SCM or similar,
-its impossible to have absolute paths in the configuration options to
-the location of items in the local filesystem (e.g. configuration directories).
-
-There's two techniques
-
-1. Keep the data in HDFS and refer to it there. This works if there is a shared,
-persistent HDFS cluster.
-
-1. Use the special property `SLIDER_CONF_DIR` that is set to the path
-of the directory, and which can then be used to create an absolute path
-from paths relative to the configuration dir:
-
- <property>
- <name>slider.test.hbase.appconf</name>
- <description>Path to the directory containing the HBase application config</description>
- <value>file://${SLIDER_CONF_DIR}/../hbase</value>
- </property>
-
-
-If the actual XML file path is required, use the property
-`slider.test.conf.xml`
-
## Parallel execution
-Attempts to run test cases in parallel failed -even with a configuration
+Attempts to run test cases in parallel failed âeven with a configuration
to run methods in a class sequentially, but separate classes independently.
Even after identifying and eliminating some unintended sharing of static
@@ -421,48 +396,10 @@ For example, to run all Agent IT tests:
mvn integration-test -Dslider.conf.dir=${your-config-dir} -Dit.test=Agent\*IT
-### HBase Tests
-The HBase tests can be enabled or disabled
-
- <property>
- <name>slider.test.hbase.enabled</name>
- <description>Flag to enable/disable HBase tests</description>
- <value>true</value>
- </property>
-
-Mandatory test parameters must be added to `slider-client.xml`
-
- <property>
- <name>slider.test.hbase.tar</name>
- <description>Path to the HBase Tar file in HDFS</description>
- <value>hdfs://sandbox:8020/user/slider/hbase.tar.gz</value>
- </property>
-
- <property>
- <name>slider.test.hbase.appconf</name>
- <description>Path to the directory containing the HBase application config</description>
- <value>file://${${SLIDER_CONF_DIR}}/../hbase</value>
- </property>
-
-Optional parameters:
-
- <property>
- <name>slider.test.hbase.launch.wait.seconds</name>
- <description>Time to wait in seconds for HBase to start</description>
- <value>1800</value>
- </property>
#### Accumulo configuration options
-Enable/disable the tests
-
- <property>
- <name>slider.test.accumulo.enabled</name>
- <description>Flag to enable/disable Accumulo tests</description>
- <value>true</value>
- </property>
-
Optional parameters
<property>
Modified: incubator/slider/site/trunk/content/developing/testing.md
URL: http://svn.apache.org/viewvc/incubator/slider/site/trunk/content/developing/testing.md?rev=1641881&r1=1641880&r2=1641881&view=diff
==============================================================================
--- incubator/slider/site/trunk/content/developing/testing.md (original)
+++ incubator/slider/site/trunk/content/developing/testing.md Wed Nov 26 18:35:33 2014
@@ -28,173 +28,3 @@ Slider core contains a suite of tests th
using Hadoop's `MiniDFSCluster` and `MiniYARNCluster` classes to create small,
one-node test clusters. All the YARN/HDFS code runs in the JUnit process; the
AM and spawned processeses run independently.
-
-
-
-### For HBase Tests in `slider-providers/hbase`
-
-Requirements
-* A copy of `hbase.tar.gz` in the local filesystem
-* A an expanded `hbase.tar.gz` in the local filesystem
-
-
-### For Accumulo Tests in `slider-providers/accumulo`
-* A copy of `accumulo.tar.gz` in the local filesystem,
-* An expanded `accumulo.tar.gz` in the local filesystem,
-* an expanded Zookeeper installation
-
-All of these need to be defined in the file `slider-core/src/test/resources/slider-test.xml`
-
-Example:
-
- <configuration>
-
- <property>
- <name>slider.test.hbase.enabled</name>
- <description>Flag to enable/disable HBase tests</description>
- <value>true</value>
- </property>
-
- <property>
- <name>slider.test.hbase.home</name>
- <value>/home/slider/hbase-0.98.0</value>
- <description>HBASE Home</description>
- </property>
-
- <property>
- <name>slider.test.hbase.tar</name>
- <value>/home/slider/Projects/hbase-0.98.0-bin.tar.gz</value>
- <description>HBASE archive URI</description>
- </property>
-
- <property>
- <name>slider.test.accumulo.enabled</name>
- <description>Flag to enable/disable Accumulo tests</description>
- <value>true</value>
- </property>
-
- <property>
- <name>slider.test.accumulo.home</name>
- <value>
- /home/slider/accumulo-1.6.0-SNAPSHOT/</value>
- <description>Accumulo Home</description>
- </property>
-
- <property>
- <name>slider.test.accumulo.tar</name>
- <value>/home/slider/accumulo-1.6.0-SNAPSHOT-bin.tar</value>
- <description>Accumulo archive URI</description>
- </property>
-
- <property>
- <name>slider.test.am.restart.time</name>
- <description>Time in millis to await an AM restart</description>
- <value>30000</value>
- </property>
-
- <property>
- <name>zk.home</name>
- <value>/home/slider/zookeeper</value>
- <description>Zookeeper home dir on target systems</description>
- </property>
-
- <property>
- <name>hadoop.home</name>
- <value>/home/slider/hadoop-2.6.0</value>
- <description>Hadoop home dir on target systems</description>
- </property>
-
- </configuration>
-
-*Important:* For the local tests, a simple local filesystem path is used for
-all the values.
-
-For the functional tests, the accumulo and hbase tar properties will
-need to be set to a URL of a tar file that is accessible to all the
-nodes in the cluster -which usually means HDFS, and so an `hdfs://` URL
-
-## Security
-
- <property>
- <name>slider.am.login.keytab.name</name>
- <value></value>
- </property>
- <property>
- <name>slider.am.keytab.local.path</name>
- <description>absolute path to keytab</description>
- <value></value>
- </property>
- <property>
- <name>slider.keytab.principal.name</name>
- <value></value>
- </property>
-
-
-## Provider-specific parameters
-
-An individual provider can pick up settings from their own
-`src/test/resources/slider-client.xml` file, or the one in `slider-core`.
-We strongly advice placing all the values in the `slider-core` file.
-
-1. All uncertainty about which file is picked up on the class path first goes
-away
-2. There's one place to keep all the configuration values in sync.
-
-### Agent Tests
-
-
-
-### HBase Tests
-
-The HBase tests can be enabled or disabled
-
- <property>
- <name>slider.test.hbase.enabled</name>
- <description>Flag to enable/disable HBase tests</description>
- <value>true</value>
- </property>
-
-Mandatory test parameters must be added to `slider-client.xml`
-
-
- <property>
- <name>slider.test.hbase.tar</name>
- <description>Path to the HBase Tar file in HDFS</description>
- <value>hdfs://sandbox:8020/user/slider/hbase.tar.gz</value>
- </property>
-
- <property>
- <name>slider.test.hbase.appconf</name>
- <description>Path to the directory containing the HBase application config</description>
- <value>file://${user.dir}/src/test/configs/sandbox/hbase</value>
- </property>
-
-Optional parameters:
-
- <property>
- <name>slider.test.hbase.launch.wait.seconds</name>
- <description>Time to wait in seconds for HBase to start</description>
- <value>180000</value>
- </property>
-
-
-#### Accumulo configuration options
-
-Enable/disable the tests
-
- <property>
- <name>slider.test.accumulo.enabled</name>
- <description>Flag to enable/disable Accumulo tests</description>
- <value>true</value>
- </property>
-
-
-Optional parameters
-
- <property>
- <name>slider.test.accumulo.launch.wait.seconds</name>
- <description>Time to wait in seconds for Accumulo to start</description>
- <value>180000</value>
- </property
-
-
\ No newline at end of file