You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-commits@hadoop.apache.org by ga...@apache.org on 2020/02/06 14:13:47 UTC
[hadoop] branch trunk updated: HADOOP-16832. S3Guard testing doc:
Add required parameters for S3Guard testing in IDE. (#1822). Contributed by
Mukund Thakur.
This is an automated email from the ASF dual-hosted git repository.
gabota pushed a commit to branch trunk
in repository https://gitbox.apache.org/repos/asf/hadoop.git
The following commit(s) were added to refs/heads/trunk by this push:
new 146ca0f HADOOP-16832. S3Guard testing doc: Add required parameters for S3Guard testing in IDE. (#1822). Contributed by Mukund Thakur.
146ca0f is described below
commit 146ca0f545c715218732ef702171acee398247c5
Author: Mukund Thakur <mu...@users.noreply.github.com>
AuthorDate: Thu Feb 6 19:43:25 2020 +0530
HADOOP-16832. S3Guard testing doc: Add required parameters for S3Guard testing in IDE. (#1822). Contributed by Mukund Thakur.
---
.../src/site/markdown/tools/hadoop-aws/testing.md | 25 ++++++++++++++++++++++
1 file changed, 25 insertions(+)
diff --git a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md
index ca35ce8..3c201e1 100644
--- a/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md
+++ b/hadoop-tools/hadoop-aws/src/site/markdown/tools/hadoop-aws/testing.md
@@ -813,6 +813,31 @@ sequential one afterwards. The IO heavy ones must also be subclasses of
This is invaluable for debugging test failures.
+How to set test options in your hadoop configuration rather
+than on the maven command line:
+
+As an example let's assume you want to run S3Guard integration tests using IDE.
+Please add the following properties in
+`hadoop-tools/hadoop-aws/src/test/resources/auth-keys.xml` file.
+ Local configuration is stored in auth-keys.xml. The changes to this file won't be committed,
+ so it's safe to store local config here.
+```xml
+<property>
+ <name>fs.s3a.s3guard.test.enabled</name>
+ <value>true</value>
+</property>
+```
+
+```xml
+<property>
+ <name>fs.s3a.s3guard.test.implementation</name>
+ <value>dynamo</value>
+</property>
+```
+
+Warning : Although this is easier for IDE debugging setups, once you do this,
+you cannot change configurations on the mvn command line, such as testing without s3guard.
+
### Keeping AWS Costs down
Most of the base S3 tests are designed to use public AWS data
---------------------------------------------------------------------
To unsubscribe, e-mail: common-commits-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-commits-help@hadoop.apache.org