[jira] [Created] (HADOOP-18486) hadoop-aws tests to take a configurable subdir in the test bucket

["Steve Loughran (Jira)" <ji...@apache.org>]

Steve Loughran created HADOOP-18486:
---------------------------------------

             Summary: hadoop-aws tests to take a configurable subdir in the test bucket
                 Key: HADOOP-18486
                 URL: https://issues.apache.org/jira/browse/HADOOP-18486
             Project: Hadoop Common
          Issue Type: Sub-task
          Components: fs/s3, test
    Affects Versions: 3.3.5
            Reporter: Steve Loughran


For parallel jenkins runs (now possible with s3guard cut) we need to be able to run the failsafe test suites either in separate buckets brackets (which doesn't scale) or in subdirectories of a single bucket. That needs a way to pass in a base directory for the suites and to disable cleanup of the entire bucket afterwards. Option pick up is straightforward; we will do it the way we have done with the others –an auth-keys option which can be overridden on the command line. 

{{S3ATestUtils.createTestPath(Path defVal)}} is already used to create test paths; it can be extended to pick up a unique process id as well as thread id system property, and use that for the path it constructs. 

another system property/config option is needed to disable root dir tests (ITestMarkerToolRootOperations, ITestS3AContractRootDir). a config/property picked up by the S3AContract returning false when probed for "test.root-tests-enabled" should do most of that.




--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org