You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Juan Yu (JIRA)" <ji...@apache.org> on 2014/09/25 02:46:33 UTC

[jira] [Created] (HADOOP-11128) abstracting out the scale tests for FileSystem Contract tests

Juan Yu created HADOOP-11128:
--------------------------------

             Summary: abstracting out the scale tests for FileSystem Contract tests
                 Key: HADOOP-11128
                 URL: https://issues.apache.org/jira/browse/HADOOP-11128
             Project: Hadoop Common
          Issue Type: Improvement
            Reporter: Juan Yu


Currently we have some scale tests for openstack and s3a. For now we'll just trust HDFS to handle files >5GB and delete thousands of file in a directory properly.
We should abstract out the scale tests so it can be applied to all FileSystems.

A few things to consider for scale tests:
scale tests rely on the tester having good/stable upload bandwidth, might need large disk space. It needs to be configurable or optional.
scale tests might need long time to finish, consider have test timeout configurable if possible



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)