[jira] [Created] (IMPALA-7153) filesystem_client methods expect unusual paths

["Dan Hecht (JIRA)" <ji...@apache.org>]

Dan Hecht created IMPALA-7153:
---------------------------------

             Summary: filesystem_client methods expect unusual paths
                 Key: IMPALA-7153
                 URL: https://issues.apache.org/jira/browse/IMPALA-7153
             Project: IMPALA
          Issue Type: Bug
          Components: Infrastructure
    Affects Versions: Impala 3.0
            Reporter: Dan Hecht


In Impala end to end python tests, most paths are either absolute or fully qualified (i.e. /test-warehouse/db/table or hdfs://namenode:port/test-warehouse/db/table), yet the classes derived from BaseFilesystem tend to expect paths that are absolute but without the leading slash.

This leads to awkward and error prone testing code. For example, see IMPALA-7099 and {{test_unsupported_text_compression()}} which does e.g.:
{code}
    self.filesystem_client.create_file("{0}/fake.lz4".format(lz4_ym_partition_loc)[1:],
        "some test data")
{code}

Not only is this confusing, but it doesn't work when the test is run with FILESYSTEM_PREFIX not empty.

We should fix the filesystem_client classes to handle absolute and fully qualified paths so that each test doesn't have to worry about this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org