[jira] [Updated] (IMPALA-7153) filesystem_client methods expect unusual paths

["Dan Hecht (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-7153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Dan Hecht updated IMPALA-7153:
------------------------------
    Labels: ramp-up  (was: )

> filesystem_client methods expect unusual paths
> ----------------------------------------------
>
>                 Key: IMPALA-7153
>                 URL: https://issues.apache.org/jira/browse/IMPALA-7153
>             Project: IMPALA
>          Issue Type: Bug
>          Components: Infrastructure
>    Affects Versions: Impala 3.0
>            Reporter: Dan Hecht
>            Priority: Major
>              Labels: ramp-up
>
> In Impala end to end python tests, most paths are either absolute or fully qualified (i.e. /test-warehouse/db/table or hdfs://namenode:port/test-warehouse/db/table), yet the classes derived from BaseFilesystem tend to expect paths that are absolute but without the leading slash.
> This leads to awkward and error prone testing code. For example, see IMPALA-7099 and {{test_unsupported_text_compression()}} which does e.g.:
> {code}
>     self.filesystem_client.create_file("{0}/fake.lz4".format(lz4_ym_partition_loc)[1:],
>         "some test data")
> {code}
> Not only is this confusing, but it doesn't work when the test is run with FILESYSTEM_PREFIX not empty.
> We should fix the filesystem_client classes to handle absolute and fully qualified paths so that each test doesn't have to worry about this.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org