You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@impala.apache.org by "Joe McDonnell (JIRA)" <ji...@apache.org> on 2017/10/16 18:38:03 UTC

[jira] [Created] (IMPALA-6061) Impala needs to handle deprecation of s3n in hadoop 3.0

Joe McDonnell created IMPALA-6061:
-------------------------------------

             Summary: Impala needs to handle deprecation of s3n in hadoop 3.0
                 Key: IMPALA-6061
                 URL: https://issues.apache.org/jira/browse/IMPALA-6061
             Project: IMPALA
          Issue Type: Bug
          Components: Frontend
    Affects Versions: Impala 2.10.0
            Reporter: Joe McDonnell
            Priority: Critical


Recently, support for s3n was removed from Hadoop by HADOOP-14738. All calls to s3n APIs will now throw an error:
"The s3n:// client to Amazon S3 is no longer available: please migrate to the s3a:// client"

This change impacts some Impala frontend tests that cover s3n. Some fail because they expect s3n to work. Some fail because the error message is different from the one expected. The failing tests are in these two test files:
org.apache.impala.analysis.AnalyzeDDLTest
org.apache.impala.analysis.AnalyzeStmtsTest

Since this is only in a recent version of hadoop, Impala still needs to maintain support for s3n, but it needs to be able to run tests on this new version of hadoop.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)