[jira] [Commented] (IMPALA-10771) Support Tencent COS File System

["LiPenglin (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/IMPALA-10771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17609357#comment-17609357 ] 

LiPenglin commented on IMPALA-10771:
------------------------------------

ClassNotfoundexception was thrown when using "cosn://test-warehouse-xxx"(https://cloud.tencent.com/product/cos). I guess that 'CDP_HADOOP_VERSION=3.1.1.7.2.16.0-164' and 'IMPALA_COS_VERSION=3.1.0-5.9.3' might not match. I solved the problem by temporarily replacing them with cos_api-bundle-5.6.69.jar and hadoop-cos-3.1.0-8.0.8.jar (https://github.com/tencentyun/hadoop-cos/releases/tag/v8.0.8) locally.

FYI:
https://github.com/tencentyun/hadoop-cos/releases
The latest version also does not match 'CDP_HADOOP_VERSION=3.1.1.7.2.16.0-164'.

> Support Tencent COS File System
> -------------------------------
>
>                 Key: IMPALA-10771
>                 URL: https://issues.apache.org/jira/browse/IMPALA-10771
>             Project: IMPALA
>          Issue Type: New Feature
>          Components: Backend
>            Reporter: Fucun Chu
>            Assignee: Fucun Chu
>            Priority: Major
>              Labels: connector
>
> [Tencent COS|https://intl.cloud.tencent.com/product/cos] is a famous object storage system provided by Tencent Corp. Hadoop-COS is a client that makes the upper computing systems based on HDFS be able to use the COS as its underlying storage system. The big data-processing systems that have been identified for support are: Hadoop MR, Spark, Alluxio and etc. In addition, Druid also can use COS as its deep storage by configuring HDFS-Load-Plugin integerating with HADOOP-COS.
> More information:
> https://hadoop.apache.org/docs/current/hadoop-cos/cloud-storage/index.html
> Hadoop 3.3 officially supports COS storage , see: [HADOOP-15616|https://issues.apache.org/jira/browse/HADOOP-15616]



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org