You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "ASF subversion and git services (Jira)" <ji...@apache.org> on 2022/10/12 23:07:00 UTC

[jira] [Commented] (IMPALA-11630) ERROR: NoSuchMethodError when create table on Tencent COS FileSystem

    [ https://issues.apache.org/jira/browse/IMPALA-11630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17616724#comment-17616724 ] 

ASF subversion and git services commented on IMPALA-11630:
----------------------------------------------------------

Commit cf2d7289fb53660acc37595aada7ff4c2071de04 in impala's branch refs/heads/master from yx91490
[ https://gitbox.apache.org/repos/asf?p=impala.git;h=cf2d7289f ]

IMPALA-11630: Update COS version

Update COS version to 3.1.0-8.0.8 to make it compatible with hadoop
version 3.1.1.7.2.16.0-164.

Testing:
 - Manually create | insert data to | query data from | drop an iceberg
   table stored on Tencent COS FileSystem.

Change-Id: I13385ed4843af2061366c7b656cb6a2f85c0c9d3
Reviewed-on: http://gerrit.cloudera.org:8080/19111
Reviewed-by: Impala Public Jenkins <im...@cloudera.com>
Tested-by: Impala Public Jenkins <im...@cloudera.com>


> ERROR: NoSuchMethodError when create table on Tencent COS FileSystem
> --------------------------------------------------------------------
>
>                 Key: IMPALA-11630
>                 URL: https://issues.apache.org/jira/browse/IMPALA-11630
>             Project: IMPALA
>          Issue Type: Bug
>            Reporter: LiPenglin
>            Assignee: yx91490
>            Priority: Major
>
> * step.1
> describe database tpcds100_iceberg_cos_db
> +-------------------------+-----------------------------------------------------------------------+---------+
> | name                    | location                                                              | comment |
> +-------------------------+-----------------------------------------------------------------------+---------+
> | tpcds100_iceberg_cos_db | cosn://iceberg-test-xxx/test-warehouse/tpcds100_iceberg_cos_db |         |
> +-------------------------+-----------------------------------------------------------------------+---------+ * step.2
> create table time_dim (
>   t_time_sk int,
>   t_time_id string,
>   t_time int,
>   t_hour int,
>   t_minute int,
>   t_second int,
>   t_am_pm string,
>   t_shift string,
>   t_sub_shift string,
>   t_meal_time string
> )
> stored as iceberg; * error msg:
> ERROR: NoSuchMethodError: org.apache.hadoop.fs.PartialListing.<init>(Ljava/lang/String;[Lorg/apache/hadoop/fs/FileMetadata;[Lorg/apache/hadoop/fs/FileMetadata;)V
>  
> E0930 18:00:49.240738 31592 JniCatalog.java:268] Error in execDdl for CREATE_TABLE tpcds100_iceberg_cos_db.time_dim issued by impala. Time spent: 1s222ms.
> I0930 18:00:49.241204 31592 jni-util.cc:288] java.lang.NoSuchMethodError: org.apache.hadoop.fs.PartialListing.<init>(Ljava/lang/String;[Lorg/apache/hadoop/fs/FileMetadata;[Lorg/apache/hadoop/fs/FileMetadata;)V
>         at org.apache.hadoop.fs.CosNativeFileSystemStore.list(CosNativeFileSystemStore.java:932)
>         at org.apache.hadoop.fs.CosNativeFileSystemStore.list(CosNativeFileSystemStore.java:830)
>         at org.apache.hadoop.fs.CosNativeFileSystemStore.list(CosNativeFileSystemStore.java:816)
>         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>         at java.lang.reflect.Method.invoke(Method.java:498)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:431)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:166)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:158)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:96)
>         at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:362)
>         at com.sun.proxy.$Proxy17.list(Unknown Source)
>         at org.apache.hadoop.fs.CosFileSystem.getFileStatus(CosFileSystem.java:444)
>         at org.apache.hadoop.fs.FileSystem.exists(FileSystem.java:1742)
>         at org.apache.hadoop.fs.CosFileSystem.create(CosFileSystem.java:299)
>         at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1177)
>         at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1157)
>         at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:1046)
>         at org.apache.iceberg.hadoop.HadoopOutputFile.createOrOverwrite(HadoopOutputFile.java:88)



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org