You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@amoro.apache.org by "sjxiaoyang (via GitHub)" <gi...@apache.org> on 2024/08/14 05:50:56 UTC
[I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
sjxiaoyang opened a new issue, #3095:
URL: https://github.com/apache/amoro/issues/3095
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/amoro/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
When I use external catalog connect to HMS + S3 + Iceberg. There is an ClassNotFoundException.
I found this class in aws sdk，there is the download page and mvn gav.
```
https://repo1.maven.org/maven2/software/amazon/awssdk/s3-transfer-manager/
<dependency>
<groupId>software.amazon.awssdk</groupId>
<artifactId>s3-transfer-manager</artifactId>
<version>2.27.3</version>
</dependency>
```
When I put this jar into lib dir, and restart ams ,The program is running properly.
### How should we improve?
I don't know that is my env problem or everyone catch this, Maybe we can add this library?
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Subtasks
_No response_
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "sjxiaoyang (via GitHub)" <gi...@apache.org>.
sjxiaoyang commented on issue #3095:
URL: https://github.com/apache/amoro/issues/3095#issuecomment-2290365014
```
java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:261)
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:399)
at java.base/javax.security.auth.Subject.doAs(Subject.java:376)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930)
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231)
at org.apache.amoro.io.AuthenticatedHadoopFileIO.newOutputFile(AuthenticatedHadoopFileIO.java:68)
at org.apache.iceberg.io.OutputFileFactory.newOutputFile(OutputFileFactory.java:105)
at org.apache.iceberg.io.BaseTaskWriter$BaseRollingWriter.openCurrent(BaseTaskWriter.java:298)
at org.apache.iceberg.io.BaseTaskWriter$BaseRollingWriter.<init>(BaseTaskWriter.java:265)
at org.apache.iceberg.io.BaseTaskWriter$BaseRollingWriter.<init>(BaseTaskWriter.java:255)
at org.apache.iceberg.io.BaseTaskWriter$RollingFileWriter.<init>(BaseTaskWriter.java:347)
at org.apache.iceberg.io.UnpartitionedWriter.<init>(UnpartitionedWriter.java:37)
at org.apache.amoro.optimizing.IcebergRewriteExecutor.dataWriter(IcebergRewriteExecutor.java:98)
at org.apache.amoro.optimizing.AbstractRewriteFilesExecutor.rewriterDataFiles(AbstractRewriteFilesExecutor.java:147)
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256)
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231)
at java.base/java.security.AccessController.doPrivileged(AccessController.java:399)
at java.base/javax.security.auth.Subject.doAs(Subject.java:376)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930)
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231)
at org.apache.amoro.io.AuthenticatedHadoopFileIO.doAs(AuthenticatedHadoopFileIO.java:201)
at org.apache.amoro.optimizing.AbstractRewriteFilesExecutor.execute(AbstractRewriteFilesExecutor.java:108)
at org.apache.amoro.optimizing.AbstractRewriteFilesExecutor.execute(AbstractRewriteFilesExecutor.java:64)
at org.apache.amoro.optimizer.common.OptimizerExecutor.executeTask(OptimizerExecutor.java:149)
at org.apache.amoro.optimizer.common.OptimizerExecutor.executeTask(OptimizerExecutor.java:103)
at org.apache.amoro.optimizer.common.OptimizerExecutor.start(OptimizerExecutor.java:52)
at java.base/java.lang.Thread.run(Thread.java:833)
Caused by: java.lang.NoClassDefFoundError: software/amazon/awssdk/transfer/s3/progress/TransferListener
at java.base/java.lang.Class.forName0(Native Method)
at java.base/java.lang.Class.forName(Class.java:467)
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652)
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713)
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563)
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598)
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171)
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555)
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366)
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56)
at org.apache.iceberg.hadoop.HadoopOutputFile.fromPath(HadoopOutputFile.java:53)
at org.apache.iceberg.hadoop.HadoopFileIO.newOutputFile(HadoopFileIO.java:97)
at org.apache.amoro.io.AuthenticatedHadoopFileIO.lambda$newOutputFile$2(AuthenticatedHadoopFileIO.java:68)
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256)
... 27 more
Caused by: java.lang.ClassNotFoundException: software.amazon.awssdk.transfer.s3.progress.TransferListener
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(Builtin
```
Finally , i choice the same this s3-transfer-manager-2.24.12
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "zhoujinsong (via GitHub)" <gi...@apache.org>.
zhoujinsong commented on issue #3095:
URL: https://github.com/apache/amoro/issues/3095#issuecomment-2290389097
Thanks for the detailed error information.
When I looked deep into the [S3AFileSystem](https://github.com/apache/hadoop/blob/trunk/hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/S3AFileSystem.java) implementation, I found some classes under `software.amazon.awssdk.transfer` package is required.
So the `software.amazon.awssdk:s3-transfer-manager` dependency seems to be necessary for all s3a users.
We should add it to our default dependencies.
We would greatly appreciate it if you are willing to contribute.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "zhoujinsong (via GitHub)" <gi...@apache.org>.
zhoujinsong commented on issue #3095:
URL: https://github.com/apache/amoro/issues/3095#issuecomment-2288667932
Hi, thanks for reporting this bug.
Can you provide the full error stack information to help us find out where the dependency is needed?
It may help us to identify if this dependency is required for all s3 users.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "sjxiaoyang (via GitHub)" <gi...@apache.org>.
sjxiaoyang commented on issue #3095:
URL: https://github.com/apache/amoro/issues/3095#issuecomment-2290365660
This is another Exception
```
org.apache.amoro.server.exception.PersistenceException: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.server.exception.AmoroRuntimeException.wrap(AmoroRuntimeException.java:141) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:65) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.syncTable(DefaultTableService.java:554) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$null$14(DefaultTableService.java:472) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_422]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_422]
Caused by: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:261) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.NoClassDefFoundError: software/amazon/awssdk/transfer/s3/model/ObjectTransfer
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer
at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_422]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_422]
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
2024-08-14 12:10:38,556 ERROR [table-explorer-executor-3] [org.apache.amoro.server.table.DefaultTableService] [] - TableExplorer sync table TableIdentity{database=land, tableName=land_mes_cn_cc_activity_log_i_
rt} error
org.apache.amoro.server.exception.PersistenceException: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.server.exception.AmoroRuntimeException.wrap(AmoroRuntimeException.java:141) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:65) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.syncTable(DefaultTableService.java:554) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$null$14(DefaultTableService.java:472) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_422]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_422]
Caused by: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:261) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.NoClassDefFoundError: software/amazon/awssdk/transfer/s3/model/ObjectTransfer
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer
at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_422]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_422]
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
2024-08-14 12:10:38,564 ERROR [table-explorer-executor-6] [org.apache.amoro.server.table.DefaultTableService] [] - TableExplorer sync table TableIdentity{database=land, tableName=land_mes_cn_cc_nc_group_member
_i_rt} error
org.apache.amoro.server.exception.PersistenceException: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.server.exception.AmoroRuntimeException.wrap(AmoroRuntimeException.java:141) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:65) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.syncTable(DefaultTableService.java:554) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$null$14(DefaultTableService.java:472) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_422]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_422]
Caused by: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:261) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.NoClassDefFoundError: software/amazon/awssdk/transfer/s3/model/ObjectTransfer
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer
at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_422]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_422]
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
2024-08-14 12:10:38,566 ERROR [table-explorer-executor-7] [org.apache.amoro.server.table.DefaultTableService] [] - TableExplorer sync table TableIdentity{database=land, tableName=land_mes_cn_cc_router_scrap_st
ep_i_rt} error
org.apache.amoro.server.exception.PersistenceException: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.server.exception.AmoroRuntimeException.wrap(AmoroRuntimeException.java:141) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:65) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.syncTable(DefaultTableService.java:554) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$null$14(DefaultTableService.java:472) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1640) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_422]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_422]
at java.lang.Thread.run(Thread.java:750) [?:1.8.0_422]
Caused by: java.lang.RuntimeException: Run with ugi request failed.
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:261) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.NoClassDefFoundError: software/amazon/awssdk/transfer/s3/model/ObjectTransfer
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
Caused by: java.lang.ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer
at java.net.URLClassLoader.findClass(URLClassLoader.java:387) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:418) ~[?:1.8.0_422]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) ~[?:1.8.0_422]
at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ~[?:1.8.0_422]
at java.lang.Class.forName0(Native Method) ~[?:1.8.0_422]
at java.lang.Class.forName(Class.java:348) ~[?:1.8.0_422]
at org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2652) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2617) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2713) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3563) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3598) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.access$300(FileSystem.java:171) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3702) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3653) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:555) ~[hadoop-common-3.4.0.jar:?]
at org.apache.hadoop.fs.Path.getFileSystem(Path.java:366) ~[hadoop-common-3.4.0.jar:?]
at org.apache.iceberg.hadoop.Util.getFs(Util.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopInputFile.fromLocation(HadoopInputFile.java:56) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hadoop.HadoopFileIO.newInputFile(HadoopFileIO.java:87) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.TableMetadataParser.read(TableMetadataParser.java:266) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$0(BaseMetastoreTableOperations.java:189) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.lambda$refreshFromMetadataLocation$1(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runTaskWithRetry(Tasks.java:413) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.runSingleThreaded(Tasks.java:219) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:203) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.util.Tasks$Builder.run(Tasks.java:196) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:208) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:185) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refreshFromMetadataLocation(BaseMetastoreTableOperations.java:180) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.hive.HiveTableOperations.doRefresh(HiveTableOperations.java:178) ~[iceberg-hive-metastore-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.refresh(BaseMetastoreTableOperations.java:97) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreTableOperations.current(BaseMetastoreTableOperations.java:80) ~[iceberg-core-1.4.3.jar:?]
at org.apache.iceberg.BaseMetastoreCatalog.loadTable(BaseMetastoreCatalog.java:47) ~[iceberg-core-1.4.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.lambda$doComputeIfAbsent$14(BoundedLocalCache.java:2406) ~[caffeine-2.9.3.jar:?]
at java.util.concurrent.ConcurrentHashMap.compute(ConcurrentHashMap.java:1853) ~[?:1.8.0_422]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.doComputeIfAbsent(BoundedLocalCache.java:2404) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.BoundedLocalCache.computeIfAbsent(BoundedLocalCache.java:2387) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalCache.computeIfAbsent(LocalCache.java:108) ~[caffeine-2.9.3.jar:?]
at com.github.benmanes.caffeine.cache.LocalManualCache.get(LocalManualCache.java:62) ~[caffeine-2.9.3.jar:?]
at org.apache.iceberg.CachingCatalog.loadTable(CachingCatalog.java:166) ~[iceberg-core-1.4.3.jar:?]
at org.apache.amoro.formats.iceberg.IcebergCatalog.lambda$loadTable$6(IcebergCatalog.java:104) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.formats.iceberg.IcebergCatalog.loadTable(IcebergCatalog.java:101) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.CommonUnifiedCatalog.lambda$loadTable$1(CommonUnifiedCatalog.java:116) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$3$1.accept(ReferencePipeline.java:193) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:175) ~[?:1.8.0_422]
at java.util.Spliterators$ArraySpliterator.tryAdvance(Spliterators.java:958) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.forEachWithCancel(ReferencePipeline.java:126) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyIntoWithCancel(AbstractPipeline.java:499) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:486) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472) ~[?:1.8.0_422]
at java.util.stream.FindOps$FindOp.evaluateSequential(FindOps.java:152) ~[?:1.8.0_422]
at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline.findFirst(ReferencePipeline.java:531) ~[?:1.8.0_422]
at org.apache.amoro.CommonUnifiedCatalog.loadTable(CommonUnifiedCatalog.java:122) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.lambda$loadTable$11(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.call(TableMetaStore.java:256) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.table.TableMetaStore.lambda$doAs$0(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_422]
at javax.security.auth.Subject.doAs(Subject.java:360) ~[?:1.8.0_422]
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1930) ~[hadoop-common-3.4.0.jar:?]
at org.apache.amoro.table.TableMetaStore.doAs(TableMetaStore.java:231) ~[amoro-core-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.doAs(ExternalCatalog.java:161) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.catalog.ExternalCatalog.loadTable(ExternalCatalog.java:137) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.triggerTableAdded(DefaultTableService.java:577) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at org.apache.amoro.server.table.DefaultTableService.lambda$syncTable$19(DefaultTableService.java:564) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
at java.util.Spliterators$ArraySpliterator.forEachRemaining(Spliterators.java:948) ~[?:1.8.0_422]
at java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:647) ~[?:1.8.0_422]
at org.apache.amoro.server.persistence.PersistentBase.doAsTransaction(PersistentBase.java:61) ~[amoro-ams-server-0.7.0-incubating.jar:0.7.0-incubating]
... 6 more
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "liujie-yt (via GitHub)" <gi...@apache.org>.
liujie-yt commented on issue #3095:
URL: https://github.com/apache/amoro/issues/3095#issuecomment-2290736842
I'm glad I can help someting and I willing to fix this issue.
I just started try to use and learn Amoro. I think this is a good frist.
Give me a little time to learn how to contribute
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "zhoujinsong (via GitHub)" <gi...@apache.org>.
zhoujinsong commented on issue #3095:
URL: https://github.com/apache/amoro/issues/3095#issuecomment-2291002294
> Give me a little time to learn how to contribute
Here are some guilds for your first contribution and feel free to tell us if you have any problem.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer [amoro]
Posted by "zhoujinsong (via GitHub)" <gi...@apache.org>.
zhoujinsong closed issue #3095: [Improvement]: ClassNotFoundException: software.amazon.awssdk.transfer.s3.model.ObjectTransfer
URL: https://github.com/apache/amoro/issues/3095
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@amoro.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org