You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/01 05:49:08 UTC
[GitHub] [hudi] zjw722188 opened a new issue, #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
zjw722188 opened a new issue, #5724:
URL: https://github.com/apache/hudi/issues/5724
hi,During the integration of Flink Hudi and hive, I execute tasks and insert data normally. However, when hive metadata is synchronized, the following error messages always appear.
**version: hudi 0.10.1 flink 1.13.1 scala 2.12.10**
2022-06-01 10:55:03,191 ERROR org.apache.hudi.sink.StreamWriteOperatorCoordinator [] - Executor executes action [sync hive metadata for instant 2
0220601105502016] error
java.lang.NoClassDefFoundError: org/apache/thrift/TBase
at java.lang.ClassLoader.defineClass1(Native Method) ~[?:1.8.0_212]
at java.lang.ClassLoader.defineClass(ClassLoader.java:763) ~[?:1.8.0_212]
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) ~[?:1.8.0_212]
at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) ~[?:1.8.0_212]
at java.net.URLClassLoader.access$100(URLClassLoader.java:74) ~[?:1.8.0_212]
at java.net.URLClassLoader$1.run(URLClassLoader.java:369) ~[?:1.8.0_212]
at java.net.URLClassLoader$1.run(URLClassLoader.java:363) ~[?:1.8.0_212]
at java.security.AccessController.doPrivileged(Native Method) ~[?:1.8.0_212]
at java.net.URLClassLoader.findClass(URLClassLoader.java:362) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_212]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_212]
at org.apache.hudi.hive.HiveSyncTool.<init>(HiveSyncTool.java:78) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1]
at org.apache.hudi.sink.utils.HiveSyncContext.hiveSyncTool(HiveSyncContext.java:51) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1]
at org.apache.hudi.sink.StreamWriteOperatorCoordinator.syncHive(StreamWriteOperatorCoordinator.java:302) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.
1]
at org.apache.hudi.sink.utils.NonThrownExecutor.lambda$execute$0(NonThrownExecutor.java:93) ~[hudi-flink-bundle_2.12-0.10.1.jar:0.10.1]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_212]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_212]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_212]
Caused by: java.lang.ClassNotFoundException: org.apache.thrift.TBase
at java.net.URLClassLoader.findClass(URLClassLoader.java:382) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:424) ~[?:1.8.0_212]
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349) ~[?:1.8.0_212]
at java.lang.ClassLoader.loadClass(ClassLoader.java:357) ~[?:1.8.0_212]
... 19 more
**Environment Description**
* Hudi version :0.10.1
* Spark version :3.0.3
* Hive version :2.3.1
* Hadoop version :2.7.3
* Storage (HDFS/S3/GCS..) :HDFS
* Running on Docker? (yes/no) :no
**Stacktrace**
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] xushiyan commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
xushiyan commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1296319459
@nsivabalan @yuzhaojing for this one we should try to reproduce the setup with the latest master version. if meta sync works properly, then we can close this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] yuzhaojing commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
yuzhaojing commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1156313204
Do you have another package conflict with this?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1152607749
@yuzhaojing : can you help triage this.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1301589311
@yuzhaojing : can you try hive sync w/ flink w/ latest master and close out the issue if things are good.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1299698727
this was reported on May 31st and we haven't heard back from the author.
thought we had some policy around closing tickets due to in activity. Do you want us to reproduce? @xushiyan
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 closed issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
danny0405 closed issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
URL: https://github.com/apache/hudi/issues/5724
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] nsivabalan commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
nsivabalan commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1245979209
closing it due to no activity. feel free to raise a new issue if you are looking for assistance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5724: [SUPPORT]Executor executes action [sync hive metadata for instant 2 0220601105502016] error java.lang.NoClassDefFoundError: org/apache/thrift/TBase
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5724:
URL: https://github.com/apache/hudi/issues/5724#issuecomment-1306552715
Close because of chronic inactivity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org