You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/02/16 08:15:20 UTC

[GitHub] [hudi] gaoasi opened a new issue #4827: [SUPPORT] flink1.12.4 hudi 0.9.0 java.lang.ClassNotFoundException: org.apache.hudi.sink.StreamWriteOperatorCoordinator$Provider

gaoasi opened a new issue #4827:
URL: https://github.com/apache/hudi/issues/4827


   hi ! 
   I expect to write data to hudi through flink sql-client, however, I have encountered a problem, the problem is as follows:
   
   flink version is 1.12.4
   hudi version is 0.9.0
   
   flink lib info is :
   ![image](https://user-images.githubusercontent.com/43560964/154222694-171da3ec-6048-4461-9d0d-af1c146437ea.png)
   ![image](https://user-images.githubusercontent.com/43560964/154222742-3ab077ad-1324-4061-857e-f80ed4837be6.png)
   
   
   Exception in thread "main" org.apache.flink.table.client.SqlClientException: Unexpected exception. This is a bug. Please consider filing an issue.
           at org.apache.flink.table.client.SqlClient.main(SqlClient.java:215)
   Caused by: java.lang.RuntimeException: Error running SQL job.
           at org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeUpdateInternal$4(LocalExecutor.java:514)
           at org.apache.flink.table.client.gateway.local.ExecutionContext.wrapClassLoader(ExecutionContext.java:256)
           at org.apache.flink.table.client.gateway.local.LocalExecutor.executeUpdateInternal(LocalExecutor.java:507)
           at org.apache.flink.table.client.gateway.local.LocalExecutor.executeUpdate(LocalExecutor.java:428)
           at org.apache.flink.table.client.cli.CliClient.callInsert(CliClient.java:690)
           at org.apache.flink.table.client.cli.CliClient.callCommand(CliClient.java:327)
           at java.util.Optional.ifPresent(Optional.java:159)
           at org.apache.flink.table.client.cli.CliClient.open(CliClient.java:214)
           at org.apache.flink.table.client.SqlClient.openCli(SqlClient.java:144)
           at org.apache.flink.table.client.SqlClient.start(SqlClient.java:115)
           at org.apache.flink.table.client.SqlClient.main(SqlClient.java:201)
   Caused by: java.util.concurrent.ExecutionException: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager.
           at java.util.concurrent.CompletableFuture.reportGet(CompletableFuture.java:357)
           at java.util.concurrent.CompletableFuture.get(CompletableFuture.java:1895)
           at org.apache.flink.table.client.gateway.local.LocalExecutor.lambda$executeUpdateInternal$4(LocalExecutor.java:511)
           ... 10 more
   Caused by: java.lang.RuntimeException: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager.
           at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:316)
           at org.apache.flink.util.function.FunctionUtils.lambda$uncheckedFunction$2(FunctionUtils.java:75)
           at java.util.concurrent.CompletableFuture.uniApply(CompletableFuture.java:602)
           at java.util.concurrent.CompletableFuture$UniApply.tryFire(CompletableFuture.java:577)
           at java.util.concurrent.CompletableFuture$Completion.exec(CompletableFuture.java:443)
           at java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:289)
           at java.util.concurrent.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1056)
           at java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1692)
           at java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:157)
   Caused by: org.apache.flink.runtime.client.JobInitializationException: Could not instantiate JobManager.
           at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:494)
           at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
           at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
           at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
           at java.lang.Thread.run(Thread.java:748)
   Caused by: org.apache.flink.runtime.JobException: Cannot instantiate the coordinator for operator hoodie_stream_write
           at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:231)
           at org.apache.flink.runtime.executiongraph.ExecutionGraph.attachJobGraph(ExecutionGraph.java:866)
           at org.apache.flink.runtime.executiongraph.ExecutionGraphBuilder.buildGraph(ExecutionGraphBuilder.java:257)
           at org.apache.flink.runtime.scheduler.SchedulerBase.createExecutionGraph(SchedulerBase.java:322)
           at org.apache.flink.runtime.scheduler.SchedulerBase.createAndRestoreExecutionGraph(SchedulerBase.java:276)
           at org.apache.flink.runtime.scheduler.SchedulerBase.<init>(SchedulerBase.java:249)
           at org.apache.flink.runtime.scheduler.DefaultScheduler.<init>(DefaultScheduler.java:133)
           at org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:111)
           at org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:342)
           at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:327)
           at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:95)
           at org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.createJobMasterService(DefaultJobMasterServiceFactory.java:39)
           at org.apache.flink.runtime.jobmaster.JobManagerRunnerImpl.<init>(JobManagerRunnerImpl.java:162)
           at org.apache.flink.runtime.dispatcher.DefaultJobManagerRunnerFactory.createJobManagerRunner(DefaultJobManagerRunnerFactory.java:86)
           at org.apache.flink.runtime.dispatcher.Dispatcher.lambda$createJobManagerRunner$5(Dispatcher.java:478)
           ... 4 more
   Caused by: java.lang.ClassNotFoundException: org.apache.hudi.sink.StreamWriteOperatorCoordinator$Provider
           at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
           at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
           at org.apache.flink.util.FlinkUserCodeClassLoader.loadClassWithoutExceptionHandling(FlinkUserCodeClassLoader.java:64)
           at org.apache.flink.util.ChildFirstClassLoader.loadClassWithoutExceptionHandling(ChildFirstClassLoader.java:74)
           at org.apache.flink.util.FlinkUserCodeClassLoader.loadClass(FlinkUserCodeClassLoader.java:48)
           at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
           at org.apache.flink.runtime.execution.librarycache.FlinkUserCodeClassLoaders$SafetyNetWrapperClassLoader.loadClass(FlinkUserCodeClassLoaders.java:172)
           at java.lang.Class.forName0(Native Method)
           at java.lang.Class.forName(Class.java:348)
           at org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:76)
           at java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1868)
           at java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1751)
           at java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2042)
           at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1573)
           at java.io.ObjectInputStream.readObject(ObjectInputStream.java:431)
           at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:615)
           at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:600)
           at org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:587)
           at org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:67)
           at org.apache.flink.runtime.operators.coordination.OperatorCoordinatorHolder.create(OperatorCoordinatorHolder.java:442)
           at org.apache.flink.runtime.executiongraph.ExecutionJobVertex.<init>(ExecutionJobVertex.java:225)
           ... 18 more
   
   
   Is this exception thrown because hudi0.9.0 does not support flink1.12.4?
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [hudi] gaoasi closed issue #4827: [SUPPORT] flink1.12.4 hudi 0.9.0 java.lang.ClassNotFoundException: org.apache.hudi.sink.StreamWriteOperatorCoordinator$Provider

Posted by GitBox <gi...@apache.org>.
gaoasi closed issue #4827:
URL: https://github.com/apache/hudi/issues/4827


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org