You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by "Matwey V. Kornilov" <ma...@gmail.com> on 2023/12/04 12:08:31 UTC

Could not start the JobMaster. org.apache.flink.api.common.ExecutionConfig not found

Hello,

I am trying to run very simple job locally via maven exec plugin:


public class DataStreamJob {

         public static void main(String[] args) throws Exception {
                 final StreamExecutionEnvironment env = 
StreamExecutionEnvironment.getExecutionEnvironment();

                 DataStream<Integer> dataStream = env.fromElements(1,2,3);

                 dataStream.print();

                 env.execute("Flink Java API Skeleton");
         }
}


To be able to run the jar package via maven exec plugin, I created the 
maven profile with flink-java, flink-core, flink-clients, flink-runtime, 
and flink-java-streaming installed. I see that the temporary cluster 
deploying is starting until the following error happens:


org.apache.flink.runtime.client.JobInitializationException: Could not 
start the JobMaster.
	at 
org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97)
	at 
java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
	at 
java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
	at 
java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
	at 
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1773)
	at 
java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
	at 
java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
	at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: java.util.concurrent.CompletionException: 
java.lang.RuntimeException: java.lang.ClassNotFoundException: 
org.apache.flink.api.common.ExecutionConfig
	at 
java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
	at 
java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
	at 
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1770)
	... 3 more
Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: 
org.apache.flink.api.common.ExecutionConfig
	at org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321)
	at 
org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:114)
	at 
java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
	... 3 more
Caused by: java.lang.ClassNotFoundException: 
org.apache.flink.api.common.ExecutionConfig
	at 
java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
	at 
java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:526)
	at java.base/java.lang.Class.forName0(Native Method)
	at java.base/java.lang.Class.forName(Class.java:534)
	at java.base/java.lang.Class.forName(Class.java:513)
	at 
org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:78)
	at 
java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2061)
	at 
java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1927)
	at 
java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2252)
	at 
java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1762)
	at 
java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:540)
	at 
java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:498)
	at 
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:539)
	at 
org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:527)
	at 
org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:67)
	at 
org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:101)
	at 
org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:122)
	at 
org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:379)
	at org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:356)
	at 
org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128)
	at 
org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100)
	at 
org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112)
	... 4 more


How could I figure out what is going wrong? Since 
org.apache.flink.api.common.ExecutionConfig is definitely here.


Re: Could not start the JobMaster. org.apache.flink.api.common.ExecutionConfig not found

Posted by "Matwey V. Kornilov" <ma...@gmail.com>.

Sorry for the noise. Reverting to version 1.17.2 fixed the issue.


04.12.2023 15:08, Matwey V. Kornilov пишет:
> Hello,
> 
> I am trying to run very simple job locally via maven exec plugin:
> 
> 
> public class DataStreamJob {
> 
>          public static void main(String[] args) throws Exception {
>                  final StreamExecutionEnvironment env = 
> StreamExecutionEnvironment.getExecutionEnvironment();
> 
>                  DataStream<Integer> dataStream = env.fromElements(1,2,3);
> 
>                  dataStream.print();
> 
>                  env.execute("Flink Java API Skeleton");
>          }
> }
> 
> 
> To be able to run the jar package via maven exec plugin, I created the 
> maven profile with flink-java, flink-core, flink-clients, flink-runtime, 
> and flink-java-streaming installed. I see that the temporary cluster 
> deploying is starting until the following error happens:
> 
> 
> org.apache.flink.runtime.client.JobInitializationException: Could not 
> start the JobMaster.
>      at 
> org.apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97)
>      at 
> java.base/java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:863)
>      at 
> java.base/java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:841)
>      at 
> java.base/java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:510)
>      at 
> java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1773)
>      at 
> java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
>      at 
> java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
>      at java.base/java.lang.Thread.run(Thread.java:1583)
> Caused by: java.util.concurrent.CompletionException: 
> java.lang.RuntimeException: java.lang.ClassNotFoundException: 
> org.apache.flink.api.common.ExecutionConfig
>      at 
> java.base/java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:315)
>      at 
> java.base/java.util.concurrent.CompletableFuture.completeThrowable(CompletableFuture.java:320)
>      at 
> java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1770)
>      ... 3 more
> Caused by: java.lang.RuntimeException: java.lang.ClassNotFoundException: 
> org.apache.flink.api.common.ExecutionConfig
>      at 
> org.apache.flink.util.ExceptionUtils.rethrow(ExceptionUtils.java:321)
>      at 
> org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:114)
>      at 
> java.base/java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1768)
>      ... 3 more
> Caused by: java.lang.ClassNotFoundException: 
> org.apache.flink.api.common.ExecutionConfig
>      at 
> java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
>      at 
> java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
>      at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:526)
>      at java.base/java.lang.Class.forName0(Native Method)
>      at java.base/java.lang.Class.forName(Class.java:534)
>      at java.base/java.lang.Class.forName(Class.java:513)
>      at 
> org.apache.flink.util.InstantiationUtil$ClassLoaderObjectInputStream.resolveClass(InstantiationUtil.java:78)
>      at 
> java.base/java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:2061)
>      at 
> java.base/java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1927)
>      at 
> java.base/java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:2252)
>      at 
> java.base/java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1762)
>      at 
> java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:540)
>      at 
> java.base/java.io.ObjectInputStream.readObject(ObjectInputStream.java:498)
>      at 
> org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:539)
>      at 
> org.apache.flink.util.InstantiationUtil.deserializeObject(InstantiationUtil.java:527)
>      at 
> org.apache.flink.util.SerializedValue.deserializeValue(SerializedValue.java:67)
>      at 
> org.apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:101)
>      at 
> org.apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:122)
>      at 
> org.apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:379)
>      at 
> org.apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:356)
>      at 
> org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:128)
>      at 
> org.apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:100)
>      at 
> org.apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112)
>      ... 4 more
> 
> 
> How could I figure out what is going wrong? Since 
> org.apache.flink.api.common.ExecutionConfig is definitely here.
> 
>