You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@texera.apache.org by "aglinxinyuan (via GitHub)" <gi...@apache.org> on 2026/04/22 00:54:52 UTC

[I] Arrow Flight startup failure after gRPC dependency upgrade [texera]

aglinxinyuan opened a new issue, #4438:
URL: https://github.com/apache/texera/issues/4438

   ### What happened?
   
   After the recent sbt-fs2-grpc upgrade in PR #4423t, the runtime gRPC version is resolved to a newer version that is incompatible with the current Arrow Flight 14.0.1 dependency.
   
   Root cause:
   - Arrow Flight 14.0.1 expects an older gRPC runtime.
   - The newer build dependency resolution brings in a newer gRPC version.
   - The old internal gRPC class AbstractServerImplBuilder is no longer available.
   
   ### How to reproduce?
   
   Python worker startup can fail when creating the Arrow Flight server with:
   `java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder`
   The failure happens in:
   `org.apache.arrow.flight.FlightServer$Builder.build`
   
   ### Version
   
   1.1.0-incubating (Pre-release/Master)
   
   ### Commit Hash (Optional)
   
   _No response_
   
   ### What browsers are you seeing the problem on?
   
   _No response_
   
   ### Relevant log output
   
   ```shell
   [2026-04-21 17:35:21,752] [WARN] [WF185-LoopStart-d9fe65-main-0] [PythonWorkflowWorker] [Amber-pekko.actor.default-dispatcher-4] - actor initialization failed due to exception 
   java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder
   	at java.base/java.lang.ClassLoader.defineClass1(Native Method)
   	at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1022)
   	at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:800)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
   	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
   	at org.apache.arrow.flight.FlightServer$Builder.build(FlightServer.java:233)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonProxyServer.<init>(PythonProxyServer.scala:169)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.startProxyServer(PythonWorkflowWorker.scala:151)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.initState(PythonWorkflowWorker.scala:141)
   	at org.apache.texera.amber.engine.architecture.common.WorkflowActor.preStart(WorkflowActor.scala:232)
   	at org.apache.pekko.actor.Actor.aroundPreStart(Actor.scala:558)
   	at org.apache.pekko.actor.Actor.aroundPreStart$(Actor.scala:558)
   	at org.apache.texera.amber.engine.architecture.common.WorkflowActor.aroundPreStart(WorkflowActor.scala:78)
   	at org.apache.pekko.actor.ActorCell.create(ActorCell.scala:653)
   	at org.apache.pekko.actor.ActorCell.invokeAll$1(ActorCell.scala:523)
   	at org.apache.pekko.actor.ActorCell.systemInvoke(ActorCell.scala:545)
   	at org.apache.pekko.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:298)
   	at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
   	at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:246)
   	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
   	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
   	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
   	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
   	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
   Caused by: java.lang.ClassNotFoundException: io.grpc.internal.AbstractServerImplBuilder
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
   	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
   	... 28 common frames omitted
   [2026-04-21 17:35:21,756] [ERROR] [org.apache.pekko.actor.ActorSystemImpl] [Amber-pekko.actor.default-dispatcher-22] - Uncaught error from thread [Amber-pekko.actor.default-dispatcher-4]: io/grpc/internal/AbstractServerImplBuilder, shutting down JVM since 'pekko.jvm-exit-on-fatal-error' is enabled for ActorSystem[Amber] 
   java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder
   	at java.base/java.lang.ClassLoader.defineClass1(Native Method)
   	at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1022)
   	at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:800)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
   	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
   	at org.apache.arrow.flight.FlightServer$Builder.build(FlightServer.java:233)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonProxyServer.<init>(PythonProxyServer.scala:169)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.startProxyServer(PythonWorkflowWorker.scala:151)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.initState(PythonWorkflowWorker.scala:141)
   	at org.apache.texera.amber.engine.architecture.common.WorkflowActor.preStart(WorkflowActor.scala:232)
   	at org.apache.pekko.actor.Actor.aroundPreStart(Actor.scala:558)
   	at org.apache.pekko.actor.Actor.aroundPreStart$(Actor.scala:558)
   	at org.apache.texera.amber.engine.architecture.common.WorkflowActor.aroundPreStart(WorkflowActor.scala:78)
   	at org.apache.pekko.actor.ActorCell.create(ActorCell.scala:653)
   	at org.apache.pekko.actor.ActorCell.invokeAll$1(ActorCell.scala:523)
   	at org.apache.pekko.actor.ActorCell.systemInvoke(ActorCell.scala:545)
   	at org.apache.pekko.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:298)
   	at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
   	at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:246)
   	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
   	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
   	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
   	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
   	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
   Caused by: java.lang.ClassNotFoundException: io.grpc.internal.AbstractServerImplBuilder
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
   	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
   	... 28 common frames omitted
   [2026-04-21 17:35:21,761] [INFO] [org.apache.pekko.actor.CoordinatedShutdown] [Amber-pekko.actor.default-dispatcher-22] - Running CoordinatedShutdown with reason [JvmExitReason] 
   Uncaught error from thread [Amber-pekko.actor.default-dispatcher-4]: io/grpc/internal/AbstractServerImplBuilder, shutting down JVM since 'pekko.jvm-exit-on-fatal-error' is enabled for ActorSystem[Amber]
   java.lang.NoClassDefFoundError: io/grpc/internal/AbstractServerImplBuilder
   	at java.base/java.lang.ClassLoader.defineClass1(Native Method)
   	at java.base/java.lang.ClassLoader.defineClass(ClassLoader.java:1022)
   	at java.base/java.security.SecureClassLoader.defineClass(SecureClassLoader.java:174)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.defineClass(BuiltinClassLoader.java:800)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.findClassOnClassPathOrNull(BuiltinClassLoader.java:698)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClassOrNull(BuiltinClassLoader.java:621)
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:579)
   	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
   	at org.apache.arrow.flight.FlightServer$Builder.build(FlightServer.java:233)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonProxyServer.<init>(PythonProxyServer.scala:169)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.startProxyServer(PythonWorkflowWorker.scala:151)
   	at org.apache.texera.amber.engine.architecture.pythonworker.PythonWorkflowWorker.initState(PythonWorkflowWorker.scala:141)
   	at org.apache.texera.amber.engine.architecture.common.WorkflowActor.preStart(WorkflowActor.scala:232)
   	at org.apache.pekko.actor.Actor.aroundPreStart(Actor.scala:558)
   	at org.apache.pekko.actor.Actor.aroundPreStart$(Actor.scala:558)
   	at org.apache.texera.amber.engine.architecture.common.WorkflowActor.aroundPreStart(WorkflowActor.scala:78)
   	at org.apache.pekko.actor.ActorCell.create(ActorCell.scala:653)
   	at org.apache.pekko.actor.ActorCell.invokeAll$1(ActorCell.scala:523)
   	at org.apache.pekko.actor.ActorCell.systemInvoke(ActorCell.scala:545)
   	at org.apache.pekko.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:298)
   	at org.apache.pekko.dispatch.Mailbox.run(Mailbox.scala:233)
   	at org.apache.pekko.dispatch.Mailbox.exec(Mailbox.scala:246)
   	at java.base/java.util.concurrent.ForkJoinTask.doExec(ForkJoinTask.java:290)
   	at java.base/java.util.concurrent.ForkJoinPool$WorkQueue.topLevelExec(ForkJoinPool.java:1020)
   	at java.base/java.util.concurrent.ForkJoinPool.scan(ForkJoinPool.java:1656)
   	at java.base/java.util.concurrent.ForkJoinPool.runWorker(ForkJoinPool.java:1594)
   	at java.base/java.util.concurrent.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:183)
   Caused by: java.lang.ClassNotFoundException: io.grpc.internal.AbstractServerImplBuilder
   	at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:581)
   	at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:178)
   	at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
   	... 28 more
   ```


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] Arrow Flight startup failure after gRPC dependency upgrade [texera]

Posted by "aglinxinyuan (via GitHub)" <gi...@apache.org>.
aglinxinyuan closed issue #4438: Arrow Flight startup failure after gRPC dependency upgrade
URL: https://github.com/apache/texera/issues/4438


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: notifications-unsubscribe@texera.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org