You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "pauloricardoferreira (via GitHub)" <gi...@apache.org> on 2026/10/23 22:59:49 UTC

[I] [Bug]: REST Connection metadata not found when executing pipeline on remote Hop Server (Docker) - 2.18.1 (hop)

pauloricardoferreira opened a new issue, #9100:
URL: https://github.com/apache/hop/issues/9100

   ### Apache Hop version?
   
   2.18.1
   
   ### Java version?
   
   21.0.11
   
   ### Operating system
   
   Docker
   
   ### What happened?
   
   When executing a pipeline on a remote Hop Server using the Remote Pipeline Engine, the execution fails because the REST Client transform cannot find an existing REST Connection metadata definition.
   
   The REST Connection metadata was created and configured in Apache Hop GUI, and the pipeline was configured to execute on a remote Hop Server running inside a Docker container.
   
   The Docker environment has the necessary directories and configurations mapped through volumes.
   
   However, during remote execution, the REST Client transform fails to initialize because the REST Connection metadata cannot be found.
   
   Environment
   
   Apache Hop version: 2.18.1
   
   Execution engine: Remote Pipeline Engine
   
   Remote server: Apache Hop Server
   
   Deployment: Docker container
   
   Hop Server authentication: Basic Authentication enabled
   
   Hop Server project: default
   
   Remote run configuration: hop-server-pipeline
   
   Steps to Reproduce
   
   Open Apache Hop GUI (version 2.18.1).
   
   Create a new REST Connection under the Metadata section.
   
   Configure the REST Connection with the required endpoint and authentication settings.
   
   Create and configure a connection to a remote Hop Server.
   
   Create a pipeline containing a REST Client transform.
   
   Configure the REST Client transform to use the previously created REST Connection metadata.
   
   Configure the pipeline to execute using the Remote Pipeline Engine.
   
   Execute the pipeline on the remote Hop Server running in Docker.
   
   Expected Behavior
   
   The remote Hop Server should be able to resolve and load the REST Connection metadata, provided that the corresponding metadata is available in the configured project/environment.
   
   The REST Client transform should initialize successfully, allowing the pipeline to execute.
   
   Actual Behavior
   
   The pipeline fails during initialization because the REST Client transform cannot locate the configured REST Connection metadata.
   
   The following error is returned:
   
   Error preparing remote pipeline
   
   There was an error preparing the pipeline
   for execution on the remote server:
   
   Initialisation of pipeline failed
   
   REST client 2.0 - ERROR:
   Error initializing transform [REST client 2]
   
   org.apache.hop.core.exception.HopRuntimeException:
   REST connection ENVIAR_EMAIL_NAO_RESPONSA_AGROTERENAS
   could not be found
   
   at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:921)
   
   Transform [REST client 2.0] failed to initialize!
   
   HopException:
   We failed to initialize at least one transform.
   Execution can not begin!
   
   The remote Hop Server itself starts successfully and accepts the pipeline execution request. The failure occurs during REST Client transform initialization.
   
   Additional Information
   
   The Hop Server is running inside a Docker container.
   
   The required directories and configurations are mapped using Docker volumes.
   
   The REST Connection metadata is configured in Apache Hop GUI.
   
   The remote pipeline execution reaches the Hop Server, but fails when resolving the REST Connection metadata.
   
   The error occurs before the pipeline begins processing data.
   
   Questions
   
   Is REST Connection metadata expected to be automatically transferred to the remote Hop Server when executing a pipeline using the Remote Pipeline Engine?
   
   Does REST Connection metadata require additional configuration or explicit registration on the remote Hop Server?
   
   Could this behavior indicate an issue with metadata resolution in Apache Hop 2.18.1?
   
   Are there additional configuration requirements for loading REST Connection metadata when running Hop Server inside Docker?
   
   Attachments
   
   Screenshots will be attached showing:
   
   REST Connection metadata configuration
   
   <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/10f5b29e-21cc-4ef3-af28-f08dffb04bc3" />
   
   Remote Hop Server connection configuration
   
   <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/3feb9f43-b1b7-44fc-930d-6e11e10d5b3e" />
   
   Pipeline and REST Client transform configuration
   
   <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/f3b8ce43-0dbb-45bf-a004-4fe79814dfeb" />
   
   Remote pipeline execution configuration
   
   <img width="1000" height="725" alt="Image" src="https://github.com/user-attachments/assets/607f78a3-87c7-4644-9d12-4ee01cabe61a" />
   
   Error message and execution logs
   2026/10/23 19:48:00 [Basic]    Hop - Pipeline opened.
   2026/10/23 19:48:00 [Basic]    Hop - Launching pipeline [INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR]...
   2026/10/23 19:48:00 [Basic]    Hop - Started executing pipeline 'INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR'.
   2026/10/23 19:48:00 [Basic]    INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Executing this pipeline using the Remote Pipeline Engine with run configuration 'hop-server-pipeline'
   2026/10/23 19:48:00 [Error]    Hop - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR: preparing pipeline execution failed
   2026/10/23 19:48:00 [Error]    Hop - org.apache.hop.core.exception.HopException: 
   2026/10/23 19:48:00 [Error]    Hop - Error preparing remote pipeline
   2026/10/23 19:48:00 [Error]    Hop - 
   2026/10/23 19:48:00 [Error]    Hop - There was an error preparing the pipeline for execution on the remote server: 
   2026/10/23 19:48:00 [Error]    Hop - Initialisation of pipeline failed: 2026/10/23 19:44:41 - HopServer - Enabling project 'default'2026/10/23 19:44:41 - HopServer - Installing timer to purge stale objects after 1440 minutes.2026/10/23 19:44:42 - HopServer - Hop Server: Basic authentication is ENABLED2026/10/23 19:44:42 - HopServer - Created listener for webserver @ address : 0.0.0.0:80802026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Execution started for pipeline [INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR]2026/10/23 19:48:00 - REST client 2.0 - ERROR: Error initializing transform [REST client 2]2026/10/23 19:48:00 - REST client 2.0 - ERROR: org.apache.hop.core.exception.HopRuntimeException: REST connection ENVIAR_EMAIL_NAO_RESPONSA_AGROTERENAS could not be found2026/10/23 19:48:00 - REST client 2.
 0 - 
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:921)2026/10/23 19:48:00 - REST client 2.0 - 
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:74)2026/10/23 19:48:00 - REST client 2.0 - 
   2026/10/23 19:48:00 [Error]    Hop - at java.base/java.lang.Thread.run(Thread.java:1583)2026/10/23 19:48:00 - Table output.0 - Connected to database [BASEMYSQL_PROJURIS] (commit=1000)2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - ERROR: Transform [REST client 2.0] failed to initialize!2026/10/23 19:48:00 - Table input.0 - Finished reading query, closing connection.HopException: We failed to initialize at least one transform.  Execution can not begin!Root cause: HopException: We failed to initialize at least one transform.  Execution can not begin!org.apache.hop.core.exception.HopException: We failed to initialize at least one transform.  Execution can not begin!
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.Pipeline.prepareExecution(Pipeline.java:1117)
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.prepareExecution(LocalPipelineEngine.java:236)
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.www.PrepareExecutionPipelineServlet.doGet(PrepareExecutionPipelineServlet.java:145)
   2026/10/23 19:48:00 [Error]    Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:633)
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.www.BaseHttpServlet.service(BaseHttpServlet.java:112)
   2026/10/23 19:48:00 [Error]    Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:723)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHolder.handle(ServletHolder.java:750)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1668)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$MappedServlet.handle(ServletHandler.java:1602)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.dispatch(ServletChannel.java:868)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.handle(ServletChannel.java:449)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler.handle(ServletHandler.java:470)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.SessionHandler.handle(SessionHandler.java:763)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1224)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:178)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.Handler$Sequence.handle(Handler.java:859)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:546)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.Server.handle(Server.java:197)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:787)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:420)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.internal.HttpConnection$FillableCallback.succeeded(HttpConnection.java:1809)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:54)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:492)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.epcRunTask(AdaptiveExecutionStrategy.java:428)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:401)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:255)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:204)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:317)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:1009)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1239)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1194)
   2026/10/23 19:48:00 [Error]    Hop - at java.base/java.lang.Thread.run(Thread.java:1583)
   2026/10/23 19:48:00 [Error]    Hop - 
   2026/10/23 19:48:00 [Error]    Hop - 
   2026/10/23 19:48:00 [Error]    Hop - 	at org.apache.hop.pipeline.engines.remote.RemotePipelineEngine.prepareExecution(RemotePipelineEngine.java:266)
   2026/10/23 19:48:00 [Error]    Hop - 	at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.lambda$preparePipeline$21(HopGuiPipelineGraph.java:4828)
   2026/10/23 19:48:00 [Error]    Hop - 	at java.base/java.lang.Thread.run(Thread.java:1583)
   2026/10/23 19:48:00 [Error]    Hop - Caused by: org.apache.hop.core.exception.HopException: 
   2026/10/23 19:48:00 [Error]    Hop - There was an error preparing the pipeline for execution on the remote server: 
   2026/10/23 19:48:00 [Error]    Hop - Initialisation of pipeline failed: 2026/10/23 19:44:41 - HopServer - Enabling project 'default'2026/10/23 19:44:41 - HopServer - Installing timer to purge stale objects after 1440 minutes.2026/10/23 19:44:42 - HopServer - Hop Server: Basic authentication is ENABLED2026/10/23 19:44:42 - HopServer - Created listener for webserver @ address : 0.0.0.0:80802026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - Execution started for pipeline [INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR]2026/10/23 19:48:00 - REST client 2.0 - ERROR: Error initializing transform [REST client 2]2026/10/23 19:48:00 - REST client 2.0 - ERROR: org.apache.hop.core.exception.HopRuntimeException: REST connection ENVIAR_EMAIL_NAO_RESPONSA_AGROTERENAS could not be found2026/10/23 19:48:00 - REST client 2.
 0 - 
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.transforms.rest.Rest.init(Rest.java:921)2026/10/23 19:48:00 - REST client 2.0 - 
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:74)2026/10/23 19:48:00 - REST client 2.0 - 
   2026/10/23 19:48:00 [Error]    Hop - at java.base/java.lang.Thread.run(Thread.java:1583)2026/10/23 19:48:00 - Table output.0 - Connected to database [BASEMYSQL_PROJURIS] (commit=1000)2026/10/23 19:48:00 - INT_PROJURIS_ALERTA_DOC_ENVIAR_ALERTA_CONTADOR - ERROR: Transform [REST client 2.0] failed to initialize!2026/10/23 19:48:00 - Table input.0 - Finished reading query, closing connection.HopException: We failed to initialize at least one transform.  Execution can not begin!Root cause: HopException: We failed to initialize at least one transform.  Execution can not begin!org.apache.hop.core.exception.HopException: We failed to initialize at least one transform.  Execution can not begin!
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.Pipeline.prepareExecution(Pipeline.java:1117)
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.prepareExecution(LocalPipelineEngine.java:236)
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.www.PrepareExecutionPipelineServlet.doGet(PrepareExecutionPipelineServlet.java:145)
   2026/10/23 19:48:00 [Error]    Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:633)
   2026/10/23 19:48:00 [Error]    Hop - at org.apache.hop.www.BaseHttpServlet.service(BaseHttpServlet.java:112)
   2026/10/23 19:48:00 [Error]    Hop - at jakarta.servlet.http.HttpServlet.service(HttpServlet.java:723)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHolder.handle(ServletHolder.java:750)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$ChainEnd.doFilter(ServletHandler.java:1668)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler$MappedServlet.handle(ServletHandler.java:1602)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.dispatch(ServletChannel.java:868)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletChannel.handle(ServletChannel.java:449)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.ServletHandler.handle(ServletHandler.java:470)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.ee11.servlet.SessionHandler.handle(SessionHandler.java:763)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.handler.ContextHandler.handle(ContextHandler.java:1224)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:178)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.Handler$Sequence.handle(Handler.java:859)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:546)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.Server.handle(Server.java:197)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.internal.HttpChannelState$HandlerInvoker.run(HttpChannelState.java:787)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.internal.HttpConnection.onFillable(HttpConnection.java:420)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.server.internal.HttpConnection$FillableCallback.succeeded(HttpConnection.java:1809)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.io.SelectableChannelEndPoint$1.run(SelectableChannelEndPoint.java:54)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.runTask(AdaptiveExecutionStrategy.java:492)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.epcRunTask(AdaptiveExecutionStrategy.java:428)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.consumeTask(AdaptiveExecutionStrategy.java:401)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.tryProduce(AdaptiveExecutionStrategy.java:255)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.strategy.AdaptiveExecutionStrategy.run(AdaptiveExecutionStrategy.java:204)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:317)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:1009)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.doRunJob(QueuedThreadPool.java:1239)
   2026/10/23 19:48:00 [Error]    Hop - at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1194)
   2026/10/23 19:48:00 [Error]    Hop - at java.base/java.lang.Thread.run(Thread.java:1583)
   2026/10/23 19:48:00 [Error]    Hop - 
   2026/10/23 19:48:00 [Error]    Hop - 	at org.apache.hop.pipeline.engines.remote.RemotePipelineEngine.sendToHopServer(RemotePipelineEngine.java:395)
   2026/10/23 19:48:00 [Error]    Hop - 	at org.apache.hop.pipeline.engines.remote.RemotePipelineEngine.prepareExecution(RemotePipelineEngine.java:262)
   2026/10/23 19:48:00 [Error]    Hop - 	... 2 more
   
   
   Thank you for your assistance!
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: Other, Component: Containers


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org