You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by "ravamo (via GitHub)" <gi...@apache.org> on 2024/12/09 20:21:09 UTC
[D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
GitHub user ravamo created a discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
I checked a project migrated from PDI to Hop using the tool, and everything seems fine. However, when I execute it as mentioned in the [thread ](https://github.com/apache/hop/discussions/4634), I get this error, and I don’t know why. I searched for this error on Google and found this [thread ](https://www.mail-archive.com/users@hop.apache.org/msg00079.html), but it's not clear to me why it happens, especially since it runs perfectly fine locally.
```
Starting action
Opening pipeline: [/servers/hop/server/resources/etl/repository/setExecutionTime.hpl]
Starting pipeline...(file=/servers/hop/server/resources/etl/repository/setExecutionTime.hpl, name=Set Execution time, repinfo=null)
ERROR: Unable to open pipeline:
This action needs a run configuration to use to execute the specified pipeline
ERROR: org.apache.hop.core.exception.HopException:
This action needs a run configuration to use to execute the specified pipeline
Set Execution time -
at org.apache.hop.workflow.actions.pipeline.ActionPipeline.execute(ActionPipeline.java:491)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:745)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:888)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:447)
at org.apache.hop.workflow.Workflow.startExecution(Workflow.java:307)
at org.apache.hop.workflow.engines.local.LocalWorkflowEngine.startExecution(LocalWorkflowEngine.java:248)
at java.base/java.lang.Thread.run(Thread.java:833)
mainRedmineLoadDatalake - Starting action [Error Handling]
mainRedmineLoadDatalake - exec(5, 0, Error Handling)
Error Handling - Starting action
Error Handling - Opening pipeline: [/servers/hop/server/resources/etl/repository/errorHandling.hpl]
Error Handling - Starting pipeline...(file=/servers/hop/server/resources/etl/repository/errorHandling.hpl, name=Error Handling, repinfo=null)
Error Handling - ERROR: Unable to open pipeline:
Error Handling - This action needs a run configuration to use to execute the specified pipeline
Error Handling - ERROR: org.apache.hop.core.exception.HopException:
Error Handling - This action needs a run configuration to use to execute the specified pipeline
Error Handling -
Error Handling - at org.apache.hop.workflow.actions.pipeline.ActionPipeline.execute(ActionPipeline.java:491)
Error Handling - at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:745)
Error Handling - at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:888)
Error Handling - at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:447)
Error Handling - at org.apache.hop.workflow.Workflow.startExecution(Workflow.java:307)
Error Handling - at org.apache.hop.workflow.engines.local.LocalWorkflowEngine.startExecution(LocalWorkflowEngine.java:248)
Error Handling - at java.base/java.lang.Thread.run(Thread.java:833)
mainRedmineLoadDatalake - Starting action [Abort job]
````
GitHub link: https://github.com/apache/hop/discussions/4685
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
I've this configuration :
And I’ve checked, and all of them have the "local" mode set both on my local machine and on the server, for both pipelines and workflows.
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11518057
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
it looks like that database connection isn't known on the server though
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11521717
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
not something I use frequently myself, but I would avoid the metadata folders for the `samples` and `default` projects for your own metadata. anyway, this is now a configuration issue and no longer a PDI migration issue.
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11522516
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "NicoDupont (via GitHub)" <gi...@apache.org>.
GitHub user NicoDupont added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
try with the remote run configuration not local
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11517723
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "NicoDupont (via GitHub)" <gi...@apache.org>.
GitHub user NicoDupont added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
did you set the run configuration ?
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11517549
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
Hi !
Actually, there are two ETLs that fail to execute, but I don't understand why. They work perfectly fine on the local machine, but on the server, they throw this error and stop. I've checked to ensure that all the metadata is in the folder, and it is. I don't quite understand where the problem lies. Is there any additional step required for migrating ETLs from PDI to Hop that I might have missed? (I used the migration tool, added the database configuration, and set the parameters).
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11517484
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
Well, look at that! I ran a grep to search for the word "local" within the XML files, and there’s nothing. I understand that’s not right, correct? I mean, each XML should have a tag indicating that, right?
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11518866
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo edited a discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
I checked a project migrated from PDI to Hop using the tool, and everything seems fine. However, when I execute it as mentioned in the [thread ](https://github.com/apache/hop/discussions/4634), I get this error, and I don’t know why. I searched for this error on Google and found this [thread ](https://www.mail-archive.com/users@hop.apache.org/msg00079.html), but it's not clear to me why it happens, especially since it runs perfectly fine locally.
```
Starting action
Opening pipeline: [/servers/hop/server/resources/etl/repository/setExecutionTime.hpl]
Starting pipeline...(file=/servers/hop/server/resources/etl/repository/setExecutionTime.hpl, name=Set Execution time, repinfo=null)
ERROR: Unable to open pipeline:
This action needs a run configuration to use to execute the specified pipeline
ERROR: org.apache.hop.core.exception.HopException:
This action needs a run configuration to use to execute the specified pipeline
at org.apache.hop.workflow.actions.pipeline.ActionPipeline.execute(ActionPipeline.java:491)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:745)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:888)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:447)
at org.apache.hop.workflow.Workflow.startExecution(Workflow.java:307)
at org.apache.hop.workflow.engines.local.LocalWorkflowEngine.startExecution(LocalWorkflowEngine.java:248)
at java.base/java.lang.Thread.run(Thread.java:833)
mainRedmineLoadDatalake - Starting action [Error Handling]
mainRedmineLoadDatalake - exec(5, 0, Error Handling)
Starting action
Opening pipeline: [/servers/hop/server/resources/etl/repository/errorHandling.hpl]
Starting pipeline...(file=/servers/hop/server/resources/etl/repository/errorHandling.hpl, name=Error Handling, repinfo=null)
ERROR: Unable to open pipeline:
This action needs a run configuration to use to execute the specified pipeline
ERROR: org.apache.hop.core.exception.HopException:
This action needs a run configuration to use to execute the specified pipeline
at org.apache.hop.workflow.actions.pipeline.ActionPipeline.execute(ActionPipeline.java:491)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:745)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:888)
at org.apache.hop.workflow.Workflow.executeFromStart(Workflow.java:447)
at org.apache.hop.workflow.Workflow.startExecution(Workflow.java:307)
at org.apache.hop.workflow.engines.local.LocalWorkflowEngine.startExecution(LocalWorkflowEngine.java:248)
at java.base/java.lang.Thread.run(Thread.java:833)
mainRedmineLoadDatalake - Starting action [Abort job]
````
GitHub link: https://github.com/apache/hop/discussions/4685
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer edited a comment on the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
looks like your `mainRedmineLoadDatalake` workflow has a pipeline action for `/servers/hop/server/resources/etl/repository/errorHandling.hpl` that doesn't have a run configuration that the server knows
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11513067
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
Well, I deleted everything and recreated it manually, and it seems to be working now—or at least I’m getting new errors because I set everything to debug mode. Now I’m dealing with this error:
``` less
ERROR: Error initializing transform [Salida Tabla]
ERROR: java.lang.NullPointerException: Cannot invoke "org.apache.hop.core.database.DatabaseMeta.getIDatabase()" because "this.data.databaseMeta" is null
at org.apache.hop.pipeline.transforms.tableoutput.TableOutput.init(TableOutput.java:482)
at org.apache.hop.pipeline.transform.TransformInitThread.run(TransformInitThread.java:66)
at java.base/java.lang.Thread.run(Thread.java:833)
repository\setExecutionTime - Transform [Información de sistema.0] initialized flawlessly.
````
But the datasoure was defined .. i'm lost right now
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11521612
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
did you check the XML for the problematic workflow? we had an issue with Hop Gui showing the default run config, even if it wasn't serialized. Selecting the run config for that action and saving the workflow fixed that issue, and that issue should have been resolved ages ago, but you never know.
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11518085
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
yep looks list a problem with rdbs , but I added the JSON that I created locally (it’s parameterized) to the folder hop/config/projects/default/metadata/rdbms, and then I added the path in the XML file before starting the server:
```xml
<metadata_folder></metadata_folder>
```
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11522175
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
yes, just create a backup of that failing workflow, open it in Hop Gui, select the run config for that pipeline action, save your workflow and compare that last version's XML to the XML from the backup and you'll know if that is the issue
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11519360
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
looks like your `mainRedmineLoadDatalake` workflow has a pipeline action for `/servers/hop/server/resources/etl/repository/errorHandling.hpl` that doesn't have a run configuration
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11513067
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
Yes, but now I’m lost... Honestly, I’m not sure what tests I can run. I think it’s better if I close this one and open a new one for this issue, right?
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11530174
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
yes, that's probably better to avoid having two separate discussions in a single discussion
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11532158
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "NicoDupont (via GitHub)" <gi...@apache.org>.
GitHub user NicoDupont added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11517996
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer edited a comment on the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
It looks like your `mainRedmineLoadDatalake` workflow has a pipeline action for `/servers/hop/server/resources/etl/repository/errorHandling.hpl` that doesn't have a run configuration or one that the server doesn't recognize.
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11513067
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "ravamo (via GitHub)" <gi...@apache.org>.
GitHub user ravamo added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
yep
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11517560
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
and make sure you have both a `local` workflow run config AND a `local` pipeline run config on the server.
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11517950
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely [hop]
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer edited a comment on the discussion: Error Running Migrated PDI to Hop Project: Works Locally but Fails Remotely
yes, that's probably better to avoid having two separate topics in a single discussion
GitHub link: https://github.com/apache/hop/discussions/4685#discussioncomment-11532158
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org