You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by "fbourgine-cpu (via GitHub)" <gi...@apache.org> on 2025/11/06 19:17:14 UTC
[D] Pipeline Executor return no rows (hop)
GitHub user fbourgine-cpu created a discussion: Pipeline Executor return no rows
Hi everyone !
I try to use Pipeline Executor but I can't make it work properly.
The sub pipeline works fine and return many rows. I try to output on Google Sheet, and everything works fine.
I substitute with "Copy rows to results" and the results are good in the preview.
But when I try to execute this pipeline in a parent pipeline with Pipeline Executor, the execution is immediate and return nothing.
I tried many things but nothing is working ...
Can you help me understand ?
Thank you ! đ
--
Apache Hop 2.14
MacOS 26.1
openjdk 21.0.8 2025-07-15 LTS
OpenJDK Runtime Environment Microsoft-11933201 (build 21.0.8+9-LTS)
OpenJDK 64-Bit Server VM Microsoft-11933201 (build 21.0.8+9-LTS, mixed mode, sharing)
GitHub link: https://github.com/apache/hop/discussions/5965
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
GitHub user hansva added a comment to the discussion: Pipeline Executor return no rows
Also take a look at the sample in the samples project under `loops/pipeline-executor.hpl` to see how it works.
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14899453
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "fbourgine-cpu (via GitHub)" <gi...@apache.org>.
GitHub user fbourgine-cpu added a comment to the discussion: Pipeline Executor return no rows
Hi
Thank you for your reply
I tried but get an issue (JSON..)
Error registering execution information
sub_pipeline1.hpl.0 - Null key for a Map not allowed in JSON (use a
converting NullKeySerializer?) (through reference chain:
org.apache.hop.execution.Execution["parameterValues"])
Le ven. 7 nov. 2025 Ă 10:08, dave-csc ***@***.***> a Ă©crit :
> If I get correctly, you need to get the output of two distinct pipelines
> and merge them somehow in a parent pipeline.
>
> Then you can call each one with a Pipeline Executor, but as mentioned
> above you need to trigger them with a single row: use a Generate row
> transform, configure it to create a single row and no schema. Link this
> transform to (all) the subsequent Pipeline Executor(s), this is enough to
> trigger it/them (remember to "copy" the row and not to "distribute" it)
>
> Finally, link the Pipeline Executor output(s) to the merging transform
>
> â
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/hop/discussions/5965#discussioncomment-14900377>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/BZZ3DEHOM6ED7YU7DGZCYPT33RORXAVCNFSM6AAAAACLLWDUFOVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTIOJQGAZTONY>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14901141
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "liosc (via GitHub)" <gi...@apache.org>.
GitHub user liosc added a comment to the discussion: Pipeline Executor return no rows
Can you share the two pipelines?
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14895872
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "fbourgine-cpu (via GitHub)" <gi...@apache.org>.
GitHub user fbourgine-cpu added a comment to the discussion: Pipeline Executor return no rows
Ok I succeded !
My input parameter was not set in the sub_pipelines
See attached
Thanks very much !
Best Regards
Fabrice
Le ven. 7 nov. 2025 Ă 11:28, Fabrice BOURGINE <
***@***.***> a Ă©crit :
>
> Hi
> Thank you for your reply
>
> I tried but get an issue (JSON..)
>
> Error registering execution information
> sub_pipeline1.hpl.0 - Null key for a Map not allowed in JSON (use a
> converting NullKeySerializer?) (through reference chain:
> org.apache.hop.execution.Execution["parameterValues"])
>
> Le ven. 7 nov. 2025 Ă 10:08, dave-csc ***@***.***> a Ă©crit :
>
>> If I get correctly, you need to get the output of two distinct pipelines
>> and merge them somehow in a parent pipeline.
>>
>> Then you can call each one with a Pipeline Executor, but as mentioned
>> above you need to trigger them with a single row: use a Generate row
>> transform, configure it to create a single row and no schema. Link this
>> transform to (all) the subsequent Pipeline Executor(s), this is enough to
>> trigger it/them (remember to "copy" the row and not to "distribute" it)
>>
>> Finally, link the Pipeline Executor output(s) to the merging transform
>>
>> â
>> Reply to this email directly, view it on GitHub
>> <https://github.com/apache/hop/discussions/5965#discussioncomment-14900377>,
>> or unsubscribe
>> <https://github.com/notifications/unsubscribe-auth/BZZ3DEHOM6ED7YU7DGZCYPT33RORXAVCNFSM6AAAAACLLWDUFOVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTIOJQGAZTONY>
>> .
>> You are receiving this because you authored the thread.Message ID:
>> ***@***.***>
>>
>
>
>
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14901314
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "dave-csc (via GitHub)" <gi...@apache.org>.
GitHub user dave-csc added a comment to the discussion: Pipeline Executor return no rows
Does your sub-pipeline have an input, too (i.e. starts with a **Get rows from result**)?
Pipeline Executor is meant to execute a pipeline for each row (or group of rows) in a parent pipeline, if you have no input you should probably place the sub-pipeline in a workflow rather than a pipeline.
Alternatively, you can still place it in a parent pipeline, but you need to trigger it with at least one row (the simplest way is to link a **Generate rows** transform before)
Hope this helps :)
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14899505
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "fbourgine-cpu (via GitHub)" <gi...@apache.org>.
GitHub user fbourgine-cpu added a comment to the discussion: Pipeline Executor return no rows
Hi
Thank you very much for your help. I tried to execute the sample project
and it works fine.
So my usage is wrong I guess..
I try to execute 2 branches in parallel and merge data but not looping.
So my sub transform has no input. I just want to clarify my code.
Here is an example.
Fabrice
Le ven. 7 nov. 2025 Ă 08:24, dave-csc ***@***.***> a Ă©crit :
> Does your sub-pipeline have an input, too (i.e. starts with a *Get rows
> from result*)?
>
> Pipeline Executor is meant to execute a pipeline for each row (or group of
> rows) in a parent pipeline, if you have no input you should probably place
> the sub-pipeline in a workflow rather than a pipeline.
>
> Alternatively, you can still place it in a parent pipeline, but you need
> to trigger it with at least one row (the simplest way is to link a *Generate
> rows* transform before)
>
> Hope this helps :)
>
> â
> Reply to this email directly, view it on GitHub
> <https://github.com/apache/hop/discussions/5965#discussioncomment-14899505>,
> or unsubscribe
> <https://github.com/notifications/unsubscribe-auth/BZZ3DEAHURBIKY6TJ64NQX333RCLBAVCNFSM6AAAAACLLWDUFOVHI2DSMVQWIX3LMV43URDJONRXK43TNFXW4Q3PNVWWK3TUHMYTIOBZHE2TANI>
> .
> You are receiving this because you authored the thread.Message ID:
> ***@***.***>
>
--
<https://www.letelegramme.fr/>
*Fabrice BOURGINE*
* DIRECTEUR SYSTEMES D'INFORMATION GROUPE *
***@***.***
<http:///cdn-cgi/l/email-protection#680e460a071d1a0f01060d28040d1c0d040d0f1a0905050d460e1a>
02 98 62 20 19 / 06 15 69 34 43
Plan d'accĂšs MORLAIX
<https://www.google.com/maps?q=7+VOIE+D'ACCĂS+AU+PORT+-+29600+MORLAIX>
[image: LinkedIn] <https://fr.linkedin.com/company/letelegramme>
[image: Facebook] <https://www.facebook.com/letelegramme>
[image: Twitter X] <https://x.com/LeTelegramme>
[image: Instagram] <https://www.instagram.com/letelegramme>
[image: Youtube] <https://www.youtube.com/user/LeTelegramme>
[image: Campagne mail]
***@***.***>
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14900187
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
GitHub user hansva added a comment to the discussion: Pipeline Executor return no rows
You could add a generate rows and generate 1 row to make them execute. Though if there is no "looping" aspect then I am not sure using pipeline executors is the best approach. What is the reasoning? Do you want to have a reusable block that has to be used somewhere else?
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14900323
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Pipeline Executor return no rows (hop)
Posted by "dave-csc (via GitHub)" <gi...@apache.org>.
GitHub user dave-csc added a comment to the discussion: Pipeline Executor return no rows
If I get correctly, you need to get the output of two distinct pipelines and merge them somehow in a parent pipeline.
Then you can call each one with a Pipeline Executor, but as mentioned above you need to trigger them with a single row: use a Generate row transform, configure it to create a single row and no schema. Link this transform to (all) the subsequent Pipeline Executor(s), this is enough to trigger it/them (remember to "copy" the row and not to "distribute" it)
Finally, link the Pipeline Executor output(s) to the merging transform
GitHub link: https://github.com/apache/hop/discussions/5965#discussioncomment-14900377
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org