running workflows imported from PDI

[Paul Drangeid <pd...@gmail.com>]

I'm taking a stab at importing several of my PDI jobs.

Figured out the import process, and testing some individual Pipelines works
fine.
But when I attempt to run the entire workflow (job) it errors on the first
step and says:

 ERROR: Unable to open pipeline:
2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - This action
needs a run configuration to use to execute the specified pipeline
2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - ERROR:
org.apache.hop.core.exception.HopException:

When I Start the workflow Execution I've tried running the existing "local"
run configuration, and tried creating a new "MyRunConfig", but the pipeline
step continues to fail.

The pipeline runs fine if I open it individually.  Shouldn't the Workflow
configuration flow down to the sub-pipeline tasks within my workflow?

Thanks!

Re: running workflows imported from PDI

[Matt Casters <ma...@neo4j.com>]

The GUI tries to help by automatically selecting the only defined run
configuration. Indeed, perhaps it's a bit confusing. It's worth thinking of
better alternatives for doing this. Feel free to create a JIRA case if you
have a good idea.
Cheers,
Matt

Op ma 14 feb. 2022 20:46 schreef Paul Drangeid <pd...@gmail.com>:

> Right after replying to you I think I figured it out.
>
> I had to "edit the action" for the pipeline.  The Run configuration was
> already set to "local", but I selected it from the dropdown ANYWAY, hit OK,
> Save, then it ran.
>
> The value appears "there" but I had to manually select it for some reason,
> as it was not picking it up for some reason... Maybe this is a bug?
>
> On Mon, Feb 14, 2022 at 1:43 PM Paul Drangeid <pd...@gmail.com> wrote:
>
>> Hans,
>> Thanks for the reply!
>>
>> After re-importing with the "Pipeline default run configuration" AND
>> "Workflow default run configuration" set to "local"
>> The SAME error still occurs when trying to run a workflow: "ERROR: Unable
>> to open pipeline: This action needs a run configuration to use to execute
>> the specified pipeline"
>>
>> If I had wanted to, where (in the UI) would I manually change that AFTER
>> the import process? It doesn't seem to be setting it properly during import.
>>
>> On Mon, Feb 14, 2022 at 11:12 AM Hans Van Akelyen <
>> hans.van.akelyen@gmail.com> wrote:
>>
>>> Hi Paul,
>>>
>>> In your workflow you will probably have other pipeline or workflow
>>> actions, In the import dialog there is an option to specify the default
>>> pipeline and workflow run configuration, if these were not set the actions
>>> to run a pipeline or workflow will not have a run configuration specified
>>> and will trigger this error.
>>>
>>> Kind regards,
>>> Hans
>>>
>>>
>>> On Mon, 14 Feb 2022 at 17:49, Paul Drangeid <pd...@gmail.com> wrote:
>>>
>>>> I'm taking a stab at importing several of my PDI jobs.
>>>>
>>>> Figured out the import process, and testing some individual Pipelines
>>>> works fine.
>>>> But when I attempt to run the entire workflow (job) it errors on the
>>>> first step and says:
>>>>
>>>>  ERROR: Unable to open pipeline:
>>>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - This
>>>> action needs a run configuration to use to execute the specified pipeline
>>>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - ERROR:
>>>> org.apache.hop.core.exception.HopException:
>>>>
>>>> When I Start the workflow Execution I've tried running the existing
>>>> "local" run configuration, and tried creating a new "MyRunConfig", but the
>>>> pipeline step continues to fail.
>>>>
>>>> The pipeline runs fine if I open it individually.  Shouldn't the
>>>> Workflow configuration flow down to the sub-pipeline tasks within my
>>>> workflow?
>>>>
>>>> Thanks!
>>>>
>>>

Re: running workflows imported from PDI

[Matt Casters <ma...@neo4j.com>]

The GUI tries to help by automatically selecting the only defined run
configuration. Indeed, perhaps it's a bit confusing. It's worth thinking of
better alternatives for doing this. Feel free to create a JIRA case if you
have a good idea.
Cheers,
Matt

Op ma 14 feb. 2022 20:46 schreef Paul Drangeid <pd...@gmail.com>:

> Right after replying to you I think I figured it out.
>
> I had to "edit the action" for the pipeline.  The Run configuration was
> already set to "local", but I selected it from the dropdown ANYWAY, hit OK,
> Save, then it ran.
>
> The value appears "there" but I had to manually select it for some reason,
> as it was not picking it up for some reason... Maybe this is a bug?
>
> On Mon, Feb 14, 2022 at 1:43 PM Paul Drangeid <pd...@gmail.com> wrote:
>
>> Hans,
>> Thanks for the reply!
>>
>> After re-importing with the "Pipeline default run configuration" AND
>> "Workflow default run configuration" set to "local"
>> The SAME error still occurs when trying to run a workflow: "ERROR: Unable
>> to open pipeline: This action needs a run configuration to use to execute
>> the specified pipeline"
>>
>> If I had wanted to, where (in the UI) would I manually change that AFTER
>> the import process? It doesn't seem to be setting it properly during import.
>>
>> On Mon, Feb 14, 2022 at 11:12 AM Hans Van Akelyen <
>> hans.van.akelyen@gmail.com> wrote:
>>
>>> Hi Paul,
>>>
>>> In your workflow you will probably have other pipeline or workflow
>>> actions, In the import dialog there is an option to specify the default
>>> pipeline and workflow run configuration, if these were not set the actions
>>> to run a pipeline or workflow will not have a run configuration specified
>>> and will trigger this error.
>>>
>>> Kind regards,
>>> Hans
>>>
>>>
>>> On Mon, 14 Feb 2022 at 17:49, Paul Drangeid <pd...@gmail.com> wrote:
>>>
>>>> I'm taking a stab at importing several of my PDI jobs.
>>>>
>>>> Figured out the import process, and testing some individual Pipelines
>>>> works fine.
>>>> But when I attempt to run the entire workflow (job) it errors on the
>>>> first step and says:
>>>>
>>>>  ERROR: Unable to open pipeline:
>>>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - This
>>>> action needs a run configuration to use to execute the specified pipeline
>>>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - ERROR:
>>>> org.apache.hop.core.exception.HopException:
>>>>
>>>> When I Start the workflow Execution I've tried running the existing
>>>> "local" run configuration, and tried creating a new "MyRunConfig", but the
>>>> pipeline step continues to fail.
>>>>
>>>> The pipeline runs fine if I open it individually.  Shouldn't the
>>>> Workflow configuration flow down to the sub-pipeline tasks within my
>>>> workflow?
>>>>
>>>> Thanks!
>>>>
>>>

Re: running workflows imported from PDI

[Paul Drangeid <pd...@gmail.com>]

Right after replying to you I think I figured it out.

I had to "edit the action" for the pipeline.  The Run configuration was
already set to "local", but I selected it from the dropdown ANYWAY, hit OK,
Save, then it ran.

The value appears "there" but I had to manually select it for some reason,
as it was not picking it up for some reason... Maybe this is a bug?

On Mon, Feb 14, 2022 at 1:43 PM Paul Drangeid <pd...@gmail.com> wrote:

> Hans,
> Thanks for the reply!
>
> After re-importing with the "Pipeline default run configuration" AND
> "Workflow default run configuration" set to "local"
> The SAME error still occurs when trying to run a workflow: "ERROR: Unable
> to open pipeline: This action needs a run configuration to use to execute
> the specified pipeline"
>
> If I had wanted to, where (in the UI) would I manually change that AFTER
> the import process? It doesn't seem to be setting it properly during import.
>
> On Mon, Feb 14, 2022 at 11:12 AM Hans Van Akelyen <
> hans.van.akelyen@gmail.com> wrote:
>
>> Hi Paul,
>>
>> In your workflow you will probably have other pipeline or workflow
>> actions, In the import dialog there is an option to specify the default
>> pipeline and workflow run configuration, if these were not set the actions
>> to run a pipeline or workflow will not have a run configuration specified
>> and will trigger this error.
>>
>> Kind regards,
>> Hans
>>
>>
>> On Mon, 14 Feb 2022 at 17:49, Paul Drangeid <pd...@gmail.com> wrote:
>>
>>> I'm taking a stab at importing several of my PDI jobs.
>>>
>>> Figured out the import process, and testing some individual Pipelines
>>> works fine.
>>> But when I attempt to run the entire workflow (job) it errors on the
>>> first step and says:
>>>
>>>  ERROR: Unable to open pipeline:
>>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - This action
>>> needs a run configuration to use to execute the specified pipeline
>>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - ERROR:
>>> org.apache.hop.core.exception.HopException:
>>>
>>> When I Start the workflow Execution I've tried running the existing
>>> "local" run configuration, and tried creating a new "MyRunConfig", but the
>>> pipeline step continues to fail.
>>>
>>> The pipeline runs fine if I open it individually.  Shouldn't the
>>> Workflow configuration flow down to the sub-pipeline tasks within my
>>> workflow?
>>>
>>> Thanks!
>>>
>>

Re: running workflows imported from PDI

[Paul Drangeid <pd...@gmail.com>]

Hans,
Thanks for the reply!

After re-importing with the "Pipeline default run configuration" AND
"Workflow default run configuration" set to "local"
The SAME error still occurs when trying to run a workflow: "ERROR: Unable
to open pipeline: This action needs a run configuration to use to execute
the specified pipeline"

If I had wanted to, where (in the UI) would I manually change that AFTER
the import process? It doesn't seem to be setting it properly during import.

On Mon, Feb 14, 2022 at 11:12 AM Hans Van Akelyen <
hans.van.akelyen@gmail.com> wrote:

> Hi Paul,
>
> In your workflow you will probably have other pipeline or workflow
> actions, In the import dialog there is an option to specify the default
> pipeline and workflow run configuration, if these were not set the actions
> to run a pipeline or workflow will not have a run configuration specified
> and will trigger this error.
>
> Kind regards,
> Hans
>
>
> On Mon, 14 Feb 2022 at 17:49, Paul Drangeid <pd...@gmail.com> wrote:
>
>> I'm taking a stab at importing several of my PDI jobs.
>>
>> Figured out the import process, and testing some individual Pipelines
>> works fine.
>> But when I attempt to run the entire workflow (job) it errors on the
>> first step and says:
>>
>>  ERROR: Unable to open pipeline:
>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - This action
>> needs a run configuration to use to execute the specified pipeline
>> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - ERROR:
>> org.apache.hop.core.exception.HopException:
>>
>> When I Start the workflow Execution I've tried running the existing
>> "local" run configuration, and tried creating a new "MyRunConfig", but the
>> pipeline step continues to fail.
>>
>> The pipeline runs fine if I open it individually.  Shouldn't the Workflow
>> configuration flow down to the sub-pipeline tasks within my workflow?
>>
>> Thanks!
>>
>

Re: running workflows imported from PDI

[Hans Van Akelyen <ha...@gmail.com>]

Hi Paul,

In your workflow you will probably have other pipeline or workflow actions,
In the import dialog there is an option to specify the default pipeline and
workflow run configuration, if these were not set the actions to run a
pipeline or workflow will not have a run configuration specified and will
trigger this error.

Kind regards,
Hans


On Mon, 14 Feb 2022 at 17:49, Paul Drangeid <pd...@gmail.com> wrote:

> I'm taking a stab at importing several of my PDI jobs.
>
> Figured out the import process, and testing some individual Pipelines
> works fine.
> But when I attempt to run the entire workflow (job) it errors on the first
> step and says:
>
>  ERROR: Unable to open pipeline:
> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - This action
> needs a run configuration to use to execute the specified pipeline
> 2022/02/14 10:39:15 - (pre) set-each-tenant-to-last-update - ERROR:
> org.apache.hop.core.exception.HopException:
>
> When I Start the workflow Execution I've tried running the existing
> "local" run configuration, and tried creating a new "MyRunConfig", but the
> pipeline step continues to fail.
>
> The pipeline runs fine if I open it individually.  Shouldn't the Workflow
> configuration flow down to the sub-pipeline tasks within my workflow?
>
> Thanks!
>