You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by Maykel Moya <mm...@mmoya.org> on 2022/09/02 15:57:59 UTC
'Group by' fails remotely when is part of a workflow, works locally
Hello
First time Hop user, first time mailing list message.
Using version 2.0.0 both locally (desktop application) and in a remote
Hop server.
I have a pipeline P1 that is called from a workflow W1. When P1 runs as
part of W1 in the remote hop server, I get the following error:
2022/09/02 14:53:48 - Group by.0 - ERROR: Unexpected error
2022/09/02 14:53:48 - Group by.0 - ERROR:
org.apache.hop.core.exception.HopException:
2022/09/02 14:53:48 - Group by.0 - Please specify an aggregation type
for field 'field_name'
2022/09/02 14:53:48 - Group by.0 -
2022/09/02 14:53:48 - Group by.0 - at
org.apache.hop.pipeline.transforms.groupby.GroupBy.newAggregate(GroupBy.java:622)
2022/09/02 14:53:48 - Group by.0 - at
org.apache.hop.pipeline.transforms.groupby.GroupBy.processRow(GroupBy.java:168)
2022/09/02 14:53:48 - Group by.0 - at
org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:51)
2022/09/02 14:53:48 - Group by.0 - at
java.base/java.lang.Thread.run(Thread.java:833)
2022/09/02 14:53:48 - Table input.0 - Finished reading query, closing
connection.
2022/09/02 14:53:48 - Group by.0 - Finished processing (I=0, O=0, R=1,
W=0, U=0, E=1)
The transformation has an aggregation type set for field 'field_name'.
Actually, the only way to reproduce it is by running W1 remotely, in any
other setup (running P1 locally, running P1 remotely, running W1
locally) the transformation runs without error.
Summarizing:
PASS /path/to/hop-run.sh -r local P1.hwf
PASS /path/to/hop-run.sh -r local W1.hwf
PASS /path/to/hop-run.sh -r remote1 P1.hwf
FAIL /path/to/hop-run.sh -r remote1 W1.hwf
passing '-l ROWLEVEL' doesn't add any meaningful information.
I've tried to look for 'Group By' in Hop's Jira but 'group by' is a term
so generic that search result are noisy.
Do you have any recommendation on how to continue debugging this?
Thanks
m
Re: 'Group by' fails remotely when is part of a workflow, works locally
Posted by Hans Van Akelyen <ha...@gmail.com>.
Hi Maykel,
Thank you for the ticket, we will take a look at it as soon as possible.
Cheers,
Hans
On Mon, 5 Sept 2022 at 15:44, Maykel Moya <mm...@mmoya.org> wrote:
> Hello
>
> I've reported the issue with a reproducer included:
>
> https://issues.apache.org/jira/browse/HOP-4194
>
> Regards
> m
>
> On 2/9/22 17:57, Maykel Moya wrote:
> > Hello
> >
> > First time Hop user, first time mailing list message.
> >
> > Using version 2.0.0 both locally (desktop application) and in a remote
> > Hop server.
> >
> > I have a pipeline P1 that is called from a workflow W1. When P1 runs as
> > part of W1 in the remote hop server, I get the following error:
> >
> > 2022/09/02 14:53:48 - Group by.0 - ERROR: Unexpected error
> > 2022/09/02 14:53:48 - Group by.0 - ERROR:
> > org.apache.hop.core.exception.HopException:
> > 2022/09/02 14:53:48 - Group by.0 - Please specify an aggregation type
> > for field 'field_name'
> > 2022/09/02 14:53:48 - Group by.0 -
> > 2022/09/02 14:53:48 - Group by.0 - at
> >
> org.apache.hop.pipeline.transforms.groupby.GroupBy.newAggregate(GroupBy.java:622)
> > 2022/09/02 14:53:48 - Group by.0 - at
> >
> org.apache.hop.pipeline.transforms.groupby.GroupBy.processRow(GroupBy.java:168)
> > 2022/09/02 14:53:48 - Group by.0 - at
> > org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:51)
> > 2022/09/02 14:53:48 - Group by.0 - at
> > java.base/java.lang.Thread.run(Thread.java:833)
> > 2022/09/02 14:53:48 - Table input.0 - Finished reading query, closing
> > connection.
> > 2022/09/02 14:53:48 - Group by.0 - Finished processing (I=0, O=0, R=1,
> > W=0, U=0, E=1)
> >
> > The transformation has an aggregation type set for field 'field_name'.
> >
> > Actually, the only way to reproduce it is by running W1 remotely, in any
> > other setup (running P1 locally, running P1 remotely, running W1
> > locally) the transformation runs without error.
> >
> > Summarizing:
> >
> > PASS /path/to/hop-run.sh -r local P1.hwf
> > PASS /path/to/hop-run.sh -r local W1.hwf
> > PASS /path/to/hop-run.sh -r remote1 P1.hwf
> > FAIL /path/to/hop-run.sh -r remote1 W1.hwf
> >
> > passing '-l ROWLEVEL' doesn't add any meaningful information.
> >
> > I've tried to look for 'Group By' in Hop's Jira but 'group by' is a term
> > so generic that search result are noisy.
> >
> > Do you have any recommendation on how to continue debugging this?
> >
> > Thanks
> > m
>
Re: 'Group by' fails remotely when is part of a workflow, works locally
Posted by Maykel Moya <mm...@mmoya.org>.
Hello
I've reported the issue with a reproducer included:
https://issues.apache.org/jira/browse/HOP-4194
Regards
m
On 2/9/22 17:57, Maykel Moya wrote:
> Hello
>
> First time Hop user, first time mailing list message.
>
> Using version 2.0.0 both locally (desktop application) and in a remote
> Hop server.
>
> I have a pipeline P1 that is called from a workflow W1. When P1 runs as
> part of W1 in the remote hop server, I get the following error:
>
> 2022/09/02 14:53:48 - Group by.0 - ERROR: Unexpected error
> 2022/09/02 14:53:48 - Group by.0 - ERROR:
> org.apache.hop.core.exception.HopException:
> 2022/09/02 14:53:48 - Group by.0 - Please specify an aggregation type
> for field 'field_name'
> 2022/09/02 14:53:48 - Group by.0 -
> 2022/09/02 14:53:48 - Group by.0 - at
> org.apache.hop.pipeline.transforms.groupby.GroupBy.newAggregate(GroupBy.java:622)
> 2022/09/02 14:53:48 - Group by.0 - at
> org.apache.hop.pipeline.transforms.groupby.GroupBy.processRow(GroupBy.java:168)
> 2022/09/02 14:53:48 - Group by.0 - at
> org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:51)
> 2022/09/02 14:53:48 - Group by.0 - at
> java.base/java.lang.Thread.run(Thread.java:833)
> 2022/09/02 14:53:48 - Table input.0 - Finished reading query, closing
> connection.
> 2022/09/02 14:53:48 - Group by.0 - Finished processing (I=0, O=0, R=1,
> W=0, U=0, E=1)
>
> The transformation has an aggregation type set for field 'field_name'.
>
> Actually, the only way to reproduce it is by running W1 remotely, in any
> other setup (running P1 locally, running P1 remotely, running W1
> locally) the transformation runs without error.
>
> Summarizing:
>
> PASS /path/to/hop-run.sh -r local P1.hwf
> PASS /path/to/hop-run.sh -r local W1.hwf
> PASS /path/to/hop-run.sh -r remote1 P1.hwf
> FAIL /path/to/hop-run.sh -r remote1 W1.hwf
>
> passing '-l ROWLEVEL' doesn't add any meaningful information.
>
> I've tried to look for 'Group By' in Hop's Jira but 'group by' is a term
> so generic that search result are noisy.
>
> Do you have any recommendation on how to continue debugging this?
>
> Thanks
> m