You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "Cupropituvanso (via GitHub)" <gi...@apache.org> on 2023/11/23 10:19:41 UTC
[I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Cupropituvanso opened a new issue, #3451:
URL: https://github.com/apache/hop/issues/3451
### Apache Hop version?
2.6
### Java version?
openjdk version "11.0.20" 2023-07-18
### Operating system
Docker
### What happened?
Hello
We have discovered a problem that cannot be directly understood, but occurs very frequently.
We are daily staring a workflow over the webservice which starts several pipelines in parallel.
And randomly, not every day and not the same pipeline one or more pipelines crashes on a dummy transform with:
2023/11/22 22:10:43 - DPK.0 - ERROR: Unexpected error
2023/11/22 22:10:43 - DPK.0 - ERROR: java.lang.NullPointerException
2023/11/22 22:10:46 - forb_transaction - Pipeline detected one or more transforms with errors.
2023/11/22 22:10:46 - forb_transaction - Pipeline is killing the other transforms!
DPK ist ein Dummy
Wenn man die betroffene Pipeline dann gleich wieder startet gibt es keine Probleme.
Wenn mehrere Pipelines betroffen sind tritt das Zeitgleich auf.
### Issue Priority
Priority: 1
### Issue Component
Component: Transforms
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "Wescley-Brasil (via GitHub)" <gi...@apache.org>.
Wescley-Brasil commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1893642373
Hello, we recently started migrating our transformations and jobs to Apache Hop, we were previously using PDI, and in some jobs we are running into this same problem of NullPointerException on Dummy. And the worst thing is that this occurs completely randomly, this problem for me happens when running a workflow as a for.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "Cupropituvanso (via GitHub)" <gi...@apache.org>.
Cupropituvanso commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1829653189
How should I make a reproduction plan of this? :)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva closed issue #3451: [Bug]: Random NullPointerException on Dummy Transforms
URL: https://github.com/apache/hop/issues/3451
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1824156512
Can you provide a stack trace of the issue please, this information is not giving us much to work with.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
bamaer commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1830555487
is the stream layout (output) for "Nostro Kunden" and "Nostro Beveiliging" exactly the same?
Customers and security seem to be very different data sets, and a dummy is not a join.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "Wescley-Brasil (via GitHub)" <gi...@apache.org>.
Wescley-Brasil commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1896254239
@hansva After using version 2.8 of the hop, the NullPointerException problem stopped happening, I tested it again on the same load that caused the problem before and the error was resolved. Thank you for the quick and prompt response.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "Cupropituvanso (via GitHub)" <gi...@apache.org>.
Cupropituvanso commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1824970953
its still warm ...
2023/11/23 22:12:30 - DPK.0 - ERROR: Unexpected error
2023/11/23 22:12:30 - DPK.0 - ERROR: java.lang.NullPointerException
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transform.BaseTransform.putRowToRowSet(BaseTransform.java:1270)
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transform.BaseTransform.noPartitioning(BaseTransform.java:1212)
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transform.BaseTransform.handlePutRow(BaseTransform.java:1097)
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transform.BaseTransform$DefaultRowHandler.putRow(BaseTransform.java:3794)
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transform.BaseTransform.putRow(BaseTransform.java:1010)
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transforms.dummy.Dummy.processRow(Dummy.java:51)
2023/11/23 22:12:30 - DPK.0 - at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:55)
2023/11/23 22:12:30 - DPK.0 - at java.base/java.lang.Thread.run(Thread.java:829)
2023/11/23 22:12:30 - DPK.0 - Finished processing (I=0, O=0, R=44, W=44, U=0, E=0)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "CuproAT (via GitHub)" <gi...@apache.org>.
CuproAT commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-2257101106
It took a while for us to upgrade to 2.8, but yes, the problem is solved.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "Cupropituvanso (via GitHub)" <gi...@apache.org>.
Cupropituvanso commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1824252292
<img width="673" alt="stacktrace" src="https://github.com/apache/hop/assets/6313389/9b4a3e60-9b18-43f6-8eb2-8d5522e9c5aa">
only in form of screenshot some weeks ago ... at the moment because of another problem, which seems to be a config error on our site we do not get pipeline logs (or even pipelines) in the hop status if a workflow runs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "sramazzina (via GitHub)" <gi...@apache.org>.
sramazzina commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1825302572
I think the best option to investigate better on this issue is to provide a reproduction path? Can you provide that sample?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "sramazzina (via GitHub)" <gi...@apache.org>.
sramazzina commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1830338018
What does that means?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "Phsacar (via GitHub)" <gi...@apache.org>.
Phsacar commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1839779277
Hi, I am a member of cupro's team and will try to clarify our issue:
Our Workflow starts multiple pipelines in parallel.
After some time, some pipelines crash with this mentioned error - this happens only every few days.
However, when we execute the same pipeline, with the same input data a few minutes later, everything is fine (Data is processed correctly).
However, we cant really get the error to be reproducible. We have a second hop instance running that has the same error with the same pipelines. Also, as you may understand, we cant give you access to our data.
From our perspective the error seems to be completely random - we actually even considered this to be an hardware issue of our server, but we ruled that one out with testing the same instance on another server.
Is there any way we could provide you with additional info ?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Random NullPointerException on Dummy Transforms (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #3451:
URL: https://github.com/apache/hop/issues/3451#issuecomment-1893659535
The issue might have been resolved with #3056
You can test it in a test environment using an unreleased version of hop fetched from [here](https://repository.apache.org/content/repositories/snapshots/org/apache/hop/hop-client/2.8.0-SNAPSHOT/)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org