You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "cvdenzen (via GitHub)" <gi...@apache.org> on 2026/08/13 08:13:04 UTC
[I] [Bug]: Kafka pipeline not starting (hop)
cvdenzen opened a new issue, #7929:
URL: https://github.com/apache/hop/issues/7929
### Apache Hop version?
2.19.0-rc1
### Java version?
openjdk version "21.0.2" 2024-01-16
### Operating system
Windows
### What happened?
**Setup:**
A pipeline with 4 Transforms: two Kafka consumers and two "Write to log" Transforms.
Each Kafka consumer is connected to a Write to log Transform.
One Kafka consumer has a quite complicated kafka pipeline.
The other Kafka consumer has a very simple Kafka pipeline: an Injector and a Dummy (do nothing) Transform.
**Result when running this pipeline:**
Both Kafka topics contain data.
The complicated pipeline is not started.
The simple pipeline is starting.
Some remarks:
When the pipeline with the two Kafka Consumers is started from a Workflow, neither of the Kafka pipelines is started (the Kafka consumers do start).
The origin of these Workflows and Pipelines are in Pentaho (where they work quite reliably). I have imported them (with some patches after the import, see my other issues).
This is a blocking issue for us.
If needed, I can provide more information (log files, hop files).
### Issue Priority
Priority: 2
### Issue Component
Component: Pipelines
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #7929:
URL: https://github.com/apache/hop/issues/7929#issuecomment-5277948917
ok, then we can investigate why/which type of logging isn't propagating to the error path.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "cvdenzen (via GitHub)" <gi...@apache.org>.
cvdenzen commented on issue #7929:
URL: https://github.com/apache/hop/issues/7929#issuecomment-5277969325
[scratch_5.zip](https://github.com/user-attachments/files/31020374/scratch_5.zip)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "cvdenzen (via GitHub)" <gi...@apache.org>.
cvdenzen commented on issue #7929:
URL: https://github.com/apache/hop/issues/7929#issuecomment-5278750601
When I run the JSON input Transform in isolation with the same input data, I still see the "Unexpected conversion error while converting value [cachestatus Integer] to an Integer" error, but the pipeline simply continues (the following Write to log outputs the parsed data). So it is not clear this message has anything to do with the issue that the Kafka pipeline is not running.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "cvdenzen (via GitHub)" <gi...@apache.org>.
cvdenzen commented on issue #7929:
URL: https://github.com/apache/hop/issues/7929#issuecomment-5333721668
The problem is in the pipeline. I close this ticket.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "cvdenzen (via GitHub)" <gi...@apache.org>.
cvdenzen closed issue #7929: [Bug]: Kafka pipeline not starting
URL: https://github.com/apache/hop/issues/7929
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "cvdenzen (via GitHub)" <gi...@apache.org>.
cvdenzen commented on issue #7929:
URL: https://github.com/apache/hop/issues/7929#issuecomment-5277894613
My conclusion was premature. The Kafka pipeline is started, but apparently it dies somewhere. This was only visible in the detailed logging (no basic logging was output by the dying pipeline).
I will upload the relevant logging in scratch_5.zip.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Bug]: Kafka pipeline not starting (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
hansva commented on issue #7929:
URL: https://github.com/apache/hop/issues/7929#issuecomment-5277802079
pipelines and logs in a zipfile would be great then we at least know what to look at
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org