You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@hop.apache.org by "Pelayo-Reguera (via GitHub)" <gi...@apache.org> on 2026/10/08 06:48:36 UTC
[D] Very unstable version v0.20 (hop)
GitHub user Pelayo-Reguera created a discussion: Very unstable version v0.20
Honestly, I don't know what this error means, but it doens't allow me to finish the pipeline (see details). Apart from that, it's quite unstable the application, because now de GUI gets freeze like 5 or 10 times a day. I will be posting the errors if the console says something, but for the moment, it would be nice to not freeze the screen while trying to load execution information of previous pipelines or workflows executions. For example, if I change to the execution perspective and needs to take a time until the download completes all the executions, it would be nice to have a progress bar and during the download be able to keep working.
<details><summary>Details</summary>
<p>
```shell
S NULL.0[0m
[31m2026/10/08 08:40:35 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/inquilino IS NULL.0[0m
[31m2026/10/08 08:40:35 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/grupo IS NULL 2.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/inquilino IS NOT NULL AND nombre NOT [BAJA] 2.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/inquilino IS NOT NULL AND nombre NOT [BAJA].0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/Filter rows.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/ID inquilino IS NULL 2.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/grupo IS NULL.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/inquilino IS NULL 2.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/Referencia NOT NULL.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/Dummy (do nothing) 5.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/Dummy (do nothing) 3.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/ID inquilino IS NULL.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/inquilino IS NULL.0[0m
[31m2026/10/08 08:40:46 - General - ERROR: Skipping execution data set without row metadata: FirstOutput/grupo IS NULL 2.0[0m
```
</p>
</details>
GitHub link: https://github.com/apache/hop/discussions/8798
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
Okay thank you! Although not setting a data profile wouldn't be an option because I need a small sample. However, I don't find now the option of setting the number of rows I want to store. Was it moved from the execution data profile configuration? I think it was its place in the previous version
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19044521
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
I could finally try it without any problem and... THANK YOU SO MUCH!! ❤️ Thanks to be able to set the maximum size of JSON and String fields as well as the number of rows, now I can see the data table in the execution perspective, the execution lineage and more! Thank you again, it is totally useful for me because now, my database is not fullfilled of useless information and it's only about 10GB while before could be 50GB or more with the same number of executions. Again, I appreciate it a lot.
As an improvement, although I’m in no rush, do it whenever it suits you, It would be fine to be able to apart from setting the limitations which already exist, to choose the columns we want to store. The UI I imagine it something similar to what you did with _table views_ of the output sample. Again and again thank you so much!!
<img width="153" height="101" alt="image" src="https://github.com/user-attachments/assets/66380b53-2884-4442-b19c-c484e511021f" />
<img width="396" height="141" alt="image" src="https://github.com/user-attachments/assets/f871ba2f-9301-4a68-b2b3-4eaa6b1097fc" />
<img width="532" height="578" alt="image" src="https://github.com/user-attachments/assets/ea366f0b-4dad-4c1c-916e-2eeb3d30a1da" />
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19287867
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
Don't use a data profile in the pipeline run configuration. Or you can store fewer rows, only the Last 10 for example.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19022052
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "hansva (via GitHub)" <gi...@apache.org>.
GitHub user hansva added a comment to the discussion: Very unstable version v0.20
can you provide a reproducible sample and tell us how your execution information location is configured, a lot will depend on that.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18809188
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
It all depends on what you're doing of-course. Try not saving individual rows into Neo4j. If that solves the out-of-memory issues, it's really just that you don't have enough memory. You can give Hop more memory. The default of 2GB might not be enough for the use-case.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18997586
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
You are absolutely right! Some UI bug is preventing the regular options from appearing. Thanks for mentioning this. I'll fix it later today.
https://github.com/apache/hop/issues/9022
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19044636
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
I try it and the option appears now. But there is another problem. There is an error related to timestamp parsing I guess, and instead of showing the execution history and remark the one with the error (like in previous versions), it simply hides everything. It is reported in #9039
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19070223
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
This should be fixed with a bit of code hardening against locale shenanigans, and extra integration testing.
Thanks again for reporting this!
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19079313
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
Please create a new feature request for selectively storing columns in execution information. We can put that selection in the transform metadata with some user interface.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19287915
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
> can you provide a reproducible sample and tell us how your execution information location is configured, a lot will depend on that.
<img width="1340" height="298" alt="image" src="https://github.com/user-attachments/assets/223f3a78-0835-4014-9475-a02b34054f0d" />
<img width="1471" height="267" alt="image" src="https://github.com/user-attachments/assets/84c80712-af70-4b4b-bdd9-7323de6f8375" />
<img width="859" height="265" alt="image" src="https://github.com/user-attachments/assets/0b015378-59e0-4cb7-8926-842160190e55" />
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18810461
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
Try it with the latest version from `main`.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19049470
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera edited a comment on the discussion: Very unstable version v0.20
Not really. I mean, everything it's executed correctly and each transform has the corresponding rowns although some of them are empty and that's the correct functionality. But in v0.19 works and in v0.20 keeps writing the messages of the console I shared before. And if try to stop the execution in that moment, then the GUI freezes.
Apart from this, I just remembered that in previous versions I was able to review the configuration of a transform or move the elements of the diagram during the execution and now in v0.20 the GUI freezes.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18808513
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
Issue #8625 is unlikely to hit Neo4j as that one doesn't use the caching base code (essentially a JSON serializer).
My money is on https://github.com/apache/hop/pull/8865 which fixed an inefficiency in storing/finding parent/child relationships between executions. Some LLM (Gemini 3.8 Flash) was supposed to fix the storing of the parenting but grew a brain and I overlooked it. My advice would be to try a recent version and see if this goes away.
Thanks for telling us about it!
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18983624
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
And how do I not store individual rows?
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19022026
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
Yes! I compiled a recent version of it and now it works. At least the pipelines finish and don't show repeatedly the messages I mentioned before.
However, I still have the problem of memory overflow when doing the commit of the execution information against the Neo4J database, although that's discussed in other conversation #8204 suppposedly addressed in #8282. I have configured the maximum length of strings and JSON but it seems that nothing changes.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18996971
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Very unstable version v0.20
It took a closer look, this was probably caused by PR #8625. Shouldn't be too hard to fix. Create a ticket and we'll look into it.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18810108
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "bamaer (via GitHub)" <gi...@apache.org>.
GitHub user bamaer added a comment to the discussion: Very unstable version v0.20
By "very unstable v0.20", I assume you mean you found a very specific issue in the Neo4j execution information location in Apache Hop 2.20.0-SNAPSHOT.
If that's the case, can you share a screenshot of your pipeline and let us know if it (at least partially) runs with 0 rows?
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18807603
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "Pelayo-Reguera (via GitHub)" <gi...@apache.org>.
GitHub user Pelayo-Reguera added a comment to the discussion: Very unstable version v0.20
Not really. I mean, everything it's executed correctly and each transform has the corresponding rowns although some of them are empty and that's the correct functionality. But in v0.19 works and in v0.20 keeps writing the messages of the console I shared before. And if try to stop the execution in that moment, then the GUI is frozen.
Apart from this, I just remembered that in previous versions I was able to review the configuration of a transform or move the elements of the diagram during the execution and now in v0.20 the GUI freezes.
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-18808513
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org
Re: [D] Very unstable version v0.20 (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
GitHub user mattcasters added a comment to the discussion: Very unstable version v0.20
I'm glad we figured it out. Thanks for the feedback!
GitHub link: https://github.com/apache/hop/discussions/8798#discussioncomment-19287882
----
This is an automatically sent email for users@hop.apache.org.
To unsubscribe, please send an email to: users-unsubscribe@hop.apache.org