You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by "mattcasters (via GitHub)" <gi...@apache.org> on 2026/09/25 10:32:09 UTC
[I] [Feature Request]: Gracefully support Avro Record data type in data profiling (hop)
mattcasters opened a new issue, #8600:
URL: https://github.com/apache/hop/issues/8600
### What would you like to happen?
Rows with one or more Avro Record fields in them don't serialize to an execution information location through a data profile.
Worst case serialize the Avro as compressed base64 in the JSON objects.
### Issue Priority
Priority: 2
### Issue Component
Component: Other
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: Gracefully support Avro Record data type in data profiling (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters commented on issue #8600:
URL: https://github.com/apache/hop/issues/8600#issuecomment-5831551640
When trying to retrieve a Kafka pipeline I got this error related to the Avro Record:
```
org.apache.hop.core.exception.HopException:
Error finding child executions for parent ID 3cf64457-09a3-4ba0-bc9b-648fdb10f6f2
Error finding execution ids from database table hop_executions
Error loading execution information from database for executionId 'c104b42e-8795-4858-bdc1-e9b90697968a'
Error accessing the execution information database
An Avro schema is needed to read a GenericRecord from an input stream
at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1, column: 46044] (through reference chain: org.apache.hop.execution.caching.CacheEntry["childExecutionData"]->java.util.LinkedHashMap["all-transforms"]->org.apache.hop.execution.ExecutionData["rowsBinaryGzipBase64Encoded"])
at org.apache.hop.execution.caching.BaseCachingExecutionInfoLocation.findExecutions(BaseCachingExecutionInfoLocation.java:639)
at org.apache.hop.ui.hopgui.perspective.execution.WorkflowExecutionViewer.drillDown(WorkflowExecutionViewer.java:962)
at java.base/jdk.internal.reflect.DirectMethodHandleAccessor.invoke(DirectMethodHandleAccessor.java:103)
at java.base/java.lang.reflect.Method.invoke(Method.java:580)
at org.apache.hop.ui.core.gui.BaseGuiWidgets.lambda$1(BaseGuiWidgets.java:246)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:91)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4363)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1217)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4161)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3749)
at org.apache.hop.ui.core.dialog.BaseDialog.defaultShellHandling(BaseDialog.java:931)
at org.apache.hop.ui.core.dialog.BaseDialog.defaultShellHandling(BaseDialog.java:856)
at org.apache.hop.ui.core.dialog.BaseDialog.defaultShellHandling(BaseDialog.java:841)
at org.apache.hop.ui.core.dialog.ShowRowsDialog.open(ShowRowsDialog.java:130)
at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.showOutputDataDialog(HopGuiPipelineGraph.java:1658)
at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.showTransformOutputData(HopGuiPipelineGraph.java:1597)
at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.showTransformOutputData(HopGuiPipelineGraph.java:1578)
at org.apache.hop.ui.hopgui.file.pipeline.HopGuiPipelineGraph.mouseUp(HopGuiPipelineGraph.java:1338)
at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:262)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:91)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4363)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1217)
at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4161)
at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3749)
at org.apache.hop.ui.hopgui.HopGui.open(HopGui.java:879)
at org.apache.hop.ui.hopgui.HopGui.main(HopGui.java:697)
Caused by: org.apache.hop.core.exception.HopException:
Error finding execution ids from database table hop_executions
Error loading execution information from database for executionId 'c104b42e-8795-4858-bdc1-e9b90697968a'
Error accessing the execution information database
An Avro schema is needed to read a GenericRecord from an input stream
at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1, column: 46044] (through reference chain: org.apache.hop.execution.caching.CacheEntry["childExecutionData"]->java.util.LinkedHashMap["all-transforms"]->org.apache.hop.execution.ExecutionData["rowsBinaryGzipBase64Encoded"])
at org.apache.hop.execution.database.CachingDatabaseExecutionInfoLocation.retrieveIds(CachingDatabaseExecutionInfoLocation.java:649)
at org.apache.hop.execution.caching.BaseCachingExecutionInfoLocation.getExecutionIds(BaseCachingExecutionInfoLocation.java:282)
at org.apache.hop.execution.caching.BaseCachingExecutionInfoLocation.findExecutions(BaseCachingExecutionInfoLocation.java:631)
... 25 more
Caused by: org.apache.hop.core.exception.HopException:
Error loading execution information from database for executionId 'c104b42e-8795-4858-bdc1-e9b90697968a'
Error accessing the execution information database
An Avro schema is needed to read a GenericRecord from an input stream
at [Source: REDACTED (`StreamReadFeature.INCLUDE_SOURCE_IN_LOCATION` disabled); line: 1, column: 46044] (through reference chain: org.apache.hop.execution.caching.CacheEntry["childExecutionData"]->java.util.LinkedHashMap["all-transforms"]->org.apache.hop.execution.ExecutionData["rowsBinaryGzipBase64Encoded"])
at org.apache.hop.execution.database.CachingDatabaseExecutionInfoLocation.loadCacheEntry(CachingDatabaseExecutionInfoLocation.java:553)
at org.apache.hop.execution.database.CachingDatabaseExecutionInfoLocation.lambda$3(CachingDatabaseExecutionInfoLocation.java:635)
at org.apache.hop.execution.database.CachingDatabaseExecutionInfoLocation.callWithDatabase(CachingDatabaseExecutionInfoLocation.java:380)
at org.apache.hop.execution.database.CachingDatabaseExecutionInfoLocation.callWithDatabase(CachingDatabaseExecutionInfoLocation.java:372)
at org.apache.hop.execution.database.CachingDatabaseExecutionInfoLocation.retrieveIds(CachingDatabaseExecutionInfoLocation.java:618)
... 27 more
Caused by: org.apache.hop.core.exception.HopException:
Error accessing the execution information database
An Avro schema is needed to read a GenericRecord from an input stream
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] [Feature Request]: Gracefully support Avro Record data type in data profiling (hop)
Posted by "mattcasters (via GitHub)" <gi...@apache.org>.
mattcasters closed issue #8600: [Feature Request]: Gracefully support Avro Record data type in data profiling
URL: https://github.com/apache/hop/issues/8600
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org