You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hop.apache.org by GitBox <gi...@apache.org> on 2022/12/22 10:11:18 UTC

[GitHub] [hop] enricomariam42 opened a new issue, #2098: [Bug]: exception saving bigNumber in neo4j Execution Information

enricomariam42 opened a new issue, #2098:
URL: https://github.com/apache/hop/issues/2098

   ### Apache Hop version?
   
   SNAPSHOT-20221221
   
   ### Java version?
   
   openjdk version "11.0.9.1" 2020-11-04 OpenJDK Runtime Environment (build 11.0.9.1+1-post-Uos-1deb10u2) OpenJDK 64-Bit Server VM (build 11.0.9.1+1-post-Uos-1deb10u2, mixed mode, sharing)
   
   ### Operating system
   
   Linux
   
   ### What happened?
   
   When the pipeline contains a `bigNumber` field type an exception is raised trying to save execution information to neo4j.
   
   Sample pipeline, containing only a datagrid tranform:
   [test_bigNumber.zip](https://github.com/apache/hop/files/10285895/test_bigNumber.zip)
   
   Step to reproduce:
   1. Create a test project
   2. Define a Execution data profile "last_100" with sampler "last output rows" and size "100"
   3. Define a Execution information location "neo4j" as neo4j location
   4. Define a Pipeline run configuration "local" choosing up the previous Execution information location "neo4j" and Execution data profile "last_100"
   5. Unzip and add the attached pipeline "test_bigNumber.hpl" to the project
   6. Run the pipeline with the "local" run configuration
   
   log:
   ```
   2022/12/22 11:02:37 - Hop - Pipeline opened.
   2022/12/22 11:02:37 - Hop - Launching pipeline [test_bigNumber]...
   2022/12/22 11:02:37 - Hop - Started the pipeline execution.
   2022/12/22 11:02:37 - test_bigNumber - Executing this pipeline using the Local Pipeline Engine with run configuration 'local'
   2022/12/22 11:02:37 - test_bigNumber - Execution started for pipeline [test_bigNumber]
   2022/12/22 11:02:37 - [test_bigNumber].Data grid.0 - Finished processing (I=0, O=0, R=0, W=3, U=0, E=0)
   2022/12/22 11:02:37 - test_bigNumber - Pipeline duration : 0.072 seconds [  0.072" ]
   2022/12/22 11:02:37 - test_bigNumber - ERROR: Error handling writing final pipeline state to location (non-fatal)
   2022/12/22 11:02:37 - test_bigNumber - ERROR: org.apache.hop.core.exception.HopException: 
   2022/12/22 11:02:37 - test_bigNumber - Error getting execution from Neo4j
   2022/12/22 11:02:37 - test_bigNumber - org.neo4j.driver.exceptions.ClientException: Unable to convert java.math.BigDecimal to Neo4j Value.
   2022/12/22 11:02:37 - test_bigNumber - 
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.registerData(NeoExecutionInfoLocation.java:877)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.stopTransformExecutionInfoTimer(LocalPipelineEngine.java:486)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.engines.local.LocalPipelineEngine.pipelineCompleted(LocalPipelineEngine.java:465)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.Pipeline.firePipelineExecutionFinishedListeners(Pipeline.java:1343)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.Pipeline.lambda$startThreads$0(Pipeline.java:1142)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.transform.BaseTransform.fireTransformFinishedListeners(BaseTransform.java:2779)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.transform.BaseTransform.markStop(BaseTransform.java:2768)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.pipeline.transform.RunThread.run(RunThread.java:142)
   2022/12/22 11:02:37 - test_bigNumber - 	at java.base/java.lang.Thread.run(Thread.java:834)
   2022/12/22 11:02:37 - test_bigNumber - Caused by: java.lang.RuntimeException: org.neo4j.driver.exceptions.ClientException: Unable to convert java.math.BigDecimal to Neo4j Value.
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.saveNeo4jRowsAndMeta(NeoExecutionInfoLocation.java:1115)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.registerNeo4jData(NeoExecutionInfoLocation.java:944)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.lambda$registerData$11(NeoExecutionInfoLocation.java:875)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.InternalSession.lambda$transaction$4(InternalSession.java:150)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.retry.ExponentialBackoffRetryLogic.retry(ExponentialBackoffRetryLogic.java:103)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.InternalSession.transaction(InternalSession.java:146)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.InternalSession.writeTransaction(InternalSession.java:124)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.InternalSession.writeTransaction(InternalSession.java:118)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.registerData(NeoExecutionInfoLocation.java:875)
   2022/12/22 11:02:37 - test_bigNumber - 	... 8 more
   2022/12/22 11:02:37 - test_bigNumber - Caused by: org.neo4j.driver.exceptions.ClientException: Unable to convert java.math.BigDecimal to Neo4j Value.
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.Values.value(Values.java:136)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.util.Extract.mapOfValues(Extract.java:203)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.AbstractQueryRunner.parameters(AbstractQueryRunner.java:69)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.neo4j.driver.internal.AbstractQueryRunner.run(AbstractQueryRunner.java:43)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.execute(NeoExecutionInfoLocation.java:1463)
   2022/12/22 11:02:37 - test_bigNumber - 	at org.apache.hop.neo4j.execution.NeoExecutionInfoLocation.saveNeo4jRowsAndMeta(NeoExecutionInfoLocation.java:1083)
   2022/12/22 11:02:37 - test_bigNumber - 	... 16 more
   2022/12/22 11:02:37 - test_bigNumber - Execution finished on a local pipeline engine with run configuration 'local'
   ```
   
   ### Issue Priority
   
   Priority: 3
   
   ### Issue Component
   
   Component: Execution Information


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@hop.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org