You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/02/19 12:59:27 UTC

[GitHub] [hudi] rubenssoto opened a new issue #2585: [SUPPORT] NullPointerException Incremental query on COW

rubenssoto opened a new issue #2585:
URL: https://github.com/apache/hudi/issues/2585


   Hello Guys,
   
   I'm querying some Hudi COW tables with incremental queries, I have a job running on each hour, it worked very well yesterday and started to have problems today.
   
   
   ```
   py4j.protocol.Py4JJavaError: An error occurred while calling o86.load.
   : java.lang.NullPointerException
   	at java.lang.String.compareTo(String.java:1155)
   	at org.apache.hudi.common.table.timeline.HoodieTimeline.lambda$static$2(HoodieTimeline.java:262)
   	at org.apache.hudi.common.table.timeline.HoodieTimeline.compareTimestamps(HoodieTimeline.java:267)
   	at org.apache.hudi.common.table.timeline.HoodieTimeline.isInRange(HoodieTimeline.java:274)
   	at org.apache.hudi.common.table.timeline.HoodieDefaultTimeline.lambda$findInstantsInRange$9(HoodieDefaultTimeline.java:136)
   	at java.util.stream.ReferencePipeline$2$1.accept(ReferencePipeline.java:174)
   	at java.util.ArrayList$ArrayListSpliterator.forEachRemaining(ArrayList.java:1382)
   	at java.util.stream.AbstractPipeline.copyInto(AbstractPipeline.java:482)
   	at java.util.stream.AbstractPipeline.wrapAndCopyInto(AbstractPipeline.java:472)
   	at java.util.stream.ReduceOps$ReduceOp.evaluateSequential(ReduceOps.java:708)
   	at java.util.stream.AbstractPipeline.evaluate(AbstractPipeline.java:234)
   	at java.util.stream.ReferencePipeline.collect(ReferencePipeline.java:566)
   	at org.apache.hudi.common.table.timeline.HoodieDefaultTimeline.<init>(HoodieDefaultTimeline.java:57)
   	at org.apache.hudi.common.table.timeline.HoodieDefaultTimeline.findInstantsInRange(HoodieDefaultTimeline.java:136)
   	at org.apache.hudi.common.table.timeline.HoodieDefaultTimeline.findInstantsInRange(HoodieDefaultTimeline.java:45)
   	at org.apache.hudi.IncrementalRelation.<init>(IncrementalRelation.scala:73)
   	at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:101)
   	at org.apache.hudi.DefaultSource.createRelation(DefaultSource.scala:53)
   	at org.apache.spark.sql.execution.datasources.DataSource.resolveRelation(DataSource.scala:339)
   	at org.apache.spark.sql.DataFrameReader.loadV1Source(DataFrameReader.scala:279)
   	at org.apache.spark.sql.DataFrameReader.$anonfun$load$2(DataFrameReader.scala:268)
   	at scala.Option.getOrElse(Option.scala:189)
   	at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:268)
   	at org.apache.spark.sql.DataFrameReader.load(DataFrameReader.scala:214)
   	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
   	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
   	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
   	at java.lang.reflect.Method.invoke(Method.java:498)
   	at py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
   	at py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
   	at py4j.Gateway.invoke(Gateway.java:282)
   	at py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
   	at py4j.commands.CallCommand.execute(CallCommand.java:79)
   	at py4j.GatewayConnection.run(GatewayConnection.java:238)
   	at java.lang.Thread.run(Thread.java:748)
   ```
   
   
   
   EMR 6.1
   Hudi 0.7.0 on write and read side.
   
   Could you help me?
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] rubenssoto commented on issue #2585: [SUPPORT] NullPointerException Incremental query on COW

Posted by GitBox <gi...@apache.org>.
rubenssoto commented on issue #2585:
URL: https://github.com/apache/hudi/issues/2585#issuecomment-782069533


   Hi guys,
   
   I found a bug on my side


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [hudi] rubenssoto closed issue #2585: [SUPPORT] NullPointerException Incremental query on COW

Posted by GitBox <gi...@apache.org>.
rubenssoto closed issue #2585:
URL: https://github.com/apache/hudi/issues/2585


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org