[jira] [Created] (HUDI-1224) Fix HoodieIOException: No content to map due to end-of-input

["wangxianghu (Jira)" <ji...@apache.org>]

wangxianghu created HUDI-1224:
---------------------------------

             Summary: Fix HoodieIOException: No content to map due to end-of-input
                 Key: HUDI-1224
                 URL: https://issues.apache.org/jira/browse/HUDI-1224
             Project: Apache Hudi
          Issue Type: Bug
          Components: Common Core
            Reporter: wangxianghu
            Assignee: wangxianghu
             Fix For: 0.6.1


step to reproduce:
 # use Deltastreamer to consumer Kafka msg
 # send empty msg to topic

 

hudi throws:

20/08/25 18:47:02 WARN scheduler.TaskSetManager: Lost task 0.0 in stage 2.0 (TID 2, incubator-t3-infra02, executor 2): org.apache.hudi.exception.HoodieIOException: No content to map due to end-of-input
 at [Source: (String)""; line: 1, column: 0]
 at org.apache.hudi.avro.MercifulJsonConverter.convert(MercifulJsonConverter.java:96)
 at org.apache.hudi.utilities.sources.helpers.AvroConvertor.fromJson(AvroConvertor.java:86)
 at org.apache.spark.api.java.JavaPairRDD$$anonfun$toScalaFunction$1.apply(JavaPairRDD.scala:1040)
 at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
 at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
 at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
 at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:193)
 at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
 at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
 at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
 at org.apache.spark.scheduler.Task.run(Task.scala:121)
 at org.apache.spark.executor.Executor$TaskRunner$$anonfun$11.apply(Executor.scala:407)
 at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1408)
 at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:413)
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
 at java.lang.Thread.run(Thread.java:748)
Caused by: com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
 at [Source: (String)""; line: 1, column: 0]
 at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
 at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4145)
 at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4000)
 at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3004)
 at org.apache.hudi.avro.MercifulJsonConverter.convert(MercifulJsonConverter.java:93)
 ... 16 more



--
This message was sent by Atlassian Jira
(v8.3.4#803005)