You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "wangxianghu (Jira)" <ji...@apache.org> on 2020/08/26 02:29:00 UTC

[jira] [Closed] (HUDI-1224) Fix HoodieIOException: No content to map due to end-of-input

     [ https://issues.apache.org/jira/browse/HUDI-1224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

wangxianghu closed HUDI-1224.
-----------------------------
    Resolution: Duplicate

> Fix HoodieIOException: No content to map due to end-of-input
> ------------------------------------------------------------
>
>                 Key: HUDI-1224
>                 URL: https://issues.apache.org/jira/browse/HUDI-1224
>             Project: Apache Hudi
>          Issue Type: Bug
>          Components: Common Core
>            Reporter: wangxianghu
>            Assignee: wangxianghu
>            Priority: Major
>             Fix For: 0.6.1
>
>
> step to reproduce:
>  # use Deltastreamer to consumer Kafka msg
>  # send empty msg to topic
>  
> hudi throws:
> 20/08/25 18:47:02 WARN scheduler.TaskSetManager: Lost task 0.0 in stage 2.0 (TID 2, incubator-t3-infra02, executor 2): org.apache.hudi.exception.HoodieIOException: No content to map due to end-of-input
>  at [Source: (String)""; line: 1, column: 0]
>  at org.apache.hudi.avro.MercifulJsonConverter.convert(MercifulJsonConverter.java:96)
>  at org.apache.hudi.utilities.sources.helpers.AvroConvertor.fromJson(AvroConvertor.java:86)
>  at org.apache.spark.api.java.JavaPairRDD$$anonfun$toScalaFunction$1.apply(JavaPairRDD.scala:1040)
>  at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
>  at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
>  at scala.collection.Iterator$$anon$11.next(Iterator.scala:410)
>  at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:193)
>  at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:62)
>  at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
>  at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:55)
>  at org.apache.spark.scheduler.Task.run(Task.scala:121)
>  at org.apache.spark.executor.Executor$TaskRunner$$anonfun$11.apply(Executor.scala:407)
>  at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1408)
>  at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:413)
>  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
>  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
>  at java.lang.Thread.run(Thread.java:748)
> Caused by: com.fasterxml.jackson.databind.exc.MismatchedInputException: No content to map due to end-of-input
>  at [Source: (String)""; line: 1, column: 0]
>  at com.fasterxml.jackson.databind.exc.MismatchedInputException.from(MismatchedInputException.java:59)
>  at com.fasterxml.jackson.databind.ObjectMapper._initForReading(ObjectMapper.java:4145)
>  at com.fasterxml.jackson.databind.ObjectMapper._readMapAndClose(ObjectMapper.java:4000)
>  at com.fasterxml.jackson.databind.ObjectMapper.readValue(ObjectMapper.java:3004)
>  at org.apache.hudi.avro.MercifulJsonConverter.convert(MercifulJsonConverter.java:93)
>  ... 16 more



--
This message was sent by Atlassian Jira
(v8.3.4#803005)