You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/02/09 11:07:00 UTC
[jira] [Updated] (HUDI-3401) NPE exception caused by KeyGenClassName validation
[ https://issues.apache.org/jira/browse/HUDI-3401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ASF GitHub Bot updated HUDI-3401:
---------------------------------
Labels: pull-request-available (was: )
> NPE exception caused by KeyGenClassName validation
> --------------------------------------------------
>
> Key: HUDI-3401
> URL: https://issues.apache.org/jira/browse/HUDI-3401
> Project: Apache Hudi
> Issue Type: Bug
> Reporter: todd
> Priority: Major
> Labels: pull-request-available
>
> Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 0.0 failed 1 times, most recent failure: Lost task 0.0 in stage 0.0 (TID 0, 192.168.8.170, executor driver): java.lang.NullPointerException
> at org.apache.spark.sql.hudi.command.SqlKeyGenerator.getRecordKey(SqlKeyGenerator.scala:63)
> at org.apache.hudi.keygen.BaseKeyGenerator.getKey(BaseKeyGenerator.java:62)
> at org.apache.hudi.HoodieSparkSqlWriter$.$anonfun$write$9(HoodieSparkSqlWriter.scala:249)
> at scala.collection.Iterator$$anon$10.next(Iterator.scala:459)
> at org.apache.spark.storage.memory.MemoryStore.putIterator(MemoryStore.scala:222)
> at org.apache.spark.storage.memory.MemoryStore.putIteratorAsBytes(MemoryStore.scala:349)
> at org.apache.spark.storage.BlockManager.$anonfun$doPutIterator$1(BlockManager.scala:1388)
> at org.apache.spark.storage.BlockManager.org$apache$spark$storage$BlockManager$$doPut(BlockManager.scala:1298)
> at org.apache.spark.storage.BlockManager.doPutIterator(BlockManager.scala:1362)
> at org.apache.spark.storage.BlockManager.getOrElseUpdate(BlockManager.scala:1186)
> at org.apache.spark.rdd.RDD.getOrCompute(RDD.scala:360)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:311)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:313)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:52)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:349)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:313)
--
This message was sent by Atlassian Jira
(v8.20.1#820001)