[jira] [Created] (HUDI-4330) NPE when trying to upsert into a dataset with no Meta Fields

["Alexey Kudinkin (Jira)" <ji...@apache.org>]

|  ![](cid:jira-generated-image-avatar-83ecd3da-0406-400a-a9e7-e7686f71593f) |
[Alexey
Kudinkin](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=alexey.kudinkin)
**created** an issue  
---|---  
|  
---  
|  [Apache Hudi](https://issues.apache.org/jira/browse/HUDI) /
[![Bug](cid:jira-generated-image-
avatar-82ef411f-6fab-470f-9cdd-a9f173ccd882)](https://issues.apache.org/jira/browse/HUDI-4330)
[HUDI-4330](https://issues.apache.org/jira/browse/HUDI-4330)  
---  
[NPE when trying to upsert into a dataset with no Meta
Fields](https://issues.apache.org/jira/browse/HUDI-4330)  
| Issue Type: |  ![Bug](cid:jira-generated-image-
avatar-82ef411f-6fab-470f-9cdd-a9f173ccd882) Bug  
---|---  
Assignee: |  Unassigned  
Created: |  27/Jun/22 21:39  
Fix Versions: |  0.12.0  
Priority: |  ![Critical](cid:jira-generated-image-static-
critical-a63feeae-d4ca-4679-96e0-0c6be38ebd74) Critical  
Reporter: |  [Alexey
Kudinkin](https://issues.apache.org/jira/secure/ViewProfile.jspa?name=alexey.kudinkin)  
|

When trying to upsert into a dataset with Meta Fields being disabled, you will
encounter obscure NPE like below:

    
    
    Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 25 in stage 20.0 failed 4 times, most recent failure: Lost task 25.3 in stage 20.0 (TID 4110) (ip-172-31-20-53.us-west-2.compute.internal executor 7): java.lang.RuntimeException: org.apache.hudi.exception.HoodieIndexException: Error checking bloom filter index.
            at org.apache.hudi.client.utils.LazyIterableIterator.next(LazyIterableIterator.java:121)
            at scala.collection.convert.Wrappers$JIteratorWrapper.next(Wrappers.scala:46)
            at scala.collection.Iterator$$anon$11.nextCur(Iterator.scala:486)
            at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:492)
            at scala.collection.Iterator$$anon$12.hasNext(Iterator.scala:513)
            at scala.collection.Iterator$$anon$11.hasNext(Iterator.scala:491)
            at org.apache.spark.shuffle.sort.BypassMergeSortShuffleWriter.write(BypassMergeSortShuffleWriter.java:140)
            at org.apache.spark.shuffle.ShuffleWriteProcessor.write(ShuffleWriteProcessor.scala:59)
            at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:99)
            at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:52)
            at org.apache.spark.scheduler.Task.run(Task.scala:131)
            at org.apache.spark.executor.Executor$TaskRunner.$anonfun$run$3(Executor.scala:506)
            at org.apache.spark.util.Utils$.tryWithSafeFinally(Utils.scala:1462)
            at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:509)
            at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
            at java.lang.Thread.run(Thread.java:750)
    Caused by: org.apache.hudi.exception.HoodieIndexException: Error checking bloom filter index.
            at org.apache.hudi.index.bloom.HoodieBloomIndexCheckFunction$LazyKeyCheckIterator.computeNext(HoodieBloomIndexCheckFunction.java:110)
            at org.apache.hudi.index.bloom.HoodieBloomIndexCheckFunction$LazyKeyCheckIterator.computeNext(HoodieBloomIndexCheckFunction.java:60)
            at org.apache.hudi.client.utils.LazyIterableIterator.next(LazyIterableIterator.java:119)
            ... 16 more
    Caused by: java.lang.NullPointerException
            at org.apache.hudi.io.HoodieKeyLookupHandle.addKey(HoodieKeyLookupHandle.java:88)
            at org.apache.hudi.index.bloom.HoodieBloomIndexCheckFunction$LazyKeyCheckIterator.computeNext(HoodieBloomIndexCheckFunction.java:92)
            ... 18 more 

Instead, we could be more explicit as to why this could have happened (meta-
fields disabled -> no bloom filter created -> unable to do upserts)  
  
---  
|  |  [ ![Add Comment](cid:jira-generated-image-static-comment-icon-
eea351b4-2778-4e0a-b878-60677cb07a18)
](https://issues.apache.org/jira/browse/HUDI-4330#add-comment "Add Comment") |
[Add Comment](https://issues.apache.org/jira/browse/HUDI-4330#add-comment "Add
Comment")  
---|---  
  
|  This message was sent by Atlassian Jira (v8.20.10#820010-sha1:ace47f9) |  |
![Atlassian logo](https://issues.apache.org/jira/images/mail/atlassian-email-
logo.png)  
---