You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2022/06/15 03:18:18 UTC
[GitHub] [hudi] xccui opened a new issue, #5871: [SUPPORT] NPE when writing metadata
xccui opened a new issue, #5871:
URL: https://github.com/apache/hudi/issues/5871
**Describe the problem you faced**
Got NPE when using Flink to write metadata table with column stats and bloom filter enabled.
**To Reproduce**
```
setBoolean(FlinkOptions.METADATA_ENABLED, true)
setBoolean(HoodieMetadataConfig.ENABLE_METADATA_INDEX_COLUMN_STATS.key(), true)
setBoolean(HoodieMetadataConfig.ENABLE_METADATA_INDEX_BLOOM_FILTER.key(), true)
```
**Environment Description**
* Hudi version : 0.12.0-SNAPSHOT on master
* Flink version : 1.14
* Storage (HDFS/S3/GCS..) : S3
* Running on Docker? (yes/no) : no
**Additional context**
Some values are `null` in the table.
**Stacktrace**
```
Caused by: java.lang.NullPointerException
at org.apache.hudi.avro.HoodieAvroUtils.convertValueForAvroLogicalTypes(HoodieAvroUtils.java:654)
at org.apache.hudi.avro.HoodieAvroUtils.convertValueForSpecificDataTypes(HoodieAvroUtils.java:630)
at org.apache.hudi.metadata.HoodieTableMetadataUtil.lambda$null$1(HoodieTableMetadataUtil.java:147)
at java.util.ArrayList.forEach(ArrayList.java:1259)
at org.apache.hudi.metadata.HoodieTableMetadataUtil.lambda$collectColumnRangeMetadata$2(HoodieTableMetadataUtil.java:142)
at java.util.ArrayList.forEach(ArrayList.java:1259)
at org.apache.hudi.metadata.HoodieTableMetadataUtil.collectColumnRangeMetadata(HoodieTableMetadataUtil.java:139)
at org.apache.hudi.io.HoodieAppendHandle.processAppendResult(HoodieAppendHandle.java:363)
at org.apache.hudi.io.HoodieAppendHandle.appendDataAndDeleteBlocks(HoodieAppendHandle.java:405)
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5871: [SUPPORT] NPE when writing metadata with Flink
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5871:
URL: https://github.com/apache/hudi/issues/5871#issuecomment-1280280822
We may need some fix for the null value metadata values.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5871: [SUPPORT] NPE when writing metadata with Flink
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5871:
URL: https://github.com/apache/hudi/issues/5871#issuecomment-1156088612
It is cool if there is a log to show which field missing causes this error, for line: `HoodieTableMetadataUtil.java:147`
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 commented on issue #5871: [SUPPORT] NPE when writing metadata with Flink
Posted by GitBox <gi...@apache.org>.
danny0405 commented on issue #5871:
URL: https://github.com/apache/hudi/issues/5871#issuecomment-1306544476
Close because of prolonged inactivity.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [hudi] danny0405 closed issue #5871: [SUPPORT] NPE when writing metadata with Flink
Posted by GitBox <gi...@apache.org>.
danny0405 closed issue #5871: [SUPPORT] NPE when writing metadata with Flink
URL: https://github.com/apache/hudi/issues/5871
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@hudi.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org