You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by GitBox <gi...@apache.org> on 2020/02/27 00:23:39 UTC
[GitHub] [druid] samarthjain edited a comment on issue #9421: Unknown
complex types break Druid SQL
samarthjain edited a comment on issue #9421: Unknown complex types break Druid SQL
URL: https://github.com/apache/druid/issues/9421#issuecomment-591709254
I was seeing SegmentMetadata queries fail on the historical nodes with an NPE.
```
Caused by: java.lang.NullPointerException
@400000005de84b7507eae4c4 at org.apache.druid.segment.column.SimpleColumnHolder.getColumn(SimpleColumnHolder.java:68) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb0404 at org.apache.druid.segment.QueryableIndexColumnSelectorFactory.lambda$getCachedColumn$2(QueryableIndexColumnSelectorFactory.java:175) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb07ec at java.util.HashMap.computeIfAbsent(HashMap.java:1127) ~[?:1.8.0_231]
@400000005de84b7507eb07ec at org.apache.druid.segment.QueryableIndexColumnSelectorFactory.getCachedColumn(QueryableIndexColumnSelectorFactory.java:171) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb0bd4 at org.apache.druid.segment.QueryableIndexColumnSelectorFactory.lambda$makeColumnValueSelector$1(QueryableIndexColumnSelectorFactory.java:146) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb0bd4 at org.apache.druid.segment.QueryableIndexColumnSelectorFactory.makeColumnValueSelector(QueryableIndexColumnSelectorFactory.java:160) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb0fbc at org.apache.druid.query.aggregation.tdigestsketch.TDigestSketchAggregatorFactory.factorizeBuffered(TDigestSketchAggregatorFactory.java:117) ~[?:?]
@400000005de84b7507eb178c at org.apache.druid.query.aggregation.AggregatorAdapters.factorizeBuffered(AggregatorAdapters.java:103) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb178c at org.apache.druid.query.groupby.epinephelinae.GroupByQueryEngineV2$HashAggregateIterator.newGrouper(GroupByQueryEngineV2.java:550) ~[druid-processing-0.16.0.jar:0.16.0]
@400000005de84b7507eb1b74
```
These metadata queries were generated by DruidSchema over here:
https://github.com/apache/druid/blob/master/sql/src/main/java/org/apache/druid/sql/calcite/schema/DruidSchema.java#L508
The reason behind NPE was `columnSupplier` being null in `SimpleColumnHolder`. This was happening because the metadata deserialization was failing here:
https://github.com/apache/druid/blob/master/processing/src/main/java/org/apache/druid/segment/IndexIO.java#L578
which was "silently" setting the `columnSupplier` to null.
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
With regards,
Apache Git Services
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org