You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Tamas Mate (Jira)" <ji...@apache.org> on 2022/01/10 13:09:00 UTC
[jira] [Closed] (IMPALA-11071) NPE when PARQUET_READ_STATISTICS is set to false
[ https://issues.apache.org/jira/browse/IMPALA-11071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tamas Mate closed IMPALA-11071.
-------------------------------
Resolution: Duplicate
> NPE when PARQUET_READ_STATISTICS is set to false
> ------------------------------------------------
>
> Key: IMPALA-11071
> URL: https://issues.apache.org/jira/browse/IMPALA-11071
> Project: IMPALA
> Issue Type: Bug
> Components: Frontend
> Affects Versions: Impala 4.0.0
> Reporter: Tamas Mate
> Priority: Major
>
> A NullPointerException happens when the {{PARQUET_READ_STATISTICS}} is set to false, the overlap predicate initialisation is triggered, but the stats are not available.
> *Repro query:*
> {code:sql}
> SET PARQUET_READ_STATISTICS=false;
> SELECT * FROM functional_parquet.alltypes a
> JOIN functional_parquet.alltypes b ON a.id = b.id;
> {code}
> {*}Workaround{*}, disable further min/max filter options to avoid initialising the overlap predicate:
> {code:bash}
> SET MINMAX_FILTER_THRESHOLD = 0.0;
> SET MINMAX_FILTER_SORTED_COLUMNS=FALSE;
> SET MINMAX_FILTER_PARTITION_COLUMNS=FALSE;
> {code}
> *Stack:*
> {code:none}
> I0110 12:50:18.481575 12627 jni-util.cc:286] 1c493743f9081832:186a787f00000000] java.lang.NullPointerException
> at com.google.common.base.Preconditions.checkNotNull(Preconditions.java:878)
> at org.apache.impala.planner.HdfsScanNode.initOverlapPredicate(HdfsScanNode.java:744)
> at org.apache.impala.planner.RuntimeFilterGenerator.assignRuntimeFilters(RuntimeFilterGenerator.java:925)
> at org.apache.impala.planner.RuntimeFilterGenerator.generateFilters(RuntimeFilterGenerator.java:835)
> at org.apache.impala.planner.RuntimeFilterGenerator.generateFilters(RuntimeFilterGenerator.java:838)
> at org.apache.impala.planner.RuntimeFilterGenerator.generateFilters(RuntimeFilterGenerator.java:828)
> at org.apache.impala.planner.RuntimeFilterGenerator.generateFilters(RuntimeFilterGenerator.java:838)
> at org.apache.impala.planner.RuntimeFilterGenerator.generateRuntimeFilters(RuntimeFilterGenerator.java:699)
> at org.apache.impala.planner.Planner.createPlanFragments(Planner.java:144)
> at org.apache.impala.planner.Planner.createPlans(Planner.java:249)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1562)
> at org.apache.impala.service.Frontend.getPlannedExecRequest(Frontend.java:1939)
> at org.apache.impala.service.Frontend.doCreateExecRequest(Frontend.java:1779)
> at org.apache.impala.service.Frontend.getTExecRequest(Frontend.java:1644)
> at org.apache.impala.service.Frontend.createExecRequest(Frontend.java:1614)
> at org.apache.impala.service.JniFrontend.createExecRequest(JniFrontend.java:164)
> {code}
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org