[jira] [Created] (HIVE-14616) CBO phase fails with NPE when quering a table with array field

["Javier (JIRA)" <ji...@apache.org>]

Javier created HIVE-14616:
-----------------------------

             Summary: CBO phase fails with NPE when quering a table with array field
                 Key: HIVE-14616
                 URL: https://issues.apache.org/jira/browse/HIVE-14616
             Project: Hive
          Issue Type: Bug
          Components: CBO
    Affects Versions: 1.2.1
            Reporter: Javier
            Priority: Minor


A "Error: Error while compiling statement: FAILED: NullPointerException null (state=42000,code=40000)" message appears when issuing a query involving a table with array. Statistics where gathered issuing:

analyze table test.table_with_array compute statistics;
analyze table test.table_with_array compute statistics for columns
<all_columns_but_array_field>;

We couldn't compute statistics for all columns because we got a "FAILED: UDFArgumentTypeException Only primitive type arguments are accepted but array<string> is passed."

The hive log shows:

2016-08-24 02:35:29,987 INFO  [HiveServer2-Handler-Pool: Thread-145434]: metastore.HiveMetaStore (HiveMetaStore.java:logInfo(747)) - 485: get_table_statistics_req: db=test table=table_with_array
2016-08-24 02:35:29,988 INFO  [HiveServer2-Handler-Pool: Thread-145434]: HiveMetaStore.audit (HiveMetaStore.java:logAuditEvent(372)) - ugi=user    ip=unknown-ip-addr      cmd=get_table_statistics_req: db=test table=table_with_array
2016-08-24 02:35:30,002 ERROR [HiveServer2-Handler-Pool: Thread-145434]: ql.Driver (SessionState.java:printError(932)) - FAILED: NullPointerException null
java.lang.NullPointerException
        at org.apache.hadoop.hive.ql.stats.StatsUtils.getColStatistics(StatsUtils.java:695)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.convertColStats(StatsUtils.java:741)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.getTableColumnStats(StatsUtils.java:730)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.collectStatistics(StatsUtils.java:185)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.collectStatistics(StatsUtils.java:138)
        at org.apache.hadoop.hive.ql.stats.StatsUtils.collectStatistics(StatsUtils.java:126)
        at org.apache.hadoop.hive.ql.optimizer.stats.annotation.StatsRulesProcFactory$TableScanStatsRule.process(StatsRulesProcFactory.java:110)
        at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
        at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:95)
        at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:79)
        at org.apache.hadoop.hive.ql.lib.PreOrderWalker.walk(PreOrderWalker.java:56)
        at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:110)

Best wishes



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)