Re: analyze hive tables with null values in partition columns

[Dileep Kumar <di...@gmail.com>]

> I have a table that has partition based on column ss_sold_date_sk which
> has null value partition as well.
>
> When I run the analyze ..compute stat it fails with attached exception.
> Is there a way to avoid this or bypass this exception, also what would be
> the impact on query performance of stat being not collected ?
>
> The analyze statement I run is as:
>
> analyze table store_sales partition(ss_sold_date_sk) compute statistics;
> Please suggest.
>
> Thanks,
> Dileep
>
> Diagnostic Messages for this Task:
>
> Error: java.lang.RuntimeException:
> org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime Error while
> processing row
> {"ss_sold_time_sk":null,"ss_item_sk":null,"ss_customer_sk":null,"ss_cdemo_sk":null,"ss_hdemo_sk":null,"ss_addr_sk":null,"ss_store_sk":null,"ss_promo_sk":null,"ss_ticket_number":null,"ss_quantity":null,"ss_wholesale_cost":null,"ss_list_price":null,"ss_sales_price":null,"ss_ext_discount_amt":null,"ss_ext_sales_price":null,"ss_ext_wholesale_cost":null,"ss_ext_list_price":null,"ss_ext_tax":null,"ss_coupon_amt":null,"ss_net_paid":null,"ss_net_paid_inc_tax":null,"ss_net_profit":null,"ss_sold_date_sk":null,"raw__data__size":0}
>
> at org.apache.hadoop.hive.ql.exec.mr.ExecMapper.map(ExecMapper.java:195)
>
> at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
>
> at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:430)
>
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:342)
>
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:167)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:415)
>
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
>
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)
>
> Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Hive Runtime
> Error while processing row
> {"ss_sold_time_sk":null,"ss_item_sk":null,"ss_customer_sk":null,"ss_cdemo_sk":null,"ss_hdemo_sk":null,"ss_addr_sk":null,"ss_store_sk":null,"ss_promo_sk":null,"ss_ticket_number":null,"ss_quantity":null,"ss_wholesale_cost":null,"ss_list_price":null,"ss_sales_price":null,"ss_ext_discount_amt":null,"ss_ext_sales_price":null,"ss_ext_wholesale_cost":null,"ss_ext_list_price":null,"ss_ext_tax":null,"ss_coupon_amt":null,"ss_net_paid":null,"ss_net_paid_inc_tax":null,"ss_net_profit":null,"ss_sold_date_sk":null,"raw__data__size":0}
>
>