[jira] [Created] (HIVE-10398) Variables to raise errors on select from non-existent or empty partitions rather than just return 0 rows

["Hari Sekhon (JIRA)" <ji...@apache.org>]

Hari Sekhon created HIVE-10398:
----------------------------------

             Summary: Variables to raise errors on select from non-existent or empty partitions rather than just return 0 rows
                 Key: HIVE-10398
                 URL: https://issues.apache.org/jira/browse/HIVE-10398
             Project: Hive
          Issue Type: New Feature
          Components: Query Processor
    Affects Versions: 0.14.0
         Environment: HDP 2.2
            Reporter: Hari Sekhon
            Priority: Minor


Feature request to add 2 new variables to raise errors on queries that select from empty or non-existent partitions, eg:
{code}set hive.error.select.non-existent.partition=true;
SELECT * FROM myTable WHERE date='2015-02-29';
<raise some error here>
{code}
Currently the behaviour is to return success with zero rows, which doesn't make practical sense in many cases, and I only detected this because my bulk jobs started completing too quickly. I work around this now by listing all partitions and then checking against that before launching the bulk job but it would be more convenient to have the query just fail as is logical in these sorts of scenarios.

There should also be a similar variable for selecting from empty partitions for people who expect their partitions to be populated (a very common expectation), such as:
{code}hive.error.select.empty.partition{code}
This is somewhat similar to the existing variable
{code}hive.error.on.empty.partition{code}
except this existing one only covers dynamic partition inserts that generate empty partitions, so the suggested query side variable would be a logical counterpart to that.

Having these variables as 'false' by default these would make these completely backwards compatible improvements.

Hari Sekhon
http://www.linkedin.com/in/harisekhon



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)