[jira] [Commented] (HIVE-24484) Upgrade Hadoop to 3.3.0

["David Mollitor (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-24484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17367606#comment-17367606 ] 

David Mollitor commented on HIVE-24484:
---------------------------------------

[HADOOP-16458] caused a small regression for Hive.

{code:java|title=InvalidInputException.java}
    if (!probs.isEmpty()) {
      initCause(probs.get(0));
    }
{code}

{code:java|title=FetchOperator.java}
    try {
      splits = inputFormat.getSplits(job, 1);
    } catch (Exception ex) {
      Throwable t = ExceptionUtils.getRootCause(ex);
      if (t instanceof FileNotFoundException || t instanceof InvalidInputException) {
        LOG.warn("Input path " + currPath + " is empty", t.getMessage());
        return;
      }
      throw ex;
    }
{code}

So Hive is looking at the "root cause" and was seeing the {{InvalidInputException}}.  With [HADOOP-16458], the {{InvalidInputException}} now sets a cause so Hive is finding the underlying cause which happens to be an {{IOException}}.

I updated my PR to be able to catch the {{InvalidInputException}} and not the root cause.

> Upgrade Hadoop to 3.3.0
> -----------------------
>
>                 Key: HIVE-24484
>                 URL: https://issues.apache.org/jira/browse/HIVE-24484
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: David Mollitor
>            Assignee: David Mollitor
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)