You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by timrobertson100 <gi...@git.apache.org> on 2016/04/20 15:27:45 UTC

[GitHub] hive pull request: HIVE-13539: HiveHFileOutputFormat searching the...

GitHub user timrobertson100 opened a pull request:

    https://github.com/apache/hive/pull/74

    HIVE-13539: HiveHFileOutputFormat searching the wrong directory for H…

    I believe this is a fix for https://issues.apache.org/jira/browse/HIVE-13539
    
    When there are several reducers (or speculative execution) there becomes multiple output dircetories for the task attempts.  Previous behaviour threw exception incorrectly as it assumed multiple HFiles.
    
    Here, I am attempting to start the descending directory search from the task attempt folder and not from the higher directory for the table.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/timrobertson100/hive master

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/hive/pull/74.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #74
    
----
commit a4abe6bec0c0141bddcbfa75408b49123af65066
Author: timrobertson100 <ti...@gmail.com>
Date:   2016-04-20T13:23:24Z

    HIVE-13539: HiveHFileOutputFormat searching the wrong directory for HFiles

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---