You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@drill.apache.org by vkorukanti <gi...@git.apache.org> on 2015/12/15 17:00:54 UTC

[GitHub] drill pull request: DRILL-4169: Upgrade Hive storage plugin to wor...

GitHub user vkorukanti opened a pull request:

    https://github.com/apache/drill/pull/302

    DRILL-4169: Upgrade Hive storage plugin to work with Hive 1.2.1

    + HadoopShims.setTokenStr is moved to Utils.setTokenStr. There is no change
      in functionality.
    + Disable binary partitions columns in Hive test suites. Binary
      partition column feature is regressed in Hive 1.2.1. This should affect
      only the Hive execution which is used to generate the test data. If Drill
      is talking to Hive v1.0.0 (which has binary partition columns working),
      Drill should be able to get the data from Hive without any issues (tested)
    + Update StorageHandler based test as there is an issue with test data
      generation in Hive. Need a separate test with custom test StorageHandler.

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/vkorukanti/drill hive121

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/drill/pull/302.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #302
    
----
commit 1579d40641a8731b9478233d252349a7bf7166c5
Author: vkorukanti <ve...@gmail.com>
Date:   2015-12-11T19:36:11Z

    DRILL-4194: Improve performance of the HiveScan metadata fetch operation
    
    + Use the stats (numRows) stored in Hive metastore whenever available to
      calculate the costs for planning purpose
    + Delay the costly operation of loading of InputSplits until needed. When
      InputSplits are loaded, cache them at query level to speedup subsequent
      access.
    
    this closes #301

commit ff555e63218038c5dddc5a4eecea7faf8cff058c
Author: vkorukanti <ve...@gmail.com>
Date:   2015-08-26T00:51:19Z

    DRILL-4169: Upgrade Hive storage plugin to work with Hive 1.2.1
    
    + HadoopShims.setTokenStr is moved to Utils.setTokenStr. There is no change
      in functionality.
    + Disable binary partitions columns in Hive test suites. Binary
      partition column feature is regressed in Hive 1.2.1. This should affect
      only the Hive execution which is used to generate the test data. If Drill
      is talking to Hive v1.0.0 (which has binary partition columns working),
      Drill should be able to get the data from Hive without any issues (tested)
    + Update StorageHandler based test as there is an issue with test data
      generation in Hive. Need a separate test with custom test StorageHandler.

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] drill pull request: DRILL-4169: Upgrade Hive storage plugin to wor...

Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:

    https://github.com/apache/drill/pull/302


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---