[jira] [Comment Edited] (HIVE-14373) Add integration tests for hive on S3

["Abdullah Yousufi (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-14373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15427324#comment-15427324 ] 

Abdullah Yousufi edited comment on HIVE-14373 at 8/18/16 10:54 PM:
-------------------------------------------------------------------

Hey everyone, I've updated RB with this patch, which takes into account HIVE-14444's removal of vm files. I've also added features like source and output table paths, as well as making the bucket path a property to pass in when running the test. Major thanks to [~yalovyyi] for the reference patch and everyone else for their feedback so far.


was (Author: ayousufi):
Hey everyone, I've updated RB with this patch, which takes into account HIVE-14444's removal of vm files. I've also added features like source and output table paths, as well as making the bucket path a property to pass in when running the test. Major thanks to [~yalovyyi]'s for the reference patch and everyone else for their feedback so far.

> Add integration tests for hive on S3
> ------------------------------------
>
>                 Key: HIVE-14373
>                 URL: https://issues.apache.org/jira/browse/HIVE-14373
>             Project: Hive
>          Issue Type: Sub-task
>            Reporter: Sergio Peña
>            Assignee: Abdullah Yousufi
>         Attachments: HIVE-14373.02.patch, HIVE-14373.03.patch, HIVE-14373.patch
>
>
> With Hive doing improvements to run on S3, it would be ideal to have better integration testing on S3.
> These S3 tests won't be able to be executed by HiveQA because it will need Amazon credentials. We need to write suite based on ideas from the Hadoop project where:
> - an xml file is provided with S3 credentials
> - a committer must run these tests manually to verify it works
> - the xml file should not be part of the commit, and hiveqa should not run these tests.
> https://wiki.apache.org/hadoop/HowToContribute#Submitting_patches_against_object_stores_such_as_Amazon_S3.2C_OpenStack_Swift_and_Microsoft_Azure



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)