You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Kanna Karanam (JIRA)" <ji...@apache.org> on 2012/06/15 22:47:42 UTC
[jira] [Created] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Kanna Karanam created HIVE-3146:
-----------------------------------
Summary: Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
Key: HIVE-3146
URL: https://issues.apache.org/jira/browse/HIVE-3146
Project: Hive
Issue Type: Sub-task
Components: Windows
Affects Versions: 0.10.0
Reporter: Kanna Karanam
Fix For: 0.10.0
Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399723#comment-13399723 ]
Edward Capriolo commented on HIVE-3146:
---------------------------------------
Kanna, I actually do not believe we need this check at all.
{noformat}
private String downloadResource(String value, boolean convertToUnix) {
if (value.matches("("+ getMatchingSchemaAsRegex() +")://.*")) {
try {
FileSystem fs = FileSystem.get(new URI(value), conf);
{noformat}
I just dealt with one of these.
https://issues.apache.org/jira/browse/HIVE-1444?attachmentSortBy=dateTime
Hadoop and hive are supposed to support pluggable DFS's, we should not have a 'list of approved fs' anywhere, it just makes more work and more incomparability problems.
If I understand this method correctly all we probably need is a check for:
{noformat}
if (!fs.contains("file:///")){ }
{noformat}
Am I right?
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Carl Steinbach (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Carl Steinbach updated HIVE-3146:
---------------------------------
Status: Open (was: Patch Available)
@Kanna: please create a review request on reviews.apache.org. Thanks.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kanna Karanam updated HIVE-3146:
--------------------------------
Status: Patch Available (was: Open)
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-3146:
-----------------------------------
Status: Open (was: Patch Available)
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-3146:
-----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
Committed to trunk. Thanks, Kanna!
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt, HIVE-3146.3.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kanna Karanam updated HIVE-3146:
--------------------------------
Attachment: HIVE-3146.1.patch.txt
Attached the patch
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405467#comment-13405467 ]
Kanna Karanam commented on HIVE-3146:
-------------------------------------
Thanks Ashutosh.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt, HIVE-3146.3.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Ashutosh Chauhan updated HIVE-3146:
-----------------------------------
Assignee: Kanna Karanam
Status: Patch Available (was: Open)
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Edward Capriolo (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13397803#comment-13397803 ]
Edward Capriolo commented on HIVE-3146:
---------------------------------------
Can you please do a study into what calls into this function and why? Maybe if can be removed entirely or moved into a configuration setting. We do not want to recode each time a new filesystem is introduced.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kanna Karanam updated HIVE-3146:
--------------------------------
Status: Patch Available (was: Open)
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt, HIVE-3146.3.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405711#comment-13405711 ]
Hudson commented on HIVE-3146:
------------------------------
Integrated in Hive-trunk-h0.21 #1526 (See [https://builds.apache.org/job/Hive-trunk-h0.21/1526/])
HIVE-3146 : Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV) (Kanna Karanam via Ashutosh Chauhan) (Revision 1356524)
Result = FAILURE
hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1356524
Files :
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
* /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt, HIVE-3146.3.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "JQ Hadoop (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399449#comment-13399449 ]
JQ Hadoop commented on HIVE-3146:
---------------------------------
I think make it a configuration setting will be more flexible.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399586#comment-13399586 ]
Kanna Karanam commented on HIVE-3146:
-------------------------------------
please find the code review request at https://reviews.apache.org/r/5530/
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399600#comment-13399600 ]
Kanna Karanam commented on HIVE-3146:
-------------------------------------
@Edward, @JQ – If I understand correctly, the suggestion is
1)Create a new setting in the hive-conf.xml
2)Set the default value to the existing values in hiveConf.java & hive-conf.xml template.
3)Customer can override this setting if they want to work with a different storage system.
I personally don’t see so many changes to this but if you strongly feel that it has to be configurable then please let me know. I will update the patch and send it for review.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kanna Karanam updated HIVE-3146:
--------------------------------
Attachment: HIVE-3146.3.patch.txt
Updated the patch.
Addressed the Ashutosh code review comments.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt, HIVE-3146.3.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13399181#comment-13399181 ]
Ashutosh Chauhan commented on HIVE-3146:
----------------------------------------
@Ed,
According to https://issues.apache.org/jira/browse/HIVE-1624?focusedCommentId=12914176&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-12914176 schemes were picked rather defensively. Adding ASV in there should be fine.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Ashutosh Chauhan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405189#comment-13405189 ]
Ashutosh Chauhan commented on HIVE-3146:
----------------------------------------
+1 will commit if tests pass.
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt, HIVE-3146.3.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kanna Karanam updated HIVE-3146:
--------------------------------
Attachment: HIVE-3146.2.patch.txt
Attached the patch. Code review request for this patch is https://reviews.apache.org/r/5687/
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt, HIVE-3146.2.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-3146) Support external hive tables whose
data are stored in Azure blob store/Azure Storage Volumes (ASV)
Posted by "Kanna Karanam (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HIVE-3146?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13404419#comment-13404419 ]
Kanna Karanam commented on HIVE-3146:
-------------------------------------
@Edward, @Ashutosh - I think we need the following check here. I tried with if (!fs.contains("file:///")){ and noticed that around 70 Unoit tests are failing.
As per HIVE-1624 - They want to download resources from S3 (external FS to local system) and then move them to cluster.
public static boolean canDownloadResource(String value) {
// Allow to download resources from any external FileSystem.
// And no need to download if it already exists on local file system.
return value.matches("\\w+://.*")
&& !value.toLowerCase().contains("file://");
}
I am running unit tests with this change. If 100% pass then I will upload the patch.
Thanks
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
> --------------------------------------------------------------------------------------------------
>
> Key: HIVE-3146
> URL: https://issues.apache.org/jira/browse/HIVE-3146
> Project: Hive
> Issue Type: Sub-task
> Components: Windows
> Affects Versions: 0.10.0
> Reporter: Kanna Karanam
> Assignee: Kanna Karanam
> Labels: Windows
> Fix For: 0.10.0
>
> Attachments: HIVE-3146.1.patch.txt
>
>
> Support external hive tables whose data are stored in Azure blob store/Azure Storage Volumes (ASV)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira