You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Thejas M Nair (JIRA)" <ji...@apache.org> on 2014/10/10 01:58:33 UTC
[jira] [Commented] (HIVE-7699) HIVE fails to LOAD DATA INTO TABLE
from external storage
[ https://issues.apache.org/jira/browse/HIVE-7699?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14166019#comment-14166019 ]
Thejas M Nair commented on HIVE-7699:
-------------------------------------
I believe that check is there to ensure that the "hdfs mv" would work. I don't think it works across file systems.
> HIVE fails to LOAD DATA INTO TABLE from external storage
> ---------------------------------------------------------
>
> Key: HIVE-7699
> URL: https://issues.apache.org/jira/browse/HIVE-7699
> Project: Hive
> Issue Type: Bug
> Affects Versions: 0.13.0
> Reporter: Xiaobing Zhou
> Assignee: Xiaobing Zhou
>
> Hive is supposed to support loading data to table from external storage like Azure blob storage. Here's an exampLe:
> {noformat}
> <property>
> <name>fs.azure.account.key.XXX.blob.core.windows.net</name>
> <value>CREDENTIAL-KEY</value>
> </property>
> {noformat}
> is configured into hadoop core-site.xml. bin/hadoop fs -ls / works fine, however if run the query like:
> {noformat}
> LOAD DATA INPATH 'wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt' OVERWRITE INTO TABLE hivetable;
> {noformat}, where wasb is schema of Azure blob store.
> HIVE CLI will complain as
> {noformat}
> FAILED: SemanticException [Error 10028]: Line 1:17 Path is not legal ''wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.t
> xt'': Move from: wasb://test@ACCOUNT-NAME.blob.core.windows.net/data.txt to: hdfs://HDFS-HOST:8020/hivetable is not vali
> d. Please check that values for params "default.fs.name" and "hive.metastore.warehouse.dir" do not conflict.
> {noformat}
> Stack trace:
> {noformat}
> at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.applyConstraints(LoadSemanticAnalyzer.java:170)
> at org.apache.hadoop.hive.ql.parse.LoadSemanticAnalyzer.analyzeInternal(LoadSemanticAnalyzer.java:236)
> at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:427)
> at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:323)
> at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:980)
> at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1045)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:916)
> at org.apache.hadoop.hive.ql.Driver.run(Driver.java:906)
> at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:272)
> at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:224)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:427)
> at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:363)
> at org.apache.hadoop.hive.cli.CliDriver.processReader(CliDriver.java:460)
> at org.apache.hadoop.hive.cli.CliDriver.processFile(CliDriver.java:489)
> at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:772)
> at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:709)
> at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:648)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:601)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)