You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@hive.apache.org by songj songj <so...@gmail.com> on 2017/01/23 10:11:14 UTC

table&partition location URI check

hi, all:
     I have a question about the URI check in table/parition's location.

I make some test on hive-2.0.0. and I found that there are some confused
problems.

1. alter table t set location '/a b'
    `FAILED: SemanticException Cannot connect to namenode, please check if
host/port pair for /a b is valid`

2. alter table t set location 'hdfs:/a b';
`FAILED: SemanticException Cannot connect to namenode, please check if
host/port pair for hdfs:/a b is valid`

3.alter table t add partition(b='xyz')  location '/a b';
 it is ok

4. alter table t partition(b='xyz') set  location '/a b';
`FAILED: SemanticException Cannot connect to namenode, please check if
host/port pair for /a b is valid`

5.create external table t1(a string) location '/a b'
 it is ok.

above tests shows that some situation do URI check ,some did not(add
partition & create external table).

so i am confused why they different, and it is hive's design? if it is ,
someone can tell me what is this design concern, or it is better to give me
a design document.

additional:
before hive-0.13, the location is URI type, after this jira(
https://issues.apache.org/jira/browse/HIVE-6185), it changed to Path.

Thanks very much!!

Fwd: table&partition location URI check

Posted by songj songj <so...@gmail.com>.

hi, all:
     I have a question about the URI check in table/parition's location.

I make some test on hive-2.0.0. and I found that there are some confused
problems.

1. alter table t set location '/a b'
    `FAILED: SemanticException Cannot connect to namenode, please check if
host/port pair for /a b is valid`

2. alter table t set location 'hdfs:/a b';
`FAILED: SemanticException Cannot connect to namenode, please check if
host/port pair for hdfs:/a b is valid`

3.alter table t add partition(b='xyz')  location '/a b';
 it is ok

4. alter table t partition(b='xyz') set  location '/a b';
`FAILED: SemanticException Cannot connect to namenode, please check if
host/port pair for /a b is valid`

5.create external table t1(a string) location '/a b'
 it is ok.

above tests shows that some situation do URI check ,some did not(add
partition & create external table).

so i am confused why they different, and it is hive's design? if it is ,
someone can tell me what is this design concern, or it is better to give me
a design document.

additional:
before hive-0.13, the location is URI type, after this jira(
https://issues.apache.org/jira/browse/HIVE-6185), it changed to Path.

Thanks very much!!