You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "kairen lo (Jira)" <ji...@apache.org> on 2020/01/06 10:22:00 UTC
[jira] [Assigned] (HIVE-22693) Modify fs.defaultFS. The location of
the new table does not change. It is still the value of fs.defaultFS before
modification
[ https://issues.apache.org/jira/browse/HIVE-22693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
kairen lo reassigned HIVE-22693:
--------------------------------
Assignee: kairen lo
> Modify fs.defaultFS. The location of the new table does not change. It is still the value of fs.defaultFS before modification
> -----------------------------------------------------------------------------------------------------------------------------
>
> Key: HIVE-22693
> URL: https://issues.apache.org/jira/browse/HIVE-22693
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Affects Versions: 3.1.0
> Environment: HDP: 3.1.4.0
> Hadoop: 3.1.1
> Hive: 3.1.0
> HBase: 2.0.2
> Tez:0.9.1
> Reporter: kairen lo
> Assignee: kairen lo
> Priority: Major
> Attachments: log.txt
>
>
> Change the hive-site. xml configuration item fs.defaultfs, or set fs.defaultfs =alluxio://master:19998 in beeline, without effect, such as create table dual(data string), table LOCATION is still the previous fs.defaultFS value hdfs://master:8020. By rights, FS in LOCATION should be the modified alluxio://master:19998
>
> Example log:
> [root@master ~]# beeline
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in [jar:file:/usr/hdp/3.1.4.0-315/hive/lib/log4j-slf4j-impl-2.10.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in [jar:file:/usr/hdp/3.1.4.0-315/hadoop/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
> SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
> 20/01/04 20:09:58 [main]: WARN conf.Configuration: file:/etc/hive/3.1.4.0-315/0/hive-site.xml:an attempt to override final parameter: fs.defaultFS; Ignoring.
> Connecting to jdbc:hive2://master:2181/default;serviceDiscoveryMode=zooKeeper;zooKeeperNamespace=hiveserver2
> Enter username for jdbc:hive2://master:2181/default:
> Enter password for jdbc:hive2://master:2181/default:
> 20/01/04 20:10:01 [main]: INFO jdbc.HiveConnection: Connected to master:10000
> Connected to: Apache Hive (version 3.1.0.3.1.4.0-315)
> Driver: Hive JDBC (version 3.1.0.3.1.4.0-315)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> Beeline version 3.1.0.3.1.4.0-315 by Apache Hive
> 0: jdbc:hive2://master:2181/default> set fs.defaultFS;
> +----------------------------------+
> | set |
> +----------------------------------+
> | fs.defaultFS=hdfs://master:8020 |
> +----------------------------------+
> 1 row selected (0.122 seconds)
> 0: jdbc:hive2://master:2181/default> set fs.defaultFS=alluxio://master:19998;
> No rows affected (0.005 seconds)
> 0: jdbc:hive2://master:2181/default> set fs.defaultFS;
> +--------------------------------------+
> | set |
> +--------------------------------------+
> | fs.defaultFS=alluxio://master:19998 |
> +--------------------------------------+
> 1 row selected (0.009 seconds)
> 0: jdbc:hive2://master:2181/default> create table dual99(data string);
> INFO : Compiling command(queryId=hive_20200104201105_57ed827c-1e8f-4a39-a179-eda0f69e44d2): create table dual99(data string)
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:null, properties:null)
> INFO : Completed compiling command(queryId=hive_20200104201105_57ed827c-1e8f-4a39-a179-eda0f69e44d2); Time taken: 0.028 seconds
> INFO : Executing command(queryId=hive_20200104201105_57ed827c-1e8f-4a39-a179-eda0f69e44d2): create table dual99(data string)
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing command(queryId=hive_20200104201105_57ed827c-1e8f-4a39-a179-eda0f69e44d2); Time taken: 0.029 seconds
> INFO : OK
> No rows affected (0.095 seconds)
> 0: jdbc:hive2://master:2181/default> show create table dual99;
> INFO : Compiling command(queryId=hive_20200104201114_db013c67-91ab-4465-9841-737722d53113): show create table dual99
> INFO : Semantic Analysis Completed (retrial = false)
> INFO : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:createtab_stmt, type:string, comment:from deserializer)], properties:null)
> INFO : Completed compiling command(queryId=hive_20200104201114_db013c67-91ab-4465-9841-737722d53113); Time taken: 0.021 seconds
> INFO : Executing command(queryId=hive_20200104201114_db013c67-91ab-4465-9841-737722d53113): show create table dual99
> INFO : Starting task [Stage-0:DDL] in serial mode
> INFO : Completed executing command(queryId=hive_20200104201114_db013c67-91ab-4465-9841-737722d53113); Time taken: 0.013 seconds
> INFO : OK
> +----------------------------------------------------+
> | createtab_stmt |
> +----------------------------------------------------+
> | CREATE TABLE `dual99`( |
> | `data` string) |
> | ROW FORMAT SERDE |
> | 'org.apache.hadoop.hive.ql.io.orc.OrcSerde' |
> | STORED AS INPUTFORMAT |
> | 'org.apache.hadoop.hive.ql.io.orc.OrcInputFormat' |
> | OUTPUTFORMAT |
> | 'org.apache.hadoop.hive.ql.io.orc.OrcOutputFormat' |
> | LOCATION |
> | 'hdfs://master:8020/warehouse/tablespace/managed/hive/dual99' |
> | TBLPROPERTIES ( |
> | 'bucketing_version'='2', |
> | 'transient_lastDdlTime'='1578139865') |
> +----------------------------------------------------+
> 13 rows selected (0.08 seconds)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)