You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hive.apache.org by "Mahesh Raju Somalaraju (Jira)" <ji...@apache.org> on 2023/02/06 08:04:00 UTC

[jira] [Created] (HIVE-27029) hive query fails with Filesystem closed error

Mahesh Raju Somalaraju created HIVE-27029:
---------------------------------------------

             Summary: hive query fails with Filesystem closed error
                 Key: HIVE-27029
                 URL: https://issues.apache.org/jira/browse/HIVE-27029
             Project: Hive
          Issue Type: Bug
            Reporter: Mahesh Raju Somalaraju


Caused by: java.io.IOException: Filesystem closed
        at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:483) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.hdfs.DFSClient.getEZForPath(DFSClient.java:2771) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2796) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.hdfs.DistributedFileSystem$54.doCall(DistributedFileSystem.java:2793) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) ~[hadoop-common-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.hdfs.DistributedFileSystem.getEZForPath(DistributedFileSystem.java:2812) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.hdfs.client.HdfsAdmin.getEncryptionZoneForPath(HdfsAdmin.java:374) ~[hadoop-hdfs-client-3.1.1.7.1.8.11-3.jar:?]
        at org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.getEncryptionZoneForPath(Hadoop23Shims.java:1384) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
        at org.apache.hadoop.hive.shims.Hadoop23Shims$HdfsEncryptionShim.isPathEncrypted(Hadoop23Shims.java:1379) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
        at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.isPathEncrypted(SemanticAnalyzer.java:2484) ~[hive-exec-3.1.3000.7.1.8.11-3.jar:3.1.3000.7.1.8.11-3]
 

 

steps:
1. When using explicit queue name the tez.queue.access is used. If statistics gathering is enabled the second insert fails at the compute_stats() phase.

beeline --hiveconf tez.queue.name=default  -e "
SET hive.query.results.cache.enabled=false;
SET hive.fetch.task.conversion=none;

SET hive.stats.autogather=true;

drop table if exists default.bigd35368p100;
create  table default.bigd35368p100 (name string) partitioned by ( id int);
insert into default.bigd35368p100 select * from default.bigd35368e100;

drop table if exists default.bigd35368p100;
create  table default.bigd35368p100 (name string) partitioned by ( id int);
insert into default.bigd35368p100 select * from default.bigd35368e100;
"



--
This message was sent by Atlassian Jira
(v8.20.10#820010)