You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2022/05/02 04:08:00 UTC
[jira] [Work logged] (HIVE-22013) "Show table extended" query fails with Wrong FS error for partition in customized location
[ https://issues.apache.org/jira/browse/HIVE-22013?focusedWorklogId=764836&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-764836 ]
ASF GitHub Bot logged work on HIVE-22013:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 02/May/22 04:07
Start Date: 02/May/22 04:07
Worklog Time Spent: 10m
Work Description: ganeshashree commented on PR #3231:
URL: https://github.com/apache/hive/pull/3231#issuecomment-1114473524
@miklosgergely Thanks for reviewing. Please help with merging this fix to master branch.
Issue Time Tracking
-------------------
Worklog Id: (was: 764836)
Time Spent: 20m (was: 10m)
> "Show table extended" query fails with Wrong FS error for partition in customized location
> ------------------------------------------------------------------------------------------
>
> Key: HIVE-22013
> URL: https://issues.apache.org/jira/browse/HIVE-22013
> Project: Hive
> Issue Type: Bug
> Components: Hive
> Reporter: Rajesh Balamohan
> Assignee: Ganesha Shreedhara
> Priority: Minor
> Labels: pull-request-available
> Time Spent: 20m
> Remaining Estimate: 0h
>
> In some of the `show table extended` statements, following codepath is invoked
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java#L421]
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java#L449]
> [https://github.com/apache/hive/blob/master/ql/src/java/org/apache/hadoop/hive/ql/metadata/formatting/TextMetaDataFormatter.java#L468]
> 1. Not sure why this invokes stats computation. This should be removed?
> 2. Even if #1 is needed, it would be broken when {{tblPath}} and {{partitionPaths}} are different (i.e when both of them of them are in different fs or configured via router etc).
> {noformat}
> Caused by: java.lang.IllegalArgumentException: Wrong FS: hdfs://xyz/blah/tables/location/, expected: hdfs://zzz..
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:657)
> at org.apache.hadoop.hdfs.DistributedFileSystem.getPathName(DistributedFileSystem.java:194)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatusInternal(DistributedFileSystem.java:698)
> at org.apache.hadoop.hdfs.DistributedFileSystem.access$600(DistributedFileSystem.java:106)
> at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:763)
> at org.apache.hadoop.hdfs.DistributedFileSystem$15.doCall(DistributedFileSystem.java:759)
> at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81)
> at org.apache.hadoop.hdfs.DistributedFileSystem.listStatus(DistributedFileSystem.java:759)
> at org.apache.hadoop.hive.ql.metadata.formatting.TextMetaDataFormatter.writeFileSystemStats(TextMetaDataFormatter.java
> {noformat}
--
This message was sent by Atlassian Jira
(v8.20.7#820007)