You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Yuya Ebihara (JIRA)" <ji...@apache.org> on 2019/04/16 04:26:00 UTC
[jira] [Updated] (HADOOP-16258) FileSystem.listLocatedStatus for
path including '=' encodes it and returns FileNotFoundException
[ https://issues.apache.org/jira/browse/HADOOP-16258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Yuya Ebihara updated HADOOP-16258:
----------------------------------
Description:
Recently, we upgraded hadoop library from 2.7.7 to 3.2.0. When we call FileSystem.listLocatedStatus with location 'webhdfs://hadoop-master:50070/user/hive/warehouse/test_part/dt=1', the internal calls are
* 2.7.7 [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx|http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx%27,]
* 3.2.0 [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt%253D1?op=LISTSTATUS&user.name=xxx]'
As a result, it returns RemoteException with FileNotFoundException.
{code:java}
{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File /user/hive/warehouse/test_part/dt%3D1 does not exist."}}
{code}
Could you please tell me whether it's a bug and the way to avoid it?
was:
Recently, we upgraded hadoop library from 2.7.7 to 3.2.0. When we call FileSystem.listLocatedStatus with location 'webhdfs://hadoop-master:50070/user/hive/warehouse/test_part/dt=1', the internal calls are
* 2.7.7 [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx|http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx%27,]
* 3.2.0 [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt%253D1?op=LISTSTATUS&user.name=xxx]'
As a result, it returns RemoteException.
{code:java}
{"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File /user/hive/warehouse/test_part/dt%3D1 does not exist."}}
{code}
Could you please tell me whether it's a bug and the way to avoid it?
> FileSystem.listLocatedStatus for path including '=' encodes it and returns FileNotFoundException
> ------------------------------------------------------------------------------------------------
>
> Key: HADOOP-16258
> URL: https://issues.apache.org/jira/browse/HADOOP-16258
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Reporter: Yuya Ebihara
> Priority: Minor
>
> Recently, we upgraded hadoop library from 2.7.7 to 3.2.0. When we call FileSystem.listLocatedStatus with location 'webhdfs://hadoop-master:50070/user/hive/warehouse/test_part/dt=1', the internal calls are
> * 2.7.7 [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx|http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt=1?op=LISTSTATUS&user.name=xxx%27,]
> * 3.2.0 [http://hadoop-master:50070/webhdfs/v1/user/hive/warehouse/test_part/dt%253D1?op=LISTSTATUS&user.name=xxx]'
> As a result, it returns RemoteException with FileNotFoundException.
> {code:java}
> {"RemoteException":{"exception":"FileNotFoundException","javaClassName":"java.io.FileNotFoundException","message":"File /user/hive/warehouse/test_part/dt%3D1 does not exist."}}
> {code}
> Could you please tell me whether it's a bug and the way to avoid it?
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: common-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-issues-help@hadoop.apache.org