You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-issues@hadoop.apache.org by "Maxime Brugidou (Created) (JIRA)" <ji...@apache.org> on 2012/03/01 11:59:58 UTC
[jira] [Created] (HADOOP-8127) FTPFileSystem is broken when a file
is modified on 02/29
FTPFileSystem is broken when a file is modified on 02/29
--------------------------------------------------------
Key: HADOOP-8127
URL: https://issues.apache.org/jira/browse/HADOOP-8127
Project: Hadoop Common
Issue Type: Bug
Components: fs
Affects Versions: 1.0.0, 0.23.0, 0.22.0, 0.21.0, 0.20.0
Reporter: Maxime Brugidou
Priority: Critical
Due to NET-188 the FTPClient from commons-net that is used by hadoop FTPFileSystem is broken.
The solution is to upgrade the commons-net version (that has been fixed 4 years ago).
We are currently running hadoop 0.20 with commons-net-2.0 without trouble and it fixed our issue with FTPClient.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8127) FTPFileSystem is broken when a
file is modified on 02/29
Posted by "none_ (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13219980#comment-13219980 ]
none_ commented on HADOOP-8127:
-------------------------------
Hi,
we are facing this problem too, but upgrading to commons-net 2.0 doesn't seem to solve this problem.
Have you tested it on file with creation time set to something different from 0:00?
File with timestamp 2012-02-29 00:00:00.000000000 +0100 works fine, but I am not able download file with timestamp for example 2012-02-29 12:30:00.000000000 +0100.
> FTPFileSystem is broken when a file is modified on 02/29
> --------------------------------------------------------
>
> Key: HADOOP-8127
> URL: https://issues.apache.org/jira/browse/HADOOP-8127
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.20.0, 0.21.0, 0.22.0, 0.23.0, 1.0.0
> Reporter: Maxime Brugidou
> Priority: Critical
>
> Due to NET-188 the FTPClient from commons-net that is used by hadoop FTPFileSystem is broken.
> The solution is to upgrade the commons-net version (that has been fixed 4 years ago).
> We are currently running hadoop 0.20 with commons-net-2.0 without trouble and it fixed our issue with FTPClient.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8127) FTPFileSystem is broken when a
file is modified on 02/29
Posted by "Maxime Brugidou (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220031#comment-13220031 ]
Maxime Brugidou commented on HADOOP-8127:
-----------------------------------------
We had files and directories created all day long every hour without any trouble using commons-net-2.0.jar (that we put in /usr/lib/hadoop/lib).
We are using the FTPFileSystem as a distcp source for some data like this:
{code}
hadoop distcp ftp://ftpserver/data/ hdfs://hadoop/data2/
{code}
> FTPFileSystem is broken when a file is modified on 02/29
> --------------------------------------------------------
>
> Key: HADOOP-8127
> URL: https://issues.apache.org/jira/browse/HADOOP-8127
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.20.0, 0.21.0, 0.22.0, 0.23.0, 1.0.0
> Reporter: Maxime Brugidou
> Priority: Critical
>
> Due to NET-188 the FTPClient from commons-net that is used by hadoop FTPFileSystem is broken.
> The solution is to upgrade the commons-net version (that has been fixed 4 years ago).
> We are currently running hadoop 0.20 with commons-net-2.0 without trouble and it fixed our issue with FTPClient.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8127) FTPFileSystem is broken when a
file is modified on 02/29
Posted by "Maxime Brugidou (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220813#comment-13220813 ]
Maxime Brugidou commented on HADOOP-8127:
-----------------------------------------
The FTP server is an isilon cluster using vsftp (http://www.isilon.com/)
I didn't do more testing to see if the problem comes up with other FTP servers, but from the NET-188 bug I can tell it happened to a lot of people.
> FTPFileSystem is broken when a file is modified on 02/29
> --------------------------------------------------------
>
> Key: HADOOP-8127
> URL: https://issues.apache.org/jira/browse/HADOOP-8127
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.20.0, 0.21.0, 0.22.0, 0.23.0, 1.0.0
> Reporter: Maxime Brugidou
> Priority: Critical
>
> Due to NET-188 the FTPClient from commons-net that is used by hadoop FTPFileSystem is broken.
> The solution is to upgrade the commons-net version (that has been fixed 4 years ago).
> We are currently running hadoop 0.20 with commons-net-2.0 without trouble and it fixed our issue with FTPClient.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HADOOP-8127) FTPFileSystem is broken when a
file is modified on 02/29
Posted by "Steve Loughran (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-8127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13220279#comment-13220279 ]
Steve Loughran commented on HADOOP-8127:
----------------------------------------
# poignant that the NET-188 bug got filed the last time there was a leap year.
# it should be fairly straightforward to add a test for this if we can serve up some files
# what platform was the FTP server?
> FTPFileSystem is broken when a file is modified on 02/29
> --------------------------------------------------------
>
> Key: HADOOP-8127
> URL: https://issues.apache.org/jira/browse/HADOOP-8127
> Project: Hadoop Common
> Issue Type: Bug
> Components: fs
> Affects Versions: 0.20.0, 0.21.0, 0.22.0, 0.23.0, 1.0.0
> Reporter: Maxime Brugidou
> Priority: Critical
>
> Due to NET-188 the FTPClient from commons-net that is used by hadoop FTPFileSystem is broken.
> The solution is to upgrade the commons-net version (that has been fixed 4 years ago).
> We are currently running hadoop 0.20 with commons-net-2.0 without trouble and it fixed our issue with FTPClient.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira