You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Pedro Urbina Escos (JIRA)" <ji...@apache.org> on 2013/05/02 09:26:15 UTC
[jira] [Updated] (FLUME-2032) HDFSEventSink doesn't work in Windows
[ https://issues.apache.org/jira/browse/FLUME-2032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Pedro Urbina Escos updated FLUME-2032:
--------------------------------------
Description: Fix for [FLUME-1373] (Remove hardcoded file separator in HDFSEventSink ) regressed the HDFS in Windows. The fix was done per PMD/Findbugs alert. The fix was to replace '/' with the OS file separator. The problem is that the code is not trying to build a local path; it's trying to combine strings to form a URI. In Linux, OS separator is '/' and this is not a problem. In windows, OS separator is '\' and therefore you end up with paths like hdfs://foo\var. The best fix would be to use URL objects but new URL("hdfs://..") throws unknown protocol HDFS. The most cost effective fix seems to be revert to '/' (was: Fix for [FLUME-1373] (Remove hardcoded file separator in HDFSEventSink ) regressed the HDFS in Windows. The fix was done per PMD/Findbugs alert. The fix was to replace '/' with the OS file separator. The problem is that the code is not trying to build a local path; it's trying to combine strings to form a URI. In Linux, OS separator is '/' and this is not a problem. In windows, OS separator is '\' and therefore you end up with paths like hdfs://foo\var. The best fix is to use URL objects or go back to hardcoded '/'.)
> HDFSEventSink doesn't work in Windows
> -------------------------------------
>
> Key: FLUME-2032
> URL: https://issues.apache.org/jira/browse/FLUME-2032
> Project: Flume
> Issue Type: Bug
> Components: Sinks+Sources, Windows
> Affects Versions: v1.3.0
> Environment: Windows.
> Reporter: Pedro Urbina Escos
> Priority: Trivial
> Fix For: v1.4.0
>
> Original Estimate: 1h
> Remaining Estimate: 1h
>
> Fix for [FLUME-1373] (Remove hardcoded file separator in HDFSEventSink ) regressed the HDFS in Windows. The fix was done per PMD/Findbugs alert. The fix was to replace '/' with the OS file separator. The problem is that the code is not trying to build a local path; it's trying to combine strings to form a URI. In Linux, OS separator is '/' and this is not a problem. In windows, OS separator is '\' and therefore you end up with paths like hdfs://foo\var. The best fix would be to use URL objects but new URL("hdfs://..") throws unknown protocol HDFS. The most cost effective fix seems to be revert to '/'
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira