You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Corentin Baron (JIRA)" <ji...@apache.org> on 2015/02/03 16:40:35 UTC

[jira] [Commented] (FLUME-2443) org.apache.hadoop.fs.FSDataOutputStream.sync() is deprecated in hadoop 2.4

    [ https://issues.apache.org/jira/browse/FLUME-2443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14303455#comment-14303455 ] 

Corentin Baron commented on FLUME-2443:
---------------------------------------

Hi Hari,

This has been freezed for quite some time now, and this issue would prevent Flume from working with newer versions of Hadoop until resolved. Do you know  anyone who could help reviewing your patch so we could mark the ticket as resolved?

Thanks,
Corentin.

> org.apache.hadoop.fs.FSDataOutputStream.sync() is deprecated in hadoop 2.4
> --------------------------------------------------------------------------
>
>                 Key: FLUME-2443
>                 URL: https://issues.apache.org/jira/browse/FLUME-2443
>             Project: Flume
>          Issue Type: Dependency upgrade
>          Components: Sinks+Sources, Technical Debt
>    Affects Versions: v1.5.0, v1.5.0.1, v1.6.0
>         Environment: Linux PPC / x86
>            Reporter: Corentin Baron
>            Assignee: Hari Shreedharan
>             Fix For: v1.6.0
>
>         Attachments: FLUME-2443.patch
>
>
> HDFS sink uses this method, which is deprecated in hadoop 2.4.1, and no longer present in the current hadoop developments:
> java.lang.NoSuchMethodError: org/apache/hadoop/fs/FSDataOutputStream.sync()V
> 	at org.apache.flume.sink.hdfs.HDFSDataStream.sync(HDFSDataStream.java:131)
> 	at org.apache.flume.sink.hdfs.BucketWriter$6.call(BucketWriter.java:502)
> 	at org.apache.flume.sink.hdfs.BucketWriter$6.call(BucketWriter.java:499)
> 	at org.apache.flume.sink.hdfs.BucketWriter$9$1.run(BucketWriter.java:718)
> 	at org.apache.flume.sink.hdfs.BucketWriter.runPrivileged(BucketWriter.java:183)
> 	at org.apache.flume.sink.hdfs.BucketWriter.access$1700(BucketWriter.java:59)
> 	at org.apache.flume.sink.hdfs.BucketWriter$9.call(BucketWriter.java:715)
> 	at java.util.concurrent.FutureTask.run(FutureTask.java:273)
> 	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1176)
> 	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:641)
> 	at java.lang.Thread.run(Thread.java:853)



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)