You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flume.apache.org by "Inder SIngh (Updated) (JIRA)" <ji...@apache.org> on 2012/04/03 13:58:25 UTC
[jira] [Updated] (FLUME-1096) Issues in using AvroClient with
HDFSEvent for regex based destination paths
[ https://issues.apache.org/jira/browse/FLUME-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Inder SIngh updated FLUME-1096:
-------------------------------
Description:
Configured HDFSEvent Sink to generate file path's using regex based date format.
Config for hdfs-sink -> collector1.sinks.hdfs-sink1.hdfs.filePrefix = flume/%D
Hit NumberFormatException in BucketPath.replaceShorthand() as it reads timestamp from headers
Date date = new Date(Long.valueOf(headers.get("timestamp")));
java.lang.NumberFormatException: null
at java.lang.Long.parseLong(Long.java:375)
at java.lang.Long.valueOf(Long.java:525)
at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:341)
at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
at java.lang.Thread.run(Thread.java:680)
Sending the events using - ./flume-ng avro-client --conf ../conf/ -H localhost -p 41415 -F ~/.bash_profile
Issue - AvroCLiClient isn't adding timestamp in headers
Assignee: Inder SIngh
> Issues in using AvroClient with HDFSEvent for regex based destination paths
> ---------------------------------------------------------------------------
>
> Key: FLUME-1096
> URL: https://issues.apache.org/jira/browse/FLUME-1096
> Project: Flume
> Issue Type: Bug
> Reporter: Inder SIngh
> Assignee: Inder SIngh
> Priority: Minor
>
> Configured HDFSEvent Sink to generate file path's using regex based date format.
> Config for hdfs-sink -> collector1.sinks.hdfs-sink1.hdfs.filePrefix = flume/%D
> Hit NumberFormatException in BucketPath.replaceShorthand() as it reads timestamp from headers
>
> Date date = new Date(Long.valueOf(headers.get("timestamp")));
> java.lang.NumberFormatException: null
> at java.lang.Long.parseLong(Long.java:375)
> at java.lang.Long.valueOf(Long.java:525)
> at org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
> at org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
> at org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:341)
> at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
> at java.lang.Thread.run(Thread.java:680)
> Sending the events using - ./flume-ng avro-client --conf ../conf/ -H localhost -p 41415 -F ~/.bash_profile
> Issue - AvroCLiClient isn't adding timestamp in headers
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira