[jira] [Created] (FLUME-1960) Flume syslog sink missing serializer documentation

["Rob Johnson (JIRA)" <ji...@apache.org>]

Rob Johnson created FLUME-1960:
----------------------------------

             Summary: Flume syslog sink missing serializer documentation
                 Key: FLUME-1960
                 URL: https://issues.apache.org/jira/browse/FLUME-1960
             Project: Flume
          Issue Type: Documentation
          Components: Docs
    Affects Versions: v1.3.1
            Reporter: Rob Johnson
            Priority: Minor


A special serializer for HDFS Sink was added to Flume a while back, but it's not documented.  This serializer is useful when the source is any type of syslog source.

Without specifying the serializer, the timestamp and host are not logged to the file with the event information, which is pretty useless without the timestamp and hosts.

The serializer can be configured on an hdfs sink like so:

agent1.sinks.k1.serializer=HEADER_AND_TEXT

Without this serializer specified you get (for example):
adclient[12112]: INFO  <bg:krb5.conf> daemon.main Start trusted domain discovery

as an event.  

When you specify the serializer, the same event looks like this:

{timestamp=1364380838000, Severity=6, host=myhostname, Facility=4} adclient[12112]: INFO  <bg:krb5.conf> daemon.main Start trusted domain discovery

Which is much more useful.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira