[GitHub] flume pull request: check message size before send to kafka

[darionyaphet <gi...@git.apache.org>]

GitHub user darionyaphet opened a pull request:

    https://github.com/apache/flume/pull/25

    check message size before send to kafka

    Kafka Sink fetch message from channel and use Kafka Producer to send message to Kafka Broker . When Kafka Broker's config `message.max.bytes` and message is too long Flume Kafka Sink will failed to send message. 
    
    I add a check before message send to Kafka Broker . The too long message will be discard and record log with message size.
    You also can config the messageMaxSize in properties file.
    
    I Create a JIRA Ticket:https://issues.apache.org/jira/browse/FLUME-2837
    
    thanks

You can merge this pull request into a Git repository by running:

    $ git pull https://github.com/darionyaphet/flume trunk

Alternatively you can review and apply these changes as the patch at:

    https://github.com/apache/flume/pull/25.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #25
    
----
commit a256cd2160e36919867c00cb147113786080f9bc
Author: darionyaphet <da...@gmail.com>
Date:   2015-11-06T10:35:07Z

    check message size before send to kafka

----


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] flume pull request #25: check message size before send to kafka

[darionyaphet <gi...@git.apache.org>]

Github user darionyaphet closed the pull request at:

    https://github.com/apache/flume/pull/25


---