[jira] [Commented] (FLUME-3020) Improve HDFSEventSink Escape Ingestion by more then 10x by not getting InetAddress on every record

["Hari Shreedharan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/FLUME-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15626313#comment-15626313 ] 

Hari Shreedharan commented on FLUME-3020:
-----------------------------------------

This looks good. We could actually cache even the replacement strings in local static variables to save that cost as well (which of course is trivial compared to the lookup cost). 

> Improve HDFSEventSink Escape Ingestion by more then 10x by not getting InetAddress on every record
> --------------------------------------------------------------------------------------------------
>
>                 Key: FLUME-3020
>                 URL: https://issues.apache.org/jira/browse/FLUME-3020
>             Project: Flume
>          Issue Type: Improvement
>            Reporter: Theodore michael Malaska
>            Assignee: Theodore michael Malaska
>         Attachments: flume-3020.patch
>
>
> If you are use escaping the current code will call InetAddress on every record.  Which will result is a huge impact to performance.
> TotalTime,8403,
> totalEventTakeTime,1498,
> totalWriteTime,1981,
> totalWriterSetupTime,65,
> commitTime,201,
> flushTime,18,
> startTrans,7,
> The rest is all InetAddress



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)