[jira] [Resolved] (EAGLE-20) Support Filebeat as Log Shipper for better performance

["Hao Chen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/EAGLE-20?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hao Chen resolved EAGLE-20.
---------------------------
    Resolution: Fixed
      Assignee: Zhao, Qingwen  (was: Hao Chen)

> Support Filebeat as Log Shipper for better performance
> ------------------------------------------------------
>
>                 Key: EAGLE-20
>                 URL: https://issues.apache.org/jira/browse/EAGLE-20
>             Project: Eagle
>          Issue Type: New Feature
>            Reporter: Hao Chen
>            Assignee: Zhao, Qingwen
>
> Currently we provide two approaches for user to ship hadoop audit log from local to kafka, while they have some problems for large log flow
> 1)  log4j kafka appender: impact hadoop name node stability
> 2)  logstash: consume too many machine resource like CPU/Memory
> So we may need to evaluate some other possible solutions like Elastic Filebeat: https://github.com/elastic/filebeat



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)