You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@bigtop.apache.org by "wuzhiguo (Jira)" <ji...@apache.org> on 2022/07/22 03:30:00 UTC
[jira] [Comment Edited] (BIGTOP-3757) Remove Logstash from Bigtop stack
[ https://issues.apache.org/jira/browse/BIGTOP-3757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17569767#comment-17569767 ]
wuzhiguo edited comment on BIGTOP-3757 at 7/22/22 3:29 AM:
-----------------------------------------------------------
[~yqGu] Logstash is typically used in transfer log to elasticsearch, but in k8s environment, fluentd/filebeat are more popular, and use Kibana to search for these logs.
Elasticsearch are still used in some projects, like Atlas is using Janusgraph, and Janusgraph is using es/solr + hbase/berkerly to store the graph data, es/solr is only used for store the index information.
Kibana is a visualize solution for es, but most people are only use it for search logs(or maybe I miss something), but it can still be used to manage the indexes.
That's why I suggest remove logstash and upgrade elasticsearch.
was (Author: JIRAUSER279839):
[~yqGu] Logstash is typically used in transfer log to elasticsearch, but in k8s environment, fluent/filebeat are more popular, and use Kibana to search for these logs.
Elasticsearch are still used in some projects, like Atlas is using Janusgraph, and Janusgraph is using es/solr + hbase/berkerly to store the graph data, es/solr is only used for store the index information.
Kibana is a visualize solution for es, but most people are only use it for search logs(or maybe I miss something), but it can still be used to manage the indexes.
That's why I suggest remove logstash and upgrade elasticsearch.
> Remove Logstash from Bigtop stack
> ---------------------------------
>
> Key: BIGTOP-3757
> URL: https://issues.apache.org/jira/browse/BIGTOP-3757
> Project: Bigtop
> Issue Type: Wish
> Reporter: wuzhiguo
> Priority: Major
>
> Logstash 5.4.1 is an old version which has been released more than 5 years.
> And is rarely used in big data related applications.
> So I'd like to remove it from bigtop stack.
> Any objections?[~sekikn] [~iwasakims] [~guyuqi]
--
This message was sent by Atlassian Jira
(v8.20.10#820010)