You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@eagle.apache.org by "Lh Reddy, Kesava" <kr...@paypal.com.INVALID> on 2018/01/03 10:58:28 UTC
Elastic search sink usage in eagle
Hi,
We are planning to dump storm metrics to elasticsearch (using ElasticSearchSink). We have few questions on the same.
1.Is it recommended to allow system to create index automatically?
2.If we create index will the mapping/schema be carried to subsequent indexes with change in date.
Please let us know more details about the same.
Regards
Kesava Reddy
Fwd: Elastic search sink usage in eagle
Posted by Hao Chen <ha...@apache.org>.
FYI.
- Hao
---------- Forwarded message ----------
From: Hao Chen <ha...@apache.org>
Date: Thu, Jan 4, 2018 at 11:14 PM
Subject: Re: Elastic search sink usage in eagle
To: dev@eagle.apache.org
Hi,
The ElasticSearchSink checks for the existence of an index template called "
*metrics_template*". If this template does not exist, it is created. This
template ensures that all strings used in metrics are set to not_analyzed
and disables the _all field.
So answers to your questions are *YES*. Please create an index template
named "metrics_template" and allow the system to create index automatically.
- Hao
On Wed, Jan 3, 2018 at 6:58 PM, Lh Reddy, Kesava <
kreddylh@paypal.com.invalid> wrote:
> Hi,
>
> We are planning to dump storm metrics to elasticsearch (using
> ElasticSearchSink). We have few questions on the same.
>
> 1.Is it recommended to allow system to create index automatically?
> 2.If we create index will the mapping/schema be carried to subsequent
> indexes with change in date.
>
> Please let us know more details about the same.
>
> Regards
> Kesava Reddy
>
Re: Elastic search sink usage in eagle
Posted by Hao Chen <ha...@apache.org>.
Hi,
The ElasticSearchSink checks for the existence of an index template called "
*metrics_template*". If this template does not exist, it is created. This
template ensures that all strings used in metrics are set to not_analyzed
and disables the _all field.
So answers to your questions are *YES*. Please create an index template
named "metrics_template" and allow the system to create index automatically.
- Hao
On Wed, Jan 3, 2018 at 6:58 PM, Lh Reddy, Kesava <
kreddylh@paypal.com.invalid> wrote:
> Hi,
>
> We are planning to dump storm metrics to elasticsearch (using
> ElasticSearchSink). We have few questions on the same.
>
> 1.Is it recommended to allow system to create index automatically?
> 2.If we create index will the mapping/schema be carried to subsequent
> indexes with change in date.
>
> Please let us know more details about the same.
>
> Regards
> Kesava Reddy
>