You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@karaf.apache.org by Mark Bordelon <mb...@savoirtech.com> on 2020/11/02 21:11:39 UTC
Kibana (2.5.0) -- ElasticSearch Appender config error
With the following minimal configuration, (just setting the address, authentication, and index prefix) …
################################################
# Decanter Elasticsearch Appender Configuration
################################################
# HTTP address of the elasticsearch nodes (separated with comma)
addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
# Basic username and password authentication
username=batchoi
password=batchoipwd
# The index name.
# The index prefix is a static string used to construct the index
index.prefix=karafCamelCWS
# If true, it creates an index per Decanter event day
#index.event.timestamped=true
# For Elasticsearch < 7.5, index type is mandatory (not defined by default)
index.type=
# Marshaller to use (json is heavily recommended)
marshaller.target=(dataFormat=json)
I get this 405 error when i install the elasticsearch appender feature.
2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
{"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
If the HTTP verb could be set to PUT, seems like it might work based on this:
curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
-XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
{"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
-XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
{"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
Re: Kibana (2.5.0) -- ElasticSearch Appender config error
Posted by Mark Bordelon <mb...@savoirtech.com>.
Thank you, JB. You followed my no sequitur to prometheus perfectly! What you say about prometeus certainly confirms what the documentation says. However, I cannot find how to push to a prometheus server. I gather this is not done using decanter. What is the normal/correct way to do this?
> On Nov 3, 2020, at 20:38, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>
> Hi,
>
> Decanter Prometheus exposes the Prometheus servlet. So, it’s not pushing, it’s polling: prometheus polls data from the prometheus servlet exposed by decanter.
> If you want pushing, you can directly push to prometheus backend (but it’s not the prometheus appender).
>
> Regards
> JB
>
>> Le 3 nov. 2020 à 23:53, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>
>> Hi JB.
>> Got things to work by just setting the prefix and making sure everything was lowercase!
>> Next problem is getting the data from the karaf endpoint (decanter/prometheus) to a prometheus server (promeefee:9090/graph)
>> I see nothing in the decanter documentation on prometheus appender for pushing data to a url.
>> Is it assumed that a prometheus server must always pull from the decanter/prometheus endpoint?
>>
>>> On Nov 3, 2020, at 12:51, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>>>
>>> Hi Mark
>>>
>>> 6.8, ok, the tests are using newer version.
>>>
>>> But it should work anyway. I will test it tomorrow.
>>>
>>> Regards
>>> JB
>>>
>>>> Le 3 nov. 2020 à 21:44, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>>>
>>>> Hi JB,
>>>>
>>>> This is the version of the Elastic Search I wish to push to:
>>>>
>>>> {
>>>> "name" : "sitesc104w224m7",
>>>> "cluster_name" : "vela",
>>>> "cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
>>>> "version" : {
>>>> "number" : "6.8.12",
>>>> "build_flavor" : "default",
>>>> "build_type" : "tar",
>>>> "build_hash" : "7a15d2a",
>>>> "build_date" : "2020-08-12T07:27:20.804867Z",
>>>> "build_snapshot" : false,
>>>> "lucene_version" : "7.7.3",
>>>> "minimum_wire_compatibility_version" : "5.6.0",
>>>> "minimum_index_compatibility_version" : "5.0.0"
>>>> },
>>>> "tagline" : "You Know, for Search"
>>>> }
>>>>
>>>>> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>>>>>
>>>>> Hi Mark,
>>>>>
>>>>> What elasticsearch version are you using ?
>>>>>
>>>>> Regards
>>>>> JB
>>>>>
>>>>>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>>>>>
>>>>>> With the following minimal configuration, (just setting the address, authentication, and index prefix) …
>>>>>>
>>>>>> ################################################
>>>>>> # Decanter Elasticsearch Appender Configuration
>>>>>> ################################################
>>>>>>
>>>>>> # HTTP address of the elasticsearch nodes (separated with comma)
>>>>>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>>>>>
>>>>>> # Basic username and password authentication
>>>>>> username=batchoi
>>>>>> password=batchoipwd
>>>>>>
>>>>>> # The index name.
>>>>>> # The index prefix is a static string used to construct the index
>>>>>> index.prefix=karafCamelCWS
>>>>>> # If true, it creates an index per Decanter event day
>>>>>> #index.event.timestamped=true
>>>>>> # For Elasticsearch < 7.5, index type is mandatory (not defined by default)
>>>>>> index.type=
>>>>>>
>>>>>> # Marshaller to use (json is heavily recommended)
>>>>>> marshaller.target=(dataFormat=json)
>>>>>>
>>>>>>
>>>>>> I get this 405 error when i install the elasticsearch appender feature.
>>>>>>
>>>>>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
>>>>>> org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
>>>>>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>>>>>> at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
>>>>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
>>>>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
>>>>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
>>>>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
>>>>>> at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
>>>>>> at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
>>>>>> at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
>>>>>> at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
>>>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
>>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
>>>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
>>>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
>>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>>
>>>>>>
>>>>>> If the HTTP verb could be set to PUT, seems like it might work based on this:
>>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>>>>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
>>>>>>
>>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>>>>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
>>>>>>
>>>>>
>>>>
>>>
>>
>
Re: Kibana (2.5.0) -- ElasticSearch Appender config error
Posted by Jean-Baptiste Onofre <jb...@nanthrax.net>.
Hi,
Decanter Prometheus exposes the Prometheus servlet. So, it’s not pushing, it’s polling: prometheus polls data from the prometheus servlet exposed by decanter.
If you want pushing, you can directly push to prometheus backend (but it’s not the prometheus appender).
Regards
JB
> Le 3 nov. 2020 à 23:53, Mark Bordelon <mb...@savoirtech.com> a écrit :
>
> Hi JB.
> Got things to work by just setting the prefix and making sure everything was lowercase!
> Next problem is getting the data from the karaf endpoint (decanter/prometheus) to a prometheus server (promeefee:9090/graph)
> I see nothing in the decanter documentation on prometheus appender for pushing data to a url.
> Is it assumed that a prometheus server must always pull from the decanter/prometheus endpoint?
>
>> On Nov 3, 2020, at 12:51, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>>
>> Hi Mark
>>
>> 6.8, ok, the tests are using newer version.
>>
>> But it should work anyway. I will test it tomorrow.
>>
>> Regards
>> JB
>>
>>> Le 3 nov. 2020 à 21:44, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>>
>>> Hi JB,
>>>
>>> This is the version of the Elastic Search I wish to push to:
>>>
>>> {
>>> "name" : "sitesc104w224m7",
>>> "cluster_name" : "vela",
>>> "cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
>>> "version" : {
>>> "number" : "6.8.12",
>>> "build_flavor" : "default",
>>> "build_type" : "tar",
>>> "build_hash" : "7a15d2a",
>>> "build_date" : "2020-08-12T07:27:20.804867Z",
>>> "build_snapshot" : false,
>>> "lucene_version" : "7.7.3",
>>> "minimum_wire_compatibility_version" : "5.6.0",
>>> "minimum_index_compatibility_version" : "5.0.0"
>>> },
>>> "tagline" : "You Know, for Search"
>>> }
>>>
>>>> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>>>>
>>>> Hi Mark,
>>>>
>>>> What elasticsearch version are you using ?
>>>>
>>>> Regards
>>>> JB
>>>>
>>>>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>>>>
>>>>> With the following minimal configuration, (just setting the address, authentication, and index prefix) …
>>>>>
>>>>> ################################################
>>>>> # Decanter Elasticsearch Appender Configuration
>>>>> ################################################
>>>>>
>>>>> # HTTP address of the elasticsearch nodes (separated with comma)
>>>>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>>>>
>>>>> # Basic username and password authentication
>>>>> username=batchoi
>>>>> password=batchoipwd
>>>>>
>>>>> # The index name.
>>>>> # The index prefix is a static string used to construct the index
>>>>> index.prefix=karafCamelCWS
>>>>> # If true, it creates an index per Decanter event day
>>>>> #index.event.timestamped=true
>>>>> # For Elasticsearch < 7.5, index type is mandatory (not defined by default)
>>>>> index.type=
>>>>>
>>>>> # Marshaller to use (json is heavily recommended)
>>>>> marshaller.target=(dataFormat=json)
>>>>>
>>>>>
>>>>> I get this 405 error when i install the elasticsearch appender feature.
>>>>>
>>>>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
>>>>> org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
>>>>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>>>>> at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
>>>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
>>>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
>>>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
>>>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
>>>>> at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
>>>>> at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
>>>>> at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
>>>>> at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
>>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
>>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
>>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
>>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
>>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>>
>>>>>
>>>>> If the HTTP verb could be set to PUT, seems like it might work based on this:
>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>>>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
>>>>>
>>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>>>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
>>>>>
>>>>
>>>
>>
>
Re: Kibana (2.5.0) -- ElasticSearch Appender config error
Posted by Mark Bordelon <mb...@savoirtech.com>.
Hi JB.
Got things to work by just setting the prefix and making sure everything was lowercase!
Next problem is getting the data from the karaf endpoint (decanter/prometheus) to a prometheus server (promeefee:9090/graph)
I see nothing in the decanter documentation on prometheus appender for pushing data to a url.
Is it assumed that a prometheus server must always pull from the decanter/prometheus endpoint?
> On Nov 3, 2020, at 12:51, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>
> Hi Mark
>
> 6.8, ok, the tests are using newer version.
>
> But it should work anyway. I will test it tomorrow.
>
> Regards
> JB
>
>> Le 3 nov. 2020 à 21:44, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>
>> Hi JB,
>>
>> This is the version of the Elastic Search I wish to push to:
>>
>> {
>> "name" : "sitesc104w224m7",
>> "cluster_name" : "vela",
>> "cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
>> "version" : {
>> "number" : "6.8.12",
>> "build_flavor" : "default",
>> "build_type" : "tar",
>> "build_hash" : "7a15d2a",
>> "build_date" : "2020-08-12T07:27:20.804867Z",
>> "build_snapshot" : false,
>> "lucene_version" : "7.7.3",
>> "minimum_wire_compatibility_version" : "5.6.0",
>> "minimum_index_compatibility_version" : "5.0.0"
>> },
>> "tagline" : "You Know, for Search"
>> }
>>
>>> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>>>
>>> Hi Mark,
>>>
>>> What elasticsearch version are you using ?
>>>
>>> Regards
>>> JB
>>>
>>>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>>>
>>>> With the following minimal configuration, (just setting the address, authentication, and index prefix) …
>>>>
>>>> ################################################
>>>> # Decanter Elasticsearch Appender Configuration
>>>> ################################################
>>>>
>>>> # HTTP address of the elasticsearch nodes (separated with comma)
>>>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>>>
>>>> # Basic username and password authentication
>>>> username=batchoi
>>>> password=batchoipwd
>>>>
>>>> # The index name.
>>>> # The index prefix is a static string used to construct the index
>>>> index.prefix=karafCamelCWS
>>>> # If true, it creates an index per Decanter event day
>>>> #index.event.timestamped=true
>>>> # For Elasticsearch < 7.5, index type is mandatory (not defined by default)
>>>> index.type=
>>>>
>>>> # Marshaller to use (json is heavily recommended)
>>>> marshaller.target=(dataFormat=json)
>>>>
>>>>
>>>> I get this 405 error when i install the elasticsearch appender feature.
>>>>
>>>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
>>>> org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
>>>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>>>> at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
>>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
>>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
>>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
>>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
>>>> at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
>>>> at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
>>>> at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
>>>> at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
>>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
>>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
>>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
>>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
>>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>>
>>>>
>>>> If the HTTP verb could be set to PUT, seems like it might work based on this:
>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
>>>>
>>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
>>>>
>>>
>>
>
Re: Kibana (2.5.0) -- ElasticSearch Appender config error
Posted by Jean-Baptiste Onofre <jb...@nanthrax.net>.
Hi Mark
6.8, ok, the tests are using newer version.
But it should work anyway. I will test it tomorrow.
Regards
JB
> Le 3 nov. 2020 à 21:44, Mark Bordelon <mb...@savoirtech.com> a écrit :
>
> Hi JB,
>
> This is the version of the Elastic Search I wish to push to:
>
> {
> "name" : "sitesc104w224m7",
> "cluster_name" : "vela",
> "cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
> "version" : {
> "number" : "6.8.12",
> "build_flavor" : "default",
> "build_type" : "tar",
> "build_hash" : "7a15d2a",
> "build_date" : "2020-08-12T07:27:20.804867Z",
> "build_snapshot" : false,
> "lucene_version" : "7.7.3",
> "minimum_wire_compatibility_version" : "5.6.0",
> "minimum_index_compatibility_version" : "5.0.0"
> },
> "tagline" : "You Know, for Search"
> }
>
>> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>>
>> Hi Mark,
>>
>> What elasticsearch version are you using ?
>>
>> Regards
>> JB
>>
>>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>>
>>> With the following minimal configuration, (just setting the address, authentication, and index prefix) …
>>>
>>> ################################################
>>> # Decanter Elasticsearch Appender Configuration
>>> ################################################
>>>
>>> # HTTP address of the elasticsearch nodes (separated with comma)
>>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>>
>>> # Basic username and password authentication
>>> username=batchoi
>>> password=batchoipwd
>>>
>>> # The index name.
>>> # The index prefix is a static string used to construct the index
>>> index.prefix=karafCamelCWS
>>> # If true, it creates an index per Decanter event day
>>> #index.event.timestamped=true
>>> # For Elasticsearch < 7.5, index type is mandatory (not defined by default)
>>> index.type=
>>>
>>> # Marshaller to use (json is heavily recommended)
>>> marshaller.target=(dataFormat=json)
>>>
>>>
>>> I get this 405 error when i install the elasticsearch appender feature.
>>>
>>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
>>> org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
>>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>>> at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
>>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
>>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
>>> at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
>>> at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
>>> at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
>>> at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
>>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
>>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
>>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
>>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
>>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>>
>>>
>>> If the HTTP verb could be set to PUT, seems like it might work based on this:
>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
>>>
>>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
>>>
>>
>
Re: Kibana (2.5.0) -- ElasticSearch Appender config error
Posted by Mark Bordelon <mb...@savoirtech.com>.
Hi JB,
This is the version of the Elastic Search I wish to push to:
{
"name" : "sitesc104w224m7",
"cluster_name" : "vela",
"cluster_uuid" : "fNKKGBcoTJmh42LDDxDkow",
"version" : {
"number" : "6.8.12",
"build_flavor" : "default",
"build_type" : "tar",
"build_hash" : "7a15d2a",
"build_date" : "2020-08-12T07:27:20.804867Z",
"build_snapshot" : false,
"lucene_version" : "7.7.3",
"minimum_wire_compatibility_version" : "5.6.0",
"minimum_index_compatibility_version" : "5.0.0"
},
"tagline" : "You Know, for Search"
}
> On Nov 2, 2020, at 21:17, Jean-Baptiste Onofre <jb...@nanthrax.net> wrote:
>
> Hi Mark,
>
> What elasticsearch version are you using ?
>
> Regards
> JB
>
>> Le 2 nov. 2020 à 22:11, Mark Bordelon <mb...@savoirtech.com> a écrit :
>>
>> With the following minimal configuration, (just setting the address, authentication, and index prefix) …
>>
>> ################################################
>> # Decanter Elasticsearch Appender Configuration
>> ################################################
>>
>> # HTTP address of the elasticsearch nodes (separated with comma)
>> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>>
>> # Basic username and password authentication
>> username=batchoi
>> password=batchoipwd
>>
>> # The index name.
>> # The index prefix is a static string used to construct the index
>> index.prefix=karafCamelCWS
>> # If true, it creates an index per Decanter event day
>> #index.event.timestamped=true
>> # For Elasticsearch < 7.5, index type is mandatory (not defined by default)
>> index.type=
>>
>> # Marshaller to use (json is heavily recommended)
>> marshaller.target=(dataFormat=json)
>>
>>
>> I get this 405 error when i install the elasticsearch appender feature.
>>
>> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
>> org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
>> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
>> at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
>> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
>> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
>> at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
>> at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
>> at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
>> at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
>> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
>> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>>
>>
>> If the HTTP verb could be set to PUT, seems like it might work based on this:
>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
>>
>> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
>> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
>> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
>>
>
Re: Kibana (2.5.0) -- ElasticSearch Appender config error
Posted by Jean-Baptiste Onofre <jb...@nanthrax.net>.
Hi Mark,
What elasticsearch version are you using ?
Regards
JB
> Le 2 nov. 2020 à 22:11, Mark Bordelon <mb...@savoirtech.com> a écrit :
>
> With the following minimal configuration, (just setting the address, authentication, and index prefix) …
>
> ################################################
> # Decanter Elasticsearch Appender Configuration
> ################################################
>
> # HTTP address of the elasticsearch nodes (separated with comma)
> addresses=http://elasticsearch-vela-1.sit.etrade.com:9200 <http://elasticsearch-vela-1.sit.etrade.com:9200/>
>
> # Basic username and password authentication
> username=batchoi
> password=batchoipwd
>
> # The index name.
> # The index prefix is a static string used to construct the index
> index.prefix=karafCamelCWS
> # If true, it creates an index per Decanter event day
> #index.event.timestamped=true
> # For Elasticsearch < 7.5, index type is mandatory (not defined by default)
> index.type=
>
> # Marshaller to use (json is heavily recommended)
> marshaller.target=(dataFormat=json)
>
>
> I get this 405 error when i install the elasticsearch appender feature.
>
> 2020-11-02T15:32:15,870 | WARN | EventAdminAsyncThread #23 | ElasticsearchAppender | 188 - org.apache.karaf.decanter.appender.elasticsearch - 2.5.0 | Can't append into Elasticsearch
> org.elasticsearch.client.ResponseException: method [POST], host [http://elasticsearch-vela-1.sit.etrade.com:9200], URI [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed <http://elasticsearch-vela-1.sit.etrade.com:9200], uri [/karafCamelCWS-2020.11.02/], status line [HTTP/1.1 405 Method Not Allowed>]
> {"error":"Incorrect HTTP method for uri [/karafCamelCWS-2020.11.02/] and method [POST], allowed: [HEAD, GET, PUT, DELETE]","status":405}
> at org.elasticsearch.client.RestClient.convertResponse(RestClient.java:283) ~[!/:?]
> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:261) ~[!/:?]
> at org.elasticsearch.client.RestClient.performRequest(RestClient.java:235) ~[!/:?]
> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.send(ElasticsearchAppender.java:172) ~[!/:?]
> at org.apache.karaf.decanter.appender.elasticsearch.ElasticsearchAppender.handleEvent(ElasticsearchAppender.java:152) [!/:?]
> at org.apache.felix.eventadmin.impl.handler.EventHandlerProxy.sendEvent(EventHandlerProxy.java:415) [!/:?]
> at org.apache.felix.eventadmin.impl.tasks.HandlerTask.runWithoutBlacklistTiming(HandlerTask.java:82) [!/:?]
> at org.apache.felix.eventadmin.impl.tasks.SyncDeliverTasks.execute(SyncDeliverTasks.java:104) [!/:?]
> at org.apache.felix.eventadmin.impl.tasks.AsyncDeliverTasks$TaskExecuter.run(AsyncDeliverTasks.java:166) [!/:?]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) [?:1.8.0_51]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_51]
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [?:1.8.0_51]
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [?:1.8.0_51]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_51]
>
>
> If the HTTP verb could be set to PUT, seems like it might work based on this:
> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
> -XPOST "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
> {"error":"Incorrect HTTP method for uri [/] and method [POST], allowed: [HEAD, GET, DELETE]","status":405}
>
> curl -H "Content-Type: application/json" --user batchoi:batchoipwd \
> -XPUT "http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws <http://elasticsearch-vela-1.sit.etrade.com:9200/karafCamelCws>" -d ‘{ "field" : "value"}’
> {"error":{"root_cause":[{"type":"remote_transport_exception","reason":"[sitesm111w88m7][10.247.33.25:9300][indices:admin/create]"}],"type":"illegal_argument_exception","reason":"unknown setting [index.field] please check that any required plugins are installed, or check the breaking changes documentation for removed settings"},"status":400}
>