You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@camel.apache.org by "Ahmed M (Jira)" <ji...@apache.org> on 2020/07/25 17:32:00 UTC
[jira] [Commented] (CAMEL-14237) camel-elasticsearch-rest: Index,
BulkIndex, Bulk operations not working in Spring Boot
[ https://issues.apache.org/jira/browse/CAMEL-14237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17165078#comment-17165078 ]
Ahmed M commented on CAMEL-14237:
---------------------------------
Can't reproduce this with *camel 3.4.1* and spring-boot *2.3.2.RELEASE*
[Spring boot upgraded to Elastic 7.6 in 2.3.0.RELEASE|https://spring.io/blog/2020/05/15/spring-boot-2-3-0-available-now]
[INFO] +- org.apache.camel.springboot:camel-elasticsearch-rest-starter:jar:*3.4.1*:compile
[INFO] | - org.apache.camel:camel-elasticsearch-rest:jar:3.4.1:compile
[INFO] | +- org.elasticsearch.client:elasticsearch-rest-high-level-client:jar:*7.6.2*:compile
[INFO] | | +- org.elasticsearch:elasticsearch:jar:7.6.2:compile
[INFO] | | | +- org.elasticsearch:elasticsearch-core:jar:7.6.2:compile
[INFO] | | | +- org.elasticsearch:elasticsearch-secure-sm:jar:7.6.2:compile
[INFO] | | | +- org.elasticsearch:elasticsearch-x-content:jar:7.6.2:compile
[INFO] | | | | +- com.fasterxml.jackson.dataformat:jackson-dataformat-smile:jar:2.11.1:compile
[INFO] | | | | +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.11.1:compile
[INFO] | | | | - com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.11.1:compile
[INFO] | | | +- org.elasticsearch:elasticsearch-geo:jar:7.6.2:compile
[INFO] | | | +- org.apache.lucene:lucene-core:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-analyzers-common:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-backward-codecs:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-grouping:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-highlighter:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-join:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-memory:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-misc:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-queries:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-queryparser:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-sandbox:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-spatial:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-spatial-extras:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-spatial3d:jar:8.4.0:compile
[INFO] | | | +- org.apache.lucene:lucene-suggest:jar:8.4.0:compile
[INFO] | | | +- org.elasticsearch:elasticsearch-cli:jar:7.6.2:compile
[INFO] | | | | - net.sf.jopt-simple:jopt-simple:jar:5.0.2:compile
[INFO] | | | +- com.carrotsearch:hppc:jar:0.8.1:compile
[INFO] | | | +- joda-time:joda-time:jar:2.10.4:compile
[INFO] | | | +- com.tdunning:t-digest:jar:3.2:compile
[INFO] | | | - org.elasticsearch:jna:jar:4.5.1:compile
[INFO] | | +- org.elasticsearch.client:elasticsearch-rest-client:jar:7.6.2:compile
[INFO] | | | +- org.apache.httpcomponents:httpasyncclient:jar:4.1.4:compile
[INFO] | | | - org.apache.httpcomponents:httpcore-nio:jar:4.4.13:compile
[INFO] | | +- org.elasticsearch.plugin:mapper-extras-client:jar:7.6.2:compile
[INFO] | | +- org.elasticsearch.plugin:parent-join-client:jar:7.6.2:compile
[INFO] | | +- org.elasticsearch.plugin:aggs-matrix-stats-client:jar:7.6.2:compile
[INFO] | | +- org.elasticsearch.plugin:rank-eval-client:jar:7.6.2:compile
[INFO] | | - org.elasticsearch.plugin:lang-mustache-client:jar:7.6.2:compile
[INFO] | | - com.github.spullara.mustache.java:compiler:jar:0.9.6:compile
[INFO] | - org.elasticsearch.client:elasticsearch-rest-client-sniffer:jar:*7.7.0:*compile
[INFO] | +- org.apache.httpcomponents:httpclient:jar:4.5.12:compile
[INFO] | +- org.apache.httpcomponents:httpcore:jar:4.4.13:compile
[INFO] | - commons-codec:commons-codec:jar:1.14:compile
> camel-elasticsearch-rest: Index, BulkIndex, Bulk operations not working in Spring Boot
> --------------------------------------------------------------------------------------
>
> Key: CAMEL-14237
> URL: https://issues.apache.org/jira/browse/CAMEL-14237
> Project: Camel
> Issue Type: Bug
> Affects Versions: 3.0.0.RC1, 3.0.0.RC2, 3.0.0.RC3, 3.0.0
> Reporter: Jan Bednar
> Priority: Minor
>
> All write operations fails with
> {noformat}
> org.elasticsearch.action.ActionRequestValidationException: Validation Failed: 1: type is missing;{noformat}
> The issue here is we have upgraded dependencies to 7.3.2 to support elastic 7 (indexType was removed in Elastic 7), but somehow starter is packaged with 6.8.4 dependencies, so the request validation fails. Not sure how this could happen, all poms seems to be fine
> Using plain camel-elasticsearch-rest dependency instead of starter does not help, because elasticsearch.client versions are somewhere overriden (probably by camel-spring-boot-dependencies)
> The only way I was able to make this component work was by overriding elastic dependency versions in my pom ( [https://github.com/bedlaj/camel3-elastic-sb-workaround/blob/master/pom.xml#L91] ):
>
> {noformat}
> <dependency>
> <groupId>org.elasticsearch</groupId>
> <artifactId>elasticsearch</artifactId>
> <version>7.3.2</version>
> </dependency>
> <dependency>
> <groupId>org.elasticsearch.client</groupId>
> <artifactId>elasticsearch-rest-high-level-client</artifactId>
> <version>7.3.2</version>
> </dependency>
> <dependency>
> <groupId>org.elasticsearch.client</groupId>
> <artifactId>elasticsearch-rest-client</artifactId>
> <version>7.3.2</version>
> </dependency>{noformat}
> Reproducer project can be found here [https://github.com/bedlaj/camel3-elastic-sb-workaround/blob/master/pom.xml#L91]
> Remove workaround in pom.xml on lines 75-88 and 91-105 to see this bug in action.
> *mvn dependency:tree* on current camel master shows this:
> {code:java}
> maven-dependency-plugin:3.1.1:tree[m [1m(default-cli)[m @ [36mcamel-elasticsearch-rest-starter[0;1m ---[m
> org.apache.camel.springboot:camel-elasticsearch-rest-starter:jar:3.1.0-SNAPSHOT
> +- org.springframework.boot:spring-boot-starter:jar:2.2.1.RELEASE:compile
> | +- org.springframework.boot:spring-boot-starter-logging:jar:2.2.1.RELEASE:compile
> | | +- ch.qos.logback:logback-classic:jar:1.2.3:compile
> | | | \- ch.qos.logback:logback-core:jar:1.2.3:compile
> | | +- org.apache.logging.log4j:log4j-to-slf4j:jar:2.12.1:compile
> | | | \- org.apache.logging.log4j:log4j-api:jar:2.12.1:compile
> | | \- org.slf4j:jul-to-slf4j:jar:1.7.29:compile
> | +- jakarta.annotation:jakarta.annotation-api:jar:1.3.5:compile
> | +- org.springframework:spring-core:jar:5.2.1.RELEASE:compile
> | | \- org.springframework:spring-jcl:jar:5.2.1.RELEASE:compile
> | \- org.yaml:snakeyaml:jar:1.25:compile
> +- org.apache.camel:camel-elasticsearch-rest:jar:3.1.0-SNAPSHOT:compile
> | +- org.apache.camel:camel-support:jar:3.1.0-SNAPSHOT:compile
> | | +- org.apache.camel:camel-api:jar:3.1.0-SNAPSHOT:compile
> | | +- org.apache.camel:camel-management-api:jar:3.1.0-SNAPSHOT:compile
> | | +- org.apache.camel:camel-util:jar:3.1.0-SNAPSHOT:compile
> | | +- org.apache.camel:camel-util-json:jar:3.1.0-SNAPSHOT:compile
> | | \- org.slf4j:slf4j-api:jar:1.7.29:compile
> | +- org.elasticsearch.client:elasticsearch-rest-high-level-client:jar:6.8.4:compile
> | | +- org.elasticsearch:elasticsearch:jar:6.8.4:compile
> | | | +- org.elasticsearch:elasticsearch-core:jar:6.8.4:compile
> | | | +- org.elasticsearch:elasticsearch-secure-sm:jar:6.8.4:compile
> | | | +- org.elasticsearch:elasticsearch-x-content:jar:6.8.4:compile
> | | | | +- com.fasterxml.jackson.dataformat:jackson-dataformat-smile:jar:2.10.1:compile
> | | | | +- com.fasterxml.jackson.dataformat:jackson-dataformat-yaml:jar:2.10.1:compile
> | | | | \- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.10.1:compile
> | | | +- org.apache.lucene:lucene-core:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-analyzers-common:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-backward-codecs:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-grouping:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-highlighter:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-join:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-memory:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-misc:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-queries:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-queryparser:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-sandbox:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-spatial:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-spatial-extras:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-spatial3d:jar:7.7.2:compile
> | | | +- org.apache.lucene:lucene-suggest:jar:7.7.2:compile
> | | | +- org.elasticsearch:elasticsearch-cli:jar:6.8.4:compile
> | | | | \- net.sf.jopt-simple:jopt-simple:jar:5.0.2:compile
> | | | +- com.carrotsearch:hppc:jar:0.7.1:compile
> | | | +- joda-time:joda-time:jar:2.10.5:compile
> | | | +- com.tdunning:t-digest:jar:3.2:compile
> | | | +- org.hdrhistogram:HdrHistogram:jar:2.1.9:compile
> | | | \- org.elasticsearch:jna:jar:4.5.1:compile
> | | +- org.elasticsearch.client:elasticsearch-rest-client:jar:6.8.4:compile
> | | | +- org.apache.httpcomponents:httpasyncclient:jar:4.1.4:compile
> | | | \- org.apache.httpcomponents:httpcore-nio:jar:4.4.12:compile
> | | +- org.elasticsearch.plugin:parent-join-client:jar:6.8.4:compile
> | | +- org.elasticsearch.plugin:aggs-matrix-stats-client:jar:6.8.4:compile
> | | +- org.elasticsearch.plugin:rank-eval-client:jar:6.8.4:compile
> | | \- org.elasticsearch.plugin:lang-mustache-client:jar:6.8.4:compile
> | | \- com.github.spullara.mustache.java:compiler:jar:0.9.3:compile
> | +- org.elasticsearch.client:elasticsearch-rest-client-sniffer:jar:7.3.2:compile
> | | +- org.apache.httpcomponents:httpclient:jar:4.5.10:compile
> | | +- org.apache.httpcomponents:httpcore:jar:4.4.12:compile
> | | +- commons-codec:commons-codec:jar:1.13:compile
> | | \- com.fasterxml.jackson.core:jackson-core:jar:2.10.1:compile
> | \- com.fasterxml.jackson.core:jackson-databind:jar:2.10.1:compile
> | \- com.fasterxml.jackson.core:jackson-annotations:jar:2.10.1:compile
> ...
> {code}
> Currently this component cannot be used with ES6, because we have removed indexType option in CAMEL-13767. Also cannot be used with ES7, because old client validates indexType, which was removed.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)