[jira] [Commented] (UNOMI-70) Upgrade to ElasticSearch 5.x

["Serge Huber (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/UNOMI-70?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15721831#comment-15721831 ] 

Serge Huber commented on UNOMI-70:
----------------------------------

I created a new feature branch : feature-UNOMI-70-ES5X and created a pull request : 

https://github.com/apache/incubator-unomi/pull/21

This PR contains the following changes : 
- Upgrade to ElasticSearch 5.0.1
- ElasticSearch is no longer embedded in Unomi but used as an external service
- Upgrade to Apache CXF 3.0.2
- Upgrade to Apache Karaf 3.0.8
- Package Apache Karaf Cellar 3.0.3

All these upgrades were necessary to make ES 5.X work, for example:
- Karaf Cellar is used to replace the Unomi clustering functionality that was built on ElasticSearch and that was relying on the fact that ES was being embedded
- ElasticSearch embedding is no longer supported by Elastic, so we've now moved it out of Apache Unomi and use is as a remote external service just in the same way we would do with a database.
- Mappings had to change because in ES 5.x the type "string" has been replace by two types : "text" and "keyword". As the "text" type doesn't support aggregation we used "keyword" for most of the mappings, and had to add quite a few to make sure everything works correctly. Maybe we also need to improve the dynamic templates to make sure that everything is properly mapped.

There are still some known issues to work out : 
- Some features don't seem to work yet (some loading / saving issues)
- Integration tests and performance tests don't work yet
- Migration path hasn't been tested yet.

> Upgrade to ElasticSearch 5.x
> ----------------------------
>
>                 Key: UNOMI-70
>                 URL: https://issues.apache.org/jira/browse/UNOMI-70
>             Project: Apache Unomi
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 1.2.0-incubating
>            Reporter: Serge Huber
>            Assignee: Serge Huber
>             Fix For: 1.2.0-incubating
>
>
> I've started work on migrating Apache Unomi to ElasticSearch 5.x, along with the "externalization" of the ElasticSearch server. 
> Until now we have been embedding the ES server, but as this is no longer supported by Elastic (see https://www.elastic.co/blog/elasticsearch-the-server), and also because it is interesting to free up Unomi's JVM from ES work, my work will also modify the clustering implementation to use Karaf Cellar instead of depending on ES' clustering.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)