Need Support for ElasticSearch 7.x for beam

[Mohil Khare <mo...@prosimo.io>]

Hello,

Firstly I am on java sdk 2.23.0 and we heavily use Elasticsearch as one of
our sinks.

It's been a while since beam got upgraded to support elasticsearch version
greater than 6.x.
Elasticsearch has now moved on to 7.x and we want to use some of their new
security features.

I want to know which version of beam will support elasticsearch version 7.x.
I see the following commit, but it looks like it hasn't been merged with
master yet.

https://github.com/apache/beam/pull/10023


Thanks and regards
Mohil

Re: Need Support for ElasticSearch 7.x for beam

[Mohil Khare <mo...@prosimo.io>]

hello Kyle,

Thanks a lot for your prompt reply. Hmm.. strange, I think I was getting
some error that version was not supported. Not sure if I updated my beam
version last time when I tried with ES 7.x.
Let me try it again and let you know.

Thanks and Regards
Mohil

On Mon, Aug 24, 2020 at 11:54 AM Kyle Weaver <kc...@google.com> wrote:

> This ticket indicates Elasticsearch 7.x has been supported since Beam
> 2.19: https://issues.apache.org/jira/browse/BEAM-5192
>
> Are there any specific features you need that aren't supported?
>
> On Mon, Aug 24, 2020 at 11:33 AM Mohil Khare <mo...@prosimo.io> wrote:
>
>> Hello,
>>
>> Firstly I am on java sdk 2.23.0 and we heavily use Elasticsearch as one
>> of our sinks.
>>
>> It's been a while since beam got upgraded to support elasticsearch
>> version greater than 6.x.
>> Elasticsearch has now moved on to 7.x and we want to use some of their
>> new security features.
>>
>> I want to know which version of beam will support elasticsearch version
>> 7.x.
>> I see the following commit, but it looks like it hasn't been merged with
>> master yet.
>>
>> https://github.com/apache/beam/pull/10023
>>
>>
>> Thanks and regards
>> Mohil
>>
>>
>>
>>

Re: Need Support for ElasticSearch 7.x for beam

[Kyle Weaver <kc...@google.com>]

This ticket indicates Elasticsearch 7.x has been supported since Beam 2.19:
https://issues.apache.org/jira/browse/BEAM-5192

Are there any specific features you need that aren't supported?

On Mon, Aug 24, 2020 at 11:33 AM Mohil Khare <mo...@prosimo.io> wrote:

> Hello,
>
> Firstly I am on java sdk 2.23.0 and we heavily use Elasticsearch as one of
> our sinks.
>
> It's been a while since beam got upgraded to support elasticsearch version
> greater than 6.x.
> Elasticsearch has now moved on to 7.x and we want to use some of their new
> security features.
>
> I want to know which version of beam will support elasticsearch version
> 7.x.
> I see the following commit, but it looks like it hasn't been merged with
> master yet.
>
> https://github.com/apache/beam/pull/10023
>
>
> Thanks and regards
> Mohil
>
>
>
>