[airflow] branch main updated: Upper-bind elasticearch integration (#31255)

[po...@apache.org]

This is an automated email from the ASF dual-hosted git repository.

potiuk pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
     new 761c0da723 Upper-bind elasticearch integration (#31255)
761c0da723 is described below

commit 761c0da723799c3c37d9eb2cadaa9c4fa256d13a
Author: Jarek Potiuk <ja...@potiuk.com>
AuthorDate: Fri May 12 21:24:57 2023 +0200

    Upper-bind elasticearch integration (#31255)
    
    * Upper-bind elasticearch integration
    
    During bumping the dependencies of Google Provider we found out
    that elasticsearch >= 7.15.0 (which we never tested before because
    of other constraints) breaks our tests. Since there is an 8 version
    of eleastic search available as of 2021, we should - rather than
    solve the tests in 7, likely migrate to version 8, which should
    likely involve getting rid of elastisearch-dsl, because it has
    limitations of elasticsearch <8.
    
    * Update airflow/providers/elasticsearch/provider.yaml
    
    Co-authored-by: Jed Cunningham <66...@users.noreply.github.com>
    
    ---------
    
    Co-authored-by: Jed Cunningham <66...@users.noreply.github.com>
---
 airflow/providers/elasticsearch/provider.yaml | 7 ++++++-
 generated/provider_dependencies.json          | 2 +-
 2 files changed, 7 insertions(+), 2 deletions(-)

diff --git a/airflow/providers/elasticsearch/provider.yaml b/airflow/providers/elasticsearch/provider.yaml
index 9493ae7000..05a9acda56 100644
--- a/airflow/providers/elasticsearch/provider.yaml
+++ b/airflow/providers/elasticsearch/provider.yaml
@@ -50,7 +50,12 @@ versions:
 dependencies:
   - apache-airflow>=2.4.0
   - apache-airflow-providers-common-sql>=1.3.1
-  - elasticsearch>7
+  # We cannot use elasticsearch 8 yet. The elasticsearch-dsl is not compatible with it.
+  # elasticsearch>=7.15.0 breaks our tests.The eleasticsearch 7 is an old version that is not
+  # supported anymore. We should move to elasticsearch 8 as
+  # likely requires getting rid of elasticsearch-dsl or waiting until there is a compatible version
+  # We can also try to replace the <7.15.0 with <8.0.0 but we need to solve the test failures first
+  - elasticsearch>7,<7.15.0
   - elasticsearch-dbapi
   - elasticsearch-dsl>=5.0.0
 
diff --git a/generated/provider_dependencies.json b/generated/provider_dependencies.json
index d576dc9078..9777e3bfa1 100644
--- a/generated/provider_dependencies.json
+++ b/generated/provider_dependencies.json
@@ -296,7 +296,7 @@
       "apache-airflow>=2.4.0",
       "elasticsearch-dbapi",
       "elasticsearch-dsl>=5.0.0",
-      "elasticsearch>7"
+      "elasticsearch>7,<7.15.0"
     ],
     "cross-providers-deps": [
       "common.sql"