[jira] [Created] (BEAM-11276) Write with custom indexName and docId not present in document itself

["Lionel Setan (Jira)" <ji...@apache.org>]

Lionel Setan created BEAM-11276:
-----------------------------------

             Summary: Write with custom indexName and docId not present in document itself
                 Key: BEAM-11276
                 URL: https://issues.apache.org/jira/browse/BEAM-11276
             Project: Beam
          Issue Type: Wish
          Components: io-java-elasticsearch
    Affects Versions: 2.25.0
         Environment: Java, Google Dataflow
            Reporter: Lionel Setan


ElasticIO connector write method is taking currently as input a "PCollection<String>" element ; string value will be passed as ElasticSearch document body. With methods withIdFn, and withIndexFn, we can overload Elastic document id and index name at runtime.

There is some kind of situation where indexName and/or docId are not present in document itself (for example from Google Pubsub metadata or other).

Is there a way to implement this usecase with current ElasticIO ? Otherwise, if it makes sense for you, what kind of improvment can be performed on connector ?



--
This message was sent by Atlassian Jira
(v8.3.4#803005)