[GitHub] [nifi] davis-anthony commented on pull request #6903: NIFI-11111 add option to output Elasticsearch error responses as FlowFile to PutElasticsearchJson and PutElasticsearchRecord

["davis-anthony (via GitHub)" <gi...@apache.org>]

davis-anthony commented on PR #6903:
URL: https://github.com/apache/nifi/pull/6903#issuecomment-1513872398

   I've been struggling with the various PutElasticsearch processors and their different handling of responses/errors for a while now, and nothing really does what I would expect it to do.
   
   The only one that kind of works is PutElasticsearchHttp because at least that one places the "reason" attribute on the flowfile, but it doesn't handle all types of errors and it makes a bunch of assumptions as to what is retryable.
   
   What I really need is for the original documents that fail on a bulk index/create to be routed to failure or error and have the error message and status code added as flowfile attributes.  This would enable custom routing logic based on status code and/or error message.  I can't tell if that's what this PR is attempting to do.  Is that what this PR does or should I post a new feature request for this?
   
   If it's just sending the error response documents as separate flowfiles I can see how some developers might find that useful, but it doesn't really help with rerouting the original document and providing error information.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscribe@nifi.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org