You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@nifi.apache.org by pvillard31 <gi...@git.apache.org> on 2018/11/08 11:44:38 UTC

[GitHub] nifi issue #3159: NIFI-5794 Allow empty string demarcator in Consume/Publish...

Github user pvillard31 commented on the issue:

    https://github.com/apache/nifi/pull/3159
  
    In the end, I only changed the ConsumeKafka processors since it does not make sense in PublishKafka (one would just have to not set any demarcator to get the same result: all messages in the flow files are sent as one single message in Kafka). The main interest of this PR is to increase efficiency when we consume Avro data from Kafka: there is no need to set a demarcator and we do want to have multiples messages in the same flow file. I've used this [template](https://gist.github.com/pvillard31/57e627d206e7965cfb87cc27c09caf44) to test the change and to confirm the behavior: when pulling Avro data from Kafka with "empty string" as demarcator to have multiple messages in the same flow file, we are able to process the records in the next processor using a ConvertRecord for instance.


---