[GitHub] [samza] lakshmi-manasa-g commented on pull request #1364: AzureBlobSystemProducer: Enable adding of number of records in blob as metadata of the blob

[GitBox <gi...@apache.org>]

lakshmi-manasa-g commented on pull request #1364:
URL: https://github.com/apache/samza/pull/1364#issuecomment-631523597


   yes, generator may have additional metadata.
    it is for two reasons that it was designed this way.
   
   1. to let users have full control over what their k-v pairs should look like - we only give the value but the key is decided by the users (aka generator). For example the streamName maybe used to form a k-v pair: "table":"_source_streamName_table" to help with ingestion.
   
   2. to let users add more k-v pairs if they need to. for example, "dataFormat":"avro" for which users do not need an input from the system producer


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org