[GitHub] [samza] atoomula opened a new pull request #1233: SAMZA-2415: Fix AvroRelConverter to only consider cached schema while populating SamzaSqlRelRecord for all the nested records.

[GitBox <gi...@apache.org>]

atoomula opened a new pull request #1233: SAMZA-2415: Fix AvroRelConverter to only consider cached schema while populating SamzaSqlRelRecord for all the nested records.
URL: https://github.com/apache/samza/pull/1233
 
 
   Currently, relRecord is populated with cached schema only at the top-level fields while the nested fields are populated with the schema of the incoming record. This ticket is to fix that inconsistency and always consider cached schema (schema that is fetched when the job starts).
   
   As a by-product of considering only cached schema, Sql job will keep running even though the input schema has evolved, let's say a new field is added. We will keep dropping the new field. As a separate effort, we need to consider adding metrics to flag whenever we detect that the input schema has evolved.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services