[GitHub] [pinot] snleee commented on issue #8886: Add support for skipping/defaulting columns during managed offline flow rollup/dedup process

[GitBox <gi...@apache.org>]

snleee commented on issue #8886:
URL: https://github.com/apache/pinot/issues/8886#issuecomment-1154407952

   - I think that we need to add the transformation function support on `SegmentProcessorFramework`. We can do sth similar to the ingestion config. Currently, map phase hardcodes to initialize the default composite transformer.
   - On the merge/roll-up task level, we need to decide whether we want to expose the entire transformation layer or we just want to expose the config to skip columns to satisfy this requirement.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org