[GitHub] [incubator-pinot] MrNeocore edited a comment on issue #7090: SegmentNameGenerator: Extend interface to accept input file name

[GitBox <gi...@apache.org>]

MrNeocore edited a comment on issue #7090:
URL: https://github.com/apache/incubator-pinot/issues/7090#issuecomment-877809869


   @kkrugler As a user, this idea seems interesting and pretty flexible :) Then, as you suggested, it would seem possible to add more advanced parsing to extend that feature further down the line.
   
   FYI, the way I 'solved' this for now is by using the `fixed` strategy in conjunction with custom job spec templating.
   But this adds business-level complexity and implies to run an ingestion job for every single segment, leading to slower ingestion in case of many segments.
   (Idea suggested by @Jackie-Jiang)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@pinot.apache.org
For additional commands, e-mail: commits-help@pinot.apache.org