[GitHub] snleee removed a comment on issue #3515: DATETIMECONVERT udf conversion to Simple_Date_Format are 50x slower than conversion to epoch time

[GitBox <gi...@apache.org>]

snleee removed a comment on issue #3515:  DATETIMECONVERT udf conversion to Simple_Date_Format are 50x slower than conversion to epoch time
URL: https://github.com/apache/incubator-pinot/issues/3515#issuecomment-440394158
 
 
   If the raw data is stored as SDF (string), then we cannot do any better. If the raw data is stored as epoch and time conversion is to SDF, we can use epoch to epoch conversion on the server side and compute SDF on the broker side for the final result (similar to what @Jackie-Jiang mentioned but time conversion happens in the broker instead of client). 
   
   However, this will require Pinot to run different UDF on server/broker side from the same UDF definition and require . This feature is a good candidate for performance optimization. But for now, I would also recommend @Jackie-Jiang's approach for your query.
   
   @npawar Can you briefly look at the scope of this change

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@pinot.apache.org
For additional commands, e-mail: dev-help@pinot.apache.org