[GitHub] [druid] mounikanakkala opened a new issue #10521: Druid Lookups Auditing

[GitBox <gi...@apache.org>]

mounikanakkala opened a new issue #10521:
URL: https://github.com/apache/druid/issues/10521


   Hello Everyone,
   
   We have lookups being updated once in 4 hours to Druid sending POST request for Update, whose size goes up to 50 MB. We are not adding extra set of 50 MB sized lookups in every run. Rather, we may end up updating the same lookup in every run. We do this periodically so that the list is most recent.
   We have observed that every time there is an update, Druid audits those entries in druid_audit metadata table.
   
   1. Are those audits of any significance to Druid? Especially the ones which are older than recent n entries, say n = 4 ?
   If we are updating 50 MB worth data once in 4 hours, that metadata would become GBs in few days. We want to prune this audit.
   2. Is there a possibility of adding a config to not audit lookups so that this config would automatically not add in the audit table?
   
   Please let us know if you need additional information. Thank you for your time.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org

[GitHub] [druid] FrankChen021 commented on issue #10521: Druid Lookups Auditing

[GitBox <gi...@apache.org>]

FrankChen021 commented on issue #10521:
URL: https://github.com/apache/druid/issues/10521#issuecomment-713458282


   AFAIK, there's no such config to suppress audit log. I think currently you have to delete these logs by some code executing a delete sql periodically.
   
   I don't know the background of audit function. I guess Druid keeps these configuration in audit log in case of rolling back of a previous configuration.  @gianm could you give us more info about it ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org