[GitHub] [hive] deniskuzZ edited a comment on pull request #2915: HIVE-25842: Reimplement delta file metric collection

[GitBox <gi...@apache.org>]

deniskuzZ edited a comment on pull request #2915:
URL: https://github.com/apache/hive/pull/2915#issuecomment-1009723611


   Per design doc:
   ````
   Since we do not want to access the FileSystem in a new separate MetricsSystem, this only can be collected at points where we already list the table/partition directory content. 
   One way would be to use Initiator / Cleaner for this purpose, but that won’t be available in DWX for default DBC-s. 
   The best option seems to be the AcidUtils.getAcidState call, which is called by every read query (In TEZ AM).
   ````
   The idea was not to add extra overhead with the metrics activation. 
   - Are we addressing these concerns here? 
   - How do we handle default DBC-s on DWX with disabled Cleaner and Initiator?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: gitbox-unsubscribe@hive.apache.org
For additional commands, e-mail: gitbox-help@hive.apache.org