You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by GitBox <gi...@apache.org> on 2021/01/27 16:00:17 UTC

[GitHub] [hudi] christoph-wmt commented on issue #2423: Performance Issues due to significant Parallel Create-Dir being issued to Azure ADLS_V2

christoph-wmt commented on issue #2423:
URL: https://github.com/apache/hudi/issues/2423#issuecomment-768386541


   @bvaradar while this one code path already has made a huge difference I think it's worth approaching this elsewhere aswell.
   We've observed: if successful (on average) ~2200ms (CreatePathDir) VS ~70ms (GetFileProperties) for ADLS / Azure.  
   So making this configurable and minimizing create operations as much as possible would be huge for Azure users. 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org