You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "Alexey Kudinkin (Jira)" <ji...@apache.org> on 2021/11/30 19:03:00 UTC

[jira] [Created] (HUDI-2895) Evaluate `BoundedInMemoryExecutor` to be rebased onto FJP

Alexey Kudinkin created HUDI-2895:
-------------------------------------

             Summary: Evaluate `BoundedInMemoryExecutor` to be rebased onto FJP
                 Key: HUDI-2895
                 URL: https://issues.apache.org/jira/browse/HUDI-2895
             Project: Apache Hudi
          Issue Type: Bug
          Components: Writer Core
            Reporter: Alexey Kudinkin


Currently, it's relying on (fixed-size) `ThreadPoolExecutor`, that internally leverages BlockingQueue.

In contrast FJP is a "practically" lock-free (locks are taken only when creating new queues, insertion/polling from Qs is lock-free) implementation that is known to outperform all other JDK's Executors implementations.

 

NOTE: We should take this on after migrating to at least Java 11, since Java 8 FJP is known to have issues of rogue-threads getting into eternal spin-lock.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)