[GitHub] [airflow] antonio-antuan commented on issue #29841: high memory leak, cannot start even webserver

["antonio-antuan (via GitHub)" <gi...@apache.org>]

antonio-antuan commented on issue #29841:
URL: https://github.com/apache/airflow/issues/29841#issuecomment-1450419914

   ok, clarified
   
   this is the place where things happens: site-packages/daemon/daemon.py:868
   
   ```
   def get_maximum_file_descriptors():
       """ Get the maximum number of open file descriptors for this process.
   
           :return: The number (integer) to use as the maximum number of open
               files for this process.
   
           The maximum is the process hard resource limit of maximum number of
           open file descriptors. If the limit is “infinity”, a default value
           of ``MAXFD`` is returned.
           """
       (__, hard_limit) = resource.getrlimit(resource.RLIMIT_NOFILE)
   
       result = hard_limit
       if hard_limit == resource.RLIM_INFINITY:
           result = MAXFD
   
       return result
   
   
   _total_file_descriptor_range = (0, get_maximum_file_descriptors())
   _total_file_descriptor_set = set(range(*_total_file_descriptor_range))
   ```
   
   apache/airflow:2.3.1 (and above I think) doesn't have this version of library so nothing happens during initialization.
   I'd like to suggest better ulimits for image


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org