[GitHub] [datasketches-java] leerho commented on issue #398: [UpdateDoublesSketch] More heap allocation than `0.8.3`

[GitBox <gi...@apache.org>]

leerho commented on issue #398:
URL: https://github.com/apache/datasketches-java/issues/398#issuecomment-1151490051

   I'm not clean about exactly what metric you need to optimize for:  
   
   - Are you concerned about overall heap allocation size per sketch -- and in what state?: live, i.e., updatable, or in a more compact form and not updatable.  (The 0.8.3 version did not have a compact form, newer versions do).
   - Or are you concerned about heap allocation churn -- i.e., as the sketch is being updated, how much memory is constantly being allocated and then released (This is handled by the G.C. Eden space)
   
   If your concern is about heap allocation size per sketch, then I suggest that you consider the newer KLL sketch which is considerably smaller for the same accuracy than the older "classic" quantiles sketch and has nearly the identical API.
   
   If your concern is optimizing allocation churn, which would reduce load on the Eden space, there is not much I can say.  This is not a property we normally optimize for, other than its impact on speed performance, which you have acknowledged has not significantly changed.
   
   What we do try to optimize for is accuracy per amount of space used, especially when in compact (immutable) form, and speed of updating and merging.  
   
   Nonetheless, I would strongly encourage you to update to the latest release as you will benefit from bug fixes and other capabilities that didn't exist 5.5 years ago.  Also, the version you are using is not only very old, it is prior to our move to Apache.  We are not in a position to support it.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@datasketches.apache.org
For additional commands, e-mail: commits-help@datasketches.apache.org