[GitHub] clintropolis commented on issue #6016: Druid 'Shapeshifting' Columns

[GitBox <gi...@apache.org>]

clintropolis commented on issue #6016: Druid 'Shapeshifting' Columns
URL: https://github.com/apache/incubator-druid/pull/6016#issuecomment-434921576
 
 
   Apologies for the lack of activity on this branch, I just wanted to give an update that it is not in fact dead (and I'm still hyped about these changes), I just got a bit side tracked with a ton of other things and will be resuming work very soon as well as addressing segment format discussion, etc.
   
   Additionally, I discussed [the implications of Java and C++ version of FastPFOR not being compatible](https://github.com/lemire/FastPFor/issues/42) with @gianm, and based off of that, I think we've decided that FastPFOR is more of a strategy at this point in time than a well defined codec so it is in our interest to bring the relevant algorithm implementation(s) into Druid rather than use the library, and just own it like we have done with a handful of other things, like concise. Given this, I am going to attempt to put together a Java implementation that _is_ compatible with the C++ implementation so we can still have the opportunity to take advantage of native code. 
   
   I will also be repeating all benchmarks to take the [performance enhancements in the LZ4 update into account](https://github.com/apache/incubator-druid/pull/6478).

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org