[GitHub] [druid] JulianJaffePinterest commented on pull request #10920: Spark Direct Readers and Writers for Druid.

[GitBox <gi...@apache.org>]

JulianJaffePinterest commented on pull request #10920:
URL: https://github.com/apache/druid/pull/10920#issuecomment-988646390


   @wangxiaobaidu11 thank you for your kind wishes. The issue you've encountered is an artifact of pulling out some custom code and updating logic to match mainline Druid changes from newer versions. In your case, you can call `AggregatorFactoryRegistry.register("thetaSketch", new SketchAggregatorFactory("", "", 2, 0))` on the driver before writing (note that for historical reasons you need to pass an AggregatorFactory instance and not just the class). In the piecemeal writer code for review that is waiting on #11823, this is done automatically for you. #11823 has been approved pending a broken test in the unrelated code I'm running down, so I hope to have the writer code up soon. If I can find a few minutes I'll put up a repo with the up-to-date connector code and compatibility with older Druid versions as well.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org