You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Aaron Perrin <ap...@gravyanalytics.com> on 2017/01/31 15:42:16 UTC

Multiple quantile calculations

I want to calculate quantiles on two different columns.  I know that I can
calculate them with two separate operations. However, for performance
reasons, I'd like to calculate both with one operation.

Is this possible to do this with the Dataset API? I'm assuming that it
isn't. But, if it isn't, is it possible to calculate both in one pass,
assuming that I made some code changes? I briefly looked at the
approxQuantile code, but I haven't dug into the algorithm.