You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Arunkumar Pillai <ar...@gmail.com> on 2016/02/04 10:34:50 UTC

[Spark 1.6] Univariate Stats using apache spark

Hi


Currently after creating a dataframe i'm queryingmax max min mean  it to
get result.
sqlContext.sql("SELECT MAX(variablesArray) FROM " + tableName)


Is this an optimized way?
I'm not able to find the all stats like min max mean variance skewness
kurtosis directly from a dataframe

Please help



-- 
Thanks and Regards
        Arun