You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Shyam (Jira)" <ji...@apache.org> on 2020/03/05 17:59:00 UTC

[jira] [Created] (SPARK-31057) approxQuantile function of spark , not taking List as first parameter

Shyam created SPARK-31057:
-----------------------------

             Summary: approxQuantile function  of spark , not taking List<String> as first parameter
                 Key: SPARK-31057
                 URL: https://issues.apache.org/jira/browse/SPARK-31057
             Project: Spark
          Issue Type: Bug
          Components: Spark Core
    Affects Versions: 2.4.3, 2.4.1
         Environment: spark-sql-2.4.3 v and eclipse neon ide.

 
            Reporter: Shyam


0
I am using spark-sql-2.4.1v in my project with java8.

I need to calculate the quantiles on the some of the (calculated) columns (i.e. con_dist_1 , con_dist_2 ) of below given dataframe df.
{{List<String> calcColmns = Arrays.asList("con_dist_1","con_dist_2")}}
When I am trying to use first version of approxQuantile i.e. approxQuantile(List, List, double) as below

Dataset<Row> df = //dataset
{{List<List<Double>> quants = df.stat().approxQuantile(calcColmns , Array(0.0,0.1,0.5),0.0);}}
*It is giving error :*
{quote}The method approxQuantile(String, double[], double) in the type DataFrameStatFunctions is not applicable for the arguments (List, List, double)
{quote}
so what is wrong here , I am doing it in my eclipseIDE. Why it is not invoking List even though i am passing List ??

Really appreciate any help on this.

more details are added here

[https://stackoverflow.com/questions/60550152/issue-with-approxquantile-of-spark-not-recognizing-liststring]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org