You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "chenerlu (JIRA)" <ji...@apache.org> on 2017/03/09 01:55:38 UTC
[jira] [Comment Edited] (SPARK-16283) Implement percentile_approx
SQL function
[ https://issues.apache.org/jira/browse/SPARK-16283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901132#comment-15901132 ]
chenerlu edited comment on SPARK-16283 at 3/9/17 1:55 AM:
----------------------------------------------------------
Hi, I am little confused about percentile_approx, is it different from hive's now ? will we get different result when the input is same ?
for example, I run select percentile_approx(c4_double,array(0.1,0.2,0.3,0.4)) from test; and get different result.
c4_double is show below:
1.00000001
2.00000001
3.00000001
4.00000001
5.00000001
6.00000001
7.00000001
8.00000001
9.00000001
NULL
-8.952
-96.0
Hive:
[-87.2952,-6.961599997999999,1.3000000099999998,2.4000000100000003]
spark 2.x:
[-8.952,1.00000001,2.00000001,3.00000001]
so which result is right ? Could you pls reply me when you are free.
[~rxin] [~lwlin]
was (Author: erlu):
Hi, I am little confused about percentile_approx, is it different from hive's now ? will we get different result when the input is same ?
for example, I run select percentile_approx(c4_double,array(0.1,0.2,0.3,0.4)) from test; and get different result.
c4_double is show below:
1.00000001
2.00000001
3.00000001
4.00000001
5.00000001
6.00000001
7.00000001
8.00000001
9.00000001
NULL
-8.952
-96.0
Hive:
[-87.2952,-6.961599997999999,1.3000000099999998,2.4000000100000003]
spark 2.x:
[-8.952,1.00000001,2.00000001,3.00000001]
so which result is right ? Could you pls reply me when you are free.
[~rxin] [~linwei]
> Implement percentile_approx SQL function
> ----------------------------------------
>
> Key: SPARK-16283
> URL: https://issues.apache.org/jira/browse/SPARK-16283
> Project: Spark
> Issue Type: Sub-task
> Components: SQL
> Reporter: Reynold Xin
> Assignee: Sean Zhong
> Fix For: 2.1.0
>
>
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org