You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@flink.apache.org by "Gabor Gevay (JIRA)" <ji...@apache.org> on 2015/06/03 11:36:49 UTC
[jira] [Created] (FLINK-2142) GSoC project: Exact and Approximate
Statistics for Data Streams and Windows
Gabor Gevay created FLINK-2142:
----------------------------------
Summary: GSoC project: Exact and Approximate Statistics for Data Streams and Windows
Key: FLINK-2142
URL: https://issues.apache.org/jira/browse/FLINK-2142
Project: Flink
Issue Type: New Feature
Components: Streaming
Reporter: Gabor Gevay
Assignee: Gabor Gevay
Priority: Minor
The goal of this project is to implement basic statistics of data streams and windows (like average, median, variance, correlation, etc.) in a computationally efficient manner. This involves designing custom preaggregators.
The exact calculation of some statistics (eg. frequencies, or the number of distinct elements) would require memory proportional to the number of elements in the input (the window or the entire stream). However, there are efficient algorithms and data structures using less memory for calculating the same statistics only approximately, with user-specified error bounds.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)