You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Uttam <ud...@gmail.com> on 2018/08/01 10:11:35 UTC
Data quality measurement for streaming data with apache spark
Hello,
I have very general question about Apache Spark. I want to know if it is
possible(and where to start, if possible) to implement a data quality
measurement prototype for streaming data using Apache Spark. Let's say I
want to work on Timeliness or Completeness as a data quality metrics, is
similar work already done using spark? Are there other frameworks which are
better designed for this use case?
--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/
---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscribe@spark.apache.org