You are viewing a plain text version of this content. The canonical link for it is here.

Posted to reviews@spark.apache.org by GitBox <gi...@apache.org> on 2021/10/19 22:57:42 UTC

[GitHub] [spark] HeartSaVioR commented on pull request #34333: [SPARK-37062][SS] Introduce a new data source for providing consistent set of rows per microbatch

HeartSaVioR commented on pull request #34333:
URL: https://github.com/apache/spark/pull/34333#issuecomment-947166060


   cc. @zsxwing @viirya @xuanyuanking 
   
   This data source helps to test out the performance aspect on adjusting options (POC yet) for RocksDB state store provider. Say, you can run the streaming query twice, with different options, and it's valid to compare the metrics of micro-batches between the two as they would have same inputs. Previously it has been only possible from Kafka data source with pre-ingesting data.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org