[GitHub] [spark] andrei-ionescu commented on pull request #30841: [SPARK-28191][SS] New data source - state - reader part

[GitBox <gi...@apache.org>]

andrei-ionescu commented on pull request #30841:
URL: https://github.com/apache/spark/pull/30841#issuecomment-815544140


   I find this very helpful and indeed is a missing piece in Structured Streaming. I've been working in production with SS and a couple of times I wish I had this to be able to try migrate the state schema or at least gather more information about the state itself before starting a new empty one. In the context of exactly-once processing, in the case of being forced to start from a clean checkpoint, it would be very helpful to read the information from the state.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org