[GitHub] [beam] je-ik commented on issue #21897: [Feature Request]: Flink runner savepoint backward compatibility

[GitBox <gi...@apache.org>]

je-ik commented on issue #21897:
URL: https://github.com/apache/beam/issues/21897#issuecomment-1177221561

   Generally this is problem of Java serialization. Beam could (and should) pay more attention to not breaking it, but it nevertheless can happen from time to time. Moreover, the PTransform expansion can change and a lot of other things can go wrong, so - currently - the ability to recreate the pipeline into meaningful state from scratch is vital.
   
   I *think* it could be theoretically possible to create a runner and beam-version (into some extent) agnostic snapshot of a pipeline, which could then be used to overcome such restrictions and even port a (running) pipeline between runners. But that would be a large project so even if something like this will come into existence in the future it cannot be expected soon.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@beam.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org