Cluster to Cluster communication

[Vasu Gourabathina <vg...@gmail.com>]

All,

This is a theoretical question at this point of time. Wanted to pose this
question, before spending too much time to figure it out. Advance apologies
if this is not the right forum to ask this question.

Use-case:
- Migration from one cluster manager to another (for ex. Spark stand-alone
to YARN). OR support for running jobs in a two-cluster-manager environment

Q1: Wondering if it would be possible to setup two clusters (one of each
type) and route jobs, based on some configuration, between these two
clusters. Essentially requiring communication between two cluster managers.

Q2: Has anyone done similar thing in a non-Spark environment? If so, can
share some thoughts?

Is this a proper way to think about? If not, what are the best practices
for this use-case?

Thanks in advance,
Vasu.