You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by ni...@uom.gr.INVALID on 2020/11/02 08:44:36 UTC
Message Passing Implementation (MPI)
Hello,
I hope my email finds all of you well. I am a Phd candidate and I am
writing back to you with regard to scheduling in Apache Storm. According
to the MPI implementation of Storm the workers manage connections to
other workers and maintain a mapping from task to task. Also,
transferring takes in a task id and a tuple, and it serializes the tuple
and puts it onto a "transfer queue”.
The question is, if there is a way to organise scheduling, such that
certain tasks of an operator communicate to only certain tasks of the
following operator at a given time according to the application’s
topology (could ZeroMQ possibly do something like this?). Any hint would
help.
Thank you in advance for your valuable help.
Kind regards,
Nicole