Re: Task scheduling

[Yi Pan <ni...@gmail.com>]

Hi, Alvaro,

Sorry I saw this email late. I think that there is a fundamental question
to be asked first: why are tasks in the same job have different priority
and execution orders? Samza's design principal is that the tasks within a
single job should be independent and identical processes, which does not
need the specific execution order or coordination among them, except for
partition assignments. Could you elaborate your use case a little bit more?

Thanks!

-Yi

On Mon, Aug 24, 2015 at 6:22 AM, Alvaro Gareppe <ag...@gmail.com> wrote:

> Hi, How can I configure task schedule to be able to specify:
>
>    - Some task can only run ins some nodes (not all)
>    - Some task shouldn't run together but if there is only one server then
> they can ( In this case a have some task that are high CPU demanding, so I
> don't want to run them together, but if there's not other way.. well... let
> them run)
>    - priority among tasks
>
> The yarn fair scheduler gives me some of this functionality (but not all),
> and I also don't know how to specify the scheduling queue im samza (if
> there is a way).
>
> Can you please help me ?
>
> Thank you
>
> --
> Ing. Alvaro Gareppe
> agareppe@gmail.com
>