About Fluo cluster

[Alan Camillo <al...@blueshift.com.br>]

Hello again!

About this statement in session *Run Fluo processes:*
"If you want to distribute the processes of your Fluo application across a
cluster, you will need install Fluo on every node where you want to run a
Fluo process. It is recommended that you use a cluster management tool like
Salt, Ansible, or Chef to install and run Fluo on a cluster."

Two questions:
Is it enough to start workers using the same "fluo-conn.properties" in
other nodes or do I need do something else?

Does the "Run Fluo in YARN" eliminate this necessity?

Thanks again!
Alan Camillo
*BlueShift *I IT Director
Cel.: +55 11 98283-6358
Tel.: +55 11 4605-5082

Re: About Fluo cluster

[Mike Walch <mw...@apache.org>]

Hi Alan,

It sounds like you are using 1.2.0-SNAPSHOT, correct?  That's great.  I
just don't want to confuse others with the explanation below.

You should be able to use the same fluo-conn.properties if you start
workers as local processes on other nodes.  If you run Fluo in YARN, YARN
will distribute all necessary software and configuration to nodes where
Fluo is run.  This is easier but then you will need to manage the Fluo
application through YARN (view logs, stop application).

Either choice works.  It really depends on how you like running things on
your cluster.

-Mike

On Thu, Dec 28, 2017 at 11:33 AM Alan Camillo <al...@blueshift.com.br> wrote:

> Hello again!
>
> About this statement in session *Run Fluo processes:*
> "If you want to distribute the processes of your Fluo application across a
> cluster, you will need install Fluo on every node where you want to run a
> Fluo process. It is recommended that you use a cluster management tool like
> Salt, Ansible, or Chef to install and run Fluo on a cluster."
>
> Two questions:
> Is it enough to start workers using the same "fluo-conn.properties" in
> other nodes or do I need do something else?
>
> Does the "Run Fluo in YARN" eliminate this necessity?
>
> Thanks again!
> Alan Camillo
> *BlueShift *I IT Director
> Cel.: +55 11 98283-6358 <+55%2011%2098283-6358>
> Tel.: +55 11 4605-5082 <+55%2011%204605-5082>
>