Resources for learning Spark administration

[Somasundaram Sekar <so...@tigeranalytics.com>]

Please suggest some good resources to learn Spark administration.

Re: Resources for learning Spark administration

[Mich Talebzadeh <mi...@gmail.com>]

Hi,

There are a lof of stuff to cover here depending on the business and your
needs

Do you mean:


   1. Hardware spec for Spark master and nodes
   2. The number of nodes, How to scale the nodes
   3. Where to set up Spark nodes, on the same Hardware nodes as HDFS
   (assuming using Hadoop) or on the same subnet
   4. The network bandwidth between Spark cluster and Hadoop cluster
   5. The mode of operations; Local. Standalone, Yarn (cluster and client)
   etc.
   6. General Spark admin, job and log monitoring
   7. Security admin
   8. Setting up and configure Spark Thrift Servers (STS) and how many
   (multiple STSs on the same host, different nodes etc)
   9. Host of other matters

Spark online documents are a good way to start.

HTH

Dr Mich Talebzadeh



LinkedIn * https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw
<https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>*



http://talebzadehmich.wordpress.com


*Disclaimer:* Use it at your own risk. Any and all responsibility for any
loss, damage or destruction of data or any other property which may arise
from relying on this email's technical content is explicitly disclaimed.
The author will in no case be liable for any monetary damages arising from
such loss, damage or destruction.



On 4 September 2016 at 19:34, Somasundaram Sekar <
somasundar.sekar@tigeranalytics.com> wrote:

> Please suggest some good resources to learn Spark administration.
>