[jira] [Updated] (IGNITE-3080) Improve Spark documentation for CDH deployment

["Vladimir Ozerov (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IGNITE-3080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vladimir Ozerov updated IGNITE-3080:
------------------------------------
    Assignee:     (was: Vladimir Ozerov)

> Improve Spark documentation for CDH deployment
> ----------------------------------------------
>
>                 Key: IGNITE-3080
>                 URL: https://issues.apache.org/jira/browse/IGNITE-3080
>             Project: Ignite
>          Issue Type: Improvement
>          Components: Ignite RDD
>    Affects Versions: 1.5.0.final
>            Reporter: Vladimir Ozerov
>              Labels: bigdata
>             Fix For: 1.8
>
>
> Users might experience classpath issues when running Spark on CDH with YARN. 
> The solution is to add Ignite JARs to YARN classpath through CDH console. 
> Originally explained by Michael Dolgonos here: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Installation-with-Spark-under-CDH-tp4457p4624.html 
> {quote}
> Cloudera Manager -> YARN (MR2 Included) -> Configuration -> Service Wide ->
> Advanced -> Spark Client Advanced Configuration Snippet (Safety Valve) for
> spark-conf/spark-defaults.conf
> Added etc/ignite-fabric-1.5.0/libs/* to already present
> spark.executor.extraClassPath=/opt/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p0.4/jars/htrace-core-3.2.0-incubating.jar.
> The combined line looks like this:
> spark.executor.extraClassPath=/opt/cloudera/parcels/CDH-5.5.2-1.cdh5.5.2.p0.4/jars/htrace-core-3.2.0-incubating.jar:/etc/ignite-fabric-1.5.0/libs/*{quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)