You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@ignite.apache.org by "Naden Franciscus (JIRA)" <ji...@apache.org> on 2016/05/02 02:31:12 UTC

[jira] [Created] (IGNITE-3078) IgniteContext needs option to read config from HDFS

Naden Franciscus created IGNITE-3078:
----------------------------------------

             Summary: IgniteContext needs option to read config from HDFS
                 Key: IGNITE-3078
                 URL: https://issues.apache.org/jira/browse/IGNITE-3078
             Project: Ignite
          Issue Type: Bug
            Reporter: Naden Franciscus


If you are running Ignite in YARN mode then obviously we aren't going to have Ignite installation directories on each of the Hadoop cluster nodes. Therefore we need to store the configuration in HDFS for it to be accessible everywhere.

What is needed is a new constructor in IgniteContext:

    def this(
        sc: SparkContext,
        hdfsPath: org.apache.hadoop.fs.Path
    ) {
        this(sc, () ⇒ IgnitionEx.loadHDFSConfiguration(hdfsPath).get1())
    }




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)