You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@ignite.apache.org by "Alexey Goncharuk (JIRA)" <ji...@apache.org> on 2015/08/05 21:45:04 UTC
[jira] [Commented] (IGNITE-1198) Spark integration: problem when
create instance with ignite default config
[ https://issues.apache.org/jira/browse/IGNITE-1198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14658746#comment-14658746 ]
Alexey Goncharuk commented on IGNITE-1198:
------------------------------------------
The issue appears because IGNITE_HOME is defined in the console that started spark-shell and not in the remote processes.
Proposed fix is to check IGNITE_HOME on driver node and save it to context. When ignite is started on a remote node, check if IGNITE_HOME has been resolved, and if it was not, set it to the saved value from driver node.
> Spark integration: problem when create instance with ignite default config
> --------------------------------------------------------------------------
>
> Key: IGNITE-1198
> URL: https://issues.apache.org/jira/browse/IGNITE-1198
> Project: Ignite
> Issue Type: Bug
> Components: general
> Affects Versions: ignite-1.4
> Environment: Cent OS
> jdk 1.7
> Reporter: Ilya Suntsov
> Assignee: Alexey Goncharuk
> Priority: Blocker
> Fix For: ignite-1.4
>
>
> I try to create an instance of IgniteContext is to use a configuration file:
> *Step 0*
> Start spark master, worker and ignite node with default-config.xml
> *Step1*
> {noformat}
> $export IGNITE_HOME=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
> $ echo $IGNITE_HOME
> /home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
> {noformat}
> *Step2*
> {noformat}
> ./spark-shell --packages org.apache.ignite:ignite-spark:1.3.2 --master spark://fosters-218:7077 --repositories http://www.gridgainsystems.com/nexus/content/repositories/external
> Ivy Default Cache set to: /home/gridgain/.ivy2/cache
> The jars for the packages stored in: /home/gridgain/.ivy2/jars
> http://www.gridgainsystems.com/nexus/content/repositories/external added as a remote repository with the name: repo-1
> :: loading settings :: url = jar:file:/home/gridgain/isuntsov/spark-1.3.1-bin-hadoop2.6/lib/spark-assembly-1.3.1-hadoop2.6.0.jar!/org/apache/ivy/core/settings/ivysettings.xml
> org.apache.ignite#ignite-spark added as a dependency
> :: resolving dependencies :: org.apache.spark#spark-submit-parent;1.0
> confs: [default]
> found org.apache.ignite#ignite-spark;1.3.2 in repo-1
> found org.apache.ignite#ignite-core;1.3.2 in repo-1
> found javax.cache#cache-api;1.0.0 in central
> found org.gridgain#ignite-shmem;1.0.0 in central
> found org.apache.ignite#ignite-indexing;1.3.2 in repo-1
> found commons-codec#commons-codec;1.6 in central
> found org.apache.lucene#lucene-core;3.5.0 in central
> found com.h2database#h2;1.3.175 in central
> found org.apache.ignite#ignite-spring;1.3.2 in repo-1
> found org.springframework#spring-core;4.1.0.RELEASE in central
> found org.springframework#spring-aop;4.1.0.RELEASE in central
> found aopalliance#aopalliance;1.0 in central
> found org.springframework#spring-beans;4.1.0.RELEASE in central
> found org.springframework#spring-context;4.1.0.RELEASE in central
> found org.springframework#spring-expression;4.1.0.RELEASE in central
> found org.springframework#spring-tx;4.1.0.RELEASE in central
> found org.springframework#spring-jdbc;4.1.0.RELEASE in central
> found commons-logging#commons-logging;1.1.1 in central
> found org.apache.ignite#ignite-log4j;1.3.2 in repo-1
> found log4j#log4j;1.2.17 in central
> :: resolution report :: resolve 811ms :: artifacts dl 23ms
> :: modules in use:
> aopalliance#aopalliance;1.0 from central in [default]
> com.h2database#h2;1.3.175 from central in [default]
> commons-codec#commons-codec;1.6 from central in [default]
> commons-logging#commons-logging;1.1.1 from central in [default]
> javax.cache#cache-api;1.0.0 from central in [default]
> log4j#log4j;1.2.17 from central in [default]
> org.apache.ignite#ignite-core;1.3.2 from repo-1 in [default]
> org.apache.ignite#ignite-indexing;1.3.2 from repo-1 in [default]
> org.apache.ignite#ignite-log4j;1.3.2 from repo-1 in [default]
> org.apache.ignite#ignite-spark;1.3.2 from repo-1 in [default]
> org.apache.ignite#ignite-spring;1.3.2 from repo-1 in [default]
> org.apache.lucene#lucene-core;3.5.0 from central in [default]
> org.gridgain#ignite-shmem;1.0.0 from central in [default]
> org.springframework#spring-aop;4.1.0.RELEASE from central in [default]
> org.springframework#spring-beans;4.1.0.RELEASE from central in [default]
> org.springframework#spring-context;4.1.0.RELEASE from central in [default]
> org.springframework#spring-core;4.1.0.RELEASE from central in [default]
> org.springframework#spring-expression;4.1.0.RELEASE from central in [default]
> org.springframework#spring-jdbc;4.1.0.RELEASE from central in [default]
> org.springframework#spring-tx;4.1.0.RELEASE from central in [default]
> :: evicted modules:
> commons-logging#commons-logging;1.1.3 by [commons-logging#commons-logging;1.1.1] in [default]
> ---------------------------------------------------------------------
> | | modules || artifacts |
> | conf | number| search|dwnlded|evicted|| number|dwnlded|
> ---------------------------------------------------------------------
> | default | 21 | 0 | 0 | 1 || 20 | 0 |
> ---------------------------------------------------------------------
> :: retrieving :: org.apache.spark#spark-submit-parent
> confs: [default]
> 0 artifacts copied, 20 already retrieved (0kB/16ms)
> log4j:WARN No appenders could be found for logger (org.apache.hadoop.metrics2.lib.MutableMetricsFactory).
> log4j:WARN Please initialize the log4j system properly.
> log4j:WARN See http://logging.apache.org/log4j/1.2/faq.html#noconfig for more info.
> Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
> 15/07/30 02:25:01 INFO SecurityManager: Changing view acls to: gridgain
> 15/07/30 02:25:01 INFO SecurityManager: Changing modify acls to: gridgain
> 15/07/30 02:25:01 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(gridgain); users with modify permissions: Set(gridgain)
> 15/07/30 02:25:01 INFO HttpServer: Starting HTTP Server
> 15/07/30 02:25:01 INFO Server: jetty-8.y.z-SNAPSHOT
> 15/07/30 02:25:01 INFO AbstractConnector: Started SocketConnector@0.0.0.0:45663
> 15/07/30 02:25:01 INFO Utils: Successfully started service 'HTTP class server' on port 45663.
> Welcome to
> ____ __
> / __/__ ___ _____/ /__
> _\ \/ _ \/ _ `/ __/ '_/
> /___/ .__/\_,_/_/ /_/\_\ version 1.3.1
> /_/
> Using Scala version 2.10.4 (Java HotSpot(TM) 64-Bit Server VM, Java 1.7.0_75)
> Type in expressions to have them evaluated.
> Type :help for more information.
> 15/07/30 02:25:04 INFO SparkContext: Running Spark version 1.3.1
> 15/07/30 02:25:04 INFO SecurityManager: Changing view acls to: gridgain
> 15/07/30 02:25:04 INFO SecurityManager: Changing modify acls to: gridgain
> 15/07/30 02:25:04 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(gridgain); users with modify permissions: Set(gridgain)
> 15/07/30 02:25:04 INFO Slf4jLogger: Slf4jLogger started
> 15/07/30 02:25:04 INFO Remoting: Starting remoting
> 15/07/30 02:25:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@fosters-221:59114]
> 15/07/30 02:25:04 INFO Utils: Successfully started service 'sparkDriver' on port 59114.
> 15/07/30 02:25:04 INFO SparkEnv: Registering MapOutputTracker
> 15/07/30 02:25:04 INFO SparkEnv: Registering BlockManagerMaster
> 15/07/30 02:25:04 INFO DiskBlockManager: Created local directory at /tmp/spark-f45b7974-83aa-4523-915d-0547ecaaec48/blockmgr-6ca6af17-57bb-4a24-b621-79ea23b6bc69
> 15/07/30 02:25:04 INFO MemoryStore: MemoryStore started with capacity 265.4 MB
> 15/07/30 02:25:04 INFO HttpFileServer: HTTP File server directory is /tmp/spark-5a1bab16-2a8d-4f1b-89b9-49dc2c9d5621/httpd-3363f5ca-2c27-4c86-8c3a-790a5f7b1c54
> 15/07/30 02:25:04 INFO HttpServer: Starting HTTP Server
> 15/07/30 02:25:04 INFO Server: jetty-8.y.z-SNAPSHOT
> 15/07/30 02:25:04 INFO AbstractConnector: Started SocketConnector@0.0.0.0:52473
> 15/07/30 02:25:04 INFO Utils: Successfully started service 'HTTP file server' on port 52473.
> 15/07/30 02:25:04 INFO SparkEnv: Registering OutputCommitCoordinator
> 15/07/30 02:25:04 INFO Server: jetty-8.y.z-SNAPSHOT
> 15/07/30 02:25:04 INFO AbstractConnector: Started SelectChannelConnector@0.0.0.0:4040
> 15/07/30 02:25:04 INFO Utils: Successfully started service 'SparkUI' on port 4040.
> 15/07/30 02:25:04 INFO SparkUI: Started SparkUI at http://fosters-221:4040
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-spark.jar at http://10.20.0.221:52473/jars/ignite-spark.jar with timestamp 1438248304953
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-core.jar at http://10.20.0.221:52473/jars/ignite-core.jar with timestamp 1438248304963
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-indexing.jar at http://10.20.0.221:52473/jars/ignite-indexing.jar with timestamp 1438248304963
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-spring.jar at http://10.20.0.221:52473/jars/ignite-spring.jar with timestamp 1438248304964
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-log4j.jar at http://10.20.0.221:52473/jars/ignite-log4j.jar with timestamp 1438248304964
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/cache-api.jar at http://10.20.0.221:52473/jars/cache-api.jar with timestamp 1438248304964
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/ignite-shmem.jar at http://10.20.0.221:52473/jars/ignite-shmem.jar with timestamp 1438248304964
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/commons-codec.jar at http://10.20.0.221:52473/jars/commons-codec.jar with timestamp 1438248304965
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/lucene-core.jar at http://10.20.0.221:52473/jars/lucene-core.jar with timestamp 1438248304967
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/h2.jar at http://10.20.0.221:52473/jars/h2.jar with timestamp 1438248304970
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-core.jar at http://10.20.0.221:52473/jars/spring-core.jar with timestamp 1438248304971
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-aop.jar at http://10.20.0.221:52473/jars/spring-aop.jar with timestamp 1438248304972
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-beans.jar at http://10.20.0.221:52473/jars/spring-beans.jar with timestamp 1438248304973
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-context.jar at http://10.20.0.221:52473/jars/spring-context.jar with timestamp 1438248304975
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-expression.jar at http://10.20.0.221:52473/jars/spring-expression.jar with timestamp 1438248304975
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-tx.jar at http://10.20.0.221:52473/jars/spring-tx.jar with timestamp 1438248304976
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/spring-jdbc.jar at http://10.20.0.221:52473/jars/spring-jdbc.jar with timestamp 1438248304977
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/commons-logging.jar at http://10.20.0.221:52473/jars/commons-logging.jar with timestamp 1438248304977
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/aopalliance.jar at http://10.20.0.221:52473/jars/aopalliance.jar with timestamp 1438248304977
> 15/07/30 02:25:04 INFO SparkContext: Added JAR file:/home/gridgain/.ivy2/jars/log4j.jar at http://10.20.0.221:52473/jars/log4j.jar with timestamp 1438248304978
> 15/07/30 02:25:05 INFO AppClient$ClientActor: Connecting to master akka.tcp://sparkMaster@fosters-218:7077/user/Master...
> 15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: Connected to Spark cluster with app ID app-20150730022602-0005
> 15/07/30 02:25:05 INFO AppClient$ClientActor: Executor added: app-20150730022602-0005/0 on worker-20150730014728-fosters-221-58923 (fosters-221:58923) with 16 cores
> 15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: Granted executor ID app-20150730022602-0005/0 on hostPort fosters-221:58923 with 16 cores, 512.0 MB RAM
> 15/07/30 02:25:05 INFO AppClient$ClientActor: Executor updated: app-20150730022602-0005/0 is now LOADING
> 15/07/30 02:25:05 INFO AppClient$ClientActor: Executor updated: app-20150730022602-0005/0 is now RUNNING
> 15/07/30 02:25:05 INFO NettyBlockTransferService: Server created on 51493
> 15/07/30 02:25:05 INFO BlockManagerMaster: Trying to register BlockManager
> 15/07/30 02:25:05 INFO BlockManagerMasterActor: Registering block manager fosters-221:51493 with 265.4 MB RAM, BlockManagerId(<driver>, fosters-221, 51493)
> 15/07/30 02:25:05 INFO BlockManagerMaster: Registered BlockManager
> 15/07/30 02:25:05 INFO SparkDeploySchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.0
> 15/07/30 02:25:05 INFO SparkILoop: Created spark context..
> Spark context available as sc.
> 15/07/30 02:25:05 INFO SparkILoop: Created sql context (with Hive support)..
> SQL context available as sqlContext.
> 15/07/30 02:25:07 INFO SparkDeploySchedulerBackend: Registered executor: Actor[akka.tcp://sparkExecutor@fosters-221:33293/user/Executor#271769703] with ID 0
> scala> 15/07/30 02:25:07 INFO BlockManagerMasterActor: Registering block manager fosters-221:41747 with 265.4 MB RAM, BlockManagerId(0, fosters-221, 41747)
> {noformat}
> *Step 3*
> {noformat}
> scala> import org.apache.ignite.spark._
> import org.apache.ignite.spark._
> scala> import org.apache.ignite.configuration._
> import org.apache.ignite.configuration._
> {noformat}
> *Step 4*
> {noformat}scala> val ic = new IgniteContext[Integer, Integer](sc, "config/default-config.xml")
> 15/07/30 02:26:36 INFO XmlBeanDefinitionReader: Loading XML bean definitions from URL [file:/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/config/default-config.xml]
> 15/07/30 02:26:36 INFO GenericApplicationContext: Refreshing org.springframework.context.support.GenericApplicationContext@35816f1c: startup date [Thu Jul 30 02:26:36 PDT 2015]; root of context hierarchy
> 15/07/30 02:26:36 INFO IgniteKernal:
> >>> __________ ________________
> >>> / _/ ___/ |/ / _/_ __/ __/
> >>> _/ // (7 7 // / / / / _/
> >>> /___/\___/_/|_/___/ /_/ /___/
> >>>
> >>> ver. 1.3.2#20150717-sha1:6711d2c7
> >>> 2015 Copyright(C) Apache Software Foundation
> >>>
> >>> Ignite documentation: http://ignite.incubator.apache.org
> 15/07/30 02:26:36 INFO IgniteKernal: Config URL: n/a
> 15/07/30 02:26:36 INFO IgniteKernal: Daemon mode: off
> 15/07/30 02:26:36 INFO IgniteKernal: OS: Linux 2.6.32-358.el6.x86_64 amd64
> 15/07/30 02:26:36 INFO IgniteKernal: OS user: gridgain
> 15/07/30 02:26:36 INFO IgniteKernal: Language runtime: Scala ver. 2.10.4
> 15/07/30 02:26:36 INFO IgniteKernal: VM information: Java(TM) SE Runtime Environment 1.7.0_75-b13 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 24.75-b04
> 15/07/30 02:26:36 INFO IgniteKernal: VM total memory: 0.48GB
> 15/07/30 02:26:36 INFO IgniteKernal: Remote Management [restart: off, REST: on, JMX (remote: off)]
> 15/07/30 02:26:36 INFO IgniteKernal: IGNITE_HOME=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/
> 15/07/30 02:26:36 INFO IgniteKernal: VM arguments: [-XX:MaxPermSize=128m, -Dscala.usejavacp=true, -Xms512m, -Xmx512m]
> 15/07/30 02:26:36 INFO IgniteKernal: Configured caches ['ignite-marshaller-sys-cache', 'ignite-sys-cache', 'ignite-atomics-sys-cache']
> 15/07/30 02:26:36 INFO IgniteKernal: 3-rd party licenses can be found at: /home/gridgain/isuntsov/gridgain-community-fabric-1.3.2//libs/licenses
> 15/07/30 02:26:36 INFO IgniteKernal: Non-loopback local IPs: 10.20.0.221, fe80:0:0:0:21b:21ff:fe5b:eeab%6
> 15/07/30 02:26:36 INFO IgniteKernal: Enabled local MACs: 001B215BEEAB
> 15/07/30 02:26:36 INFO IgnitePluginProcessor: Configured plugins:
> 15/07/30 02:26:36 INFO IgnitePluginProcessor: ^-- None
> 15/07/30 02:26:36 INFO IgnitePluginProcessor:
> 15/07/30 02:26:36 INFO TcpCommunicationSpi: IPC shared memory server endpoint started [port=48101, tokDir=/home/gridgain/isuntsov/gridgain-community-fabric-1.3.2/work/ipc/shmem/d21417e8-1bdc-4f83-b131-b016c40d0f6a-26106]
> 15/07/30 02:26:36 INFO TcpCommunicationSpi: Successfully bound shared memory communication to TCP port [port=48101, locHost=0.0.0.0/0.0.0.0]
> 15/07/30 02:26:36 INFO TcpCommunicationSpi: Successfully bound to TCP port [port=47101, locHost=0.0.0.0/0.0.0.0]
> 15/07/30 02:26:36 WARN NoopCheckpointSpi: Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation)
> 15/07/30 02:26:36 WARN GridCollisionManager: Collision resolution is disabled (all jobs will be activated upon arrival).
> 15/07/30 02:26:36 WARN NoopSwapSpaceSpi: Swap space is disabled. To enable use FileSwapSpaceSpi.
> 15/07/30 02:26:36 INFO IgniteKernal: Security status [authentication=off]
> 15/07/30 02:26:36 INFO GridTcpRestProtocol: Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212]
> 15/07/30 02:26:36 WARN TcpDiscoveryMulticastIpFinder: TcpDiscoveryMulticastIpFinder has no pre-configured addresses (it is recommended in production to specify at least one address in TcpDiscoveryMulticastIpFinder.getAddresses() configuration property)
> 15/07/30 02:26:36 WARN TcpDiscoverySpi: No addresses registered in the IP finder (will retry in 2000ms): TcpDiscoveryMulticastIpFinder [mcastGrp=228.1.2.4, mcastPort=47400, resWaitTime=500, addrReqAttempts=2, locAddr=null, super=TcpDiscoveryVmIpFinder [addrs=[], super=TcpDiscoveryIpFinderAdapter [shared=true]]]
> 15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-marshaller-sys-cache, mode=REPLICATED]
> 15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-atomics-sys-cache, mode=PARTITIONED]
> 15/07/30 02:26:39 INFO GridCacheProcessor: Started cache [name=ignite-sys-cache, mode=REPLICATED]
> 15/07/30 02:26:39 WARN TcpCommunicationSpi: Failed to allocate shared memory segment (switching to TCP, may be slower).
> 15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-marshaller-sys-cache> Starting rebalancing in SYNC mode: ignite-marshaller-sys-cache
> 15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-marshaller-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-marshaller-sys-cache, time=0 ms]
> 15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-atomics-sys-cache> Starting rebalancing in SYNC mode: ignite-atomics-sys-cache
> 15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-atomics-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-atomics-sys-cache, time=0 ms]
> 15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-sys-cache> Starting rebalancing in SYNC mode: ignite-sys-cache
> 15/07/30 02:26:39 INFO GridDhtPreloader: <ignite-sys-cache> Completed rebalancing in SYNC mode [cache=ignite-sys-cache, time=0 ms]
> 15/07/30 02:26:39 INFO IgniteKernal: To start Console Management & Monitoring run ignitevisorcmd.{sh|bat}
> 15/07/30 02:26:39 INFO IgniteKernal:
> 15/07/30 02:26:39 INFO IgniteKernal:
> >>> +----------------------------------------------------------------------+
> >>> Ignite ver. 1.3.2#20150717-sha1:6711d2c799b99d7a0ae3855475cccafbf362f5dd
> >>> +----------------------------------------------------------------------+
> >>> OS name: Linux 2.6.32-358.el6.x86_64 amd64
> >>> CPU(s): 16
> >>> Heap: 0.5GB
> >>> VM name: 26106@fosters-221
> >>> Grid name: null
> >>> Local node [ID=D21417E8-1BDC-4F83-B131-B016C40D0F6A, order=17, clientMode=true]
> >>> Local node addresses: [fosters-221/0:0:0:0:0:0:0:1%1, /10.20.0.221, /127.0.0.1]
> >>> Local ports: TCP:11212 TCP:47101 UDP:47400 TCP:48101
> 15/07/30 02:26:39 INFO GridDiscoveryManager: Topology snapshot [ver=17, server nodes=1, client nodes=1, CPUs=16, heap=1.5GB]
> ic: org.apache.ignite.spark.IgniteContext[Integer,Integer] = org.apache.ignite.spark.IgniteContext@74be0783{noformat}
> *Step 5*
> {noformat}
> scala> val sharedRDD = ic.fromCache("partitioned")
> sharedRDD: org.apache.ignite.spark.IgniteRDD[Integer,Integer] = IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31
> {noformat}
> *Step 6*
> {noformat}
> scala> sharedRDD.filter(_._2 < 10).collect()
> 15/07/30 02:27:58 INFO GridCacheProcessor: Started cache [name=partitioned, mode=PARTITIONED]
> 15/07/30 02:27:58 INFO GridDhtPreloader: <partitioned> Starting rebalancing in ASYNC mode: partitioned
> 15/07/30 02:27:58 INFO GridDhtPreloader: <partitioned> Completed rebalancing in ASYNC mode [cache=partitioned, time=0 ms]
> 15/07/30 02:27:58 INFO SparkContext: Starting job: collect at <console>:32
> 15/07/30 02:27:58 INFO DAGScheduler: Got job 0 (collect at <console>:32) with 1024 output partitions (allowLocal=false)
> 15/07/30 02:27:58 INFO DAGScheduler: Final stage: Stage 0(collect at <console>:32)
> 15/07/30 02:27:58 INFO DAGScheduler: Parents of final stage: List()
> 15/07/30 02:27:58 INFO DAGScheduler: Missing parents: List()
> 15/07/30 02:27:58 INFO DAGScheduler: Submitting Stage 0 (MapPartitionsRDD[1] at filter at <console>:32), which has no missing parents
> 15/07/30 02:27:59 INFO MemoryStore: ensureFreeSpace(2368) called with curMem=0, maxMem=278302556
> 15/07/30 02:27:59 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 2.3 KB, free 265.4 MB)
> 15/07/30 02:27:59 INFO MemoryStore: ensureFreeSpace(1714) called with curMem=2368, maxMem=278302556
> 15/07/30 02:27:59 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 1714.0 B, free 265.4 MB)
> 15/07/30 02:27:59 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on fosters-221:51493 (size: 1714.0 B, free: 265.4 MB)
> 15/07/30 02:27:59 INFO BlockManagerMaster: Updated info of block broadcast_0_piece0
> 15/07/30 02:27:59 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:839
> 15/07/30 02:27:59 INFO DAGScheduler: Submitting 1024 missing tasks from Stage 0 (MapPartitionsRDD[1] at filter at <console>:32)
> 15/07/30 02:27:59 INFO TaskSchedulerImpl: Adding task set 0.0 with 1024 tasks
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on fosters-221:41747 (size: 1714.0 B, free: 265.4 MB)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 WARN TaskSetManager: Lost task 5.0 in stage 0.0 (TID 5, fosters-221): class org.apache.ignite.IgniteCheckedException: Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.
> at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:596)
> at org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:640)
> at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
> at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
> at org.apache.ignite.spark.Once.apply(IgniteContext.scala:155)
> at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:114)
> at org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37)
> at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
> at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
> at org.apache.spark.scheduler.Task.run(Task.scala:64)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.MalformedURLException: no protocol: config/default-config.xml
> at java.net.URL.<init>(URL.java:585)
> at java.net.URL.<init>(URL.java:482)
> at java.net.URL.<init>(URL.java:431)
> at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:590)
> ... 18 more
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 6.0 in stage 0.0 (TID 6) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 1]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 1.0 in stage 0.0 (TID 1) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 2]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.0 in stage 0.0 (TID 11) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 3]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.0 in stage 0.0 (TID 15) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 4]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.1 in stage 0.0 (TID 21, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.1 in stage 0.0 (TID 22, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.0 in stage 0.0 (TID 13) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 5]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.1 in stage 0.0 (TID 23, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.0 in stage 0.0 (TID 0) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 6]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.1 in stage 0.0 (TID 24, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.0 in stage 0.0 (TID 10) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 7]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.1 in stage 0.0 (TID 25, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.0 in stage 0.0 (TID 12) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 8]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.1 in stage 0.0 (TID 26, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.0 in stage 0.0 (TID 2) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 9]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.1 in stage 0.0 (TID 27, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.0 in stage 0.0 (TID 3) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 10]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.0 in stage 0.0 (TID 7) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 11]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.1 in stage 0.0 (TID 28, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.1 in stage 0.0 (TID 29, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.0 in stage 0.0 (TID 4) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 12]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.0 in stage 0.0 (TID 9) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 13]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.1 in stage 0.0 (TID 30, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.1 in stage 0.0 (TID 31, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.0 in stage 0.0 (TID 8) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 14]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.0 in stage 0.0 (TID 14) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 15]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.1 in stage 0.0 (TID 32, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.1 in stage 0.0 (TID 33, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.0 in stage 0.0 (TID 16) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 16]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.0 in stage 0.0 (TID 17) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 17]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.1 in stage 0.0 (TID 34, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.0 in stage 0.0 (TID 18) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 18]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.1 in stage 0.0 (TID 35, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.0 in stage 0.0 (TID 19) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 19]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.1 in stage 0.0 (TID 36, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.0 in stage 0.0 (TID 20) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 20]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.1 in stage 0.0 (TID 37, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.1 in stage 0.0 (TID 21) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 21]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.2 in stage 0.0 (TID 38, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.1 in stage 0.0 (TID 22) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 22]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.2 in stage 0.0 (TID 39, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.1 in stage 0.0 (TID 23) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 23]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.2 in stage 0.0 (TID 40, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.1 in stage 0.0 (TID 26) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 24]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.2 in stage 0.0 (TID 41, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.1 in stage 0.0 (TID 25) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 25]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.2 in stage 0.0 (TID 42, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.1 in stage 0.0 (TID 27) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 26]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.2 in stage 0.0 (TID 43, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.1 in stage 0.0 (TID 24) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 27]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.2 in stage 0.0 (TID 44, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.1 in stage 0.0 (TID 45, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.1 in stage 0.0 (TID 28) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 28]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.2 in stage 0.0 (TID 46, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.1 in stage 0.0 (TID 29) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 29]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.1 in stage 0.0 (TID 31) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 30]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.2 in stage 0.0 (TID 47, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.1 in stage 0.0 (TID 30) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 31]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 9.2 in stage 0.0 (TID 48, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.1 in stage 0.0 (TID 32) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 32]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.2 in stage 0.0 (TID 49, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.2 in stage 0.0 (TID 50, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.1 in stage 0.0 (TID 34) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 33]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.2 in stage 0.0 (TID 51, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.1 in stage 0.0 (TID 33) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 34]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.1 in stage 0.0 (TID 36) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 35]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.2 in stage 0.0 (TID 52, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.1 in stage 0.0 (TID 35) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 36]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.2 in stage 0.0 (TID 53, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.1 in stage 0.0 (TID 37) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 37]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.2 in stage 0.0 (TID 54, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.2 in stage 0.0 (TID 55, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.2 in stage 0.0 (TID 38) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 38]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.2 in stage 0.0 (TID 39) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 39]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 11.3 in stage 0.0 (TID 56, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.2 in stage 0.0 (TID 40) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 40]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 13.3 in stage 0.0 (TID 57, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.2 in stage 0.0 (TID 41) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 41]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 12.3 in stage 0.0 (TID 58, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.2 in stage 0.0 (TID 42) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 42]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 10.3 in stage 0.0 (TID 59, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.2 in stage 0.0 (TID 43) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 43]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 2.3 in stage 0.0 (TID 60, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.2 in stage 0.0 (TID 44) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 44]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 0.3 in stage 0.0 (TID 61, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 15.3 in stage 0.0 (TID 62, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.1 in stage 0.0 (TID 45) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 45]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.2 in stage 0.0 (TID 46) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 46]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 7.3 in stage 0.0 (TID 63, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.2 in stage 0.0 (TID 47) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 47]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 4.3 in stage 0.0 (TID 64, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 16.2 in stage 0.0 (TID 65, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 9.2 in stage 0.0 (TID 48) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 48]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.2 in stage 0.0 (TID 49) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 49]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 14.3 in stage 0.0 (TID 66, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.2 in stage 0.0 (TID 50) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 50]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 3.3 in stage 0.0 (TID 67, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.2 in stage 0.0 (TID 51) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 51]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 17.3 in stage 0.0 (TID 68, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.2 in stage 0.0 (TID 52) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 52]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 19.3 in stage 0.0 (TID 69, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.2 in stage 0.0 (TID 53) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 53]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 18.3 in stage 0.0 (TID 70, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 20.2 in stage 0.0 (TID 54) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 54]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 20.3 in stage 0.0 (TID 71, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 8.2 in stage 0.0 (TID 55) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 55]
> 15/07/30 02:27:59 INFO TaskSetManager: Starting task 8.3 in stage 0.0 (TID 72, fosters-221, NODE_LOCAL, 2152 bytes)
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 11.3 in stage 0.0 (TID 56) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 56]
> 15/07/30 02:27:59 ERROR TaskSetManager: Task 11 in stage 0.0 failed 4 times; aborting job
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 13.3 in stage 0.0 (TID 57) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 57]
> 15/07/30 02:27:59 INFO TaskSchedulerImpl: Cancelling stage 0
> 15/07/30 02:27:59 INFO TaskSchedulerImpl: Stage 0 was cancelled
> 15/07/30 02:27:59 INFO DAGScheduler: Stage 0 (collect at <console>:32) failed in 0.839 s
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 12.3 in stage 0.0 (TID 58) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 58]
> 15/07/30 02:27:59 INFO DAGScheduler: Job 0 failed: collect at <console>:32, took 1.058878 s
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 0.3 in stage 0.0 (TID 61) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 59]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 10.3 in stage 0.0 (TID 59) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 60]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 15.3 in stage 0.0 (TID 62) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 61]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 2.3 in stage 0.0 (TID 60) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 62]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 7.3 in stage 0.0 (TID 63) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 63]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 4.3 in stage 0.0 (TID 64) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 64]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 14.3 in stage 0.0 (TID 66) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 65]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 16.2 in stage 0.0 (TID 65) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 66]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 3.3 in stage 0.0 (TID 67) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 67]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 17.3 in stage 0.0 (TID 68) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 68]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 19.3 in stage 0.0 (TID 69) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 69]
> 15/07/30 02:27:59 INFO TaskSetManager: Lost task 18.3 in stage 0.0 (TID 70) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 70]
> 15/07/30 02:28:00 INFO TaskSetManager: Lost task 20.3 in stage 0.0 (TID 71) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 71]
> 15/07/30 02:28:00 INFO TaskSetManager: Lost task 8.3 in stage 0.0 (TID 72) on executor fosters-221: org.apache.ignite.IgniteCheckedException (Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.) [duplicate 72]
> 15/07/30 02:28:00 INFO TaskSchedulerImpl: Removed TaskSet 0.0, whose tasks have all completed, from pool
> org.apache.spark.SparkException: Job aborted due to stage failure: Task 11 in stage 0.0 failed 4 times, most recent failure: Lost task 11.3 in stage 0.0 (TID 56, fosters-221): class org.apache.ignite.IgniteCheckedException: Spring XML configuration path is invalid: config/default-config.xml. Note that this path should be either absolute or a relative local file system path, relative to META-INF in classpath or valid URL to IGNITE_HOME.
> at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:596)
> at org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:640)
> at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
> at org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$1.apply(IgniteContext.scala:69)
> at org.apache.ignite.spark.Once.apply(IgniteContext.scala:155)
> at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:114)
> at org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37)
> at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
> at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:35)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:277)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:244)
> at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:61)
> at org.apache.spark.scheduler.Task.run(Task.scala:64)
> at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:203)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.net.MalformedURLException: no protocol: config/default-config.xml
> at java.net.URL.<init>(URL.java:585)
> at java.net.URL.<init>(URL.java:482)
> at java.net.URL.<init>(URL.java:431)
> at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:590)
> ... 18 more
> Driver stacktrace:
> at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1204)
> at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1193)
> at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1192)
> at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
> at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
> at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1192)
> at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:693)
> at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:693)
> at scala.Option.foreach(Option.scala:236)
> at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:693)
> at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1393)
> at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1354)
> at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)