You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by percent620 <pe...@163.com> on 2016/08/22 12:45:56 UTC
Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Hello,
Everything is okay for me to integrate ignite with yarn on *Multicast Based
Discovery* in my local spark and yarn cluster , but in our production env,
some of ports could't be opened .So, I need to specify a static ip address
to discovery each other.
but when running my configuration and encountered the following issue. List
my detailed steps as below.
1、config/default-config.mxl
<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="
http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd">
<bean class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="discoverySpi">
<bean
class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<property name="ipFinder">
<bean
class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
<property name="addresses">
<list>
<value>172.16.186.200:47500..47509</value>
<value>172.16.186.201:47500..47509</value>
<value>172.16.186.202:47500..47509</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
</bean>
</beans>
2、my java code on idea
ackage com.ignite
import org.apache.ignite.spark._
import org.apache.ignite.configuration._
import org.apache.spark.{SparkConf, SparkContext}
/**
* Created by limu on 2016/8/14.
*/
object testIgniteSharedRDD {
def main(args: Array[String]): Unit = {
val conf = new SparkConf().setAppName("testIgniteSharedRDD")
val sc = new SparkContext(conf)
/* val cfg = new IgniteConfiguration()
cfg.setIgniteHome("/usr/apache-ignite-fabric-1.6.0-bin")
*/
//val ic = new IgniteContext[Integer, Integer](sc, () => new
IgniteConfiguration())
val ic = new IgniteContext[Integer, Integer](sc,
"/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml")
val sharedRDD = ic.fromCache("sharedIgniteRDD-ling-sha111o")
println("original.sharedCounter=> " + sharedRDD.count())
sharedRDD.savePairs(sc.parallelize(1 to 77000, 10).map(i => (new
Integer(i), new Integer(i))))
println("final.sharedCounter=> " + sharedRDD.count())
println("final.condition.couner=> " + sharedRDD.filter(_._2 >
21000).count )
}
3、Yarn container logs
Logs for container_1471869381289_0001_01_000001
About Apache Hadoop
ResourceManager
RM Home
NodeManager
Tools
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/usr/hadoop-2.4.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/usr/hadoop-2.4.1/tmp/nm-local-dir/usercache/root/appcache/application_1471869381289_0001/filecache/10/ignite-yarn.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
16/08/22 05:38:52 INFO impl.ContainerManagementProtocolProxy:
yarn.client.max-nodemanagers-proxies : 500
16/08/22 05:38:52 INFO client.RMProxy: Connecting to ResourceManager at
sparkup1/172.16.186.200:8030
Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
INFO: Application master registered.
Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
INFO: Making request. Memory: 1,908, cpu 1.
Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
INFO: Making request. Memory: 1,908, cpu 1.
Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
INFO: Making request. Memory: 1,908, cpu 1.
16/08/22 05:38:54 INFO impl.AMRMClientImpl: Received new token for :
sparkup3:46170
16/08/22 05:38:54 INFO impl.AMRMClientImpl: Received new token for :
sparkup2:55406
Aug 22, 2016 5:38:54 AM org.apache.ignite.yarn.ApplicationMaster
onContainersAllocated
INFO: Launching container: container_1471869381289_0001_01_000002.
16/08/22 05:38:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy
: sparkup3:46170
16/08/22 05:38:54 INFO impl.AMRMClientImpl: Received new token for :
sparkup1:53711
Aug 22, 2016 5:38:54 AM org.apache.ignite.yarn.ApplicationMaster
onContainersAllocated
INFO: Launching container: container_1471869381289_0001_01_000003.
16/08/22 05:38:54 INFO impl.ContainerManagementProtocolProxy: Opening proxy
: sparkup2:55406
Aug 22, 2016 5:38:55 AM org.apache.ignite.yarn.ApplicationMaster
onContainersAllocated
INFO: Launching container: container_1471869381289_0001_01_000004.
16/08/22 05:38:55 INFO impl.ContainerManagementProtocolProxy: Opening proxy
: sparkup1:53711
4、spark-submit errors
[root@sparkup1 config]# clear
[root@sparkup1 config]# spark-submit --driver-memory 2G --class
com.ignite.testIgniteSharedRDD --master yarn --executor-cores 2
--executor-memory 1000m --num-executors 2 --conf spark.rdd.compress=false
--conf spark.shuffle.compress=false --conf spark.broadcast.compress=false
/root/limu/ignite/spark-project-jar-with-dependencies.jar
16/08/22 05:44:36 INFO spark.SparkContext: Running Spark version 1.6.1
16/08/22 05:44:37 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
16/08/22 05:44:37 INFO spark.SecurityManager: Changing view acls to: root
16/08/22 05:44:37 INFO spark.SecurityManager: Changing modify acls to: root
16/08/22 05:44:37 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(root); users with modify permissions: Set(root)
16/08/22 05:44:38 INFO util.Utils: Successfully started service
'sparkDriver' on port 43868.
16/08/22 05:44:38 INFO slf4j.Slf4jLogger: Slf4jLogger started
16/08/22 05:44:39 INFO Remoting: Starting remoting
16/08/22 05:44:39 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkDriverActorSystem@172.16.186.200:47472]
16/08/22 05:44:39 INFO util.Utils: Successfully started service
'sparkDriverActorSystem' on port 47472.
16/08/22 05:44:39 INFO spark.SparkEnv: Registering MapOutputTracker
16/08/22 05:44:39 INFO spark.SparkEnv: Registering BlockManagerMaster
16/08/22 05:44:39 INFO storage.DiskBlockManager: Created local directory at
/tmp/blockmgr-d1426202-a59e-4436-82b3-5142d5861e0e
16/08/22 05:44:39 INFO storage.MemoryStore: MemoryStore started with
capacity 1259.8 MB
16/08/22 05:44:39 INFO spark.SparkEnv: Registering OutputCommitCoordinator
16/08/22 05:44:40 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/08/22 05:44:40 INFO server.AbstractConnector: Started
SelectChannelConnector@0.0.0.0:4040
16/08/22 05:44:40 INFO util.Utils: Successfully started service 'SparkUI' on
port 4040.
16/08/22 05:44:40 INFO ui.SparkUI: Started SparkUI at
http://172.16.186.200:4040
16/08/22 05:44:40 INFO spark.HttpFileServer: HTTP File server directory is
/tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc/httpd-91da8e86-bee0-4c5a-868a-ea7d35a2536d
16/08/22 05:44:40 INFO spark.HttpServer: Starting HTTP Server
16/08/22 05:44:40 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/08/22 05:44:40 INFO server.AbstractConnector: Started
SocketConnector@0.0.0.0:56870
16/08/22 05:44:40 INFO util.Utils: Successfully started service 'HTTP file
server' on port 56870.
16/08/22 05:44:41 INFO spark.SparkContext: Added JAR
file:/root/limu/ignite/spark-project-jar-with-dependencies.jar at
http://172.16.186.200:56870/jars/spark-project-jar-with-dependencies.jar
with timestamp 1471869881473
16/08/22 05:44:41 INFO client.RMProxy: Connecting to ResourceManager at
sparkup1/172.16.186.200:8032
16/08/22 05:44:42 INFO yarn.Client: Requesting a new application from
cluster with 3 NodeManagers
16/08/22 05:44:42 INFO yarn.Client: Verifying our application has not
requested more than the maximum memory capability of the cluster (8192 MB
per container)
16/08/22 05:44:42 INFO yarn.Client: Will allocate AM container, with 896 MB
memory including 384 MB overhead
16/08/22 05:44:42 INFO yarn.Client: Setting up container launch context for
our AM
16/08/22 05:44:42 INFO yarn.Client: Setting up the launch environment for
our AM container
16/08/22 05:44:42 INFO yarn.Client: Preparing resources for our AM container
16/08/22 05:44:43 INFO yarn.Client: Uploading resource
file:/usr/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar
->
hdfs://sparkup1:9000/user/root/.sparkStaging/application_1471869381289_0003/spark-assembly-1.6.1-hadoop2.6.0.jar
16/08/22 05:44:48 INFO yarn.Client: Uploading resource
file:/tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc/__spark_conf__522717764919469546.zip
->
hdfs://sparkup1:9000/user/root/.sparkStaging/application_1471869381289_0003/__spark_conf__522717764919469546.zip
16/08/22 05:44:48 INFO spark.SecurityManager: Changing view acls to: root
16/08/22 05:44:48 INFO spark.SecurityManager: Changing modify acls to: root
16/08/22 05:44:48 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(root); users with modify permissions: Set(root)
16/08/22 05:44:48 INFO yarn.Client: Submitting application 3 to
ResourceManager
16/08/22 05:44:48 INFO impl.YarnClientImpl: Submitted application
application_1471869381289_0003
16/08/22 05:44:49 INFO yarn.Client: Application report for
application_1471869381289_0003 (state: ACCEPTED)
16/08/22 05:44:49 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1471869888680
final status: UNDEFINED
tracking URL:
http://sparkup1:8088/proxy/application_1471869381289_0003/
user: root
16/08/22 05:44:50 INFO yarn.Client: Application report for
application_1471869381289_0003 (state: ACCEPTED)
16/08/22 05:44:51 INFO yarn.Client: Application report for
application_1471869381289_0003 (state: ACCEPTED)
16/08/22 05:44:52 INFO yarn.Client: Application report for
application_1471869381289_0003 (state: ACCEPTED)
16/08/22 05:44:53 INFO yarn.Client: Application report for
application_1471869381289_0003 (state: ACCEPTED)
16/08/22 05:44:54 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint:
ApplicationMaster registered as NettyRpcEndpointRef(null)
16/08/22 05:44:54 INFO cluster.YarnClientSchedulerBackend: Add WebUI Filter.
org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter, Map(PROXY_HOSTS
-> sparkup1, PROXY_URI_BASES ->
http://sparkup1:8088/proxy/application_1471869381289_0003),
/proxy/application_1471869381289_0003
16/08/22 05:44:54 INFO ui.JettyUtils: Adding filter:
org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
16/08/22 05:44:54 INFO yarn.Client: Application report for
application_1471869381289_0003 (state: RUNNING)
16/08/22 05:44:54 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: 172.16.186.200
ApplicationMaster RPC port: 0
queue: default
start time: 1471869888680
final status: UNDEFINED
tracking URL:
http://sparkup1:8088/proxy/application_1471869381289_0003/
user: root
16/08/22 05:44:54 INFO cluster.YarnClientSchedulerBackend: Application
application_1471869381289_0003 has started running.
16/08/22 05:44:54 INFO util.Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 34347.
16/08/22 05:44:54 INFO netty.NettyBlockTransferService: Server created on
34347
16/08/22 05:44:54 INFO storage.BlockManagerMaster: Trying to register
BlockManager
16/08/22 05:44:54 INFO storage.BlockManagerMasterEndpoint: Registering block
manager 172.16.186.200:34347 with 1259.8 MB RAM, BlockManagerId(driver,
172.16.186.200, 34347)
16/08/22 05:44:54 INFO storage.BlockManagerMaster: Registered BlockManager
16/08/22 05:45:02 INFO cluster.YarnClientSchedulerBackend: Registered
executor NettyRpcEndpointRef(null) (sparkup1:36133) with ID 1
16/08/22 05:45:02 INFO storage.BlockManagerMasterEndpoint: Registering block
manager sparkup1:37604 with 500.0 MB RAM, BlockManagerId(1, sparkup1, 37604)
16/08/22 05:45:02 INFO cluster.YarnClientSchedulerBackend: Registered
executor NettyRpcEndpointRef(null) (sparkup3:35841) with ID 2
16/08/22 05:45:02 INFO storage.BlockManagerMasterEndpoint: Registering block
manager sparkup3:53373 with 500.0 MB RAM, BlockManagerId(2, sparkup3, 53373)
16/08/22 05:45:02 INFO cluster.YarnClientSchedulerBackend: SchedulerBackend
is ready for scheduling beginning after reached minRegisteredResourcesRatio:
0.8
16/08/22 05:45:03 INFO xml.XmlBeanDefinitionReader: Loading XML bean
definitions from URL
[file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml]
16/08/22 05:45:04 INFO support.GenericApplicationContext: Refreshing
org.springframework.context.support.GenericApplicationContext@529c42c6:
startup date [Mon Aug 22 05:45:04 PDT 2016]; root of context hierarchy
16/08/22 05:45:04 INFO internal.IgniteKernal:
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
16/08/22 05:45:04 INFO internal.IgniteKernal: Config URL: n/a
16/08/22 05:45:04 INFO internal.IgniteKernal: Daemon mode: off
16/08/22 05:45:04 INFO internal.IgniteKernal: OS: Linux
2.6.32-431.el6.x86_64 amd64
16/08/22 05:45:04 INFO internal.IgniteKernal: OS user: root
16/08/22 05:45:04 INFO internal.IgniteKernal: Language runtime: Java
Platform API Specification ver. 1.7
16/08/22 05:45:04 INFO internal.IgniteKernal: VM information: Java(TM) SE
Runtime Environment 1.7.0_71-b14 Oracle Corporation Java HotSpot(TM) 64-Bit
Server VM 24.71-b01
16/08/22 05:45:04 INFO internal.IgniteKernal: VM total memory: 1.9GB
16/08/22 05:45:04 INFO internal.IgniteKernal: Remote Management [restart:
off, REST: on, JMX (remote: off)]
16/08/22 05:45:04 INFO internal.IgniteKernal:
IGNITE_HOME=/usr/apache-ignite-fabric-1.6.0-bin
16/08/22 05:45:04 INFO internal.IgniteKernal: VM arguments: [-Xms2G, -Xmx2G,
-XX:MaxPermSize=256m]
16/08/22 05:45:04 INFO internal.IgniteKernal: Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache',
'ignite-atomics-sys-cache']
16/08/22 05:45:05 INFO internal.IgniteKernal: 3-rd party licenses can be
found at: /usr/apache-ignite-fabric-1.6.0-bin/libs/licenses
16/08/22 05:45:05 INFO internal.IgniteKernal: Non-loopback local IPs:
172.16.186.200, fe80:0:0:0:20c:29ff:fecd:2f25%2
16/08/22 05:45:05 INFO internal.IgniteKernal: Enabled local MACs:
000C29CD2F25
16/08/22 05:45:05 INFO plugin.IgnitePluginProcessor: Configured plugins:
16/08/22 05:45:05 INFO plugin.IgnitePluginProcessor: ^-- None
16/08/22 05:45:05 INFO plugin.IgnitePluginProcessor:
16/08/22 05:45:05 INFO tcp.TcpCommunicationSpi: IPC shared memory server
endpoint started [port=48101,
tokDir=/usr/apache-ignite-fabric-1.6.0-bin/work/ipc/shmem/d02e3ed0-a14a-4331-9403-822aa7bd2c9f-6908]
16/08/22 05:45:05 INFO tcp.TcpCommunicationSpi: Successfully bound shared
memory communication to TCP port [port=48101, locHost=0.0.0.0/0.0.0.0]
16/08/22 05:45:05 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP
port [port=47101, locHost=0.0.0.0/0.0.0.0]
16/08/22 05:45:05 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to
enable configure any GridCheckpointSpi implementation)
16/08/22 05:45:05 WARN collision.GridCollisionManager: Collision resolution
is disabled (all jobs will be activated upon arrival).
16/08/22 05:45:05 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To
enable use FileSwapSpaceSpi.
16/08/22 05:45:05 INFO internal.IgniteKernal: Security status
[authentication=off, tls/ssl=off]
16/08/22 05:45:05 INFO tcp.GridTcpRestProtocol: Command protocol
successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212]
16/08/22 05:45:06 WARN internal.IgniteKernal: Attempting to start more nodes
than physical RAM available on current host (this can cause significant
slowdown)
16/08/22 05:45:06 INFO cache.GridCacheProcessor: Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
16/08/22 05:45:06 INFO cache.GridCacheProcessor: Started cache
[name=ignite-atomics-sys-cache, mode=PARTITIONED]
16/08/22 05:45:06 INFO cache.GridCacheProcessor: Started cache
[name=ignite-sys-cache, mode=REPLICATED]
16/08/22 05:45:07 INFO internal.IgniteKernal: To start Console Management &
Monitoring run ignitevisorcmd.{sh|bat}
16/08/22 05:45:07 INFO internal.IgniteKernal:
16/08/22 05:45:07 INFO internal.IgniteKernal:
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-431.el6.x86_64 amd64
>>> CPU(s): 1
>>> Heap: 2.0GB
>>> VM name: 6908@sparkup1
>>> Local node [ID=D02E3ED0-A14A-4331-9403-822AA7BD2C9F, order=8,
>>> clientMode=true]
>>> Local node addresses: [sparkup1/0:0:0:0:0:0:0:1%1, /127.0.0.1,
>>> /172.16.186.200]
>>> Local ports: TCP:11212 TCP:47101 TCP:48101
16/08/22 05:45:07 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=8, servers=3, clients=1, CPUs=3, heap=6.5GB]
16/08/22 05:45:07 INFO cache.GridCacheProcessor: Started cache
[name=sharedIgniteRDD-ling-sha111o, mode=PARTITIONED]
16/08/22 05:45:07 INFO spark.SparkContext: Starting job: count at
testIgniteSharedRDD.scala:19
16/08/22 05:45:07 INFO scheduler.DAGScheduler: Got job 0 (count at
testIgniteSharedRDD.scala:19) with 1024 output partitions
16/08/22 05:45:07 INFO scheduler.DAGScheduler: Final stage: ResultStage 0
(count at testIgniteSharedRDD.scala:19)
16/08/22 05:45:07 INFO scheduler.DAGScheduler: Parents of final stage:
List()
16/08/22 05:45:07 INFO scheduler.DAGScheduler: Missing parents: List()
16/08/22 05:45:07 INFO scheduler.DAGScheduler: Submitting ResultStage 0
(IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31), which has no missing
parents
16/08/22 05:45:08 INFO storage.MemoryStore: Block broadcast_0 stored as
values in memory (estimated size 1872.0 B, free 1872.0 B)
16/08/22 05:45:08 INFO storage.MemoryStore: Block broadcast_0_piece0 stored
as bytes in memory (estimated size 1853.0 B, free 3.6 KB)
16/08/22 05:45:08 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in
memory on 172.16.186.200:34347 (size: 1853.0 B, free: 1259.8 MB)
16/08/22 05:45:08 INFO spark.SparkContext: Created broadcast 0 from
broadcast at DAGScheduler.scala:1006
16/08/22 05:45:08 INFO scheduler.DAGScheduler: Submitting 1024 missing tasks
from ResultStage 0 (IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31)
16/08/22 05:45:08 INFO cluster.YarnScheduler: Adding task set 0.0 with 1024
tasks
16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 1.0 in stage
0.0 (TID 0, sparkup1, partition 1,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 0.0 in stage
0.0 (TID 1, sparkup3, partition 0,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 3.0 in stage
0.0 (TID 2, sparkup1, partition 3,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 2.0 in stage
0.0 (TID 3, sparkup3, partition 2,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:11 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in
memory on sparkup3:53373 (size: 1853.0 B, free: 500.0 MB)
16/08/22 05:45:11 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in
memory on sparkup1:37604 (size: 1853.0 B, free: 500.0 MB)
16/08/22 05:45:19 INFO discovery.GridDiscoveryManager: Added new node to
topology: TcpDiscoveryNode [id=d7f0a10f-68d7-4c8f-ab1d-d59c17b5bef7,
addrs=[0:0:0:0:0:0:0:1%1, 127.0.0.1, 172.16.186.200],
sockAddrs=[sparkup1/172.16.186.200:47501, /0:0:0:0:0:0:0:1%1:47501,
/127.0.0.1:47501, /172.16.186.200:47501], discPort=47501, order=9,
intOrder=7, lastExchangeTime=1471869918832, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=false]
16/08/22 05:45:19 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=9, servers=4, clients=1, CPUs=3, heap=7.4GB]
16/08/22 05:45:20 INFO scheduler.TaskSetManager: Starting task 5.0 in stage
0.0 (TID 4, sparkup3, partition 5,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:20 INFO scheduler.TaskSetManager: Starting task 9.0 in stage
0.0 (TID 5, sparkup3, partition 9,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:20 INFO scheduler.TaskSetManager: Finished task 2.0 in stage
0.0 (TID 3) in 12285 ms on sparkup3 (1/1024)
16/08/22 05:45:20 INFO scheduler.TaskSetManager: Finished task 0.0 in stage
0.0 (TID 1) in 12308 ms on sparkup3 (2/1024)
16/08/22 05:45:22 INFO scheduler.TaskSetManager: Starting task 4.0 in stage
0.0 (TID 6, sparkup1, partition 4,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:22 INFO scheduler.TaskSetManager: Starting task 6.0 in stage
0.0 (TID 7, sparkup1, partition 6,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:22 INFO scheduler.TaskSetManager: Finished task 3.0 in stage
0.0 (TID 2) in 13752 ms on sparkup1 (3/1024)
16/08/22 05:45:22 INFO scheduler.TaskSetManager: Finished task 1.0 in stage
0.0 (TID 0) in 13782 ms on sparkup1 (4/1024)
16/08/22 05:45:43 INFO scheduler.TaskSetManager: Starting task 10.0 in stage
0.0 (TID 8, sparkup1, partition 10,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:43 INFO scheduler.TaskSetManager: Starting task 11.0 in stage
0.0 (TID 9, sparkup1, partition 11,NODE_LOCAL, 1967 bytes)
16/08/22 05:45:43 WARN scheduler.TaskSetManager: Lost task 6.0 in stage 0.0
(TID 7, sparkup1): class org.apache.ignite.IgniteCheckedException: Failed to
instantiate Spring XML application context
[springUrl=file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml,
err=Line 6 in XML document from URL
[file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
columnNumber: 71; cvc-elt.1: Cannot find the declaration of element
'beans'.]
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:391)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:104)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:98)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:639)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:678)
at
org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:717)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
at
org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
at
org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(IgniteAbstractRDD.scala:37)
at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58)
at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
at
org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at
org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by:
org.springframework.beans.factory.xml.XmlBeanDefinitionStoreException: Line
6 in XML document from URL
[file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
columnNumber: 71; cvc-elt.1: Cannot find the declaration of element 'beans'.
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:398)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:335)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:303)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:379)
... 19 more
Caused by: org.xml.sax.SAXParseException; lineNumber: 6; columnNumber: 71;
cvc-elt.1: Cannot find the declaration of element 'beans'.
at
org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown
Source)
at org.apache.xerces.util.ErrorHandlerWrapper.error(Unknown Source)
at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
Source)
at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
Source)
at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
Source)
at
org.apache.xerces.impl.xs.XMLSchemaValidator.handleStartElement(Unknown
Source)
at org.apache.xerces.impl.xs.XMLSchemaValidator.startElement(Unknown
Source)
at
org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown
Source)
at
org.apache.xerces.impl.XMLNSDocumentScannerImpl$NSContentDispatcher.scanRootElementHook(Unknown
Source)
at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl$FragmentContentDispatcher.dispatch(Unknown
Source)
at
org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
Source)
at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown Source)
at
org.springframework.beans.factory.xml.DefaultDocumentLoader.loadDocument(DefaultDocumentLoader.java:76)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadDocument(XmlBeanDefinitionReader.java:428)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:390)
... 22 more
16/08/22 05:45:43 INFO scheduler.TaskSetManager: Lost task 4.0 in stage 0.0
(TID 6) on executor sparkup1: org.apache.ignite.IgniteCheckedException
(Failed to instantiate Spring XML application context
[springUrl=file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml,
err=Line 6 in XML document from URL
[file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
columnNumber: 71; cvc-elt.1: Cannot find the declaration of element
'beans'.]) [duplicate 1]
^C16/08/22 05:46:02 INFO typedef.G: Invoking shutdown hook...
16/08/22 05:46:02 INFO spark.SparkContext: Invoking stop() from shutdown
hook
16/08/22 05:46:02 INFO tcp.GridTcpRestProtocol: Command protocol
successfully stopped: TCP binary
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/static/sql,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/SQL/execution/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/SQL/execution,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/SQL/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/SQL,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/metrics/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages/stage/kill,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/api,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/static,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/executors/threadDump/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/executors/threadDump,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/executors/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/executors,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/environment/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/environment,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/storage/rdd/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/storage/rdd,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/storage/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/storage,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages/pool/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages/pool,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages/stage/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages/stage,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/stages,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/jobs/job/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/jobs/job,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/jobs/json,null}
16/08/22 05:46:02 INFO handler.ContextHandler: stopped
o.s.j.s.ServletContextHandler{/jobs,null}
16/08/22 05:46:02 INFO ui.SparkUI: Stopped Spark web UI at
http://172.16.186.200:4040
^C16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
ignite-marshaller-sys-cache
16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
ignite-sys-cache
16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
ignite-atomics-sys-cache
16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
sharedIgniteRDD-ling-sha111o
16/08/22 05:46:02 INFO scheduler.DAGScheduler: Job 0 failed: count at
testIgniteSharedRDD.scala:19, took 54.886757 s
Exception in thread "main" org.apache.spark.SparkException: Job 0 cancelled
because SparkContext was shut down
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:806)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:804)
at scala.collection.mutable.HashSet.foreach(HashSet.scala:79)
at
org.apache.spark.scheduler.DAGScheduler.cleanUpAfterSchedulerStop(DAGScheduler.scala:804)
at
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onStop(DAGScheduler.scala:1658)
at org.apache.spark.util.EventLoop.stop(EventLoop.scala:84)
at
org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:1581)
at
org.apache.spark.SparkContext$$anonfun$stop$9.apply$mcV$sp(SparkContext.scala:1740)
at
org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1229)
at org.apache.spark.SparkContext.stop(SparkContext.scala:1739)
at
org.apache.spark.SparkContext$$anonfun$3.apply$mcV$sp(SparkContext.scala:596)
at
org.apache.spark.util.SparkShutdownHook.run(ShutdownHookManager.scala:267)
at
org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply$mcV$sp(ShutdownHookManager.scala:239)
at
org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:239)
at
org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$apply$mcV$sp$1.apply(ShutdownHookManager.scala:239)
at
org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1765)
at
org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply$mcV$sp(ShutdownHookManager.scala:239)
at
org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:239)
at
org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(ShutdownHookManager.scala:239)
at scala.util.Try$.apply(Try.scala:161)
at
org.apache.spark.util.SparkShutdownHookManager.runAll(ShutdownHookManager.scala:239)
at
org.apache.spark.util.SparkShutdownHookManager$$anon$2.run(ShutdownHookManager.scala:218)
at
org.apache.hadoop.util.ShutdownHookManager$1.run(ShutdownHookManager.java:54)
at
org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1845)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1858)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1929)
at org.apache.spark.rdd.RDD.count(RDD.scala:1157)
at
com.ignite.testIgniteSharedRDD$.main(testIgniteSharedRDD.scala:19)
at com.ignite.testIgniteSharedRDD.main(testIgniteSharedRDD.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at
org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at
org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
16/08/22 05:46:02 INFO scheduler.DAGScheduler: ResultStage 0 (count at
testIgniteSharedRDD.scala:19) failed in 54.382 s
^C^C^C16/08/22 05:46:03 INFO internal.IgniteKernal:
>>> +---------------------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> stopped OK
>>> +---------------------------------------------------------------------------------+
>>> Grid uptime: 00:00:56:139
16/08/22 05:46:03 ERROR scheduler.LiveListenerBus: SparkListenerBus has
already stopped! Dropping event
SparkListenerStageCompleted(org.apache.spark.scheduler.StageInfo@6632c145)
16/08/22 05:46:03 ERROR scheduler.LiveListenerBus: SparkListenerBus has
already stopped! Dropping event
SparkListenerJobEnd(0,1471869963305,JobFailed(org.apache.spark.SparkException:
Job 0 cancelled because SparkContext was shut down))
16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Interrupting
monitor thread
16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Shutting down all
executors
16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Asking each
executor to shut down
16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Stopped
16/08/22 05:46:03 INFO spark.MapOutputTrackerMasterEndpoint:
MapOutputTrackerMasterEndpoint stopped!
^C16/08/22 05:46:03 INFO storage.MemoryStore: MemoryStore cleared
16/08/22 05:46:03 INFO storage.BlockManager: BlockManager stopped
16/08/22 05:46:03 INFO storage.BlockManagerMaster: BlockManagerMaster
stopped
16/08/22 05:46:03 INFO
scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:
OutputCommitCoordinator stopped!
16/08/22 05:46:03 INFO spark.SparkContext: Successfully stopped SparkContext
16/08/22 05:46:03 INFO util.ShutdownHookManager: Shutdown hook called
16/08/22 05:46:03 INFO util.ShutdownHookManager: Deleting directory
/tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc
16/08/22 05:46:03 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Shutting down remote daemon.
16/08/22 05:46:03 INFO remote.RemoteActorRefProvider$RemotingTerminator:
Remote daemon shut down; proceeding with flushing remote transports.
16/08/22 05:46:03 INFO util.ShutdownHookManager: Deleting directory
/tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc/httpd-91da8e86-bee0-4c5a-868a-ea7d35a2536d
[root@sparkup1 config]#
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by percent620 <pe...@163.com>.
Thanks Val, I have fixed my issues for above, thanks for your great help on
this issue.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7253.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by percent620 <pe...@163.com>.
I have already fixed my issues, and add classpth://....srping-bean.jar to
load native jar NOT internet.
Thanks!!!!
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7289.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by vkulichenko <va...@gmail.com>.
No, this exception means that Spring can't parse your configuration file. If
you're using the exact same file, most likely it's a classpath issue caused
by the absence of spring-beans.jar dependency. Please check your project
structure.
-Val
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7284.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by percent620 <pe...@163.com>.
Thanks Val,
I have run successfully this with yarn on my local env. but when i run this
on production env, I always get spring beans error message
<?xml version="1.0" encoding="UTF-8"?>
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="
http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd">
<bean class="org.apache.ignite.configuration.IgniteConfiguration">
<property name="discoverySpi">
<bean
class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
<property name="ipFinder">
<bean
class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.TcpDiscoveryVmIpFinder">
<property name="addresses">
<list>
<value>172.16.186.200:47500..47509</value>
<value>172.16.186.201:47500..47509</value>
<value>172.16.186.202:47500..47509</value>
</list>
</property>
</bean>
</property>
</bean>
</property>
</bean>
</beans>
in my local env , we can ping internet, but on our production env, the
internet is disabled, is this root cause for this ?
16/08/24 16:43:33 ERROR TaskSetManager: Task 5 in stage 1.0 failed 4 times;
aborting job
Exception in thread "main" org.apache.spark.SparkException: Job aborted due
to stage failure: Task 5 in stage 1.0 failed 4 times, most recent failure:
Lost task 5.3 in stage 1.0 (TID 24, xxxx): class
org.apache.ignite.IgniteCheckedException: Failed to instantiate Spring XML
application context
[springUrl=file:/u01/apache-ignite-fabric-1.6.0-bin/config/default-config.xml,
err=Line 34 in XML document from URL
[file:/u01/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 34;
columnNumber: 69; cvc-elt.1: Cannot find the declaration of element
'beans'.]
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:391)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:104)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:98)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:639)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:678)
at
org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:717)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:171)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:170)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:756)
Caused by:
org.springframework.beans.factory.xml.XmlBeanDefinitionStoreException: Line
34 in XML document from URL
[file:/u01/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 34;
columnNumber: 69; cvc-elt.1: Cannot find the declaration of element 'beans'.
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.doLoadBeanDefinitions(XmlBeanDefinitionReader.java:398)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:335)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.loadBeanDefinitions(XmlBeanDefinitionReader.java:303)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:379)
... 21 more
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7269.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by vkulichenko <va...@gmail.com>.
Configuration file is required on all nodes where Ignite will start. On
executors the same path that you provide will be used.
-Val
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7249.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by percent620 <pe...@163.com>.
This is my java code as below
1)
val igniteContext = new IgniteContext[Integer, Integer](sc,
"/u01/xxxx/apache-ignite-fabric-1.6.0-bin/config/default-config.xml")
println("define igniteContext end===")
val sharedRDD = igniteContext.fromCache("sharedBaselineCacheRDD")
//val sharedRDD = igniteContext.fromCache(new
CacheConfiguration[Integer, Integer]().setCacheMode(CacheMode.REPLICATED))
val initalRDD = sc.parallelize(1 to 100000,10).map(i => (new Integer(i),
new Integer(i)))
println("initalRDD.couner=/. " + initalRDD.count() +"\tpartition=> " +
initalRDD.partitions.size)
sharedRDD.savePairs(initalRDD, true)
println("=====>totalcounter" + sharedRDD.count + "\t paris => " +
sharedRDD.partitions.size)
println("=====>" + sharedRDD.filter(_._2 > 50000).count)
2) my ignite default.xml configuration is static IP NOT mulicast
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7238.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by percent620 <pe...@163.com>.
I have fixed the file issues
"file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml" on
today.
I verified again on our production env and found another issues as below
1) I have set IGNTE_HOME on spark driver machine and start to submit this
jar to yarn cluster
export IGNITE_HOME=/u01/xxxx/apache-ignite-fabric-1.6.0-bin
$/u01/spark-1.6.0-hive/bin/spark-submit --driver-memory 4G --class
com.ValidSparkCache --master yarn --executor-cores 5 --executor-memory
15000m --num-executors 50 --conf spark.rdd.compress=false --conf
spark.shuffle.compress=false --conf spark.broadcast.compress=false
/u01/xxxx/spark_zmqpull_engine847.jar
16/08/23 16:42:07 WARN Utils: Service 'SparkUI' could not bind on port 4040.
Attempting port 4041.
16/08/23 16:42:07 WARN Utils: Service 'SparkUI' could not bind on port 4041.
Attempting port 4042.
16/08/23 16:42:07 WARN Utils: Service 'SparkUI' could not bind on port 4042.
Attempting port 4043.
16/08/23 16:42:07 WARN Utils: Service 'SparkUI' could not bind on port 4043.
Attempting port 4044.
define igniteContext start===
define igniteContext end===
[Stage 0:=======================> (4 + 6) /
10][16:43:17] New version is available at ignite.apache.org: 1.7.0
initalRDD.couner=/. 100000 partition=> 10
*16/08/23 16:43:21 WARN TaskSetManager: Lost task 7.0 in stage 1.0 (TID 17,
xxx): class org.apache.ignite.IgniteCheckedException: Spring XML
configuration path is invalid: config/default-config.xml. Note that this
path should be either absolute or a relative local file system path,
relative to META-INF in classpath or valid URL to IGNITE_HOME.
* at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3580)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:678)
at
org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:717)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:171)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:170)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:756)
Caused by: java.net.MalformedURLException: no protocol:
config/default-config.xml
at java.net.URL.<init>(URL.java:585)
at java.net.URL.<init>(URL.java:482)
at java.net.URL.<init>(URL.java:431)
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3571)
... 18 more
[Stage 1:> (0 + 10) /
10]16/08/23 16:43:31 WARN TaskSetManager: Lost task 3.2 in stage 1.0 (TID
23, xxxx): class org.apache.ignite.IgniteCheckedException: Spring XML
configuration path is invalid: config/default-config.xml. Note that this
path should be either absolute or a relative local file system path,
relative to META-INF in classpath or valid URL to IGNITE_HOME.
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3580)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:678)
at
org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:717)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:171)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:170)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:756)
Caused by: java.net.MalformedURLException: no protocol:
config/default-config.xml
at java.net.URL.<init>(URL.java:585)
at java.net.URL.<init>(URL.java:482)
at java.net.URL.<init>(URL.java:431)
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3571)
... 18 more
16/08/23 16:43:31 ERROR TaskSetManager: Task 3 in stage 1.0 failed 4 times;
aborting job
Exception in thread "main" org.apache.spark.SparkException: Job aborted due
to stage failure: Task 3 in stage 1.0 failed 4 times, most recent failure:
Lost task 3.3 in stage 1.0 (TID 25, xxx): class
org.apache.ignite.IgniteCheckedException: Spring XML configuration path is
invalid: config/default-config.xml. Note that this path should be either
absolute or a relative local file system path, relative to META-INF in
classpath or valid URL to IGNITE_HOME.
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3580)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:678)
at
org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:717)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:171)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:170)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:756)
Caused by: java.net.MalformedURLException: no protocol:
config/default-config.xml
at java.net.URL.<init>(URL.java:585)
at java.net.URL.<init>(URL.java:482)
at java.net.URL.<init>(URL.java:431)
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3571)
... 18 more
Driver stacktrace:
at
org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1431)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1419)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1418)
at
scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:47)
at
org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1418)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)
at
org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:799)
at scala.Option.foreach(Option.scala:236)
at
org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:799)
at
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1640)
at
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1599)
at
org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1588)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1845)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1858)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:1929)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1.apply(RDD.scala:920)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1.apply(RDD.scala:918)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:150)
at
org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:111)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:316)
at org.apache.spark.rdd.RDD.foreachPartition(RDD.scala:918)
at org.apache.ignite.spark.IgniteRDD.savePairs(IgniteRDD.scala:170)
at
com.alibaba.aim.sparkrule.search.es.ValidSparkCache$.main(TestSparkCache.scala:99)
at
com.alibaba.aim.sparkrule.search.es.ValidSparkCache.main(TestSparkCache.scala)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at
org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: class org.apache.ignite.IgniteCheckedException: Spring XML
configuration path is invalid: config/default-config.xml. Note that this
path should be either absolute or a relative local file system path,
relative to META-INF in classpath or valid URL to IGNITE_HOME.
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3580)
at
org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:678)
at
org.apache.ignite.internal.IgnitionEx.loadConfiguration(IgnitionEx.java:717)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at
org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(IgniteContext.scala:85)
at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
at org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:171)
at
org.apache.ignite.spark.IgniteRDD$$anonfun$savePairs$1.apply(IgniteRDD.scala:170)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.rdd.RDD$$anonfun$foreachPartition$1$$anonfun$apply$33.apply(RDD.scala:920)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at
org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:1858)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
at org.apache.spark.scheduler.Task.run(Task.scala:89)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:213)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:756)
Caused by: java.net.MalformedURLException: no protocol:
config/default-config.xml
at java.net.URL.<init>(URL.java:585)
at java.net.URL.<init>(URL.java:482)
at java.net.URL.<init>(URL.java:431)
at
org.apache.ignite.internal.util.IgniteUtils.resolveSpringUrl(IgniteUtils.java:3571)
... 18 more
2) this error message display this config/default-config.xml is not existed
on other spark workers
3)attache one captain logs as below
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/ignite/apache-ignite-fabric-1.6.0-bin/work/log/ignite-28cf1142.0.log
[16:34:44,787][INFO][main][IgniteKernal]
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
[16:34:44,789][INFO][main][IgniteKernal] Config URL:
file:/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/./ignite-config.xml
[16:34:44,789][INFO][main][IgniteKernal] Daemon mode: off
[16:34:44,789][INFO][main][IgniteKernal] OS: Linux
2.6.32-220.23.2.ali878.el6.x86_64 amd64
[16:34:44,789][INFO][main][IgniteKernal] OS user: hbase
[16:34:44,790][INFO][main][IgniteKernal] Language runtime: Java Platform API
Specification ver. 1.7
[16:34:44,790][INFO][main][IgniteKernal] VM information: Java(TM) SE Runtime
Environment 1.7.0_79-b15 Oracle Corporation OpenJDK (Alibaba) 64-Bit Server
VM 24.79-b02-internal
[16:34:44,792][INFO][main][IgniteKernal] VM total memory: 1.9GB
[16:34:44,792][INFO][main][IgniteKernal] Remote Management [restart: on,
REST: on, JMX (remote: on, port: 49112, auth: off, ssl: off)]
[16:34:44,792][INFO][main][IgniteKernal]
IGNITE_HOME=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/ignite/apache-ignite-fabric-1.6.0-bin
[16:34:44,793][INFO][main][IgniteKernal] VM arguments: [-Xms1g, -Xmx1g,
-XX:+AggressiveOpts, -XX:MaxPermSize=256m, -DIGNITE_QUIET=true,
-DIGNITE_SUCCESS_FILE=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/ignite/apache-ignite-fabric-1.6.0-bin/work/ignite_success_42f8b644-7d8f-46db-931d-71a7bf7bdf59,
-Dcom.sun.management.jmxremote, -Dcom.sun.management.jmxremote.port=49112,
-Dcom.sun.management.jmxremote.authenticate=false,
-Dcom.sun.management.jmxremote.ssl=false,
-DIGNITE_HOME=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/ignite/apache-ignite-fabric-1.6.0-bin,
-DIGNITE_PROG_NAME=./ignite/apache-ignite-fabric-1.6.0-bin/bin/ignite.sh,
-Xmx2048m, -Xms2048m]
[16:34:44,793][INFO][main][IgniteKernal] Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache',
'ignite-atomics-sys-cache']
[16:34:44,797][INFO][main][IgniteKernal] 3-rd party licenses can be found
at:
/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/ignite/apache-ignite-fabric-1.6.0-bin/libs/licenses
[16:34:44,889][INFO][main][IgniteKernal] Non-loopback local IPs: xxx
[16:34:44,889][INFO][main][IgniteKernal] Enabled local MACs: 283152A7FE8E
[16:34:44,909][INFO][main][IgnitePluginProcessor] Configured plugins:
[16:34:44,909][INFO][main][IgnitePluginProcessor] ^-- None
[16:34:44,909][INFO][main][IgnitePluginProcessor]
[16:34:44,991][INFO][main][TcpCommunicationSpi] IPC shared memory server
endpoint started [port=48100,
tokDir=/u01/hbase/tmp/nm-local-dir/usercache/hbase/appcache/application_1455892346017_5426/container_1455892346017_5426_01_000002/ignite/apache-ignite-fabric-1.6.0-bin/work/ipc/shmem/28cf1142-e0f7-475d-91bd-694bfa96d122-119317]
[16:34:44,991][INFO][main][TcpCommunicationSpi] Successfully bound shared
memory communication to TCP port [port=48100, locHost=0.0.0.0/0.0.0.0]
[16:34:45,012][INFO][main][TcpCommunicationSpi] Successfully bound to TCP
port [port=47100, locHost=0.0.0.0/0.0.0.0]
[16:34:45,036][WARNING][main][NoopCheckpointSpi] Checkpoints are disabled
(to enable configure any GridCheckpointSpi implementation)
[16:34:45,078][WARNING][main][GridCollisionManager] Collision resolution is
disabled (all jobs will be activated upon arrival).
[16:34:45,083][WARNING][main][NoopSwapSpaceSpi] Swap space is disabled. To
enable use FileSwapSpaceSpi.
[16:34:45,086][INFO][main][IgniteKernal] Security status
[authentication=off, tls/ssl=off]
[16:34:45,448][INFO][main][GridTcpRestProtocol] Command protocol
successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211]
[16:34:45,553][INFO][main][TcpDiscoverySpi] Successfully bound to TCP port
[port=47500, localHost=0.0.0.0/0.0.0.0]
[16:41:33,493][INFO][main][GridCacheProcessor] Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
[16:41:33,531][INFO][main][GridCacheProcessor] Started cache
[name=ignite-atomics-sys-cache, mode=PARTITIONED]
[16:41:33,533][INFO][main][GridCacheProcessor] Started cache
[name=ignite-sys-cache, mode=REPLICATED]
[16:41:33,849][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Cache rebalancing scheduled: [cache=ignite-sys-cache, waitList=[]]
[16:41:33,850][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Cache rebalancing scheduled: [cache=ignite-marshaller-sys-cache,
waitList=[]]
[16:41:33,850][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Cache rebalancing scheduled: [cache=ignite-atomics-sys-cache,
waitList=[ignite-sys-cache, ignite-marshaller-sys-cache]]
[16:41:33,851][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Rebalancing required [top=AffinityTopologyVersion [topVer=5, minorTopVer=0],
evt=NODE_JOINED, node=28cf1142-e0f7-475d-91bd-694bfa96d122]
[16:41:33,851][INFO][exchange-worker-#114%null%][GridDhtPartitionDemander]
<ignite-marshaller-sys-cache> Starting rebalancing
[cache=ignite-marshaller-sys-cache, mode=SYNC,
fromNode=dafb84e5-37d8-48af-b7b3-1eed5f9e357d, partitionsCount=11,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=1]
[16:41:33,852][INFO][exchange-worker-#114%null%][GridDhtPartitionDemander]
<ignite-marshaller-sys-cache> Starting rebalancing
[cache=ignite-marshaller-sys-cache, mode=SYNC,
fromNode=5cec9032-9274-4bb8-98e0-d8c891761030, partitionsCount=9,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=1]
[16:41:33,860][INFO][sys-#52%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Starting rebalancing [cache=ignite-sys-cache, mode=SYNC,
fromNode=dafb84e5-37d8-48af-b7b3-1eed5f9e357d, partitionsCount=49,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=1]
[16:41:33,861][INFO][sys-#52%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Starting rebalancing [cache=ignite-sys-cache, mode=SYNC,
fromNode=5cec9032-9274-4bb8-98e0-d8c891761030, partitionsCount=51,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=1]
[16:41:33,862][INFO][marshaller-cache-#116%null%][GridDhtPartitionDemander]
<ignite-marshaller-sys-cache> Completed rebalancing
[cache=ignite-marshaller-sys-cache,
fromNode=dafb84e5-37d8-48af-b7b3-1eed5f9e357d,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], time=11 ms]
[16:41:33,863][INFO][marshaller-cache-#117%null%][GridDhtPartitionDemander]
<ignite-marshaller-sys-cache> Completed (final) rebalancing
[cache=ignite-marshaller-sys-cache,
fromNode=5cec9032-9274-4bb8-98e0-d8c891761030,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], time=11 ms]
[16:41:33,871][INFO][utility-#118%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Completed rebalancing [cache=ignite-sys-cache,
fromNode=5cec9032-9274-4bb8-98e0-d8c891761030,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], time=21 ms]
[16:41:33,872][INFO][utility-#119%null%][GridDhtPartitionDemander]
<ignite-sys-cache> Completed (final) rebalancing [cache=ignite-sys-cache,
fromNode=dafb84e5-37d8-48af-b7b3-1eed5f9e357d,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], time=21 ms]
[16:41:33,872][INFO][sys-#52%null%][GridDhtPartitionDemander]
<ignite-atomics-sys-cache> Starting rebalancing
[cache=ignite-atomics-sys-cache, mode=SYNC,
fromNode=dafb84e5-37d8-48af-b7b3-1eed5f9e357d, partitionsCount=182,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=1]
[16:41:33,873][INFO][sys-#52%null%][GridDhtPartitionDemander]
<ignite-atomics-sys-cache> Starting rebalancing
[cache=ignite-atomics-sys-cache, mode=SYNC,
fromNode=5cec9032-9274-4bb8-98e0-d8c891761030, partitionsCount=162,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], updateSeq=1]
[16:41:33,907][INFO][sys-#51%null%][GridDhtPartitionDemander]
<ignite-atomics-sys-cache> Completed rebalancing
[cache=ignite-atomics-sys-cache,
fromNode=5cec9032-9274-4bb8-98e0-d8c891761030,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], time=30 ms]
[16:41:33,909][INFO][sys-#53%null%][GridDhtPartitionDemander]
<ignite-atomics-sys-cache> Completed (final) rebalancing
[cache=ignite-atomics-sys-cache,
fromNode=dafb84e5-37d8-48af-b7b3-1eed5f9e357d,
topology=AffinityTopologyVersion [topVer=5, minorTopVer=0], time=30 ms]
[16:41:33,965][INFO][main][IgniteKernal] To start Console Management &
Monitoring run ignitevisorcmd.{sh|bat}
[16:41:33,966][INFO][main][IgniteKernal]
[16:41:33,970][INFO][main][IgniteKernal]
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-220.23.2.ali878.el6.x86_64 amd64
>>> CPU(s): 24
>>> Heap: 2.0GB
>>> VM name: 119317@xxxx
>>> Local node [ID=28CF1142-E0F7-475D-91BD-694BFA96D122, order=5,
>>> clientMode=false]
>>> Local node addresses: [xxxx/yyy, /127.0.0.1]
>>> Local ports: TCP:11211 TCP:47100 TCP:47500 TCP:48100
[16:41:33,972][INFO][main][GridDiscoveryManager] Topology snapshot [ver=5,
servers=3, clients=0, CPUs=72, heap=6.0GB]
[16:41:35,506][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=5, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT,
node=dafb84e5-37d8-48af-b7b3-1eed5f9e357d]
[16:41:35,754][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Added new node to topology: TcpDiscoveryNode
[id=08e62f09-26a7-4a7e-b649-7c0439974c9c, addrs=[xxx, 127.0.0.1],
sockAddrs=[xxx/xxx:47500, /xxx:47500, /127.0.0.1:47500], discPort=47500,
order=6, intOrder=5, lastExchangeTime=1471941695581, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=false]
[16:41:35,756][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Topology snapshot [ver=6, servers=4, clients=0, CPUs=96, heap=8.0GB]
[16:41:36,485][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=6, minorTopVer=0], evt=NODE_JOINED,
node=08e62f09-26a7-4a7e-b649-7c0439974c9c]
[16:41:38,683][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=6, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT,
node=dafb84e5-37d8-48af-b7b3-1eed5f9e357d]
[16:42:33,979][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:01:00:015]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.07%, avg=0.28%, GC=0%]
^-- Heap [used=417MB, free=78.72%, comm=1963MB]
^-- Non heap [used=30MB, free=90.08%, comm=30MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:42:43,210][INFO][ignite-update-notifier-timer][GridUpdateNotifier]
Update status is not available.
[16:43:07,517][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Added new node to topology: TcpDiscoveryNode
[id=f6ff2e3e-6b6f-4b2e-a7c3-07e5526edd09, addrs=[xxx, 127.0.0.1],
sockAddrs=[xxx/yyy:0, /xxx:0, /127.0.0.1:0], discPort=0, order=7,
intOrder=6, lastExchangeTime=1471941787467, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=true]
[16:43:07,520][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Topology snapshot [ver=7, servers=4, clients=1, CPUs=120, heap=12.0GB]
[16:43:07,537][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=7, minorTopVer=0], evt=NODE_JOINED,
node=f6ff2e3e-6b6f-4b2e-a7c3-07e5526edd09]
[16:43:33,987][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:02:00:020]
^-- H/N/C [hosts=5, nodes=5, CPUs=120]
^-- CPU [cur=0.07%, avg=0.17%, GC=0%]
^-- Heap [used=427MB, free=78.25%, comm=1963MB]
^-- Non heap [used=30MB, free=90.03%, comm=31MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:43:35,292][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Node left topology: TcpDiscoveryNode
[id=f6ff2e3e-6b6f-4b2e-a7c3-07e5526edd09, addrs=[xxx, 127.0.0.1],
sockAddrs=[xxx/xxx:0, /xxxx:0, /127.0.0.1:0], discPort=0, order=7,
intOrder=6, lastExchangeTime=1471941787467, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=true]
[16:43:35,294][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Topology snapshot [ver=8, servers=4, clients=0, CPUs=96, heap=8.0GB]
[16:43:35,312][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=8, minorTopVer=0], evt=NODE_LEFT,
node=f6ff2e3e-6b6f-4b2e-a7c3-07e5526edd09]
[16:44:33,994][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:03:00:028]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.14%, GC=0%]
^-- Heap [used=441MB, free=77.52%, comm=1963MB]
^-- Non heap [used=30MB, free=89.94%, comm=31MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:45:34,005][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:04:00:036]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.12%, GC=0%]
^-- Heap [used=448MB, free=77.16%, comm=1963MB]
^-- Non heap [used=30MB, free=89.93%, comm=31MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:46:34,012][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:05:00:048]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.1%, GC=0%]
^-- Heap [used=455MB, free=76.82%, comm=1963MB]
^-- Non heap [used=30MB, free=89.92%, comm=31MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:46:50,900][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Added new node to topology: TcpDiscoveryNode
[id=488d4aff-09b1-463d-aaa6-656f8adda0a4, addrs=[xxx, 127.0.0.1],
sockAddrs=[xxx/xxx:0, /xxx:0, /127.0.0.1:0], discPort=0, order=9,
intOrder=7, lastExchangeTime=1471942010840, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=true]
[16:46:50,902][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Topology snapshot [ver=9, servers=4, clients=1, CPUs=120, heap=9.0GB]
[16:46:50,915][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=9, minorTopVer=0], evt=NODE_JOINED,
node=488d4aff-09b1-463d-aaa6-656f8adda0a4]
[16:47:13,185][INFO][exchange-worker-#114%null%][GridCacheProcessor] Started
cache [name=partitioned, mode=PARTITIONED]
[16:47:13,476][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=9, minorTopVer=1], evt=DISCOVERY_CUSTOM_EVT,
node=488d4aff-09b1-463d-aaa6-656f8adda0a4]
[16:47:34,015][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:06:00:050]
^-- H/N/C [hosts=5, nodes=5, CPUs=120]
^-- CPU [cur=0.07%, avg=0.1%, GC=0%]
^-- Heap [used=472MB, free=75.93%, comm=1963MB]
^-- Non heap [used=30MB, free=89.82%, comm=31MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:48:15,510][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Node left topology: TcpDiscoveryNode
[id=488d4aff-09b1-463d-aaa6-656f8adda0a4, addrs=[xxx, 127.0.0.1],
sockAddrs=[xxx/xxx:0, /xx:0, /127.0.0.1:0], discPort=0, order=9, intOrder=7,
lastExchangeTime=1471942010840, loc=false, ver=1.6.0#20160518-sha1:0b22c45b,
isClient=true]
[16:48:15,515][INFO][disco-event-worker-#112%null%][GridDiscoveryManager]
Topology snapshot [ver=10, servers=4, clients=0, CPUs=96, heap=8.0GB]
[16:48:15,543][INFO][exchange-worker-#114%null%][GridCachePartitionExchangeManager]
Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion
[topVer=10, minorTopVer=0], evt=NODE_LEFT,
node=488d4aff-09b1-463d-aaa6-656f8adda0a4]
[16:48:34,022][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:07:00:058]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.14%, GC=0%]
^-- Heap [used=201MB, free=89.74%, comm=1963MB]
^-- Non heap [used=32MB, free=89.46%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:49:34,031][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:08:00:065]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.13%, GC=0%]
^-- Heap [used=208MB, free=89.39%, comm=1963MB]
^-- Non heap [used=32MB, free=89.46%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:50:34,037][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:09:00:072]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.12%, GC=0%]
^-- Heap [used=215MB, free=89.04%, comm=1963MB]
^-- Non heap [used=32MB, free=89.45%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:51:34,046][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:10:00:078]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.11%, GC=0%]
^-- Heap [used=221MB, free=88.71%, comm=1963MB]
^-- Non heap [used=32MB, free=89.44%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:52:34,052][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:11:00:081]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.1%, GC=0%]
^-- Heap [used=228MB, free=88.34%, comm=1963MB]
^-- Non heap [used=32MB, free=89.41%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:53:34,056][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:12:00:089]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.1%, GC=0%]
^-- Heap [used=235MB, free=88.01%, comm=1963MB]
^-- Non heap [used=32MB, free=89.4%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:54:34,062][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:13:00:093]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.1%, GC=0%]
^-- Heap [used=242MB, free=87.66%, comm=1963MB]
^-- Non heap [used=32MB, free=89.4%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:55:34,067][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:14:00:102]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.09%, GC=0%]
^-- Heap [used=248MB, free=87.33%, comm=1963MB]
^-- Non heap [used=32MB, free=89.4%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:56:34,074][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:15:00:106]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.08%, GC=0%]
^-- Heap [used=256MB, free=86.96%, comm=1963MB]
^-- Non heap [used=32MB, free=89.4%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:57:34,079][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:16:00:114]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.08%, GC=0%]
^-- Heap [used=262MB, free=86.63%, comm=1963MB]
^-- Non heap [used=32MB, free=89.39%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:57:52,170][WARNING][tcp-disco-sock-reader-#11%null%][TcpDiscoverySpi]
Unknown connection detected (is some other software connecting to this
Ignite port? missing SSL configuration on remote node?) [rmtAddr=/127.0.0.1]
[16:58:34,084][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:17:00:118]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.08%, GC=0%]
^-- Heap [used=270MB, free=86.24%, comm=1963MB]
^-- Non heap [used=32MB, free=89.38%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[16:59:34,090][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:18:00:125]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.08%, GC=0%]
^-- Heap [used=276MB, free=85.91%, comm=1963MB]
^-- Non heap [used=32MB, free=89.37%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:00:34,096][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:19:00:128]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.07%, GC=0%]
^-- Heap [used=283MB, free=85.55%, comm=1963MB]
^-- Non heap [used=32MB, free=89.37%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:01:34,103][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:20:00:134]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0%, avg=0.07%, GC=0%]
^-- Heap [used=290MB, free=85.2%, comm=1963MB]
^-- Non heap [used=32MB, free=89.37%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:02:34,110][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:21:00:141]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.07%, avg=0.07%, GC=0%]
^-- Heap [used=297MB, free=84.86%, comm=1963MB]
^-- Non heap [used=32MB, free=89.36%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:03:34,113][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:22:00:151]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.07%, GC=0%]
^-- Heap [used=305MB, free=84.46%, comm=1963MB]
^-- Non heap [used=32MB, free=89.36%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:04:34,123][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:23:00:156]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.07%, GC=0%]
^-- Heap [used=311MB, free=84.12%, comm=1963MB]
^-- Non heap [used=32MB, free=89.35%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:05:34,128][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:24:00:162]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0%, avg=0.06%, GC=0%]
^-- Heap [used=318MB, free=83.76%, comm=1963MB]
^-- Non heap [used=32MB, free=89.35%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:06:34,136][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:25:00:167]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.06%, GC=0%]
^-- Heap [used=325MB, free=83.43%, comm=1963MB]
^-- Non heap [used=32MB, free=89.35%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:07:34,137][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:26:00:168]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.07%, avg=0.06%, GC=0%]
^-- Heap [used=332MB, free=83.08%, comm=1963MB]
^-- Non heap [used=32MB, free=89.34%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
[17:08:34,136][INFO][grid-timeout-worker-#97%null%][IgniteKernal]
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=28cf1142, name=null, uptime=00:27:00:170]
^-- H/N/C [hosts=4, nodes=4, CPUs=96]
^-- CPU [cur=0.03%, avg=0.06%, GC=0%]
^-- Heap [used=338MB, free=82.74%, comm=1963MB]
^-- Non heap [used=32MB, free=89.33%, comm=32MB]
^-- Public thread pool [active=0, idle=48, qSize=0]
^-- System thread pool [active=0, idle=48, qSize=0]
^-- Outbound messages queue [size=0]
4)Does I need to copy config/default.xml to all the spark workers? I think
NO.
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7236.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In Production
Posted by Nikolai Tikhonov <nt...@apache.org>.
Hi,
How I see in your logs that your "file:/usr/apache-ignite-
fabric-1.6.0-bin/config/default-config.xml" is incorrect.
invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
columnNumber: 71; cvc-elt.1: Cannot find the declaration of element 'beans'.
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
doLoadBeanDefinitions(XmlBeanDefinitionReader.java:398)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
loadBeanDefinitions(XmlBeanDefinitionReader.java:335)
at
org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
loadBeanDefinitions(XmlBeanDefinitionReader.java:303)
at
org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.
applicationContext(IgniteSpringHelperImpl.java:379)
... 19 more
Caused by: org.xml.sax.SAXParseException; lineNumber: 6; columnNumber: 71;
cvc-elt.1: Cannot find the declaration of element 'beans'.
Could you share this file?
On Mon, Aug 22, 2016 at 3:45 PM, percent620 <pe...@163.com> wrote:
> Hello,
>
> Everything is okay for me to integrate ignite with yarn on *Multicast Based
> Discovery* in my local spark and yarn cluster , but in our production env,
> some of ports could't be opened .So, I need to specify a static ip address
> to discovery each other.
>
> but when running my configuration and encountered the following issue. List
> my detailed steps as below.
>
> 1、config/default-config.mxl
> <?xml version="1.0" encoding="UTF-8"?>
> <beans xmlns="http://www.springframework.org/schema/beans"
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
> xsi:schemaLocation="
> http://www.springframework.org/schema/beans
> http://www.springframework.org/schema/beans/spring-beans.xsd">
> <bean class="org.apache.ignite.configuration.IgniteConfiguration">
> <property name="discoverySpi">
> <bean
> class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi">
> <property name="ipFinder">
> <bean
> class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm.
> TcpDiscoveryVmIpFinder">
> <property name="addresses">
> <list>
>
> <value>172.16.186.200:47500..47509</value>
>
> <value>172.16.186.201:47500..47509</value>
>
> <value>172.16.186.202:47500..47509</value>
> </list>
> </property>
> </bean>
> </property>
> </bean>
> </property>
> </bean>
> </beans>
>
> 2、my java code on idea
> ackage com.ignite
> import org.apache.ignite.spark._
> import org.apache.ignite.configuration._
> import org.apache.spark.{SparkConf, SparkContext}
> /**
> * Created by limu on 2016/8/14.
> */
> object testIgniteSharedRDD {
> def main(args: Array[String]): Unit = {
> val conf = new SparkConf().setAppName("testIgniteSharedRDD")
> val sc = new SparkContext(conf)
>
> /* val cfg = new IgniteConfiguration()
> cfg.setIgniteHome("/usr/apache-ignite-fabric-1.6.0-bin")
> */
> //val ic = new IgniteContext[Integer, Integer](sc, () => new
> IgniteConfiguration())
> val ic = new IgniteContext[Integer, Integer](sc,
> "/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml")
> val sharedRDD = ic.fromCache("sharedIgniteRDD-ling-sha111o")
> println("original.sharedCounter=> " + sharedRDD.count())
>
> sharedRDD.savePairs(sc.parallelize(1 to 77000, 10).map(i => (new
> Integer(i), new Integer(i))))
> println("final.sharedCounter=> " + sharedRDD.count())
>
> println("final.condition.couner=> " + sharedRDD.filter(_._2 >
> 21000).count )
> }
>
>
> 3、Yarn container logs
> Logs for container_1471869381289_0001_01_000001
>
> About Apache Hadoop
> ResourceManager
>
> RM Home
>
> NodeManager
> Tools
>
>
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/usr/hadoop-2.4.1/share/hadoop/common/lib/slf4j-
> log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/usr/hadoop-2.4.1/tmp/nm-local-dir/usercache/
> root/appcache/application_1471869381289_0001/filecache/
> 10/ignite-yarn.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
> 16/08/22 05:38:52 INFO impl.ContainerManagementProtocolProxy:
> yarn.client.max-nodemanagers-proxies : 500
> 16/08/22 05:38:52 INFO client.RMProxy: Connecting to ResourceManager at
> sparkup1/172.16.186.200:8030
> Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
> INFO: Application master registered.
> Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
> INFO: Making request. Memory: 1,908, cpu 1.
> Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
> INFO: Making request. Memory: 1,908, cpu 1.
> Aug 22, 2016 5:38:53 AM org.apache.ignite.yarn.ApplicationMaster run
> INFO: Making request. Memory: 1,908, cpu 1.
> 16/08/22 05:38:54 INFO impl.AMRMClientImpl: Received new token for :
> sparkup3:46170
> 16/08/22 05:38:54 INFO impl.AMRMClientImpl: Received new token for :
> sparkup2:55406
> Aug 22, 2016 5:38:54 AM org.apache.ignite.yarn.ApplicationMaster
> onContainersAllocated
> INFO: Launching container: container_1471869381289_0001_01_000002.
> 16/08/22 05:38:54 INFO impl.ContainerManagementProtocolProxy: Opening
> proxy
> : sparkup3:46170
> 16/08/22 05:38:54 INFO impl.AMRMClientImpl: Received new token for :
> sparkup1:53711
> Aug 22, 2016 5:38:54 AM org.apache.ignite.yarn.ApplicationMaster
> onContainersAllocated
> INFO: Launching container: container_1471869381289_0001_01_000003.
> 16/08/22 05:38:54 INFO impl.ContainerManagementProtocolProxy: Opening
> proxy
> : sparkup2:55406
> Aug 22, 2016 5:38:55 AM org.apache.ignite.yarn.ApplicationMaster
> onContainersAllocated
> INFO: Launching container: container_1471869381289_0001_01_000004.
> 16/08/22 05:38:55 INFO impl.ContainerManagementProtocolProxy: Opening
> proxy
> : sparkup1:53711
>
>
> 4、spark-submit errors
>
>
> [root@sparkup1 config]# clear
> [root@sparkup1 config]# spark-submit --driver-memory 2G --class
> com.ignite.testIgniteSharedRDD --master yarn --executor-cores 2
> --executor-memory 1000m --num-executors 2 --conf spark.rdd.compress=false
> --conf spark.shuffle.compress=false --conf spark.broadcast.compress=false
> /root/limu/ignite/spark-project-jar-with-dependencies.jar
> 16/08/22 05:44:36 INFO spark.SparkContext: Running Spark version 1.6.1
> 16/08/22 05:44:37 WARN util.NativeCodeLoader: Unable to load native-hadoop
> library for your platform... using builtin-java classes where applicable
> 16/08/22 05:44:37 INFO spark.SecurityManager: Changing view acls to: root
> 16/08/22 05:44:37 INFO spark.SecurityManager: Changing modify acls to: root
> 16/08/22 05:44:37 INFO spark.SecurityManager: SecurityManager:
> authentication disabled; ui acls disabled; users with view permissions:
> Set(root); users with modify permissions: Set(root)
> 16/08/22 05:44:38 INFO util.Utils: Successfully started service
> 'sparkDriver' on port 43868.
> 16/08/22 05:44:38 INFO slf4j.Slf4jLogger: Slf4jLogger started
> 16/08/22 05:44:39 INFO Remoting: Starting remoting
> 16/08/22 05:44:39 INFO Remoting: Remoting started; listening on addresses
> :[akka.tcp://sparkDriverActorSystem@172.16.186.200:47472]
> 16/08/22 05:44:39 INFO util.Utils: Successfully started service
> 'sparkDriverActorSystem' on port 47472.
> 16/08/22 05:44:39 INFO spark.SparkEnv: Registering MapOutputTracker
> 16/08/22 05:44:39 INFO spark.SparkEnv: Registering BlockManagerMaster
> 16/08/22 05:44:39 INFO storage.DiskBlockManager: Created local directory at
> /tmp/blockmgr-d1426202-a59e-4436-82b3-5142d5861e0e
> 16/08/22 05:44:39 INFO storage.MemoryStore: MemoryStore started with
> capacity 1259.8 MB
> 16/08/22 05:44:39 INFO spark.SparkEnv: Registering OutputCommitCoordinator
> 16/08/22 05:44:40 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 16/08/22 05:44:40 INFO server.AbstractConnector: Started
> SelectChannelConnector@0.0.0.0:4040
> 16/08/22 05:44:40 INFO util.Utils: Successfully started service 'SparkUI'
> on
> port 4040.
> 16/08/22 05:44:40 INFO ui.SparkUI: Started SparkUI at
> http://172.16.186.200:4040
> 16/08/22 05:44:40 INFO spark.HttpFileServer: HTTP File server directory is
> /tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc/httpd-
> 91da8e86-bee0-4c5a-868a-ea7d35a2536d
> 16/08/22 05:44:40 INFO spark.HttpServer: Starting HTTP Server
> 16/08/22 05:44:40 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 16/08/22 05:44:40 INFO server.AbstractConnector: Started
> SocketConnector@0.0.0.0:56870
> 16/08/22 05:44:40 INFO util.Utils: Successfully started service 'HTTP file
> server' on port 56870.
> 16/08/22 05:44:41 INFO spark.SparkContext: Added JAR
> file:/root/limu/ignite/spark-project-jar-with-dependencies.jar at
> http://172.16.186.200:56870/jars/spark-project-jar-with-dependencies.jar
> with timestamp 1471869881473
> 16/08/22 05:44:41 INFO client.RMProxy: Connecting to ResourceManager at
> sparkup1/172.16.186.200:8032
> 16/08/22 05:44:42 INFO yarn.Client: Requesting a new application from
> cluster with 3 NodeManagers
> 16/08/22 05:44:42 INFO yarn.Client: Verifying our application has not
> requested more than the maximum memory capability of the cluster (8192 MB
> per container)
> 16/08/22 05:44:42 INFO yarn.Client: Will allocate AM container, with 896 MB
> memory including 384 MB overhead
> 16/08/22 05:44:42 INFO yarn.Client: Setting up container launch context for
> our AM
> 16/08/22 05:44:42 INFO yarn.Client: Setting up the launch environment for
> our AM container
> 16/08/22 05:44:42 INFO yarn.Client: Preparing resources for our AM
> container
> 16/08/22 05:44:43 INFO yarn.Client: Uploading resource
> file:/usr/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-
> 1.6.1-hadoop2.6.0.jar
> ->
> hdfs://sparkup1:9000/user/root/.sparkStaging/application_1471869381289_
> 0003/spark-assembly-1.6.1-hadoop2.6.0.jar
> 16/08/22 05:44:48 INFO yarn.Client: Uploading resource
> file:/tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc/__spark_conf__
> 522717764919469546.zip
> ->
> hdfs://sparkup1:9000/user/root/.sparkStaging/application_1471869381289_
> 0003/__spark_conf__522717764919469546.zip
> 16/08/22 05:44:48 INFO spark.SecurityManager: Changing view acls to: root
> 16/08/22 05:44:48 INFO spark.SecurityManager: Changing modify acls to: root
> 16/08/22 05:44:48 INFO spark.SecurityManager: SecurityManager:
> authentication disabled; ui acls disabled; users with view permissions:
> Set(root); users with modify permissions: Set(root)
> 16/08/22 05:44:48 INFO yarn.Client: Submitting application 3 to
> ResourceManager
> 16/08/22 05:44:48 INFO impl.YarnClientImpl: Submitted application
> application_1471869381289_0003
> 16/08/22 05:44:49 INFO yarn.Client: Application report for
> application_1471869381289_0003 (state: ACCEPTED)
> 16/08/22 05:44:49 INFO yarn.Client:
> client token: N/A
> diagnostics: N/A
> ApplicationMaster host: N/A
> ApplicationMaster RPC port: -1
> queue: default
> start time: 1471869888680
> final status: UNDEFINED
> tracking URL:
> http://sparkup1:8088/proxy/application_1471869381289_0003/
> user: root
> 16/08/22 05:44:50 INFO yarn.Client: Application report for
> application_1471869381289_0003 (state: ACCEPTED)
> 16/08/22 05:44:51 INFO yarn.Client: Application report for
> application_1471869381289_0003 (state: ACCEPTED)
> 16/08/22 05:44:52 INFO yarn.Client: Application report for
> application_1471869381289_0003 (state: ACCEPTED)
> 16/08/22 05:44:53 INFO yarn.Client: Application report for
> application_1471869381289_0003 (state: ACCEPTED)
> 16/08/22 05:44:54 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint:
> ApplicationMaster registered as NettyRpcEndpointRef(null)
> 16/08/22 05:44:54 INFO cluster.YarnClientSchedulerBackend: Add WebUI
> Filter.
> org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter,
> Map(PROXY_HOSTS
> -> sparkup1, PROXY_URI_BASES ->
> http://sparkup1:8088/proxy/application_1471869381289_0003),
> /proxy/application_1471869381289_0003
> 16/08/22 05:44:54 INFO ui.JettyUtils: Adding filter:
> org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
> 16/08/22 05:44:54 INFO yarn.Client: Application report for
> application_1471869381289_0003 (state: RUNNING)
> 16/08/22 05:44:54 INFO yarn.Client:
> client token: N/A
> diagnostics: N/A
> ApplicationMaster host: 172.16.186.200
> ApplicationMaster RPC port: 0
> queue: default
> start time: 1471869888680
> final status: UNDEFINED
> tracking URL:
> http://sparkup1:8088/proxy/application_1471869381289_0003/
> user: root
> 16/08/22 05:44:54 INFO cluster.YarnClientSchedulerBackend: Application
> application_1471869381289_0003 has started running.
> 16/08/22 05:44:54 INFO util.Utils: Successfully started service
> 'org.apache.spark.network.netty.NettyBlockTransferService' on port 34347.
> 16/08/22 05:44:54 INFO netty.NettyBlockTransferService: Server created on
> 34347
> 16/08/22 05:44:54 INFO storage.BlockManagerMaster: Trying to register
> BlockManager
> 16/08/22 05:44:54 INFO storage.BlockManagerMasterEndpoint: Registering
> block
> manager 172.16.186.200:34347 with 1259.8 MB RAM, BlockManagerId(driver,
> 172.16.186.200, 34347)
> 16/08/22 05:44:54 INFO storage.BlockManagerMaster: Registered BlockManager
> 16/08/22 05:45:02 INFO cluster.YarnClientSchedulerBackend: Registered
> executor NettyRpcEndpointRef(null) (sparkup1:36133) with ID 1
> 16/08/22 05:45:02 INFO storage.BlockManagerMasterEndpoint: Registering
> block
> manager sparkup1:37604 with 500.0 MB RAM, BlockManagerId(1, sparkup1,
> 37604)
> 16/08/22 05:45:02 INFO cluster.YarnClientSchedulerBackend: Registered
> executor NettyRpcEndpointRef(null) (sparkup3:35841) with ID 2
> 16/08/22 05:45:02 INFO storage.BlockManagerMasterEndpoint: Registering
> block
> manager sparkup3:53373 with 500.0 MB RAM, BlockManagerId(2, sparkup3,
> 53373)
> 16/08/22 05:45:02 INFO cluster.YarnClientSchedulerBackend:
> SchedulerBackend
> is ready for scheduling beginning after reached
> minRegisteredResourcesRatio:
> 0.8
> 16/08/22 05:45:03 INFO xml.XmlBeanDefinitionReader: Loading XML bean
> definitions from URL
> [file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml]
> 16/08/22 05:45:04 INFO support.GenericApplicationContext: Refreshing
> org.springframework.context.support.GenericApplicationContext@529c42c6:
> startup date [Mon Aug 22 05:45:04 PDT 2016]; root of context hierarchy
> 16/08/22 05:45:04 INFO internal.IgniteKernal:
>
> >>> __________ ________________
> >>> / _/ ___/ |/ / _/_ __/ __/
> >>> _/ // (7 7 // / / / / _/
> >>> /___/\___/_/|_/___/ /_/ /___/
> >>>
> >>> ver. 1.6.0#20160518-sha1:0b22c45b
> >>> 2016 Copyright(C) Apache Software Foundation
> >>>
> >>> Ignite documentation: http://ignite.apache.org
>
> 16/08/22 05:45:04 INFO internal.IgniteKernal: Config URL: n/a
> 16/08/22 05:45:04 INFO internal.IgniteKernal: Daemon mode: off
> 16/08/22 05:45:04 INFO internal.IgniteKernal: OS: Linux
> 2.6.32-431.el6.x86_64 amd64
> 16/08/22 05:45:04 INFO internal.IgniteKernal: OS user: root
> 16/08/22 05:45:04 INFO internal.IgniteKernal: Language runtime: Java
> Platform API Specification ver. 1.7
> 16/08/22 05:45:04 INFO internal.IgniteKernal: VM information: Java(TM) SE
> Runtime Environment 1.7.0_71-b14 Oracle Corporation Java HotSpot(TM) 64-Bit
> Server VM 24.71-b01
> 16/08/22 05:45:04 INFO internal.IgniteKernal: VM total memory: 1.9GB
> 16/08/22 05:45:04 INFO internal.IgniteKernal: Remote Management [restart:
> off, REST: on, JMX (remote: off)]
> 16/08/22 05:45:04 INFO internal.IgniteKernal:
> IGNITE_HOME=/usr/apache-ignite-fabric-1.6.0-bin
> 16/08/22 05:45:04 INFO internal.IgniteKernal: VM arguments: [-Xms2G,
> -Xmx2G,
> -XX:MaxPermSize=256m]
> 16/08/22 05:45:04 INFO internal.IgniteKernal: Configured caches
> ['ignite-marshaller-sys-cache', 'ignite-sys-cache',
> 'ignite-atomics-sys-cache']
> 16/08/22 05:45:05 INFO internal.IgniteKernal: 3-rd party licenses can be
> found at: /usr/apache-ignite-fabric-1.6.0-bin/libs/licenses
> 16/08/22 05:45:05 INFO internal.IgniteKernal: Non-loopback local IPs:
> 172.16.186.200, fe80:0:0:0:20c:29ff:fecd:2f25%2
> 16/08/22 05:45:05 INFO internal.IgniteKernal: Enabled local MACs:
> 000C29CD2F25
> 16/08/22 05:45:05 INFO plugin.IgnitePluginProcessor: Configured plugins:
> 16/08/22 05:45:05 INFO plugin.IgnitePluginProcessor: ^-- None
> 16/08/22 05:45:05 INFO plugin.IgnitePluginProcessor:
> 16/08/22 05:45:05 INFO tcp.TcpCommunicationSpi: IPC shared memory server
> endpoint started [port=48101,
> tokDir=/usr/apache-ignite-fabric-1.6.0-bin/work/ipc/
> shmem/d02e3ed0-a14a-4331-9403-822aa7bd2c9f-6908]
> 16/08/22 05:45:05 INFO tcp.TcpCommunicationSpi: Successfully bound shared
> memory communication to TCP port [port=48101, locHost=0.0.0.0/0.0.0.0]
> 16/08/22 05:45:05 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP
> port [port=47101, locHost=0.0.0.0/0.0.0.0]
> 16/08/22 05:45:05 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to
> enable configure any GridCheckpointSpi implementation)
> 16/08/22 05:45:05 WARN collision.GridCollisionManager: Collision
> resolution
> is disabled (all jobs will be activated upon arrival).
> 16/08/22 05:45:05 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To
> enable use FileSwapSpaceSpi.
> 16/08/22 05:45:05 INFO internal.IgniteKernal: Security status
> [authentication=off, tls/ssl=off]
> 16/08/22 05:45:05 INFO tcp.GridTcpRestProtocol: Command protocol
> successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212]
> 16/08/22 05:45:06 WARN internal.IgniteKernal: Attempting to start more
> nodes
> than physical RAM available on current host (this can cause significant
> slowdown)
> 16/08/22 05:45:06 INFO cache.GridCacheProcessor: Started cache
> [name=ignite-marshaller-sys-cache, mode=REPLICATED]
> 16/08/22 05:45:06 INFO cache.GridCacheProcessor: Started cache
> [name=ignite-atomics-sys-cache, mode=PARTITIONED]
> 16/08/22 05:45:06 INFO cache.GridCacheProcessor: Started cache
> [name=ignite-sys-cache, mode=REPLICATED]
> 16/08/22 05:45:07 INFO internal.IgniteKernal: To start Console Management &
> Monitoring run ignitevisorcmd.{sh|bat}
> 16/08/22 05:45:07 INFO internal.IgniteKernal:
> 16/08/22 05:45:07 INFO internal.IgniteKernal:
>
> >>> +-----------------------------------------------------------
> -----------+
> >>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf80
> 45ff34a031
> >>> +-----------------------------------------------------------
> -----------+
> >>> OS name: Linux 2.6.32-431.el6.x86_64 amd64
> >>> CPU(s): 1
> >>> Heap: 2.0GB
> >>> VM name: 6908@sparkup1
> >>> Local node [ID=D02E3ED0-A14A-4331-9403-822AA7BD2C9F, order=8,
> >>> clientMode=true]
> >>> Local node addresses: [sparkup1/0:0:0:0:0:0:0:1%1, /127.0.0.1,
> >>> /172.16.186.200]
> >>> Local ports: TCP:11212 TCP:47101 TCP:48101
>
> 16/08/22 05:45:07 INFO discovery.GridDiscoveryManager: Topology snapshot
> [ver=8, servers=3, clients=1, CPUs=3, heap=6.5GB]
> 16/08/22 05:45:07 INFO cache.GridCacheProcessor: Started cache
> [name=sharedIgniteRDD-ling-sha111o, mode=PARTITIONED]
> 16/08/22 05:45:07 INFO spark.SparkContext: Starting job: count at
> testIgniteSharedRDD.scala:19
> 16/08/22 05:45:07 INFO scheduler.DAGScheduler: Got job 0 (count at
> testIgniteSharedRDD.scala:19) with 1024 output partitions
> 16/08/22 05:45:07 INFO scheduler.DAGScheduler: Final stage: ResultStage 0
> (count at testIgniteSharedRDD.scala:19)
> 16/08/22 05:45:07 INFO scheduler.DAGScheduler: Parents of final stage:
> List()
> 16/08/22 05:45:07 INFO scheduler.DAGScheduler: Missing parents: List()
> 16/08/22 05:45:07 INFO scheduler.DAGScheduler: Submitting ResultStage 0
> (IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31), which has no missing
> parents
> 16/08/22 05:45:08 INFO storage.MemoryStore: Block broadcast_0 stored as
> values in memory (estimated size 1872.0 B, free 1872.0 B)
> 16/08/22 05:45:08 INFO storage.MemoryStore: Block broadcast_0_piece0 stored
> as bytes in memory (estimated size 1853.0 B, free 3.6 KB)
> 16/08/22 05:45:08 INFO storage.BlockManagerInfo: Added broadcast_0_piece0
> in
> memory on 172.16.186.200:34347 (size: 1853.0 B, free: 1259.8 MB)
> 16/08/22 05:45:08 INFO spark.SparkContext: Created broadcast 0 from
> broadcast at DAGScheduler.scala:1006
> 16/08/22 05:45:08 INFO scheduler.DAGScheduler: Submitting 1024 missing
> tasks
> from ResultStage 0 (IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31)
> 16/08/22 05:45:08 INFO cluster.YarnScheduler: Adding task set 0.0 with 1024
> tasks
> 16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 1.0 in stage
> 0.0 (TID 0, sparkup1, partition 1,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 0.0 in stage
> 0.0 (TID 1, sparkup3, partition 0,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 3.0 in stage
> 0.0 (TID 2, sparkup1, partition 3,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:08 INFO scheduler.TaskSetManager: Starting task 2.0 in stage
> 0.0 (TID 3, sparkup3, partition 2,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:11 INFO storage.BlockManagerInfo: Added broadcast_0_piece0
> in
> memory on sparkup3:53373 (size: 1853.0 B, free: 500.0 MB)
> 16/08/22 05:45:11 INFO storage.BlockManagerInfo: Added broadcast_0_piece0
> in
> memory on sparkup1:37604 (size: 1853.0 B, free: 500.0 MB)
> 16/08/22 05:45:19 INFO discovery.GridDiscoveryManager: Added new node to
> topology: TcpDiscoveryNode [id=d7f0a10f-68d7-4c8f-ab1d-d59c17b5bef7,
> addrs=[0:0:0:0:0:0:0:1%1, 127.0.0.1, 172.16.186.200],
> sockAddrs=[sparkup1/172.16.186.200:47501, /0:0:0:0:0:0:0:1%1:47501,
> /127.0.0.1:47501, /172.16.186.200:47501], discPort=47501, order=9,
> intOrder=7, lastExchangeTime=1471869918832, loc=false,
> ver=1.6.0#20160518-sha1:0b22c45b, isClient=false]
> 16/08/22 05:45:19 INFO discovery.GridDiscoveryManager: Topology snapshot
> [ver=9, servers=4, clients=1, CPUs=3, heap=7.4GB]
> 16/08/22 05:45:20 INFO scheduler.TaskSetManager: Starting task 5.0 in stage
> 0.0 (TID 4, sparkup3, partition 5,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:20 INFO scheduler.TaskSetManager: Starting task 9.0 in stage
> 0.0 (TID 5, sparkup3, partition 9,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:20 INFO scheduler.TaskSetManager: Finished task 2.0 in stage
> 0.0 (TID 3) in 12285 ms on sparkup3 (1/1024)
> 16/08/22 05:45:20 INFO scheduler.TaskSetManager: Finished task 0.0 in stage
> 0.0 (TID 1) in 12308 ms on sparkup3 (2/1024)
> 16/08/22 05:45:22 INFO scheduler.TaskSetManager: Starting task 4.0 in stage
> 0.0 (TID 6, sparkup1, partition 4,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:22 INFO scheduler.TaskSetManager: Starting task 6.0 in stage
> 0.0 (TID 7, sparkup1, partition 6,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:22 INFO scheduler.TaskSetManager: Finished task 3.0 in stage
> 0.0 (TID 2) in 13752 ms on sparkup1 (3/1024)
> 16/08/22 05:45:22 INFO scheduler.TaskSetManager: Finished task 1.0 in stage
> 0.0 (TID 0) in 13782 ms on sparkup1 (4/1024)
> 16/08/22 05:45:43 INFO scheduler.TaskSetManager: Starting task 10.0 in
> stage
> 0.0 (TID 8, sparkup1, partition 10,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:43 INFO scheduler.TaskSetManager: Starting task 11.0 in
> stage
> 0.0 (TID 9, sparkup1, partition 11,NODE_LOCAL, 1967 bytes)
> 16/08/22 05:45:43 WARN scheduler.TaskSetManager: Lost task 6.0 in stage 0.0
> (TID 7, sparkup1): class org.apache.ignite.IgniteCheckedException: Failed
> to
> instantiate Spring XML application context
> [springUrl=file:/usr/apache-ignite-fabric-1.6.0-bin/
> config/default-config.xml,
> err=Line 6 in XML document from URL
> [file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
> invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
> columnNumber: 71; cvc-elt.1: Cannot find the declaration of element
> 'beans'.]
> at
> org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.
> applicationContext(IgniteSpringHelperImpl.java:391)
> at
> org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.
> loadConfigurations(IgniteSpringHelperImpl.java:104)
> at
> org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.
> loadConfigurations(IgniteSpringHelperImpl.java:98)
> at
> org.apache.ignite.internal.IgnitionEx.loadConfigurations(
> IgnitionEx.java:639)
> at
> org.apache.ignite.internal.IgnitionEx.loadConfigurations(
> IgnitionEx.java:678)
> at
> org.apache.ignite.internal.IgnitionEx.loadConfiguration(
> IgnitionEx.java:717)
> at
> org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(
> IgniteContext.scala:85)
> at
> org.apache.ignite.spark.IgniteContext$$anonfun$$lessinit$greater$2.apply(
> IgniteContext.scala:85)
> at org.apache.ignite.spark.Once.apply(IgniteContext.scala:198)
> at
> org.apache.ignite.spark.IgniteContext.ignite(IgniteContext.scala:138)
> at
> org.apache.ignite.spark.impl.IgniteAbstractRDD.ensureCache(
> IgniteAbstractRDD.scala:37)
> at org.apache.ignite.spark.IgniteRDD.compute(IgniteRDD.scala:58)
> at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:306)
> at org.apache.spark.rdd.RDD.iterator(RDD.scala:270)
> at
> org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:66)
> at org.apache.spark.scheduler.Task.run(Task.scala:89)
> at
> org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:214)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by:
> org.springframework.beans.factory.xml.XmlBeanDefinitionStoreException:
> Line
> 6 in XML document from URL
> [file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
> invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
> columnNumber: 71; cvc-elt.1: Cannot find the declaration of element
> 'beans'.
> at
> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
> doLoadBeanDefinitions(XmlBeanDefinitionReader.java:398)
> at
> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
> loadBeanDefinitions(XmlBeanDefinitionReader.java:335)
> at
> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
> loadBeanDefinitions(XmlBeanDefinitionReader.java:303)
> at
> org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.
> applicationContext(IgniteSpringHelperImpl.java:379)
> ... 19 more
> Caused by: org.xml.sax.SAXParseException; lineNumber: 6; columnNumber: 71;
> cvc-elt.1: Cannot find the declaration of element 'beans'.
> at
> org.apache.xerces.util.ErrorHandlerWrapper.createSAXParseException(Unknown
> Source)
> at org.apache.xerces.util.ErrorHandlerWrapper.error(Unknown
> Source)
> at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
> Source)
> at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
> Source)
> at org.apache.xerces.impl.XMLErrorReporter.reportError(Unknown
> Source)
> at
> org.apache.xerces.impl.xs.XMLSchemaValidator.handleStartElement(Unknown
> Source)
> at org.apache.xerces.impl.xs.XMLSchemaValidator.
> startElement(Unknown
> Source)
> at
> org.apache.xerces.impl.XMLNSDocumentScannerImpl.scanStartElement(Unknown
> Source)
> at
> org.apache.xerces.impl.XMLNSDocumentScannerImpl$NSContentDispatcher.
> scanRootElementHook(Unknown
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl
> $FragmentContentDispatcher.dispatch(Unknown
> Source)
> at
> org.apache.xerces.impl.XMLDocumentFragmentScannerImpl.scanDocument(Unknown
> Source)
> at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
> Source)
> at org.apache.xerces.parsers.XML11Configuration.parse(Unknown
> Source)
> at org.apache.xerces.parsers.XMLParser.parse(Unknown Source)
> at org.apache.xerces.parsers.DOMParser.parse(Unknown Source)
> at org.apache.xerces.jaxp.DocumentBuilderImpl.parse(Unknown
> Source)
> at
> org.springframework.beans.factory.xml.DefaultDocumentLoader.loadDocument(
> DefaultDocumentLoader.java:76)
> at
> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
> doLoadDocument(XmlBeanDefinitionReader.java:428)
> at
> org.springframework.beans.factory.xml.XmlBeanDefinitionReader.
> doLoadBeanDefinitions(XmlBeanDefinitionReader.java:390)
> ... 22 more
>
> 16/08/22 05:45:43 INFO scheduler.TaskSetManager: Lost task 4.0 in stage 0.0
> (TID 6) on executor sparkup1: org.apache.ignite.IgniteCheckedException
> (Failed to instantiate Spring XML application context
> [springUrl=file:/usr/apache-ignite-fabric-1.6.0-bin/
> config/default-config.xml,
> err=Line 6 in XML document from URL
> [file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml] is
> invalid; nested exception is org.xml.sax.SAXParseException; lineNumber: 6;
> columnNumber: 71; cvc-elt.1: Cannot find the declaration of element
> 'beans'.]) [duplicate 1]
> ^C16/08/22 05:46:02 INFO typedef.G: Invoking shutdown hook...
> 16/08/22 05:46:02 INFO spark.SparkContext: Invoking stop() from shutdown
> hook
> 16/08/22 05:46:02 INFO tcp.GridTcpRestProtocol: Command protocol
> successfully stopped: TCP binary
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/static/sql,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/SQL/execution/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/SQL/execution,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/SQL/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/SQL,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/metrics/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages/stage/kill,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/api,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/static,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/executors/threadDump/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/executors/threadDump,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/executors/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/executors,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/environment/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/environment,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/storage/rdd/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/storage/rdd,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/storage/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/storage,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages/pool/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages/pool,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages/stage/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages/stage,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/stages,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/jobs/job/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/jobs/job,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/jobs/json,null}
> 16/08/22 05:46:02 INFO handler.ContextHandler: stopped
> o.s.j.s.ServletContextHandler{/jobs,null}
> 16/08/22 05:46:02 INFO ui.SparkUI: Stopped Spark web UI at
> http://172.16.186.200:4040
> ^C16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
> ignite-marshaller-sys-cache
> 16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
> ignite-sys-cache
> 16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
> ignite-atomics-sys-cache
> 16/08/22 05:46:02 INFO cache.GridCacheProcessor: Stopped cache:
> sharedIgniteRDD-ling-sha111o
> 16/08/22 05:46:02 INFO scheduler.DAGScheduler: Job 0 failed: count at
> testIgniteSharedRDD.scala:19, took 54.886757 s
> Exception in thread "main" org.apache.spark.SparkException: Job 0
> cancelled
> because SparkContext was shut down
> at
> org.apache.spark.scheduler.DAGScheduler$$anonfun$
> cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:806)
> at
> org.apache.spark.scheduler.DAGScheduler$$anonfun$
> cleanUpAfterSchedulerStop$1.apply(DAGScheduler.scala:804)
> at scala.collection.mutable.HashSet.foreach(HashSet.scala:79)
> at
> org.apache.spark.scheduler.DAGScheduler.cleanUpAfterSchedulerStop(
> DAGScheduler.scala:804)
> at
> org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.
> onStop(DAGScheduler.scala:1658)
> at org.apache.spark.util.EventLoop.stop(EventLoop.scala:84)
> at
> org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:1581)
> at
> org.apache.spark.SparkContext$$anonfun$stop$9.apply$mcV$sp(
> SparkContext.scala:1740)
> at
> org.apache.spark.util.Utils$.tryLogNonFatalError(Utils.scala:1229)
> at org.apache.spark.SparkContext.stop(SparkContext.scala:1739)
> at
> org.apache.spark.SparkContext$$anonfun$3.apply$mcV$sp(
> SparkContext.scala:596)
> at
> org.apache.spark.util.SparkShutdownHook.run(ShutdownHookManager.scala:267)
> at
> org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$
> apply$mcV$sp$1.apply$mcV$sp(ShutdownHookManager.scala:239)
> at
> org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$
> apply$mcV$sp$1.apply(ShutdownHookManager.scala:239)
> at
> org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1$$anonfun$
> apply$mcV$sp$1.apply(ShutdownHookManager.scala:239)
> at
> org.apache.spark.util.Utils$.logUncaughtExceptions(Utils.scala:1765)
> at
> org.apache.spark.util.SparkShutdownHookManager$$
> anonfun$runAll$1.apply$mcV$sp(ShutdownHookManager.scala:239)
> at
> org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(
> ShutdownHookManager.scala:239)
> at
> org.apache.spark.util.SparkShutdownHookManager$$anonfun$runAll$1.apply(
> ShutdownHookManager.scala:239)
> at scala.util.Try$.apply(Try.scala:161)
> at
> org.apache.spark.util.SparkShutdownHookManager.runAll(ShutdownHookManager.
> scala:239)
> at
> org.apache.spark.util.SparkShutdownHookManager$$anon$2.run(
> ShutdownHookManager.scala:218)
> at
> org.apache.hadoop.util.ShutdownHookManager$1.run(
> ShutdownHookManager.java:54)
> at
> org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:620)
> at org.apache.spark.SparkContext.runJob(SparkContext.scala:1832)
> at org.apache.spark.SparkContext.runJob(SparkContext.scala:1845)
> at org.apache.spark.SparkContext.runJob(SparkContext.scala:1858)
> at org.apache.spark.SparkContext.runJob(SparkContext.scala:1929)
> at org.apache.spark.rdd.RDD.count(RDD.scala:1157)
> at
> com.ignite.testIgniteSharedRDD$.main(testIgniteSharedRDD.scala:19)
> at com.ignite.testIgniteSharedRDD.main(testIgniteSharedRDD.scala)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:
> 57)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at
> org.apache.spark.deploy.SparkSubmit$.org$apache$spark$
> deploy$SparkSubmit$$runMain(SparkSubmit.scala:731)
> at
> org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
> at
> org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
> at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.
> scala:121)
> at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> 16/08/22 05:46:02 INFO scheduler.DAGScheduler: ResultStage 0 (count at
> testIgniteSharedRDD.scala:19) failed in 54.382 s
> ^C^C^C16/08/22 05:46:03 INFO internal.IgniteKernal:
>
> >>> +-----------------------------------------------------------
> ----------------------+
> >>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf80
> 45ff34a031
> >>> stopped OK
> >>> +-----------------------------------------------------------
> ----------------------+
> >>> Grid uptime: 00:00:56:139
>
>
> 16/08/22 05:46:03 ERROR scheduler.LiveListenerBus: SparkListenerBus has
> already stopped! Dropping event
> SparkListenerStageCompleted(org.apache.spark.scheduler.StageInfo@6632c145)
> 16/08/22 05:46:03 ERROR scheduler.LiveListenerBus: SparkListenerBus has
> already stopped! Dropping event
> SparkListenerJobEnd(0,1471869963305,JobFailed(org.
> apache.spark.SparkException:
> Job 0 cancelled because SparkContext was shut down))
> 16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Interrupting
> monitor thread
> 16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Shutting down
> all
> executors
> 16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Asking each
> executor to shut down
> 16/08/22 05:46:03 INFO cluster.YarnClientSchedulerBackend: Stopped
> 16/08/22 05:46:03 INFO spark.MapOutputTrackerMasterEndpoint:
> MapOutputTrackerMasterEndpoint stopped!
> ^C16/08/22 05:46:03 INFO storage.MemoryStore: MemoryStore cleared
> 16/08/22 05:46:03 INFO storage.BlockManager: BlockManager stopped
> 16/08/22 05:46:03 INFO storage.BlockManagerMaster: BlockManagerMaster
> stopped
> 16/08/22 05:46:03 INFO
> scheduler.OutputCommitCoordinator$OutputCommitCoordinatorEndpoint:
> OutputCommitCoordinator stopped!
> 16/08/22 05:46:03 INFO spark.SparkContext: Successfully stopped
> SparkContext
> 16/08/22 05:46:03 INFO util.ShutdownHookManager: Shutdown hook called
> 16/08/22 05:46:03 INFO util.ShutdownHookManager: Deleting directory
> /tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc
> 16/08/22 05:46:03 INFO remote.RemoteActorRefProvider$RemotingTerminator:
> Shutting down remote daemon.
> 16/08/22 05:46:03 INFO remote.RemoteActorRefProvider$RemotingTerminator:
> Remote daemon shut down; proceeding with flushing remote transports.
> 16/08/22 05:46:03 INFO util.ShutdownHookManager: Deleting directory
> /tmp/spark-70fba93f-d31c-44d7-ada1-5fe0b9dae5cc/httpd-
> 91da8e86-bee0-4c5a-868a-ea7d35a2536d
> [root@sparkup1 config]#
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/Yarn-deployment-for-static-
> TcpDiscoverySpi-issues-Urgent-In-Production-tp7205.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
>
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by vkulichenko <va...@gmail.com>.
Hi,
Can you please attach the configuration file instead of copy-pasting pieces
of it?
percent620 wrote*
> the sparks-run will be running successfully, but the programs always
> running NOT STOP, and didn't print message numbers
*
Can you please clarify what you meant by this? Is there still an issue? I
see in the latest log that the node is successfully started.
P.S. Please also use 'attach' to provide large log files. They are pretty
much unreadable when copy-pasted here.
-Val
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7223.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: Yarn deployment for static TcpDiscoverySpi issues:Urgent In
Production
Posted by percent620 <pe...@163.com>.
If i adjust some of default-config.xml head as below
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:util="http://www.springframework.org/schema/util"
xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/util
http://www.springframework.org/schema/util/spring-util.xsd">
*the sparks-run will be running successfully, but the programs always
running NOT STOP, and didn't print message numbers*
some of logs as blow
nohup: ignoring input
16/08/22 06:06:47 INFO spark.SparkContext: Running Spark version 1.6.1
16/08/22 06:06:47 WARN util.NativeCodeLoader: Unable to load native-hadoop
library for your platform... using builtin-java classes where applicable
16/08/22 06:06:48 INFO spark.SecurityManager: Changing view acls to: root
16/08/22 06:06:48 INFO spark.SecurityManager: Changing modify acls to: root
16/08/22 06:06:48 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(root); users with modify permissions: Set(root)
16/08/22 06:06:49 INFO util.Utils: Successfully started service
'sparkDriver' on port 41515.
16/08/22 06:06:49 INFO slf4j.Slf4jLogger: Slf4jLogger started
16/08/22 06:06:49 INFO Remoting: Starting remoting
16/08/22 06:06:49 INFO Remoting: Remoting started; listening on addresses
:[akka.tcp://sparkDriverActorSystem@172.16.186.200:47785]
16/08/22 06:06:49 INFO util.Utils: Successfully started service
'sparkDriverActorSystem' on port 47785.
16/08/22 06:06:50 INFO spark.SparkEnv: Registering MapOutputTracker
16/08/22 06:06:50 INFO spark.SparkEnv: Registering BlockManagerMaster
16/08/22 06:06:50 INFO storage.DiskBlockManager: Created local directory at
/tmp/blockmgr-e7074de5-5a9f-4cd0-ad4b-d40ac6bc3dd3
16/08/22 06:06:50 INFO storage.MemoryStore: MemoryStore started with
capacity 1259.8 MB
16/08/22 06:06:50 INFO spark.SparkEnv: Registering OutputCommitCoordinator
16/08/22 06:06:51 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/08/22 06:06:51 INFO server.AbstractConnector: Started
SelectChannelConnector@0.0.0.0:4040
16/08/22 06:06:51 INFO util.Utils: Successfully started service 'SparkUI' on
port 4040.
16/08/22 06:06:51 INFO ui.SparkUI: Started SparkUI at
http://172.16.186.200:4040
16/08/22 06:06:51 INFO spark.HttpFileServer: HTTP File server directory is
/tmp/spark-a01f56f5-d024-4bf9-8609-0e579a326231/httpd-1133f47e-3892-4749-b1dc-2b53aee5aa02
16/08/22 06:06:51 INFO spark.HttpServer: Starting HTTP Server
16/08/22 06:06:51 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/08/22 06:06:51 INFO server.AbstractConnector: Started
SocketConnector@0.0.0.0:59526
16/08/22 06:06:51 INFO util.Utils: Successfully started service 'HTTP file
server' on port 59526.
16/08/22 06:06:52 INFO spark.SparkContext: Added JAR
file:/root/limu/ignite/spark-project-jar-with-dependencies.jar at
http://172.16.186.200:59526/jars/spark-project-jar-with-dependencies.jar
with timestamp 1471871212112
16/08/22 06:06:52 INFO client.RMProxy: Connecting to ResourceManager at
sparkup1/172.16.186.200:8032
16/08/22 06:06:52 INFO yarn.Client: Requesting a new application from
cluster with 3 NodeManagers
16/08/22 06:06:52 INFO yarn.Client: Verifying our application has not
requested more than the maximum memory capability of the cluster (8192 MB
per container)
16/08/22 06:06:52 INFO yarn.Client: Will allocate AM container, with 896 MB
memory including 384 MB overhead
16/08/22 06:06:52 INFO yarn.Client: Setting up container launch context for
our AM
16/08/22 06:06:52 INFO yarn.Client: Setting up the launch environment for
our AM container
16/08/22 06:06:52 INFO yarn.Client: Preparing resources for our AM container
16/08/22 06:06:54 INFO yarn.Client: Uploading resource
file:/usr/spark-1.6.1-bin-hadoop2.6/lib/spark-assembly-1.6.1-hadoop2.6.0.jar
->
hdfs://sparkup1:9000/user/root/.sparkStaging/application_1471869381289_0005/spark-assembly-1.6.1-hadoop2.6.0.jar
16/08/22 06:06:59 INFO yarn.Client: Uploading resource
file:/tmp/spark-a01f56f5-d024-4bf9-8609-0e579a326231/__spark_conf__1100203909029762559.zip
->
hdfs://sparkup1:9000/user/root/.sparkStaging/application_1471869381289_0005/__spark_conf__1100203909029762559.zip
16/08/22 06:06:59 INFO spark.SecurityManager: Changing view acls to: root
16/08/22 06:06:59 INFO spark.SecurityManager: Changing modify acls to: root
16/08/22 06:06:59 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view permissions:
Set(root); users with modify permissions: Set(root)
16/08/22 06:06:59 INFO yarn.Client: Submitting application 5 to
ResourceManager
16/08/22 06:06:59 INFO impl.YarnClientImpl: Submitted application
application_1471869381289_0005
16/08/22 06:07:00 INFO yarn.Client: Application report for
application_1471869381289_0005 (state: ACCEPTED)
16/08/22 06:07:00 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1471871219705
final status: UNDEFINED
tracking URL:
http://sparkup1:8088/proxy/application_1471869381289_0005/
user: root
16/08/22 06:07:01 INFO yarn.Client: Application report for
application_1471869381289_0005 (state: ACCEPTED)
16/08/22 06:07:02 INFO yarn.Client: Application report for
application_1471869381289_0005 (state: ACCEPTED)
16/08/22 06:07:03 INFO yarn.Client: Application report for
application_1471869381289_0005 (state: ACCEPTED)
16/08/22 06:07:04 INFO yarn.Client: Application report for
application_1471869381289_0005 (state: ACCEPTED)
16/08/22 06:07:05 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint:
ApplicationMaster registered as NettyRpcEndpointRef(null)
16/08/22 06:07:05 INFO cluster.YarnClientSchedulerBackend: Add WebUI Filter.
org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter, Map(PROXY_HOSTS
-> sparkup1, PROXY_URI_BASES ->
http://sparkup1:8088/proxy/application_1471869381289_0005),
/proxy/application_1471869381289_0005
16/08/22 06:07:05 INFO ui.JettyUtils: Adding filter:
org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
16/08/22 06:07:05 INFO yarn.Client: Application report for
application_1471869381289_0005 (state: RUNNING)
16/08/22 06:07:05 INFO yarn.Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: 172.16.186.202
ApplicationMaster RPC port: 0
queue: default
start time: 1471871219705
final status: UNDEFINED
tracking URL:
http://sparkup1:8088/proxy/application_1471869381289_0005/
user: root
16/08/22 06:07:05 INFO cluster.YarnClientSchedulerBackend: Application
application_1471869381289_0005 has started running.
16/08/22 06:07:05 INFO util.Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port 54595.
16/08/22 06:07:05 INFO netty.NettyBlockTransferService: Server created on
54595
16/08/22 06:07:05 INFO storage.BlockManagerMaster: Trying to register
BlockManager
16/08/22 06:07:05 INFO storage.BlockManagerMasterEndpoint: Registering block
manager 172.16.186.200:54595 with 1259.8 MB RAM, BlockManagerId(driver,
172.16.186.200, 54595)
16/08/22 06:07:05 INFO storage.BlockManagerMaster: Registered BlockManager
16/08/22 06:07:14 INFO cluster.YarnClientSchedulerBackend: Registered
executor NettyRpcEndpointRef(null) (sparkup2:57582) with ID 1
16/08/22 06:07:14 INFO storage.BlockManagerMasterEndpoint: Registering block
manager sparkup2:38851 with 500.0 MB RAM, BlockManagerId(1, sparkup2, 38851)
16/08/22 06:07:14 INFO cluster.YarnClientSchedulerBackend: Registered
executor NettyRpcEndpointRef(null) (sparkup1:59594) with ID 2
16/08/22 06:07:14 INFO storage.BlockManagerMasterEndpoint: Registering block
manager sparkup1:58814 with 500.0 MB RAM, BlockManagerId(2, sparkup1, 58814)
16/08/22 06:07:14 INFO cluster.YarnClientSchedulerBackend: SchedulerBackend
is ready for scheduling beginning after reached minRegisteredResourcesRatio:
0.8
16/08/22 06:07:15 INFO xml.XmlBeanDefinitionReader: Loading XML bean
definitions from URL
[file:/usr/apache-ignite-fabric-1.6.0-bin/config/default-config.xml]
16/08/22 06:07:16 INFO support.GenericApplicationContext: Refreshing
org.springframework.context.support.GenericApplicationContext@10e3ff89:
startup date [Mon Aug 22 06:07:16 PDT 2016]; root of context hierarchy
16/08/22 06:07:16 INFO internal.IgniteKernal:
>>> __________ ________________
>>> / _/ ___/ |/ / _/_ __/ __/
>>> _/ // (7 7 // / / / / _/
>>> /___/\___/_/|_/___/ /_/ /___/
>>>
>>> ver. 1.6.0#20160518-sha1:0b22c45b
>>> 2016 Copyright(C) Apache Software Foundation
>>>
>>> Ignite documentation: http://ignite.apache.org
16/08/22 06:07:16 INFO internal.IgniteKernal: Config URL: n/a
16/08/22 06:07:16 INFO internal.IgniteKernal: Daemon mode: off
16/08/22 06:07:16 INFO internal.IgniteKernal: OS: Linux
2.6.32-431.el6.x86_64 amd64
16/08/22 06:07:16 INFO internal.IgniteKernal: OS user: root
16/08/22 06:07:16 INFO internal.IgniteKernal: Language runtime: Java
Platform API Specification ver. 1.7
16/08/22 06:07:16 INFO internal.IgniteKernal: VM information: Java(TM) SE
Runtime Environment 1.7.0_71-b14 Oracle Corporation Java HotSpot(TM) 64-Bit
Server VM 24.71-b01
16/08/22 06:07:16 INFO internal.IgniteKernal: VM total memory: 1.9GB
16/08/22 06:07:16 INFO internal.IgniteKernal: Remote Management [restart:
off, REST: on, JMX (remote: off)]
16/08/22 06:07:16 INFO internal.IgniteKernal:
IGNITE_HOME=/usr/apache-ignite-fabric-1.6.0-bin
16/08/22 06:07:16 INFO internal.IgniteKernal: VM arguments: [-Xms2G, -Xmx2G,
-XX:MaxPermSize=256m]
16/08/22 06:07:16 INFO internal.IgniteKernal: Configured caches
['ignite-marshaller-sys-cache', 'ignite-sys-cache',
'ignite-atomics-sys-cache']
16/08/22 06:07:16 INFO internal.IgniteKernal: 3-rd party licenses can be
found at: /usr/apache-ignite-fabric-1.6.0-bin/libs/licenses
16/08/22 06:07:16 INFO internal.IgniteKernal: Non-loopback local IPs:
172.16.186.200, fe80:0:0:0:20c:29ff:fecd:2f25%2
16/08/22 06:07:16 INFO internal.IgniteKernal: Enabled local MACs:
000C29CD2F25
16/08/22 06:07:16 INFO plugin.IgnitePluginProcessor: Configured plugins:
16/08/22 06:07:16 INFO plugin.IgnitePluginProcessor: ^-- None
16/08/22 06:07:16 INFO plugin.IgnitePluginProcessor:
16/08/22 06:07:16 INFO tcp.TcpCommunicationSpi: IPC shared memory server
endpoint started [port=48101,
tokDir=/usr/apache-ignite-fabric-1.6.0-bin/work/ipc/shmem/fd2cebfd-e7eb-4f5c-bd30-e0f35995b2cc-7724]
16/08/22 06:07:16 INFO tcp.TcpCommunicationSpi: Successfully bound shared
memory communication to TCP port [port=48101, locHost=0.0.0.0/0.0.0.0]
16/08/22 06:07:16 INFO tcp.TcpCommunicationSpi: Successfully bound to TCP
port [port=47101, locHost=0.0.0.0/0.0.0.0]
16/08/22 06:07:16 WARN noop.NoopCheckpointSpi: Checkpoints are disabled (to
enable configure any GridCheckpointSpi implementation)
16/08/22 06:07:16 WARN collision.GridCollisionManager: Collision resolution
is disabled (all jobs will be activated upon arrival).
16/08/22 06:07:16 WARN noop.NoopSwapSpaceSpi: Swap space is disabled. To
enable use FileSwapSpaceSpi.
16/08/22 06:07:16 INFO internal.IgniteKernal: Security status
[authentication=off, tls/ssl=off]
16/08/22 06:07:17 INFO tcp.GridTcpRestProtocol: Command protocol
successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11212]
16/08/22 06:07:17 WARN internal.IgniteKernal: Attempting to start more nodes
than physical RAM available on current host (this can cause significant
slowdown)
16/08/22 06:07:18 INFO cache.GridCacheProcessor: Started cache
[name=ignite-marshaller-sys-cache, mode=REPLICATED]
16/08/22 06:07:18 INFO cache.GridCacheProcessor: Started cache
[name=ignite-atomics-sys-cache, mode=PARTITIONED]
16/08/22 06:07:18 INFO cache.GridCacheProcessor: Started cache
[name=ignite-sys-cache, mode=REPLICATED]
16/08/22 06:07:18 INFO internal.IgniteKernal: To start Console Management &
Monitoring run ignitevisorcmd.{sh|bat}
16/08/22 06:07:18 INFO internal.IgniteKernal:
16/08/22 06:07:18 INFO internal.IgniteKernal:
>>> +----------------------------------------------------------------------+
>>> Ignite ver. 1.6.0#20160518-sha1:0b22c45bb9b97692208fd0705ddf8045ff34a031
>>> +----------------------------------------------------------------------+
>>> OS name: Linux 2.6.32-431.el6.x86_64 amd64
>>> CPU(s): 1
>>> Heap: 2.0GB
>>> VM name: 7724@sparkup1
>>> Local node [ID=FD2CEBFD-E7EB-4F5C-BD30-E0F35995B2CC, order=16,
>>> clientMode=true]
>>> Local node addresses: [sparkup1/0:0:0:0:0:0:0:1%1, /127.0.0.1,
>>> /172.16.186.200]
>>> Local ports: TCP:11212 TCP:47101 TCP:48101
16/08/22 06:07:18 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=16, servers=3, clients=1, CPUs=3, heap=6.5GB]
16/08/22 06:07:19 INFO cache.GridCacheProcessor: Started cache
[name=sharedIgniteRDD-ling-sha111o, mode=PARTITIONED]
16/08/22 06:07:19 INFO spark.SparkContext: Starting job: count at
testIgniteSharedRDD.scala:19
16/08/22 06:07:19 INFO scheduler.DAGScheduler: Got job 0 (count at
testIgniteSharedRDD.scala:19) with 1024 output partitions
16/08/22 06:07:19 INFO scheduler.DAGScheduler: Final stage: ResultStage 0
(count at testIgniteSharedRDD.scala:19)
16/08/22 06:07:19 INFO scheduler.DAGScheduler: Parents of final stage:
List()
16/08/22 06:07:19 INFO scheduler.DAGScheduler: Missing parents: List()
16/08/22 06:07:19 INFO scheduler.DAGScheduler: Submitting ResultStage 0
(IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31), which has no missing
parents
16/08/22 06:07:19 INFO storage.MemoryStore: Block broadcast_0 stored as
values in memory (estimated size 1872.0 B, free 1872.0 B)
16/08/22 06:07:19 INFO storage.MemoryStore: Block broadcast_0_piece0 stored
as bytes in memory (estimated size 1853.0 B, free 3.6 KB)
16/08/22 06:07:19 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in
memory on 172.16.186.200:54595 (size: 1853.0 B, free: 1259.8 MB)
16/08/22 06:07:19 INFO spark.SparkContext: Created broadcast 0 from
broadcast at DAGScheduler.scala:1006
16/08/22 06:07:19 INFO scheduler.DAGScheduler: Submitting 1024 missing tasks
from ResultStage 0 (IgniteRDD[0] at RDD at IgniteAbstractRDD.scala:31)
16/08/22 06:07:19 INFO cluster.YarnScheduler: Adding task set 0.0 with 1024
tasks
16/08/22 06:07:19 INFO scheduler.TaskSetManager: Starting task 1.0 in stage
0.0 (TID 0, sparkup1, partition 1,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:19 INFO scheduler.TaskSetManager: Starting task 7.0 in stage
0.0 (TID 1, sparkup2, partition 7,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:19 INFO scheduler.TaskSetManager: Starting task 3.0 in stage
0.0 (TID 2, sparkup1, partition 3,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:19 INFO scheduler.TaskSetManager: Starting task 8.0 in stage
0.0 (TID 3, sparkup2, partition 8,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:23 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in
memory on sparkup2:38851 (size: 1853.0 B, free: 500.0 MB)
16/08/22 06:07:23 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in
memory on sparkup1:58814 (size: 1853.0 B, free: 500.0 MB)
[06:07:27] New version is available at ignite.apache.org: 1.7.0
16/08/22 06:07:27 WARN cluster.GridUpdateNotifier: New version is available
at ignite.apache.org: 1.7.0
16/08/22 06:07:27 INFO discovery.GridDiscoveryManager: Added new node to
topology: TcpDiscoveryNode [id=3d11ecf0-3c21-43bf-a2bf-26e8ae132278,
addrs=[0:0:0:0:0:0:0:1%1, 127.0.0.1, 172.16.186.200],
sockAddrs=[sparkup1/172.16.186.200:47501, /0:0:0:0:0:0:0:1%1:47501,
/127.0.0.1:47501, /172.16.186.200:47501], discPort=47501, order=17,
intOrder=11, lastExchangeTime=1471871247612, loc=false,
ver=1.6.0#20160518-sha1:0b22c45b, isClient=false]
16/08/22 06:07:27 INFO discovery.GridDiscoveryManager: Topology snapshot
[ver=17, servers=4, clients=1, CPUs=3, heap=7.4GB]
16/08/22 06:07:29 INFO scheduler.TaskSetManager: Starting task 17.0 in stage
0.0 (TID 4, sparkup2, partition 17,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:29 INFO scheduler.TaskSetManager: Starting task 18.0 in stage
0.0 (TID 5, sparkup2, partition 18,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:29 INFO scheduler.TaskSetManager: Finished task 8.0 in stage
0.0 (TID 3) in 9709 ms on sparkup2 (1/1024)
16/08/22 06:07:29 INFO scheduler.TaskSetManager: Finished task 7.0 in stage
0.0 (TID 1) in 9742 ms on sparkup2 (2/1024)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Starting task 20.0 in stage
0.0 (TID 6, sparkup2, partition 20,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Finished task 17.0 in stage
0.0 (TID 4) in 421 ms on sparkup2 (3/1024)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Starting task 25.0 in stage
0.0 (TID 7, sparkup2, partition 25,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Finished task 18.0 in stage
0.0 (TID 5) in 445 ms on sparkup2 (4/1024)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Starting task 30.0 in stage
0.0 (TID 8, sparkup2, partition 30,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Finished task 20.0 in stage
0.0 (TID 6) in 402 ms on sparkup2 (5/1024)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Starting task 36.0 in stage
0.0 (TID 9, sparkup2, partition 36,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Finished task 25.0 in stage
0.0 (TID 7) in 367 ms on sparkup2 (6/1024)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Starting task 38.0 in stage
0.0 (TID 10, sparkup2, partition 38,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Finished task 30.0 in stage
0.0 (TID 8) in 393 ms on sparkup2 (7/1024)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Starting task 42.0 in stage
0.0 (TID 11, sparkup2, partition 42,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:30 INFO scheduler.TaskSetManager: Finished task 36.0 in stage
0.0 (TID 9) in 406 ms on sparkup2 (8/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 43.0 in stage
0.0 (TID 12, sparkup2, partition 43,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 42.0 in stage
0.0 (TID 11) in 383 ms on sparkup2 (9/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 44.0 in stage
0.0 (TID 13, sparkup2, partition 44,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 38.0 in stage
0.0 (TID 10) in 431 ms on sparkup2 (10/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 4.0 in stage
0.0 (TID 14, sparkup1, partition 4,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 3.0 in stage
0.0 (TID 2) in 11504 ms on sparkup1 (11/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 1.0 in stage
0.0 (TID 0) in 11538 ms on sparkup1 (12/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 6.0 in stage
0.0 (TID 15, sparkup1, partition 6,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 46.0 in stage
0.0 (TID 16, sparkup2, partition 46,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 43.0 in stage
0.0 (TID 12) in 365 ms on sparkup2 (13/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 47.0 in stage
0.0 (TID 17, sparkup2, partition 47,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 44.0 in stage
0.0 (TID 13) in 385 ms on sparkup2 (14/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 48.0 in stage
0.0 (TID 18, sparkup2, partition 48,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 46.0 in stage
0.0 (TID 16) in 353 ms on sparkup2 (15/1024)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Starting task 52.0 in stage
0.0 (TID 19, sparkup2, partition 52,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:31 INFO scheduler.TaskSetManager: Finished task 47.0 in stage
0.0 (TID 17) in 365 ms on sparkup2 (16/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 57.0 in stage
0.0 (TID 20, sparkup2, partition 57,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 48.0 in stage
0.0 (TID 18) in 369 ms on sparkup2 (17/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 63.0 in stage
0.0 (TID 21, sparkup2, partition 63,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 52.0 in stage
0.0 (TID 19) in 381 ms on sparkup2 (18/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 10.0 in stage
0.0 (TID 22, sparkup1, partition 10,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 4.0 in stage
0.0 (TID 14) in 986 ms on sparkup1 (19/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 11.0 in stage
0.0 (TID 23, sparkup1, partition 11,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 6.0 in stage
0.0 (TID 15) in 1006 ms on sparkup1 (20/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 64.0 in stage
0.0 (TID 24, sparkup2, partition 64,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 57.0 in stage
0.0 (TID 20) in 364 ms on sparkup2 (21/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 67.0 in stage
0.0 (TID 25, sparkup2, partition 67,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 63.0 in stage
0.0 (TID 21) in 365 ms on sparkup2 (22/1024)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Starting task 12.0 in stage
0.0 (TID 26, sparkup1, partition 12,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:32 INFO scheduler.TaskSetManager: Finished task 10.0 in stage
0.0 (TID 22) in 491 ms on sparkup1 (23/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 13.0 in stage
0.0 (TID 27, sparkup1, partition 13,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 11.0 in stage
0.0 (TID 23) in 561 ms on sparkup1 (24/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 68.0 in stage
0.0 (TID 28, sparkup2, partition 68,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 64.0 in stage
0.0 (TID 24) in 448 ms on sparkup2 (25/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 73.0 in stage
0.0 (TID 29, sparkup2, partition 73,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 67.0 in stage
0.0 (TID 25) in 410 ms on sparkup2 (26/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 14.0 in stage
0.0 (TID 30, sparkup1, partition 14,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 12.0 in stage
0.0 (TID 26) in 435 ms on sparkup1 (27/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 75.0 in stage
0.0 (TID 31, sparkup2, partition 75,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 68.0 in stage
0.0 (TID 28) in 383 ms on sparkup2 (28/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 77.0 in stage
0.0 (TID 32, sparkup2, partition 77,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 73.0 in stage
0.0 (TID 29) in 394 ms on sparkup2 (29/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 16.0 in stage
0.0 (TID 33, sparkup1, partition 16,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 13.0 in stage
0.0 (TID 27) in 533 ms on sparkup1 (30/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 21.0 in stage
0.0 (TID 34, sparkup1, partition 21,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 14.0 in stage
0.0 (TID 30) in 372 ms on sparkup1 (31/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 80.0 in stage
0.0 (TID 35, sparkup2, partition 80,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 75.0 in stage
0.0 (TID 31) in 333 ms on sparkup2 (32/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 84.0 in stage
0.0 (TID 36, sparkup2, partition 84,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 77.0 in stage
0.0 (TID 32) in 355 ms on sparkup2 (33/1024)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Starting task 23.0 in stage
0.0 (TID 37, sparkup1, partition 23,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:33 INFO scheduler.TaskSetManager: Finished task 16.0 in stage
0.0 (TID 33) in 385 ms on sparkup1 (34/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 27.0 in stage
0.0 (TID 38, sparkup1, partition 27,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 21.0 in stage
0.0 (TID 34) in 316 ms on sparkup1 (35/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 89.0 in stage
0.0 (TID 39, sparkup2, partition 89,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 80.0 in stage
0.0 (TID 35) in 347 ms on sparkup2 (36/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 95.0 in stage
0.0 (TID 40, sparkup2, partition 95,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 84.0 in stage
0.0 (TID 36) in 344 ms on sparkup2 (37/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 31.0 in stage
0.0 (TID 41, sparkup1, partition 31,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 23.0 in stage
0.0 (TID 37) in 394 ms on sparkup1 (38/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 32.0 in stage
0.0 (TID 42, sparkup1, partition 32,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 27.0 in stage
0.0 (TID 38) in 368 ms on sparkup1 (39/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 99.0 in stage
0.0 (TID 43, sparkup2, partition 99,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 89.0 in stage
0.0 (TID 39) in 337 ms on sparkup2 (40/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 100.0 in
stage 0.0 (TID 44, sparkup2, partition 100,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 95.0 in stage
0.0 (TID 40) in 334 ms on sparkup2 (41/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 35.0 in stage
0.0 (TID 45, sparkup1, partition 35,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 31.0 in stage
0.0 (TID 41) in 353 ms on sparkup1 (42/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 40.0 in stage
0.0 (TID 46, sparkup1, partition 40,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 32.0 in stage
0.0 (TID 42) in 333 ms on sparkup1 (43/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 102.0 in
stage 0.0 (TID 47, sparkup2, partition 102,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 99.0 in stage
0.0 (TID 43) in 347 ms on sparkup2 (44/1024)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Starting task 105.0 in
stage 0.0 (TID 48, sparkup2, partition 105,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:34 INFO scheduler.TaskSetManager: Finished task 100.0 in
stage 0.0 (TID 44) in 352 ms on sparkup2 (45/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 41.0 in stage
0.0 (TID 49, sparkup1, partition 41,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 35.0 in stage
0.0 (TID 45) in 343 ms on sparkup1 (46/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 45.0 in stage
0.0 (TID 50, sparkup1, partition 45,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 40.0 in stage
0.0 (TID 46) in 391 ms on sparkup1 (47/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 109.0 in
stage 0.0 (TID 51, sparkup2, partition 109,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 102.0 in
stage 0.0 (TID 47) in 400 ms on sparkup2 (48/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 50.0 in stage
0.0 (TID 52, sparkup1, partition 50,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 41.0 in stage
0.0 (TID 49) in 375 ms on sparkup1 (49/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 53.0 in stage
0.0 (TID 53, sparkup1, partition 53,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 45.0 in stage
0.0 (TID 50) in 321 ms on sparkup1 (50/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 112.0 in
stage 0.0 (TID 54, sparkup2, partition 112,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 105.0 in
stage 0.0 (TID 48) in 630 ms on sparkup2 (51/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 118.0 in
stage 0.0 (TID 55, sparkup2, partition 118,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 109.0 in
stage 0.0 (TID 51) in 362 ms on sparkup2 (52/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 56.0 in stage
0.0 (TID 56, sparkup1, partition 56,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 50.0 in stage
0.0 (TID 52) in 282 ms on sparkup1 (53/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 59.0 in stage
0.0 (TID 57, sparkup1, partition 59,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 53.0 in stage
0.0 (TID 53) in 310 ms on sparkup1 (54/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 123.0 in
stage 0.0 (TID 58, sparkup2, partition 123,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 112.0 in
stage 0.0 (TID 54) in 342 ms on sparkup2 (55/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 60.0 in stage
0.0 (TID 59, sparkup1, partition 60,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 56.0 in stage
0.0 (TID 56) in 283 ms on sparkup1 (56/1024)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Starting task 126.0 in
stage 0.0 (TID 60, sparkup2, partition 126,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:35 INFO scheduler.TaskSetManager: Finished task 118.0 in
stage 0.0 (TID 55) in 375 ms on sparkup2 (57/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 62.0 in stage
0.0 (TID 61, sparkup1, partition 62,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 59.0 in stage
0.0 (TID 57) in 324 ms on sparkup1 (58/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 65.0 in stage
0.0 (TID 62, sparkup1, partition 65,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 60.0 in stage
0.0 (TID 59) in 283 ms on sparkup1 (59/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 131.0 in
stage 0.0 (TID 63, sparkup2, partition 131,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 123.0 in
stage 0.0 (TID 58) in 458 ms on sparkup2 (60/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 135.0 in
stage 0.0 (TID 64, sparkup2, partition 135,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 126.0 in
stage 0.0 (TID 60) in 386 ms on sparkup2 (61/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 66.0 in stage
0.0 (TID 65, sparkup1, partition 66,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 62.0 in stage
0.0 (TID 61) in 327 ms on sparkup1 (62/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 72.0 in stage
0.0 (TID 66, sparkup1, partition 72,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 65.0 in stage
0.0 (TID 62) in 261 ms on sparkup1 (63/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 74.0 in stage
0.0 (TID 67, sparkup1, partition 74,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 66.0 in stage
0.0 (TID 65) in 300 ms on sparkup1 (64/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 139.0 in
stage 0.0 (TID 68, sparkup2, partition 139,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 135.0 in
stage 0.0 (TID 64) in 378 ms on sparkup2 (65/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 76.0 in stage
0.0 (TID 69, sparkup1, partition 76,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 72.0 in stage
0.0 (TID 66) in 287 ms on sparkup1 (66/1024)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Starting task 140.0 in
stage 0.0 (TID 70, sparkup2, partition 140,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:36 INFO scheduler.TaskSetManager: Finished task 131.0 in
stage 0.0 (TID 63) in 638 ms on sparkup2 (67/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 83.0 in stage
0.0 (TID 71, sparkup1, partition 83,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 74.0 in stage
0.0 (TID 67) in 380 ms on sparkup1 (68/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 141.0 in
stage 0.0 (TID 72, sparkup2, partition 141,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 139.0 in
stage 0.0 (TID 68) in 384 ms on sparkup2 (69/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 85.0 in stage
0.0 (TID 73, sparkup1, partition 85,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 76.0 in stage
0.0 (TID 69) in 357 ms on sparkup1 (70/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 86.0 in stage
0.0 (TID 74, sparkup1, partition 86,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 83.0 in stage
0.0 (TID 71) in 341 ms on sparkup1 (71/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 88.0 in stage
0.0 (TID 75, sparkup1, partition 88,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 85.0 in stage
0.0 (TID 73) in 343 ms on sparkup1 (72/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 144.0 in
stage 0.0 (TID 76, sparkup2, partition 144,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 141.0 in
stage 0.0 (TID 72) in 376 ms on sparkup2 (73/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 148.0 in
stage 0.0 (TID 77, sparkup2, partition 148,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 140.0 in
stage 0.0 (TID 70) in 616 ms on sparkup2 (74/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 93.0 in stage
0.0 (TID 78, sparkup1, partition 93,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 86.0 in stage
0.0 (TID 74) in 351 ms on sparkup1 (75/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 97.0 in stage
0.0 (TID 79, sparkup1, partition 97,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 88.0 in stage
0.0 (TID 75) in 312 ms on sparkup1 (76/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 150.0 in
stage 0.0 (TID 80, sparkup2, partition 150,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 144.0 in
stage 0.0 (TID 76) in 378 ms on sparkup2 (77/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 153.0 in
stage 0.0 (TID 81, sparkup2, partition 153,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 148.0 in
stage 0.0 (TID 77) in 351 ms on sparkup2 (78/1024)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Starting task 104.0 in
stage 0.0 (TID 82, sparkup1, partition 104,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:37 INFO scheduler.TaskSetManager: Finished task 93.0 in stage
0.0 (TID 78) in 257 ms on sparkup1 (79/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 107.0 in
stage 0.0 (TID 83, sparkup1, partition 107,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 97.0 in stage
0.0 (TID 79) in 299 ms on sparkup1 (80/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 157.0 in
stage 0.0 (TID 84, sparkup2, partition 157,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 150.0 in
stage 0.0 (TID 80) in 349 ms on sparkup2 (81/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 158.0 in
stage 0.0 (TID 85, sparkup2, partition 158,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 153.0 in
stage 0.0 (TID 81) in 338 ms on sparkup2 (82/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 108.0 in
stage 0.0 (TID 86, sparkup1, partition 108,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 104.0 in
stage 0.0 (TID 82) in 276 ms on sparkup1 (83/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 110.0 in
stage 0.0 (TID 87, sparkup1, partition 110,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 107.0 in
stage 0.0 (TID 83) in 290 ms on sparkup1 (84/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 159.0 in
stage 0.0 (TID 88, sparkup2, partition 159,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 157.0 in
stage 0.0 (TID 84) in 344 ms on sparkup2 (85/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 108.0 in
stage 0.0 (TID 86) in 312 ms on sparkup1 (86/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 111.0 in
stage 0.0 (TID 89, sparkup1, partition 111,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 158.0 in
stage 0.0 (TID 85) in 363 ms on sparkup2 (87/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 164.0 in
stage 0.0 (TID 90, sparkup2, partition 164,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 113.0 in
stage 0.0 (TID 91, sparkup1, partition 113,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 110.0 in
stage 0.0 (TID 87) in 315 ms on sparkup1 (88/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 166.0 in
stage 0.0 (TID 92, sparkup2, partition 166,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 159.0 in
stage 0.0 (TID 88) in 369 ms on sparkup2 (89/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 167.0 in
stage 0.0 (TID 93, sparkup2, partition 167,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 164.0 in
stage 0.0 (TID 90) in 345 ms on sparkup2 (90/1024)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Starting task 116.0 in
stage 0.0 (TID 94, sparkup1, partition 116,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:38 INFO scheduler.TaskSetManager: Finished task 111.0 in
stage 0.0 (TID 89) in 407 ms on sparkup1 (91/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 117.0 in
stage 0.0 (TID 95, sparkup1, partition 117,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 113.0 in
stage 0.0 (TID 91) in 346 ms on sparkup1 (92/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 170.0 in
stage 0.0 (TID 96, sparkup2, partition 170,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 166.0 in
stage 0.0 (TID 92) in 386 ms on sparkup2 (93/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 177.0 in
stage 0.0 (TID 97, sparkup2, partition 177,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 167.0 in
stage 0.0 (TID 93) in 376 ms on sparkup2 (94/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 119.0 in
stage 0.0 (TID 98, sparkup1, partition 119,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 117.0 in
stage 0.0 (TID 95) in 348 ms on sparkup1 (95/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 120.0 in
stage 0.0 (TID 99, sparkup1, partition 120,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 116.0 in
stage 0.0 (TID 94) in 421 ms on sparkup1 (96/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 180.0 in
stage 0.0 (TID 100, sparkup2, partition 180,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 170.0 in
stage 0.0 (TID 96) in 398 ms on sparkup2 (97/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 182.0 in
stage 0.0 (TID 101, sparkup2, partition 182,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 177.0 in
stage 0.0 (TID 97) in 376 ms on sparkup2 (98/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 121.0 in
stage 0.0 (TID 102, sparkup1, partition 121,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 119.0 in
stage 0.0 (TID 98) in 371 ms on sparkup1 (99/1024)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Starting task 122.0 in
stage 0.0 (TID 103, sparkup1, partition 122,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:39 INFO scheduler.TaskSetManager: Finished task 120.0 in
stage 0.0 (TID 99) in 351 ms on sparkup1 (100/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 124.0 in
stage 0.0 (TID 104, sparkup1, partition 124,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 121.0 in
stage 0.0 (TID 102) in 315 ms on sparkup1 (101/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 180.0 in
stage 0.0 (TID 100) in 386 ms on sparkup2 (102/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 186.0 in
stage 0.0 (TID 105, sparkup2, partition 186,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 182.0 in
stage 0.0 (TID 101) in 361 ms on sparkup2 (103/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 189.0 in
stage 0.0 (TID 106, sparkup2, partition 189,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 125.0 in
stage 0.0 (TID 107, sparkup1, partition 125,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 122.0 in
stage 0.0 (TID 103) in 350 ms on sparkup1 (104/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 127.0 in
stage 0.0 (TID 108, sparkup1, partition 127,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 125.0 in
stage 0.0 (TID 107) in 291 ms on sparkup1 (105/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 129.0 in
stage 0.0 (TID 109, sparkup1, partition 129,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 124.0 in
stage 0.0 (TID 104) in 404 ms on sparkup1 (106/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 186.0 in
stage 0.0 (TID 105) in 388 ms on sparkup2 (107/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 191.0 in
stage 0.0 (TID 110, sparkup2, partition 191,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 189.0 in
stage 0.0 (TID 106) in 404 ms on sparkup2 (108/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 195.0 in
stage 0.0 (TID 111, sparkup2, partition 195,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 132.0 in
stage 0.0 (TID 112, sparkup1, partition 132,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 127.0 in
stage 0.0 (TID 108) in 355 ms on sparkup1 (109/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 134.0 in
stage 0.0 (TID 113, sparkup1, partition 134,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 129.0 in
stage 0.0 (TID 109) in 353 ms on sparkup1 (110/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 196.0 in
stage 0.0 (TID 114, sparkup2, partition 196,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 191.0 in
stage 0.0 (TID 110) in 369 ms on sparkup2 (111/1024)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Starting task 197.0 in
stage 0.0 (TID 115, sparkup2, partition 197,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:40 INFO scheduler.TaskSetManager: Finished task 195.0 in
stage 0.0 (TID 111) in 379 ms on sparkup2 (112/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 145.0 in
stage 0.0 (TID 116, sparkup1, partition 145,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 132.0 in
stage 0.0 (TID 112) in 305 ms on sparkup1 (113/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 149.0 in
stage 0.0 (TID 117, sparkup1, partition 149,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 134.0 in
stage 0.0 (TID 113) in 329 ms on sparkup1 (114/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 201.0 in
stage 0.0 (TID 118, sparkup2, partition 201,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 196.0 in
stage 0.0 (TID 114) in 359 ms on sparkup2 (115/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 202.0 in
stage 0.0 (TID 119, sparkup2, partition 202,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 197.0 in
stage 0.0 (TID 115) in 359 ms on sparkup2 (116/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 151.0 in
stage 0.0 (TID 120, sparkup1, partition 151,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 149.0 in
stage 0.0 (TID 117) in 285 ms on sparkup1 (117/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 152.0 in
stage 0.0 (TID 121, sparkup1, partition 152,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 145.0 in
stage 0.0 (TID 116) in 383 ms on sparkup1 (118/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 203.0 in
stage 0.0 (TID 122, sparkup2, partition 203,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 201.0 in
stage 0.0 (TID 118) in 362 ms on sparkup2 (119/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 206.0 in
stage 0.0 (TID 123, sparkup2, partition 206,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 202.0 in
stage 0.0 (TID 119) in 363 ms on sparkup2 (120/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 160.0 in
stage 0.0 (TID 124, sparkup1, partition 160,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 152.0 in
stage 0.0 (TID 121) in 271 ms on sparkup1 (121/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 161.0 in
stage 0.0 (TID 125, sparkup1, partition 161,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 151.0 in
stage 0.0 (TID 120) in 333 ms on sparkup1 (122/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 208.0 in
stage 0.0 (TID 126, sparkup2, partition 208,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 203.0 in
stage 0.0 (TID 122) in 354 ms on sparkup2 (123/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 213.0 in
stage 0.0 (TID 127, sparkup2, partition 213,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 206.0 in
stage 0.0 (TID 123) in 361 ms on sparkup2 (124/1024)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Starting task 162.0 in
stage 0.0 (TID 128, sparkup1, partition 162,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:41 INFO scheduler.TaskSetManager: Finished task 161.0 in
stage 0.0 (TID 125) in 264 ms on sparkup1 (125/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 165.0 in
stage 0.0 (TID 129, sparkup1, partition 165,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 160.0 in
stage 0.0 (TID 124) in 332 ms on sparkup1 (126/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 216.0 in
stage 0.0 (TID 130, sparkup2, partition 216,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 208.0 in
stage 0.0 (TID 126) in 363 ms on sparkup2 (127/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 169.0 in
stage 0.0 (TID 131, sparkup1, partition 169,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 165.0 in
stage 0.0 (TID 129) in 282 ms on sparkup1 (128/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 213.0 in
stage 0.0 (TID 127) in 387 ms on sparkup2 (129/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 223.0 in
stage 0.0 (TID 132, sparkup2, partition 223,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 171.0 in
stage 0.0 (TID 133, sparkup1, partition 171,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 162.0 in
stage 0.0 (TID 128) in 360 ms on sparkup1 (130/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 226.0 in
stage 0.0 (TID 134, sparkup2, partition 226,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 216.0 in
stage 0.0 (TID 130) in 358 ms on sparkup2 (131/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 172.0 in
stage 0.0 (TID 135, sparkup1, partition 172,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 171.0 in
stage 0.0 (TID 133) in 286 ms on sparkup1 (132/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 173.0 in
stage 0.0 (TID 136, sparkup1, partition 173,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 169.0 in
stage 0.0 (TID 131) in 379 ms on sparkup1 (133/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Finished task 223.0 in
stage 0.0 (TID 132) in 375 ms on sparkup2 (134/1024)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 229.0 in
stage 0.0 (TID 137, sparkup2, partition 229,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:42 INFO scheduler.TaskSetManager: Starting task 233.0 in
stage 0.0 (TID 138, sparkup2, partition 233,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 226.0 in
stage 0.0 (TID 134) in 393 ms on sparkup2 (135/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 174.0 in
stage 0.0 (TID 139, sparkup1, partition 174,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 172.0 in
stage 0.0 (TID 135) in 414 ms on sparkup1 (136/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 237.0 in
stage 0.0 (TID 140, sparkup2, partition 237,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 229.0 in
stage 0.0 (TID 137) in 360 ms on sparkup2 (137/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 173.0 in
stage 0.0 (TID 136) in 414 ms on sparkup1 (138/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 181.0 in
stage 0.0 (TID 141, sparkup1, partition 181,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 241.0 in
stage 0.0 (TID 142, sparkup2, partition 241,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 233.0 in
stage 0.0 (TID 138) in 406 ms on sparkup2 (139/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 183.0 in
stage 0.0 (TID 143, sparkup1, partition 183,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 174.0 in
stage 0.0 (TID 139) in 378 ms on sparkup1 (140/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 245.0 in
stage 0.0 (TID 144, sparkup2, partition 245,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 237.0 in
stage 0.0 (TID 140) in 388 ms on sparkup2 (141/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 184.0 in
stage 0.0 (TID 145, sparkup1, partition 184,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 181.0 in
stage 0.0 (TID 141) in 393 ms on sparkup1 (142/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 187.0 in
stage 0.0 (TID 146, sparkup1, partition 187,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 184.0 in
stage 0.0 (TID 145) in 272 ms on sparkup1 (143/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 247.0 in
stage 0.0 (TID 147, sparkup2, partition 247,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 241.0 in
stage 0.0 (TID 142) in 403 ms on sparkup2 (144/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 192.0 in
stage 0.0 (TID 148, sparkup1, partition 192,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 183.0 in
stage 0.0 (TID 143) in 402 ms on sparkup1 (145/1024)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Starting task 258.0 in
stage 0.0 (TID 149, sparkup2, partition 258,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:43 INFO scheduler.TaskSetManager: Finished task 245.0 in
stage 0.0 (TID 144) in 406 ms on sparkup2 (146/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 199.0 in
stage 0.0 (TID 150, sparkup1, partition 199,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 192.0 in
stage 0.0 (TID 148) in 298 ms on sparkup1 (147/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 207.0 in
stage 0.0 (TID 151, sparkup1, partition 207,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 187.0 in
stage 0.0 (TID 146) in 388 ms on sparkup1 (148/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 264.0 in
stage 0.0 (TID 152, sparkup2, partition 264,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 247.0 in
stage 0.0 (TID 147) in 397 ms on sparkup2 (149/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 267.0 in
stage 0.0 (TID 153, sparkup2, partition 267,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 258.0 in
stage 0.0 (TID 149) in 393 ms on sparkup2 (150/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 209.0 in
stage 0.0 (TID 154, sparkup1, partition 209,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 207.0 in
stage 0.0 (TID 151) in 290 ms on sparkup1 (151/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 211.0 in
stage 0.0 (TID 155, sparkup1, partition 211,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 199.0 in
stage 0.0 (TID 150) in 357 ms on sparkup1 (152/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 268.0 in
stage 0.0 (TID 156, sparkup2, partition 268,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 264.0 in
stage 0.0 (TID 152) in 386 ms on sparkup2 (153/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 270.0 in
stage 0.0 (TID 157, sparkup2, partition 270,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 267.0 in
stage 0.0 (TID 153) in 388 ms on sparkup2 (154/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 212.0 in
stage 0.0 (TID 158, sparkup1, partition 212,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 209.0 in
stage 0.0 (TID 154) in 324 ms on sparkup1 (155/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 215.0 in
stage 0.0 (TID 159, sparkup1, partition 215,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 211.0 in
stage 0.0 (TID 155) in 300 ms on sparkup1 (156/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 274.0 in
stage 0.0 (TID 160, sparkup2, partition 274,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 268.0 in
stage 0.0 (TID 156) in 377 ms on sparkup2 (157/1024)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Starting task 281.0 in
stage 0.0 (TID 161, sparkup2, partition 281,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:44 INFO scheduler.TaskSetManager: Finished task 270.0 in
stage 0.0 (TID 157) in 373 ms on sparkup2 (158/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 218.0 in
stage 0.0 (TID 162, sparkup1, partition 218,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 215.0 in
stage 0.0 (TID 159) in 261 ms on sparkup1 (159/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 221.0 in
stage 0.0 (TID 163, sparkup1, partition 221,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 212.0 in
stage 0.0 (TID 158) in 321 ms on sparkup1 (160/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 284.0 in
stage 0.0 (TID 164, sparkup2, partition 284,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 274.0 in
stage 0.0 (TID 160) in 375 ms on sparkup2 (161/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 294.0 in
stage 0.0 (TID 165, sparkup2, partition 294,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 281.0 in
stage 0.0 (TID 161) in 370 ms on sparkup2 (162/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 222.0 in
stage 0.0 (TID 166, sparkup1, partition 222,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 218.0 in
stage 0.0 (TID 162) in 367 ms on sparkup1 (163/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 227.0 in
stage 0.0 (TID 167, sparkup1, partition 227,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 221.0 in
stage 0.0 (TID 163) in 368 ms on sparkup1 (164/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 228.0 in
stage 0.0 (TID 168, sparkup1, partition 228,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 227.0 in
stage 0.0 (TID 167) in 288 ms on sparkup1 (165/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 284.0 in
stage 0.0 (TID 164) in 410 ms on sparkup2 (166/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 295.0 in
stage 0.0 (TID 169, sparkup2, partition 295,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 230.0 in
stage 0.0 (TID 170, sparkup1, partition 230,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 222.0 in
stage 0.0 (TID 166) in 380 ms on sparkup1 (167/1024)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Starting task 298.0 in
stage 0.0 (TID 171, sparkup2, partition 298,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:45 INFO scheduler.TaskSetManager: Finished task 294.0 in
stage 0.0 (TID 165) in 632 ms on sparkup2 (168/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 231.0 in
stage 0.0 (TID 172, sparkup1, partition 231,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 230.0 in
stage 0.0 (TID 170) in 268 ms on sparkup1 (169/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 234.0 in
stage 0.0 (TID 173, sparkup1, partition 234,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 228.0 in
stage 0.0 (TID 168) in 365 ms on sparkup1 (170/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 299.0 in
stage 0.0 (TID 174, sparkup2, partition 299,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 295.0 in
stage 0.0 (TID 169) in 397 ms on sparkup2 (171/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 235.0 in
stage 0.0 (TID 175, sparkup1, partition 235,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 231.0 in
stage 0.0 (TID 172) in 305 ms on sparkup1 (172/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 236.0 in
stage 0.0 (TID 176, sparkup1, partition 236,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 234.0 in
stage 0.0 (TID 173) in 301 ms on sparkup1 (173/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 300.0 in
stage 0.0 (TID 177, sparkup2, partition 300,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 299.0 in
stage 0.0 (TID 174) in 371 ms on sparkup2 (174/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 238.0 in
stage 0.0 (TID 178, sparkup1, partition 238,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 235.0 in
stage 0.0 (TID 175) in 345 ms on sparkup1 (175/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 301.0 in
stage 0.0 (TID 179, sparkup2, partition 301,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 298.0 in
stage 0.0 (TID 171) in 711 ms on sparkup2 (176/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 239.0 in
stage 0.0 (TID 180, sparkup1, partition 239,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 236.0 in
stage 0.0 (TID 176) in 357 ms on sparkup1 (177/1024)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Starting task 308.0 in
stage 0.0 (TID 181, sparkup2, partition 308,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:46 INFO scheduler.TaskSetManager: Finished task 300.0 in
stage 0.0 (TID 177) in 377 ms on sparkup2 (178/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 243.0 in
stage 0.0 (TID 182, sparkup1, partition 243,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 239.0 in
stage 0.0 (TID 180) in 282 ms on sparkup1 (179/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 246.0 in
stage 0.0 (TID 183, sparkup1, partition 246,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 238.0 in
stage 0.0 (TID 178) in 347 ms on sparkup1 (180/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 315.0 in
stage 0.0 (TID 184, sparkup2, partition 315,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 301.0 in
stage 0.0 (TID 179) in 390 ms on sparkup2 (181/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 318.0 in
stage 0.0 (TID 185, sparkup2, partition 318,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 308.0 in
stage 0.0 (TID 181) in 378 ms on sparkup2 (182/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 248.0 in
stage 0.0 (TID 186, sparkup1, partition 248,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 246.0 in
stage 0.0 (TID 183) in 272 ms on sparkup1 (183/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 249.0 in
stage 0.0 (TID 187, sparkup1, partition 249,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 243.0 in
stage 0.0 (TID 182) in 328 ms on sparkup1 (184/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 319.0 in
stage 0.0 (TID 188, sparkup2, partition 319,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 315.0 in
stage 0.0 (TID 184) in 374 ms on sparkup2 (185/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 320.0 in
stage 0.0 (TID 189, sparkup2, partition 320,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 318.0 in
stage 0.0 (TID 185) in 376 ms on sparkup2 (186/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 250.0 in
stage 0.0 (TID 190, sparkup1, partition 250,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 248.0 in
stage 0.0 (TID 186) in 350 ms on sparkup1 (187/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 251.0 in
stage 0.0 (TID 191, sparkup1, partition 251,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 249.0 in
stage 0.0 (TID 187) in 352 ms on sparkup1 (188/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 322.0 in
stage 0.0 (TID 192, sparkup2, partition 322,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 319.0 in
stage 0.0 (TID 188) in 466 ms on sparkup2 (189/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 253.0 in
stage 0.0 (TID 193, sparkup1, partition 253,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 250.0 in
stage 0.0 (TID 190) in 304 ms on sparkup1 (190/1024)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Starting task 323.0 in
stage 0.0 (TID 194, sparkup2, partition 323,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:47 INFO scheduler.TaskSetManager: Finished task 320.0 in
stage 0.0 (TID 189) in 370 ms on sparkup2 (191/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 255.0 in
stage 0.0 (TID 195, sparkup1, partition 255,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 251.0 in
stage 0.0 (TID 191) in 331 ms on sparkup1 (192/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 257.0 in
stage 0.0 (TID 196, sparkup1, partition 257,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 255.0 in
stage 0.0 (TID 195) in 275 ms on sparkup1 (193/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 327.0 in
stage 0.0 (TID 197, sparkup2, partition 327,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 322.0 in
stage 0.0 (TID 192) in 404 ms on sparkup2 (194/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 259.0 in
stage 0.0 (TID 198, sparkup1, partition 259,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 253.0 in
stage 0.0 (TID 193) in 394 ms on sparkup1 (195/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 331.0 in
stage 0.0 (TID 199, sparkup2, partition 331,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 323.0 in
stage 0.0 (TID 194) in 372 ms on sparkup2 (196/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 261.0 in
stage 0.0 (TID 200, sparkup1, partition 261,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 257.0 in
stage 0.0 (TID 196) in 342 ms on sparkup1 (197/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 269.0 in
stage 0.0 (TID 201, sparkup1, partition 269,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 259.0 in
stage 0.0 (TID 198) in 295 ms on sparkup1 (198/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 332.0 in
stage 0.0 (TID 202, sparkup2, partition 332,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 327.0 in
stage 0.0 (TID 197) in 381 ms on sparkup2 (199/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 333.0 in
stage 0.0 (TID 203, sparkup2, partition 333,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 331.0 in
stage 0.0 (TID 199) in 371 ms on sparkup2 (200/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 271.0 in
stage 0.0 (TID 204, sparkup1, partition 271,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 261.0 in
stage 0.0 (TID 200) in 294 ms on sparkup1 (201/1024)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Starting task 278.0 in
stage 0.0 (TID 205, sparkup1, partition 278,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:48 INFO scheduler.TaskSetManager: Finished task 269.0 in
stage 0.0 (TID 201) in 324 ms on sparkup1 (202/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 334.0 in
stage 0.0 (TID 206, sparkup2, partition 334,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 332.0 in
stage 0.0 (TID 202) in 384 ms on sparkup2 (203/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 339.0 in
stage 0.0 (TID 207, sparkup2, partition 339,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 333.0 in
stage 0.0 (TID 203) in 380 ms on sparkup2 (204/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 279.0 in
stage 0.0 (TID 208, sparkup1, partition 279,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 271.0 in
stage 0.0 (TID 204) in 325 ms on sparkup1 (205/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 285.0 in
stage 0.0 (TID 209, sparkup1, partition 285,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 278.0 in
stage 0.0 (TID 205) in 313 ms on sparkup1 (206/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 342.0 in
stage 0.0 (TID 210, sparkup2, partition 342,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 334.0 in
stage 0.0 (TID 206) in 396 ms on sparkup2 (207/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 345.0 in
stage 0.0 (TID 211, sparkup2, partition 345,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 339.0 in
stage 0.0 (TID 207) in 387 ms on sparkup2 (208/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 286.0 in
stage 0.0 (TID 212, sparkup1, partition 286,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 285.0 in
stage 0.0 (TID 209) in 294 ms on sparkup1 (209/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 288.0 in
stage 0.0 (TID 213, sparkup1, partition 288,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 279.0 in
stage 0.0 (TID 208) in 352 ms on sparkup1 (210/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 346.0 in
stage 0.0 (TID 214, sparkup2, partition 346,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 342.0 in
stage 0.0 (TID 210) in 367 ms on sparkup2 (211/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 351.0 in
stage 0.0 (TID 215, sparkup2, partition 351,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 345.0 in
stage 0.0 (TID 211) in 389 ms on sparkup2 (212/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 290.0 in
stage 0.0 (TID 216, sparkup1, partition 290,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 286.0 in
stage 0.0 (TID 212) in 325 ms on sparkup1 (213/1024)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Starting task 292.0 in
stage 0.0 (TID 217, sparkup1, partition 292,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:49 INFO scheduler.TaskSetManager: Finished task 288.0 in
stage 0.0 (TID 213) in 326 ms on sparkup1 (214/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 352.0 in
stage 0.0 (TID 218, sparkup2, partition 352,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 346.0 in
stage 0.0 (TID 214) in 365 ms on sparkup2 (215/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 355.0 in
stage 0.0 (TID 219, sparkup2, partition 355,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 351.0 in
stage 0.0 (TID 215) in 353 ms on sparkup2 (216/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 296.0 in
stage 0.0 (TID 220, sparkup1, partition 296,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 292.0 in
stage 0.0 (TID 217) in 328 ms on sparkup1 (217/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 297.0 in
stage 0.0 (TID 221, sparkup1, partition 297,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 290.0 in
stage 0.0 (TID 216) in 481 ms on sparkup1 (218/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 356.0 in
stage 0.0 (TID 222, sparkup2, partition 356,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 352.0 in
stage 0.0 (TID 218) in 377 ms on sparkup2 (219/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 305.0 in
stage 0.0 (TID 223, sparkup1, partition 305,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 296.0 in
stage 0.0 (TID 220) in 352 ms on sparkup1 (220/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 357.0 in
stage 0.0 (TID 224, sparkup2, partition 357,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 355.0 in
stage 0.0 (TID 219) in 399 ms on sparkup2 (221/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 310.0 in
stage 0.0 (TID 225, sparkup1, partition 310,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 297.0 in
stage 0.0 (TID 221) in 333 ms on sparkup1 (222/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 311.0 in
stage 0.0 (TID 226, sparkup1, partition 311,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 305.0 in
stage 0.0 (TID 223) in 325 ms on sparkup1 (223/1024)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Starting task 358.0 in
stage 0.0 (TID 227, sparkup2, partition 358,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:50 INFO scheduler.TaskSetManager: Finished task 356.0 in
stage 0.0 (TID 222) in 396 ms on sparkup2 (224/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 360.0 in
stage 0.0 (TID 228, sparkup2, partition 360,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 357.0 in
stage 0.0 (TID 224) in 377 ms on sparkup2 (225/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 313.0 in
stage 0.0 (TID 229, sparkup1, partition 313,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 310.0 in
stage 0.0 (TID 225) in 323 ms on sparkup1 (226/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 314.0 in
stage 0.0 (TID 230, sparkup1, partition 314,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 311.0 in
stage 0.0 (TID 226) in 263 ms on sparkup1 (227/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 316.0 in
stage 0.0 (TID 231, sparkup1, partition 316,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 313.0 in
stage 0.0 (TID 229) in 307 ms on sparkup1 (228/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 363.0 in
stage 0.0 (TID 232, sparkup2, partition 363,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 358.0 in
stage 0.0 (TID 227) in 408 ms on sparkup2 (229/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 368.0 in
stage 0.0 (TID 233, sparkup2, partition 368,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 360.0 in
stage 0.0 (TID 228) in 390 ms on sparkup2 (230/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 317.0 in
stage 0.0 (TID 234, sparkup1, partition 317,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 314.0 in
stage 0.0 (TID 230) in 261 ms on sparkup1 (231/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 321.0 in
stage 0.0 (TID 235, sparkup1, partition 321,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 316.0 in
stage 0.0 (TID 231) in 305 ms on sparkup1 (232/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 324.0 in
stage 0.0 (TID 236, sparkup1, partition 324,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 317.0 in
stage 0.0 (TID 234) in 252 ms on sparkup1 (233/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 373.0 in
stage 0.0 (TID 237, sparkup2, partition 373,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 363.0 in
stage 0.0 (TID 232) in 380 ms on sparkup2 (234/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 374.0 in
stage 0.0 (TID 238, sparkup2, partition 374,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 368.0 in
stage 0.0 (TID 233) in 386 ms on sparkup2 (235/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 325.0 in
stage 0.0 (TID 239, sparkup1, partition 325,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 321.0 in
stage 0.0 (TID 235) in 290 ms on sparkup1 (236/1024)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Starting task 326.0 in
stage 0.0 (TID 240, sparkup1, partition 326,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:51 INFO scheduler.TaskSetManager: Finished task 324.0 in
stage 0.0 (TID 236) in 271 ms on sparkup1 (237/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 375.0 in
stage 0.0 (TID 241, sparkup2, partition 375,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 373.0 in
stage 0.0 (TID 237) in 359 ms on sparkup2 (238/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 378.0 in
stage 0.0 (TID 242, sparkup2, partition 378,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 374.0 in
stage 0.0 (TID 238) in 352 ms on sparkup2 (239/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 328.0 in
stage 0.0 (TID 243, sparkup1, partition 328,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 325.0 in
stage 0.0 (TID 239) in 263 ms on sparkup1 (240/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 330.0 in
stage 0.0 (TID 244, sparkup1, partition 330,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 326.0 in
stage 0.0 (TID 240) in 297 ms on sparkup1 (241/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 335.0 in
stage 0.0 (TID 245, sparkup1, partition 335,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 328.0 in
stage 0.0 (TID 243) in 249 ms on sparkup1 (242/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 384.0 in
stage 0.0 (TID 246, sparkup2, partition 384,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 375.0 in
stage 0.0 (TID 241) in 343 ms on sparkup2 (243/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 387.0 in
stage 0.0 (TID 247, sparkup2, partition 387,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 378.0 in
stage 0.0 (TID 242) in 361 ms on sparkup2 (244/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 337.0 in
stage 0.0 (TID 248, sparkup1, partition 337,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 330.0 in
stage 0.0 (TID 244) in 292 ms on sparkup1 (245/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 343.0 in
stage 0.0 (TID 249, sparkup1, partition 343,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 335.0 in
stage 0.0 (TID 245) in 252 ms on sparkup1 (246/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 388.0 in
stage 0.0 (TID 250, sparkup2, partition 388,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 384.0 in
stage 0.0 (TID 246) in 382 ms on sparkup2 (247/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 348.0 in
stage 0.0 (TID 251, sparkup1, partition 348,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 337.0 in
stage 0.0 (TID 248) in 294 ms on sparkup1 (248/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 391.0 in
stage 0.0 (TID 252, sparkup2, partition 391,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 387.0 in
stage 0.0 (TID 247) in 371 ms on sparkup2 (249/1024)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Starting task 349.0 in
stage 0.0 (TID 253, sparkup1, partition 349,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:52 INFO scheduler.TaskSetManager: Finished task 343.0 in
stage 0.0 (TID 249) in 249 ms on sparkup1 (250/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 350.0 in
stage 0.0 (TID 254, sparkup1, partition 350,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 348.0 in
stage 0.0 (TID 251) in 301 ms on sparkup1 (251/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 393.0 in
stage 0.0 (TID 255, sparkup2, partition 393,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 388.0 in
stage 0.0 (TID 250) in 361 ms on sparkup2 (252/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 353.0 in
stage 0.0 (TID 256, sparkup1, partition 353,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 349.0 in
stage 0.0 (TID 253) in 265 ms on sparkup1 (253/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 394.0 in
stage 0.0 (TID 257, sparkup2, partition 394,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 391.0 in
stage 0.0 (TID 252) in 353 ms on sparkup2 (254/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 354.0 in
stage 0.0 (TID 258, sparkup1, partition 354,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 350.0 in
stage 0.0 (TID 254) in 312 ms on sparkup1 (255/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 361.0 in
stage 0.0 (TID 259, sparkup1, partition 361,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 353.0 in
stage 0.0 (TID 256) in 276 ms on sparkup1 (256/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 397.0 in
stage 0.0 (TID 260, sparkup2, partition 397,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 393.0 in
stage 0.0 (TID 255) in 347 ms on sparkup2 (257/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 398.0 in
stage 0.0 (TID 261, sparkup2, partition 398,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 394.0 in
stage 0.0 (TID 257) in 353 ms on sparkup2 (258/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 362.0 in
stage 0.0 (TID 262, sparkup1, partition 362,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 354.0 in
stage 0.0 (TID 258) in 264 ms on sparkup1 (259/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 372.0 in
stage 0.0 (TID 263, sparkup1, partition 372,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 361.0 in
stage 0.0 (TID 259) in 310 ms on sparkup1 (260/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 404.0 in
stage 0.0 (TID 264, sparkup2, partition 404,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 397.0 in
stage 0.0 (TID 260) in 366 ms on sparkup2 (261/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 405.0 in
stage 0.0 (TID 265, sparkup2, partition 405,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 398.0 in
stage 0.0 (TID 261) in 370 ms on sparkup2 (262/1024)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Starting task 376.0 in
stage 0.0 (TID 266, sparkup1, partition 376,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:53 INFO scheduler.TaskSetManager: Finished task 362.0 in
stage 0.0 (TID 262) in 253 ms on sparkup1 (263/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 377.0 in
stage 0.0 (TID 267, sparkup1, partition 377,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 372.0 in
stage 0.0 (TID 263) in 286 ms on sparkup1 (264/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 379.0 in
stage 0.0 (TID 268, sparkup1, partition 379,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 376.0 in
stage 0.0 (TID 266) in 266 ms on sparkup1 (265/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 410.0 in
stage 0.0 (TID 269, sparkup2, partition 410,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 404.0 in
stage 0.0 (TID 264) in 368 ms on sparkup2 (266/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 412.0 in
stage 0.0 (TID 270, sparkup2, partition 412,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 405.0 in
stage 0.0 (TID 265) in 372 ms on sparkup2 (267/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 382.0 in
stage 0.0 (TID 271, sparkup1, partition 382,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 377.0 in
stage 0.0 (TID 267) in 287 ms on sparkup1 (268/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 390.0 in
stage 0.0 (TID 272, sparkup1, partition 390,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 379.0 in
stage 0.0 (TID 268) in 240 ms on sparkup1 (269/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 416.0 in
stage 0.0 (TID 273, sparkup2, partition 416,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 410.0 in
stage 0.0 (TID 269) in 371 ms on sparkup2 (270/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 392.0 in
stage 0.0 (TID 274, sparkup1, partition 392,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 382.0 in
stage 0.0 (TID 271) in 299 ms on sparkup1 (271/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 417.0 in
stage 0.0 (TID 275, sparkup2, partition 417,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 412.0 in
stage 0.0 (TID 270) in 367 ms on sparkup2 (272/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 395.0 in
stage 0.0 (TID 276, sparkup1, partition 395,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 390.0 in
stage 0.0 (TID 272) in 249 ms on sparkup1 (273/1024)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Starting task 419.0 in
stage 0.0 (TID 277, sparkup2, partition 419,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:54 INFO scheduler.TaskSetManager: Finished task 416.0 in
stage 0.0 (TID 273) in 351 ms on sparkup2 (274/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 400.0 in
stage 0.0 (TID 278, sparkup1, partition 400,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 392.0 in
stage 0.0 (TID 274) in 364 ms on sparkup1 (275/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 407.0 in
stage 0.0 (TID 279, sparkup1, partition 407,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 395.0 in
stage 0.0 (TID 276) in 310 ms on sparkup1 (276/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 421.0 in
stage 0.0 (TID 280, sparkup2, partition 421,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 417.0 in
stage 0.0 (TID 275) in 387 ms on sparkup2 (277/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 422.0 in
stage 0.0 (TID 281, sparkup2, partition 422,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 419.0 in
stage 0.0 (TID 277) in 350 ms on sparkup2 (278/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 409.0 in
stage 0.0 (TID 282, sparkup1, partition 409,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 407.0 in
stage 0.0 (TID 279) in 321 ms on sparkup1 (279/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 411.0 in
stage 0.0 (TID 283, sparkup1, partition 411,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 400.0 in
stage 0.0 (TID 278) in 364 ms on sparkup1 (280/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 421.0 in
stage 0.0 (TID 280) in 351 ms on sparkup2 (281/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 425.0 in
stage 0.0 (TID 284, sparkup2, partition 425,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 413.0 in
stage 0.0 (TID 285, sparkup1, partition 413,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 411.0 in
stage 0.0 (TID 283) in 293 ms on sparkup1 (282/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 428.0 in
stage 0.0 (TID 286, sparkup2, partition 428,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 422.0 in
stage 0.0 (TID 281) in 365 ms on sparkup2 (283/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 409.0 in
stage 0.0 (TID 282) in 358 ms on sparkup1 (284/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 415.0 in
stage 0.0 (TID 287, sparkup1, partition 415,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 431.0 in
stage 0.0 (TID 288, sparkup2, partition 431,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 425.0 in
stage 0.0 (TID 284) in 347 ms on sparkup2 (285/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 423.0 in
stage 0.0 (TID 289, sparkup1, partition 423,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 413.0 in
stage 0.0 (TID 285) in 329 ms on sparkup1 (286/1024)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Starting task 427.0 in
stage 0.0 (TID 290, sparkup1, partition 427,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:55 INFO scheduler.TaskSetManager: Finished task 415.0 in
stage 0.0 (TID 287) in 292 ms on sparkup1 (287/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 433.0 in
stage 0.0 (TID 291, sparkup2, partition 433,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 428.0 in
stage 0.0 (TID 286) in 374 ms on sparkup2 (288/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 434.0 in
stage 0.0 (TID 292, sparkup2, partition 434,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 431.0 in
stage 0.0 (TID 288) in 354 ms on sparkup2 (289/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 430.0 in
stage 0.0 (TID 293, sparkup1, partition 430,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 423.0 in
stage 0.0 (TID 289) in 284 ms on sparkup1 (290/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 437.0 in
stage 0.0 (TID 294, sparkup1, partition 437,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 427.0 in
stage 0.0 (TID 290) in 300 ms on sparkup1 (291/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 436.0 in
stage 0.0 (TID 295, sparkup2, partition 436,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 433.0 in
stage 0.0 (TID 291) in 372 ms on sparkup2 (292/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 439.0 in
stage 0.0 (TID 296, sparkup2, partition 439,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 434.0 in
stage 0.0 (TID 292) in 367 ms on sparkup2 (293/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 441.0 in
stage 0.0 (TID 297, sparkup1, partition 441,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 437.0 in
stage 0.0 (TID 294) in 248 ms on sparkup1 (294/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 442.0 in
stage 0.0 (TID 298, sparkup1, partition 442,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 430.0 in
stage 0.0 (TID 293) in 312 ms on sparkup1 (295/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 440.0 in
stage 0.0 (TID 299, sparkup2, partition 440,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 436.0 in
stage 0.0 (TID 295) in 365 ms on sparkup2 (296/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 443.0 in
stage 0.0 (TID 300, sparkup1, partition 443,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 442.0 in
stage 0.0 (TID 298) in 257 ms on sparkup1 (297/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 439.0 in
stage 0.0 (TID 296) in 387 ms on sparkup2 (298/1024)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 444.0 in
stage 0.0 (TID 301, sparkup2, partition 444,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Starting task 446.0 in
stage 0.0 (TID 302, sparkup1, partition 446,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:56 INFO scheduler.TaskSetManager: Finished task 441.0 in
stage 0.0 (TID 297) in 328 ms on sparkup1 (299/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 445.0 in
stage 0.0 (TID 303, sparkup2, partition 445,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 440.0 in
stage 0.0 (TID 299) in 379 ms on sparkup2 (300/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 448.0 in
stage 0.0 (TID 304, sparkup1, partition 448,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 446.0 in
stage 0.0 (TID 302) in 322 ms on sparkup1 (301/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 443.0 in
stage 0.0 (TID 300) in 369 ms on sparkup1 (302/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 449.0 in
stage 0.0 (TID 305, sparkup1, partition 449,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 444.0 in
stage 0.0 (TID 301) in 374 ms on sparkup2 (303/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 454.0 in
stage 0.0 (TID 306, sparkup2, partition 454,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 452.0 in
stage 0.0 (TID 307, sparkup1, partition 452,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 448.0 in
stage 0.0 (TID 304) in 296 ms on sparkup1 (304/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 455.0 in
stage 0.0 (TID 308, sparkup2, partition 455,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 445.0 in
stage 0.0 (TID 303) in 365 ms on sparkup2 (305/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 456.0 in
stage 0.0 (TID 309, sparkup1, partition 456,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 449.0 in
stage 0.0 (TID 305) in 361 ms on sparkup1 (306/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 458.0 in
stage 0.0 (TID 310, sparkup2, partition 458,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 454.0 in
stage 0.0 (TID 306) in 374 ms on sparkup2 (307/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 457.0 in
stage 0.0 (TID 311, sparkup1, partition 457,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 452.0 in
stage 0.0 (TID 307) in 329 ms on sparkup1 (308/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 459.0 in
stage 0.0 (TID 312, sparkup1, partition 459,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 456.0 in
stage 0.0 (TID 309) in 280 ms on sparkup1 (309/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 460.0 in
stage 0.0 (TID 313, sparkup2, partition 460,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 455.0 in
stage 0.0 (TID 308) in 378 ms on sparkup2 (310/1024)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Starting task 461.0 in
stage 0.0 (TID 314, sparkup2, partition 461,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:57 INFO scheduler.TaskSetManager: Finished task 458.0 in
stage 0.0 (TID 310) in 370 ms on sparkup2 (311/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 462.0 in
stage 0.0 (TID 315, sparkup1, partition 462,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 457.0 in
stage 0.0 (TID 311) in 252 ms on sparkup1 (312/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 467.0 in
stage 0.0 (TID 316, sparkup1, partition 467,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 459.0 in
stage 0.0 (TID 312) in 287 ms on sparkup1 (313/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 469.0 in
stage 0.0 (TID 317, sparkup2, partition 469,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 460.0 in
stage 0.0 (TID 313) in 391 ms on sparkup2 (314/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 468.0 in
stage 0.0 (TID 318, sparkup1, partition 468,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 462.0 in
stage 0.0 (TID 315) in 255 ms on sparkup1 (315/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 474.0 in
stage 0.0 (TID 319, sparkup2, partition 474,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 461.0 in
stage 0.0 (TID 314) in 378 ms on sparkup2 (316/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 471.0 in
stage 0.0 (TID 320, sparkup1, partition 471,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 467.0 in
stage 0.0 (TID 316) in 283 ms on sparkup1 (317/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 472.0 in
stage 0.0 (TID 321, sparkup1, partition 472,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 468.0 in
stage 0.0 (TID 318) in 255 ms on sparkup1 (318/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 477.0 in
stage 0.0 (TID 322, sparkup2, partition 477,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 469.0 in
stage 0.0 (TID 317) in 372 ms on sparkup2 (319/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 479.0 in
stage 0.0 (TID 323, sparkup2, partition 479,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 474.0 in
stage 0.0 (TID 319) in 369 ms on sparkup2 (320/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 473.0 in
stage 0.0 (TID 324, sparkup1, partition 473,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 471.0 in
stage 0.0 (TID 320) in 316 ms on sparkup1 (321/1024)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Starting task 475.0 in
stage 0.0 (TID 325, sparkup1, partition 475,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:58 INFO scheduler.TaskSetManager: Finished task 472.0 in
stage 0.0 (TID 321) in 236 ms on sparkup1 (322/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 478.0 in
stage 0.0 (TID 326, sparkup1, partition 478,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 473.0 in
stage 0.0 (TID 324) in 290 ms on sparkup1 (323/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 480.0 in
stage 0.0 (TID 327, sparkup1, partition 480,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 475.0 in
stage 0.0 (TID 325) in 267 ms on sparkup1 (324/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 477.0 in
stage 0.0 (TID 322) in 404 ms on sparkup2 (325/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 481.0 in
stage 0.0 (TID 328, sparkup2, partition 481,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 479.0 in
stage 0.0 (TID 323) in 386 ms on sparkup2 (326/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 482.0 in
stage 0.0 (TID 329, sparkup2, partition 482,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 483.0 in
stage 0.0 (TID 330, sparkup1, partition 483,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 478.0 in
stage 0.0 (TID 326) in 269 ms on sparkup1 (327/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 484.0 in
stage 0.0 (TID 331, sparkup1, partition 484,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 480.0 in
stage 0.0 (TID 327) in 335 ms on sparkup1 (328/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 489.0 in
stage 0.0 (TID 332, sparkup2, partition 489,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 490.0 in
stage 0.0 (TID 333, sparkup2, partition 490,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 482.0 in
stage 0.0 (TID 329) in 380 ms on sparkup2 (329/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 481.0 in
stage 0.0 (TID 328) in 394 ms on sparkup2 (330/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 488.0 in
stage 0.0 (TID 334, sparkup1, partition 488,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 483.0 in
stage 0.0 (TID 330) in 243 ms on sparkup1 (331/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 491.0 in
stage 0.0 (TID 335, sparkup1, partition 491,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 484.0 in
stage 0.0 (TID 331) in 283 ms on sparkup1 (332/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 496.0 in
stage 0.0 (TID 336, sparkup1, partition 496,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 488.0 in
stage 0.0 (TID 334) in 237 ms on sparkup1 (333/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 493.0 in
stage 0.0 (TID 337, sparkup2, partition 493,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 489.0 in
stage 0.0 (TID 332) in 379 ms on sparkup2 (334/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 494.0 in
stage 0.0 (TID 338, sparkup2, partition 494,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 490.0 in
stage 0.0 (TID 333) in 403 ms on sparkup2 (335/1024)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Starting task 498.0 in
stage 0.0 (TID 339, sparkup1, partition 498,NODE_LOCAL, 1967 bytes)
16/08/22 06:07:59 INFO scheduler.TaskSetManager: Finished task 491.0 in
stage 0.0 (TID 335) in 284 ms on sparkup1 (336/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 502.0 in
stage 0.0 (TID 340, sparkup1, partition 502,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 496.0 in
stage 0.0 (TID 336) in 263 ms on sparkup1 (337/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 497.0 in
stage 0.0 (TID 341, sparkup2, partition 497,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 493.0 in
stage 0.0 (TID 337) in 377 ms on sparkup2 (338/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 501.0 in
stage 0.0 (TID 342, sparkup2, partition 501,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 494.0 in
stage 0.0 (TID 338) in 373 ms on sparkup2 (339/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 503.0 in
stage 0.0 (TID 343, sparkup1, partition 503,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 498.0 in
stage 0.0 (TID 339) in 303 ms on sparkup1 (340/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 505.0 in
stage 0.0 (TID 344, sparkup1, partition 505,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 502.0 in
stage 0.0 (TID 340) in 277 ms on sparkup1 (341/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 509.0 in
stage 0.0 (TID 345, sparkup1, partition 509,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 503.0 in
stage 0.0 (TID 343) in 281 ms on sparkup1 (342/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 510.0 in
stage 0.0 (TID 346, sparkup1, partition 510,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 505.0 in
stage 0.0 (TID 344) in 288 ms on sparkup1 (343/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 504.0 in
stage 0.0 (TID 347, sparkup2, partition 504,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 497.0 in
stage 0.0 (TID 341) in 416 ms on sparkup2 (344/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 507.0 in
stage 0.0 (TID 348, sparkup2, partition 507,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 501.0 in
stage 0.0 (TID 342) in 402 ms on sparkup2 (345/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 513.0 in
stage 0.0 (TID 349, sparkup1, partition 513,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 509.0 in
stage 0.0 (TID 345) in 249 ms on sparkup1 (346/1024)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Starting task 516.0 in
stage 0.0 (TID 350, sparkup1, partition 516,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:00 INFO scheduler.TaskSetManager: Finished task 510.0 in
stage 0.0 (TID 346) in 314 ms on sparkup1 (347/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 508.0 in
stage 0.0 (TID 351, sparkup2, partition 508,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 507.0 in
stage 0.0 (TID 348) in 359 ms on sparkup2 (348/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 512.0 in
stage 0.0 (TID 352, sparkup2, partition 512,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 504.0 in
stage 0.0 (TID 347) in 384 ms on sparkup2 (349/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 521.0 in
stage 0.0 (TID 353, sparkup1, partition 521,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 513.0 in
stage 0.0 (TID 349) in 266 ms on sparkup1 (350/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 522.0 in
stage 0.0 (TID 354, sparkup1, partition 522,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 516.0 in
stage 0.0 (TID 350) in 303 ms on sparkup1 (351/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 525.0 in
stage 0.0 (TID 355, sparkup1, partition 525,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 521.0 in
stage 0.0 (TID 353) in 265 ms on sparkup1 (352/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 520.0 in
stage 0.0 (TID 356, sparkup2, partition 520,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 508.0 in
stage 0.0 (TID 351) in 370 ms on sparkup2 (353/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 529.0 in
stage 0.0 (TID 357, sparkup2, partition 529,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 512.0 in
stage 0.0 (TID 352) in 374 ms on sparkup2 (354/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 527.0 in
stage 0.0 (TID 358, sparkup1, partition 527,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 522.0 in
stage 0.0 (TID 354) in 296 ms on sparkup1 (355/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 532.0 in
stage 0.0 (TID 359, sparkup1, partition 532,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 525.0 in
stage 0.0 (TID 355) in 234 ms on sparkup1 (356/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 530.0 in
stage 0.0 (TID 360, sparkup2, partition 530,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 520.0 in
stage 0.0 (TID 356) in 348 ms on sparkup2 (357/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 529.0 in
stage 0.0 (TID 357) in 351 ms on sparkup2 (358/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 537.0 in
stage 0.0 (TID 361, sparkup2, partition 537,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 540.0 in
stage 0.0 (TID 362, sparkup1, partition 540,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 527.0 in
stage 0.0 (TID 358) in 299 ms on sparkup1 (359/1024)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Starting task 544.0 in
stage 0.0 (TID 363, sparkup1, partition 544,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:01 INFO scheduler.TaskSetManager: Finished task 532.0 in
stage 0.0 (TID 359) in 292 ms on sparkup1 (360/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 539.0 in
stage 0.0 (TID 364, sparkup2, partition 539,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 530.0 in
stage 0.0 (TID 360) in 335 ms on sparkup2 (361/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 545.0 in
stage 0.0 (TID 365, sparkup1, partition 545,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 540.0 in
stage 0.0 (TID 362) in 272 ms on sparkup1 (362/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 542.0 in
stage 0.0 (TID 366, sparkup2, partition 542,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 537.0 in
stage 0.0 (TID 361) in 357 ms on sparkup2 (363/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 546.0 in
stage 0.0 (TID 367, sparkup1, partition 546,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 544.0 in
stage 0.0 (TID 363) in 293 ms on sparkup1 (364/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 547.0 in
stage 0.0 (TID 368, sparkup1, partition 547,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 545.0 in
stage 0.0 (TID 365) in 292 ms on sparkup1 (365/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 543.0 in
stage 0.0 (TID 369, sparkup2, partition 543,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 539.0 in
stage 0.0 (TID 364) in 333 ms on sparkup2 (366/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 550.0 in
stage 0.0 (TID 370, sparkup1, partition 550,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 546.0 in
stage 0.0 (TID 367) in 289 ms on sparkup1 (367/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 548.0 in
stage 0.0 (TID 371, sparkup2, partition 548,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 542.0 in
stage 0.0 (TID 366) in 337 ms on sparkup2 (368/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 551.0 in
stage 0.0 (TID 372, sparkup2, partition 551,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 543.0 in
stage 0.0 (TID 369) in 336 ms on sparkup2 (369/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 552.0 in
stage 0.0 (TID 373, sparkup1, partition 552,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 550.0 in
stage 0.0 (TID 370) in 319 ms on sparkup1 (370/1024)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Starting task 553.0 in
stage 0.0 (TID 374, sparkup2, partition 553,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:02 INFO scheduler.TaskSetManager: Finished task 548.0 in
stage 0.0 (TID 371) in 339 ms on sparkup2 (371/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 554.0 in
stage 0.0 (TID 375, sparkup1, partition 554,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 552.0 in
stage 0.0 (TID 373) in 303 ms on sparkup1 (372/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 562.0 in
stage 0.0 (TID 376, sparkup2, partition 562,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 551.0 in
stage 0.0 (TID 372) in 345 ms on sparkup2 (373/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 568.0 in
stage 0.0 (TID 377, sparkup2, partition 568,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 553.0 in
stage 0.0 (TID 374) in 338 ms on sparkup2 (374/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 555.0 in
stage 0.0 (TID 378, sparkup1, partition 555,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 547.0 in
stage 0.0 (TID 368) in 992 ms on sparkup1 (375/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 556.0 in
stage 0.0 (TID 379, sparkup1, partition 556,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 554.0 in
stage 0.0 (TID 375) in 342 ms on sparkup1 (376/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 569.0 in
stage 0.0 (TID 380, sparkup2, partition 569,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 562.0 in
stage 0.0 (TID 376) in 351 ms on sparkup2 (377/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 572.0 in
stage 0.0 (TID 381, sparkup2, partition 572,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 568.0 in
stage 0.0 (TID 377) in 338 ms on sparkup2 (378/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 557.0 in
stage 0.0 (TID 382, sparkup1, partition 557,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 555.0 in
stage 0.0 (TID 378) in 303 ms on sparkup1 (379/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 561.0 in
stage 0.0 (TID 383, sparkup1, partition 561,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 556.0 in
stage 0.0 (TID 379) in 351 ms on sparkup1 (380/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 573.0 in
stage 0.0 (TID 384, sparkup2, partition 573,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 569.0 in
stage 0.0 (TID 380) in 333 ms on sparkup2 (381/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 574.0 in
stage 0.0 (TID 385, sparkup2, partition 574,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 572.0 in
stage 0.0 (TID 381) in 328 ms on sparkup2 (382/1024)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Starting task 564.0 in
stage 0.0 (TID 386, sparkup1, partition 564,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:03 INFO scheduler.TaskSetManager: Finished task 557.0 in
stage 0.0 (TID 382) in 309 ms on sparkup1 (383/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 567.0 in
stage 0.0 (TID 387, sparkup1, partition 567,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 561.0 in
stage 0.0 (TID 383) in 329 ms on sparkup1 (384/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 581.0 in
stage 0.0 (TID 388, sparkup2, partition 581,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 573.0 in
stage 0.0 (TID 384) in 343 ms on sparkup2 (385/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 584.0 in
stage 0.0 (TID 389, sparkup2, partition 584,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 574.0 in
stage 0.0 (TID 385) in 328 ms on sparkup2 (386/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 570.0 in
stage 0.0 (TID 390, sparkup1, partition 570,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 564.0 in
stage 0.0 (TID 386) in 277 ms on sparkup1 (387/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 577.0 in
stage 0.0 (TID 391, sparkup1, partition 577,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 567.0 in
stage 0.0 (TID 387) in 319 ms on sparkup1 (388/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 587.0 in
stage 0.0 (TID 392, sparkup2, partition 587,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 581.0 in
stage 0.0 (TID 388) in 327 ms on sparkup2 (389/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 596.0 in
stage 0.0 (TID 393, sparkup2, partition 596,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 584.0 in
stage 0.0 (TID 389) in 320 ms on sparkup2 (390/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 578.0 in
stage 0.0 (TID 394, sparkup1, partition 578,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 570.0 in
stage 0.0 (TID 390) in 280 ms on sparkup1 (391/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 579.0 in
stage 0.0 (TID 395, sparkup1, partition 579,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 577.0 in
stage 0.0 (TID 391) in 313 ms on sparkup1 (392/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 601.0 in
stage 0.0 (TID 396, sparkup2, partition 601,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 587.0 in
stage 0.0 (TID 392) in 323 ms on sparkup2 (393/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 602.0 in
stage 0.0 (TID 397, sparkup2, partition 602,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 596.0 in
stage 0.0 (TID 393) in 328 ms on sparkup2 (394/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 580.0 in
stage 0.0 (TID 398, sparkup1, partition 580,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Finished task 578.0 in
stage 0.0 (TID 394) in 284 ms on sparkup1 (395/1024)
16/08/22 06:08:04 INFO scheduler.TaskSetManager: Starting task 582.0 in
stage 0.0 (TID 399, sparkup1, partition 582,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 579.0 in
stage 0.0 (TID 395) in 309 ms on sparkup1 (396/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 604.0 in
stage 0.0 (TID 400, sparkup2, partition 604,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 601.0 in
stage 0.0 (TID 396) in 332 ms on sparkup2 (397/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 610.0 in
stage 0.0 (TID 401, sparkup2, partition 610,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 602.0 in
stage 0.0 (TID 397) in 337 ms on sparkup2 (398/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 590.0 in
stage 0.0 (TID 402, sparkup1, partition 590,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 582.0 in
stage 0.0 (TID 399) in 291 ms on sparkup1 (399/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 617.0 in
stage 0.0 (TID 403, sparkup2, partition 617,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 604.0 in
stage 0.0 (TID 400) in 333 ms on sparkup2 (400/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 610.0 in
stage 0.0 (TID 401) in 346 ms on sparkup2 (401/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 618.0 in
stage 0.0 (TID 404, sparkup2, partition 618,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 592.0 in
stage 0.0 (TID 405, sparkup1, partition 592,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 590.0 in
stage 0.0 (TID 402) in 298 ms on sparkup1 (402/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 593.0 in
stage 0.0 (TID 406, sparkup1, partition 593,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 580.0 in
stage 0.0 (TID 398) in 883 ms on sparkup1 (403/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 620.0 in
stage 0.0 (TID 407, sparkup2, partition 620,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 617.0 in
stage 0.0 (TID 403) in 330 ms on sparkup2 (404/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 625.0 in
stage 0.0 (TID 408, sparkup2, partition 625,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 618.0 in
stage 0.0 (TID 404) in 315 ms on sparkup2 (405/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 595.0 in
stage 0.0 (TID 409, sparkup1, partition 595,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 592.0 in
stage 0.0 (TID 405) in 294 ms on sparkup1 (406/1024)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Starting task 598.0 in
stage 0.0 (TID 410, sparkup1, partition 598,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:05 INFO scheduler.TaskSetManager: Finished task 593.0 in
stage 0.0 (TID 406) in 314 ms on sparkup1 (407/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 644.0 in
stage 0.0 (TID 411, sparkup2, partition 644,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 620.0 in
stage 0.0 (TID 407) in 324 ms on sparkup2 (408/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 646.0 in
stage 0.0 (TID 412, sparkup2, partition 646,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 625.0 in
stage 0.0 (TID 408) in 310 ms on sparkup2 (409/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 599.0 in
stage 0.0 (TID 413, sparkup1, partition 599,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 595.0 in
stage 0.0 (TID 409) in 293 ms on sparkup1 (410/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 600.0 in
stage 0.0 (TID 414, sparkup1, partition 600,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 598.0 in
stage 0.0 (TID 410) in 291 ms on sparkup1 (411/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 653.0 in
stage 0.0 (TID 415, sparkup2, partition 653,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 644.0 in
stage 0.0 (TID 411) in 312 ms on sparkup2 (412/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 654.0 in
stage 0.0 (TID 416, sparkup2, partition 654,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 646.0 in
stage 0.0 (TID 412) in 319 ms on sparkup2 (413/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 605.0 in
stage 0.0 (TID 417, sparkup1, partition 605,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 599.0 in
stage 0.0 (TID 413) in 298 ms on sparkup1 (414/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 606.0 in
stage 0.0 (TID 418, sparkup1, partition 606,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 600.0 in
stage 0.0 (TID 414) in 299 ms on sparkup1 (415/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 657.0 in
stage 0.0 (TID 419, sparkup2, partition 657,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 653.0 in
stage 0.0 (TID 415) in 364 ms on sparkup2 (416/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 609.0 in
stage 0.0 (TID 420, sparkup1, partition 609,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 605.0 in
stage 0.0 (TID 417) in 302 ms on sparkup1 (417/1024)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Starting task 611.0 in
stage 0.0 (TID 421, sparkup1, partition 611,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:06 INFO scheduler.TaskSetManager: Finished task 606.0 in
stage 0.0 (TID 418) in 317 ms on sparkup1 (418/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 659.0 in
stage 0.0 (TID 422, sparkup2, partition 659,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 657.0 in
stage 0.0 (TID 419) in 346 ms on sparkup2 (419/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 613.0 in
stage 0.0 (TID 423, sparkup1, partition 613,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 609.0 in
stage 0.0 (TID 420) in 317 ms on sparkup1 (420/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 614.0 in
stage 0.0 (TID 424, sparkup1, partition 614,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 611.0 in
stage 0.0 (TID 421) in 303 ms on sparkup1 (421/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 660.0 in
stage 0.0 (TID 425, sparkup2, partition 660,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 654.0 in
stage 0.0 (TID 416) in 942 ms on sparkup2 (422/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 622.0 in
stage 0.0 (TID 426, sparkup1, partition 622,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 613.0 in
stage 0.0 (TID 423) in 294 ms on sparkup1 (423/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 630.0 in
stage 0.0 (TID 427, sparkup1, partition 630,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 614.0 in
stage 0.0 (TID 424) in 305 ms on sparkup1 (424/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 661.0 in
stage 0.0 (TID 428, sparkup2, partition 661,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 660.0 in
stage 0.0 (TID 425) in 338 ms on sparkup2 (425/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 632.0 in
stage 0.0 (TID 429, sparkup1, partition 632,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 622.0 in
stage 0.0 (TID 426) in 303 ms on sparkup1 (426/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 637.0 in
stage 0.0 (TID 430, sparkup1, partition 637,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 630.0 in
stage 0.0 (TID 427) in 309 ms on sparkup1 (427/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 638.0 in
stage 0.0 (TID 431, sparkup1, partition 638,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 632.0 in
stage 0.0 (TID 429) in 301 ms on sparkup1 (428/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Finished task 661.0 in
stage 0.0 (TID 428) in 330 ms on sparkup2 (429/1024)
16/08/22 06:08:07 INFO scheduler.TaskSetManager: Starting task 662.0 in
stage 0.0 (TID 432, sparkup2, partition 662,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 659.0 in
stage 0.0 (TID 422) in 946 ms on sparkup2 (430/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 663.0 in
stage 0.0 (TID 433, sparkup2, partition 663,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 639.0 in
stage 0.0 (TID 434, sparkup1, partition 639,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 637.0 in
stage 0.0 (TID 430) in 297 ms on sparkup1 (431/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 640.0 in
stage 0.0 (TID 435, sparkup1, partition 640,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 638.0 in
stage 0.0 (TID 431) in 319 ms on sparkup1 (432/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 665.0 in
stage 0.0 (TID 436, sparkup2, partition 665,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 663.0 in
stage 0.0 (TID 433) in 318 ms on sparkup2 (433/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 667.0 in
stage 0.0 (TID 437, sparkup2, partition 667,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 662.0 in
stage 0.0 (TID 432) in 354 ms on sparkup2 (434/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 643.0 in
stage 0.0 (TID 438, sparkup1, partition 643,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 639.0 in
stage 0.0 (TID 434) in 303 ms on sparkup1 (435/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 645.0 in
stage 0.0 (TID 439, sparkup1, partition 645,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 640.0 in
stage 0.0 (TID 435) in 358 ms on sparkup1 (436/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 675.0 in
stage 0.0 (TID 440, sparkup2, partition 675,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 665.0 in
stage 0.0 (TID 436) in 348 ms on sparkup2 (437/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 680.0 in
stage 0.0 (TID 441, sparkup2, partition 680,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 667.0 in
stage 0.0 (TID 437) in 341 ms on sparkup2 (438/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 647.0 in
stage 0.0 (TID 442, sparkup1, partition 647,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 643.0 in
stage 0.0 (TID 438) in 312 ms on sparkup1 (439/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 652.0 in
stage 0.0 (TID 443, sparkup1, partition 652,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Finished task 645.0 in
stage 0.0 (TID 439) in 327 ms on sparkup1 (440/1024)
16/08/22 06:08:08 INFO scheduler.TaskSetManager: Starting task 681.0 in
stage 0.0 (TID 444, sparkup2, partition 681,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 675.0 in
stage 0.0 (TID 440) in 336 ms on sparkup2 (441/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 683.0 in
stage 0.0 (TID 445, sparkup2, partition 683,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 680.0 in
stage 0.0 (TID 441) in 328 ms on sparkup2 (442/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 655.0 in
stage 0.0 (TID 446, sparkup1, partition 655,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 647.0 in
stage 0.0 (TID 442) in 321 ms on sparkup1 (443/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 656.0 in
stage 0.0 (TID 447, sparkup1, partition 656,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 652.0 in
stage 0.0 (TID 443) in 318 ms on sparkup1 (444/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 688.0 in
stage 0.0 (TID 448, sparkup2, partition 688,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 681.0 in
stage 0.0 (TID 444) in 323 ms on sparkup2 (445/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 669.0 in
stage 0.0 (TID 449, sparkup1, partition 669,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 655.0 in
stage 0.0 (TID 446) in 306 ms on sparkup1 (446/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 691.0 in
stage 0.0 (TID 450, sparkup2, partition 691,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 683.0 in
stage 0.0 (TID 445) in 332 ms on sparkup2 (447/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 670.0 in
stage 0.0 (TID 451, sparkup1, partition 670,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 656.0 in
stage 0.0 (TID 447) in 301 ms on sparkup1 (448/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 695.0 in
stage 0.0 (TID 452, sparkup2, partition 695,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 688.0 in
stage 0.0 (TID 448) in 325 ms on sparkup2 (449/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 671.0 in
stage 0.0 (TID 453, sparkup1, partition 671,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 669.0 in
stage 0.0 (TID 449) in 316 ms on sparkup1 (450/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 698.0 in
stage 0.0 (TID 454, sparkup2, partition 698,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 691.0 in
stage 0.0 (TID 450) in 339 ms on sparkup2 (451/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 672.0 in
stage 0.0 (TID 455, sparkup1, partition 672,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 670.0 in
stage 0.0 (TID 451) in 315 ms on sparkup1 (452/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 674.0 in
stage 0.0 (TID 456, sparkup1, partition 674,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 671.0 in
stage 0.0 (TID 453) in 321 ms on sparkup1 (453/1024)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Starting task 704.0 in
stage 0.0 (TID 457, sparkup2, partition 704,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:09 INFO scheduler.TaskSetManager: Finished task 698.0 in
stage 0.0 (TID 454) in 313 ms on sparkup2 (454/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 677.0 in
stage 0.0 (TID 458, sparkup1, partition 677,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 672.0 in
stage 0.0 (TID 455) in 313 ms on sparkup1 (455/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 679.0 in
stage 0.0 (TID 459, sparkup1, partition 679,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 674.0 in
stage 0.0 (TID 456) in 305 ms on sparkup1 (456/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 710.0 in
stage 0.0 (TID 460, sparkup2, partition 710,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 704.0 in
stage 0.0 (TID 457) in 320 ms on sparkup2 (457/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 714.0 in
stage 0.0 (TID 461, sparkup2, partition 714,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 695.0 in
stage 0.0 (TID 452) in 747 ms on sparkup2 (458/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 682.0 in
stage 0.0 (TID 462, sparkup1, partition 682,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 677.0 in
stage 0.0 (TID 458) in 318 ms on sparkup1 (459/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 687.0 in
stage 0.0 (TID 463, sparkup1, partition 687,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 679.0 in
stage 0.0 (TID 459) in 305 ms on sparkup1 (460/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 715.0 in
stage 0.0 (TID 464, sparkup2, partition 715,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 710.0 in
stage 0.0 (TID 460) in 308 ms on sparkup2 (461/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 689.0 in
stage 0.0 (TID 465, sparkup1, partition 689,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 682.0 in
stage 0.0 (TID 462) in 318 ms on sparkup1 (462/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 690.0 in
stage 0.0 (TID 466, sparkup1, partition 690,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 687.0 in
stage 0.0 (TID 463) in 311 ms on sparkup1 (463/1024)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Starting task 718.0 in
stage 0.0 (TID 467, sparkup2, partition 718,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:10 INFO scheduler.TaskSetManager: Finished task 715.0 in
stage 0.0 (TID 464) in 309 ms on sparkup2 (464/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 720.0 in
stage 0.0 (TID 468, sparkup2, partition 720,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 714.0 in
stage 0.0 (TID 461) in 697 ms on sparkup2 (465/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 692.0 in
stage 0.0 (TID 469, sparkup1, partition 692,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 689.0 in
stage 0.0 (TID 465) in 304 ms on sparkup1 (466/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 693.0 in
stage 0.0 (TID 470, sparkup1, partition 693,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 690.0 in
stage 0.0 (TID 466) in 300 ms on sparkup1 (467/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 721.0 in
stage 0.0 (TID 471, sparkup2, partition 721,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 718.0 in
stage 0.0 (TID 467) in 317 ms on sparkup2 (468/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 725.0 in
stage 0.0 (TID 472, sparkup2, partition 725,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 720.0 in
stage 0.0 (TID 468) in 310 ms on sparkup2 (469/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 694.0 in
stage 0.0 (TID 473, sparkup1, partition 694,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 693.0 in
stage 0.0 (TID 470) in 299 ms on sparkup1 (470/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 727.0 in
stage 0.0 (TID 474, sparkup2, partition 727,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 721.0 in
stage 0.0 (TID 471) in 307 ms on sparkup2 (471/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 696.0 in
stage 0.0 (TID 475, sparkup1, partition 696,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 692.0 in
stage 0.0 (TID 469) in 450 ms on sparkup1 (472/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 730.0 in
stage 0.0 (TID 476, sparkup2, partition 730,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 725.0 in
stage 0.0 (TID 472) in 322 ms on sparkup2 (473/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 703.0 in
stage 0.0 (TID 477, sparkup1, partition 703,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 694.0 in
stage 0.0 (TID 473) in 310 ms on sparkup1 (474/1024)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Starting task 733.0 in
stage 0.0 (TID 478, sparkup2, partition 733,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:11 INFO scheduler.TaskSetManager: Finished task 727.0 in
stage 0.0 (TID 474) in 304 ms on sparkup2 (475/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 734.0 in
stage 0.0 (TID 479, sparkup2, partition 734,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 730.0 in
stage 0.0 (TID 476) in 314 ms on sparkup2 (476/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 706.0 in
stage 0.0 (TID 480, sparkup1, partition 706,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 703.0 in
stage 0.0 (TID 477) in 307 ms on sparkup1 (477/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 707.0 in
stage 0.0 (TID 481, sparkup1, partition 707,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 696.0 in
stage 0.0 (TID 475) in 534 ms on sparkup1 (478/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 737.0 in
stage 0.0 (TID 482, sparkup2, partition 737,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 733.0 in
stage 0.0 (TID 478) in 298 ms on sparkup2 (479/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 740.0 in
stage 0.0 (TID 483, sparkup2, partition 740,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 734.0 in
stage 0.0 (TID 479) in 320 ms on sparkup2 (480/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 708.0 in
stage 0.0 (TID 484, sparkup1, partition 708,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 706.0 in
stage 0.0 (TID 480) in 319 ms on sparkup1 (481/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 716.0 in
stage 0.0 (TID 485, sparkup1, partition 716,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 707.0 in
stage 0.0 (TID 481) in 320 ms on sparkup1 (482/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 741.0 in
stage 0.0 (TID 486, sparkup2, partition 741,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 737.0 in
stage 0.0 (TID 482) in 313 ms on sparkup2 (483/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 745.0 in
stage 0.0 (TID 487, sparkup2, partition 745,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 740.0 in
stage 0.0 (TID 483) in 314 ms on sparkup2 (484/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 717.0 in
stage 0.0 (TID 488, sparkup1, partition 717,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 708.0 in
stage 0.0 (TID 484) in 298 ms on sparkup1 (485/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 719.0 in
stage 0.0 (TID 489, sparkup1, partition 719,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 716.0 in
stage 0.0 (TID 485) in 320 ms on sparkup1 (486/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 750.0 in
stage 0.0 (TID 490, sparkup2, partition 750,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 741.0 in
stage 0.0 (TID 486) in 334 ms on sparkup2 (487/1024)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Starting task 752.0 in
stage 0.0 (TID 491, sparkup2, partition 752,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:12 INFO scheduler.TaskSetManager: Finished task 745.0 in
stage 0.0 (TID 487) in 294 ms on sparkup2 (488/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 722.0 in
stage 0.0 (TID 492, sparkup1, partition 722,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 717.0 in
stage 0.0 (TID 488) in 303 ms on sparkup1 (489/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 758.0 in
stage 0.0 (TID 493, sparkup2, partition 758,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 750.0 in
stage 0.0 (TID 490) in 301 ms on sparkup2 (490/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 729.0 in
stage 0.0 (TID 494, sparkup1, partition 729,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 719.0 in
stage 0.0 (TID 489) in 350 ms on sparkup1 (491/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 759.0 in
stage 0.0 (TID 495, sparkup2, partition 759,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 752.0 in
stage 0.0 (TID 491) in 290 ms on sparkup2 (492/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 732.0 in
stage 0.0 (TID 496, sparkup1, partition 732,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 722.0 in
stage 0.0 (TID 492) in 313 ms on sparkup1 (493/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 763.0 in
stage 0.0 (TID 497, sparkup2, partition 763,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 758.0 in
stage 0.0 (TID 493) in 296 ms on sparkup2 (494/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 736.0 in
stage 0.0 (TID 498, sparkup1, partition 736,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 729.0 in
stage 0.0 (TID 494) in 314 ms on sparkup1 (495/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 764.0 in
stage 0.0 (TID 499, sparkup2, partition 764,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 759.0 in
stage 0.0 (TID 495) in 290 ms on sparkup2 (496/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 738.0 in
stage 0.0 (TID 500, sparkup1, partition 738,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 732.0 in
stage 0.0 (TID 496) in 293 ms on sparkup1 (497/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 769.0 in
stage 0.0 (TID 501, sparkup2, partition 769,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 763.0 in
stage 0.0 (TID 497) in 297 ms on sparkup2 (498/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 739.0 in
stage 0.0 (TID 502, sparkup1, partition 739,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 736.0 in
stage 0.0 (TID 498) in 292 ms on sparkup1 (499/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 772.0 in
stage 0.0 (TID 503, sparkup2, partition 772,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 764.0 in
stage 0.0 (TID 499) in 286 ms on sparkup2 (500/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 743.0 in
stage 0.0 (TID 504, sparkup1, partition 743,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 738.0 in
stage 0.0 (TID 500) in 303 ms on sparkup1 (501/1024)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Starting task 774.0 in
stage 0.0 (TID 505, sparkup2, partition 774,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:13 INFO scheduler.TaskSetManager: Finished task 769.0 in
stage 0.0 (TID 501) in 315 ms on sparkup2 (502/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 744.0 in
stage 0.0 (TID 506, sparkup1, partition 744,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 739.0 in
stage 0.0 (TID 502) in 284 ms on sparkup1 (503/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 776.0 in
stage 0.0 (TID 507, sparkup2, partition 776,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 772.0 in
stage 0.0 (TID 503) in 284 ms on sparkup2 (504/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 746.0 in
stage 0.0 (TID 508, sparkup1, partition 746,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 743.0 in
stage 0.0 (TID 504) in 290 ms on sparkup1 (505/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 777.0 in
stage 0.0 (TID 509, sparkup2, partition 777,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 774.0 in
stage 0.0 (TID 505) in 291 ms on sparkup2 (506/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 749.0 in
stage 0.0 (TID 510, sparkup1, partition 749,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 744.0 in
stage 0.0 (TID 506) in 292 ms on sparkup1 (507/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 782.0 in
stage 0.0 (TID 511, sparkup2, partition 782,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 776.0 in
stage 0.0 (TID 507) in 313 ms on sparkup2 (508/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 751.0 in
stage 0.0 (TID 512, sparkup1, partition 751,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 746.0 in
stage 0.0 (TID 508) in 303 ms on sparkup1 (509/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 785.0 in
stage 0.0 (TID 513, sparkup2, partition 785,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 777.0 in
stage 0.0 (TID 509) in 288 ms on sparkup2 (510/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 753.0 in
stage 0.0 (TID 514, sparkup1, partition 753,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 749.0 in
stage 0.0 (TID 510) in 291 ms on sparkup1 (511/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 789.0 in
stage 0.0 (TID 515, sparkup2, partition 789,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 782.0 in
stage 0.0 (TID 511) in 279 ms on sparkup2 (512/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 754.0 in
stage 0.0 (TID 516, sparkup1, partition 754,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 751.0 in
stage 0.0 (TID 512) in 317 ms on sparkup1 (513/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 798.0 in
stage 0.0 (TID 517, sparkup2, partition 798,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 785.0 in
stage 0.0 (TID 513) in 305 ms on sparkup2 (514/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 756.0 in
stage 0.0 (TID 518, sparkup1, partition 756,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 753.0 in
stage 0.0 (TID 514) in 308 ms on sparkup1 (515/1024)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Starting task 799.0 in
stage 0.0 (TID 519, sparkup2, partition 799,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:14 INFO scheduler.TaskSetManager: Finished task 789.0 in
stage 0.0 (TID 515) in 288 ms on sparkup2 (516/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 757.0 in
stage 0.0 (TID 520, sparkup1, partition 757,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 754.0 in
stage 0.0 (TID 516) in 316 ms on sparkup1 (517/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 761.0 in
stage 0.0 (TID 521, sparkup1, partition 761,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 756.0 in
stage 0.0 (TID 518) in 293 ms on sparkup1 (518/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 803.0 in
stage 0.0 (TID 522, sparkup2, partition 803,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 799.0 in
stage 0.0 (TID 519) in 287 ms on sparkup2 (519/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 766.0 in
stage 0.0 (TID 523, sparkup1, partition 766,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 757.0 in
stage 0.0 (TID 520) in 300 ms on sparkup1 (520/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 767.0 in
stage 0.0 (TID 524, sparkup1, partition 767,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 761.0 in
stage 0.0 (TID 521) in 300 ms on sparkup1 (521/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 810.0 in
stage 0.0 (TID 525, sparkup2, partition 810,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 803.0 in
stage 0.0 (TID 522) in 290 ms on sparkup2 (522/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 822.0 in
stage 0.0 (TID 526, sparkup2, partition 822,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 798.0 in
stage 0.0 (TID 517) in 696 ms on sparkup2 (523/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 771.0 in
stage 0.0 (TID 527, sparkup1, partition 771,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 766.0 in
stage 0.0 (TID 523) in 331 ms on sparkup1 (524/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 781.0 in
stage 0.0 (TID 528, sparkup1, partition 781,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 767.0 in
stage 0.0 (TID 524) in 323 ms on sparkup1 (525/1024)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Starting task 823.0 in
stage 0.0 (TID 529, sparkup2, partition 823,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:15 INFO scheduler.TaskSetManager: Finished task 822.0 in
stage 0.0 (TID 526) in 297 ms on sparkup2 (526/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 825.0 in
stage 0.0 (TID 530, sparkup2, partition 825,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 810.0 in
stage 0.0 (TID 525) in 534 ms on sparkup2 (527/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 783.0 in
stage 0.0 (TID 531, sparkup1, partition 783,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 771.0 in
stage 0.0 (TID 527) in 347 ms on sparkup1 (528/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 784.0 in
stage 0.0 (TID 532, sparkup1, partition 784,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 781.0 in
stage 0.0 (TID 528) in 326 ms on sparkup1 (529/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 827.0 in
stage 0.0 (TID 533, sparkup2, partition 827,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 823.0 in
stage 0.0 (TID 529) in 292 ms on sparkup2 (530/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 828.0 in
stage 0.0 (TID 534, sparkup2, partition 828,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 825.0 in
stage 0.0 (TID 530) in 308 ms on sparkup2 (531/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 829.0 in
stage 0.0 (TID 535, sparkup2, partition 829,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 827.0 in
stage 0.0 (TID 533) in 290 ms on sparkup2 (532/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 787.0 in
stage 0.0 (TID 536, sparkup1, partition 787,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 788.0 in
stage 0.0 (TID 537, sparkup1, partition 788,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 831.0 in
stage 0.0 (TID 538, sparkup2, partition 831,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 783.0 in
stage 0.0 (TID 531) in 576 ms on sparkup1 (533/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 828.0 in
stage 0.0 (TID 534) in 306 ms on sparkup2 (534/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 784.0 in
stage 0.0 (TID 532) in 550 ms on sparkup1 (535/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 835.0 in
stage 0.0 (TID 539, sparkup2, partition 835,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 829.0 in
stage 0.0 (TID 535) in 287 ms on sparkup2 (536/1024)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Starting task 836.0 in
stage 0.0 (TID 540, sparkup2, partition 836,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:16 INFO scheduler.TaskSetManager: Finished task 831.0 in
stage 0.0 (TID 538) in 323 ms on sparkup2 (537/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 790.0 in
stage 0.0 (TID 541, sparkup1, partition 790,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 787.0 in
stage 0.0 (TID 536) in 557 ms on sparkup1 (538/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 837.0 in
stage 0.0 (TID 542, sparkup2, partition 837,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 835.0 in
stage 0.0 (TID 539) in 301 ms on sparkup2 (539/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 791.0 in
stage 0.0 (TID 543, sparkup1, partition 791,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 788.0 in
stage 0.0 (TID 537) in 378 ms on sparkup1 (540/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 838.0 in
stage 0.0 (TID 544, sparkup2, partition 838,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 836.0 in
stage 0.0 (TID 540) in 312 ms on sparkup2 (541/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 843.0 in
stage 0.0 (TID 545, sparkup2, partition 843,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 837.0 in
stage 0.0 (TID 542) in 310 ms on sparkup2 (542/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 792.0 in
stage 0.0 (TID 546, sparkup1, partition 792,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 790.0 in
stage 0.0 (TID 541) in 335 ms on sparkup1 (543/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 795.0 in
stage 0.0 (TID 547, sparkup1, partition 795,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 791.0 in
stage 0.0 (TID 543) in 327 ms on sparkup1 (544/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 845.0 in
stage 0.0 (TID 548, sparkup2, partition 845,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 838.0 in
stage 0.0 (TID 544) in 309 ms on sparkup2 (545/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 849.0 in
stage 0.0 (TID 549, sparkup2, partition 849,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 843.0 in
stage 0.0 (TID 545) in 310 ms on sparkup2 (546/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 796.0 in
stage 0.0 (TID 550, sparkup1, partition 796,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 795.0 in
stage 0.0 (TID 547) in 299 ms on sparkup1 (547/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 797.0 in
stage 0.0 (TID 551, sparkup1, partition 797,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 792.0 in
stage 0.0 (TID 546) in 332 ms on sparkup1 (548/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 850.0 in
stage 0.0 (TID 552, sparkup2, partition 850,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 845.0 in
stage 0.0 (TID 548) in 322 ms on sparkup2 (549/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 852.0 in
stage 0.0 (TID 553, sparkup2, partition 852,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 849.0 in
stage 0.0 (TID 549) in 316 ms on sparkup2 (550/1024)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Starting task 800.0 in
stage 0.0 (TID 554, sparkup1, partition 800,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:17 INFO scheduler.TaskSetManager: Finished task 796.0 in
stage 0.0 (TID 550) in 330 ms on sparkup1 (551/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 801.0 in
stage 0.0 (TID 555, sparkup1, partition 801,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 797.0 in
stage 0.0 (TID 551) in 333 ms on sparkup1 (552/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 854.0 in
stage 0.0 (TID 556, sparkup2, partition 854,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 850.0 in
stage 0.0 (TID 552) in 316 ms on sparkup2 (553/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 856.0 in
stage 0.0 (TID 557, sparkup2, partition 856,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 852.0 in
stage 0.0 (TID 553) in 318 ms on sparkup2 (554/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 804.0 in
stage 0.0 (TID 558, sparkup1, partition 804,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 801.0 in
stage 0.0 (TID 555) in 314 ms on sparkup1 (555/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 805.0 in
stage 0.0 (TID 559, sparkup1, partition 805,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 800.0 in
stage 0.0 (TID 554) in 342 ms on sparkup1 (556/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 867.0 in
stage 0.0 (TID 560, sparkup2, partition 867,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 854.0 in
stage 0.0 (TID 556) in 338 ms on sparkup2 (557/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 856.0 in
stage 0.0 (TID 557) in 307 ms on sparkup2 (558/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 871.0 in
stage 0.0 (TID 561, sparkup2, partition 871,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 806.0 in
stage 0.0 (TID 562, sparkup1, partition 806,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 804.0 in
stage 0.0 (TID 558) in 311 ms on sparkup1 (559/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 807.0 in
stage 0.0 (TID 563, sparkup1, partition 807,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 805.0 in
stage 0.0 (TID 559) in 318 ms on sparkup1 (560/1024)
16/08/22 06:08:18 INFO internal.IgniteKernal:
Metrics for local node (to disable set 'metricsLogFrequency' to 0)
^-- Node [id=fd2cebfd, name=null, uptime=00:01:00:009]
^-- H/N/C [hosts=3, nodes=5, CPUs=3]
^-- CPU [cur=16%, avg=11.89%, GC=6.8%]
^-- Heap [used=125MB, free=93.66%, comm=1979MB]
^-- Non heap [used=76MB, free=74.79%, comm=77MB]
^-- Public thread pool [active=0, idle=6, qSize=0]
^-- System thread pool [active=0, idle=16, qSize=0]
^-- Outbound messages queue [size=0]
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 878.0 in
stage 0.0 (TID 564, sparkup2, partition 878,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 867.0 in
stage 0.0 (TID 560) in 311 ms on sparkup2 (561/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 879.0 in
stage 0.0 (TID 565, sparkup2, partition 879,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 871.0 in
stage 0.0 (TID 561) in 304 ms on sparkup2 (562/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 808.0 in
stage 0.0 (TID 566, sparkup1, partition 808,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 806.0 in
stage 0.0 (TID 562) in 316 ms on sparkup1 (563/1024)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Starting task 811.0 in
stage 0.0 (TID 567, sparkup1, partition 811,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:18 INFO scheduler.TaskSetManager: Finished task 807.0 in
stage 0.0 (TID 563) in 321 ms on sparkup1 (564/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 881.0 in
stage 0.0 (TID 568, sparkup2, partition 881,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 879.0 in
stage 0.0 (TID 565) in 299 ms on sparkup2 (565/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 883.0 in
stage 0.0 (TID 569, sparkup2, partition 883,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 878.0 in
stage 0.0 (TID 564) in 330 ms on sparkup2 (566/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 816.0 in
stage 0.0 (TID 570, sparkup1, partition 816,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 808.0 in
stage 0.0 (TID 566) in 351 ms on sparkup1 (567/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 818.0 in
stage 0.0 (TID 571, sparkup1, partition 818,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 811.0 in
stage 0.0 (TID 567) in 341 ms on sparkup1 (568/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 887.0 in
stage 0.0 (TID 572, sparkup2, partition 887,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 881.0 in
stage 0.0 (TID 568) in 295 ms on sparkup2 (569/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 889.0 in
stage 0.0 (TID 573, sparkup2, partition 889,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 883.0 in
stage 0.0 (TID 569) in 296 ms on sparkup2 (570/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 832.0 in
stage 0.0 (TID 574, sparkup1, partition 832,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 818.0 in
stage 0.0 (TID 571) in 333 ms on sparkup1 (571/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 833.0 in
stage 0.0 (TID 575, sparkup1, partition 833,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 816.0 in
stage 0.0 (TID 570) in 357 ms on sparkup1 (572/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 890.0 in
stage 0.0 (TID 576, sparkup2, partition 890,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 887.0 in
stage 0.0 (TID 572) in 286 ms on sparkup2 (573/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 894.0 in
stage 0.0 (TID 577, sparkup2, partition 894,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 889.0 in
stage 0.0 (TID 573) in 295 ms on sparkup2 (574/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 840.0 in
stage 0.0 (TID 578, sparkup1, partition 840,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 832.0 in
stage 0.0 (TID 574) in 313 ms on sparkup1 (575/1024)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Starting task 841.0 in
stage 0.0 (TID 579, sparkup1, partition 841,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:19 INFO scheduler.TaskSetManager: Finished task 833.0 in
stage 0.0 (TID 575) in 312 ms on sparkup1 (576/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 895.0 in
stage 0.0 (TID 580, sparkup2, partition 895,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 890.0 in
stage 0.0 (TID 576) in 283 ms on sparkup2 (577/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 898.0 in
stage 0.0 (TID 581, sparkup2, partition 898,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 894.0 in
stage 0.0 (TID 577) in 280 ms on sparkup2 (578/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 842.0 in
stage 0.0 (TID 582, sparkup1, partition 842,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 840.0 in
stage 0.0 (TID 578) in 315 ms on sparkup1 (579/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 846.0 in
stage 0.0 (TID 583, sparkup1, partition 846,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 841.0 in
stage 0.0 (TID 579) in 324 ms on sparkup1 (580/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 902.0 in
stage 0.0 (TID 584, sparkup2, partition 902,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 895.0 in
stage 0.0 (TID 580) in 288 ms on sparkup2 (581/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 905.0 in
stage 0.0 (TID 585, sparkup2, partition 905,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 898.0 in
stage 0.0 (TID 581) in 285 ms on sparkup2 (582/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 847.0 in
stage 0.0 (TID 586, sparkup1, partition 847,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 846.0 in
stage 0.0 (TID 583) in 308 ms on sparkup1 (583/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 851.0 in
stage 0.0 (TID 587, sparkup1, partition 851,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 842.0 in
stage 0.0 (TID 582) in 337 ms on sparkup1 (584/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 907.0 in
stage 0.0 (TID 588, sparkup2, partition 907,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 902.0 in
stage 0.0 (TID 584) in 298 ms on sparkup2 (585/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 919.0 in
stage 0.0 (TID 589, sparkup2, partition 919,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 905.0 in
stage 0.0 (TID 585) in 293 ms on sparkup2 (586/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 925.0 in
stage 0.0 (TID 590, sparkup2, partition 925,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 907.0 in
stage 0.0 (TID 588) in 297 ms on sparkup2 (587/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 926.0 in
stage 0.0 (TID 591, sparkup2, partition 926,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 919.0 in
stage 0.0 (TID 589) in 298 ms on sparkup2 (588/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 853.0 in
stage 0.0 (TID 592, sparkup1, partition 853,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 847.0 in
stage 0.0 (TID 586) in 364 ms on sparkup1 (589/1024)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Starting task 855.0 in
stage 0.0 (TID 593, sparkup1, partition 855,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:20 INFO scheduler.TaskSetManager: Finished task 851.0 in
stage 0.0 (TID 587) in 366 ms on sparkup1 (590/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 934.0 in
stage 0.0 (TID 594, sparkup2, partition 934,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 925.0 in
stage 0.0 (TID 590) in 301 ms on sparkup2 (591/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 938.0 in
stage 0.0 (TID 595, sparkup2, partition 938,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 926.0 in
stage 0.0 (TID 591) in 297 ms on sparkup2 (592/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 857.0 in
stage 0.0 (TID 596, sparkup1, partition 857,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 853.0 in
stage 0.0 (TID 592) in 320 ms on sparkup1 (593/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 860.0 in
stage 0.0 (TID 597, sparkup1, partition 860,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 855.0 in
stage 0.0 (TID 593) in 320 ms on sparkup1 (594/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 939.0 in
stage 0.0 (TID 598, sparkup2, partition 939,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 934.0 in
stage 0.0 (TID 594) in 307 ms on sparkup2 (595/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 942.0 in
stage 0.0 (TID 599, sparkup2, partition 942,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 938.0 in
stage 0.0 (TID 595) in 313 ms on sparkup2 (596/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 862.0 in
stage 0.0 (TID 600, sparkup1, partition 862,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 860.0 in
stage 0.0 (TID 597) in 298 ms on sparkup1 (597/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 868.0 in
stage 0.0 (TID 601, sparkup1, partition 868,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 857.0 in
stage 0.0 (TID 596) in 328 ms on sparkup1 (598/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 950.0 in
stage 0.0 (TID 602, sparkup2, partition 950,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 939.0 in
stage 0.0 (TID 598) in 316 ms on sparkup2 (599/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 951.0 in
stage 0.0 (TID 603, sparkup2, partition 951,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 942.0 in
stage 0.0 (TID 599) in 319 ms on sparkup2 (600/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 872.0 in
stage 0.0 (TID 604, sparkup1, partition 872,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 862.0 in
stage 0.0 (TID 600) in 320 ms on sparkup1 (601/1024)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Starting task 873.0 in
stage 0.0 (TID 605, sparkup1, partition 873,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:21 INFO scheduler.TaskSetManager: Finished task 868.0 in
stage 0.0 (TID 601) in 316 ms on sparkup1 (602/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 953.0 in
stage 0.0 (TID 606, sparkup2, partition 953,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 950.0 in
stage 0.0 (TID 602) in 329 ms on sparkup2 (603/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 957.0 in
stage 0.0 (TID 607, sparkup2, partition 957,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 951.0 in
stage 0.0 (TID 603) in 332 ms on sparkup2 (604/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 874.0 in
stage 0.0 (TID 608, sparkup1, partition 874,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 872.0 in
stage 0.0 (TID 604) in 329 ms on sparkup1 (605/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 875.0 in
stage 0.0 (TID 609, sparkup1, partition 875,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 873.0 in
stage 0.0 (TID 605) in 334 ms on sparkup1 (606/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 959.0 in
stage 0.0 (TID 610, sparkup2, partition 959,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 953.0 in
stage 0.0 (TID 606) in 325 ms on sparkup2 (607/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 962.0 in
stage 0.0 (TID 611, sparkup2, partition 962,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 957.0 in
stage 0.0 (TID 607) in 327 ms on sparkup2 (608/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 876.0 in
stage 0.0 (TID 612, sparkup1, partition 876,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 874.0 in
stage 0.0 (TID 608) in 327 ms on sparkup1 (609/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 880.0 in
stage 0.0 (TID 613, sparkup1, partition 880,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 875.0 in
stage 0.0 (TID 609) in 336 ms on sparkup1 (610/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 963.0 in
stage 0.0 (TID 614, sparkup2, partition 963,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 959.0 in
stage 0.0 (TID 610) in 328 ms on sparkup2 (611/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 962.0 in
stage 0.0 (TID 611) in 300 ms on sparkup2 (612/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 966.0 in
stage 0.0 (TID 615, sparkup2, partition 966,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 884.0 in
stage 0.0 (TID 616, sparkup1, partition 884,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 876.0 in
stage 0.0 (TID 612) in 330 ms on sparkup1 (613/1024)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Starting task 885.0 in
stage 0.0 (TID 617, sparkup1, partition 885,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:22 INFO scheduler.TaskSetManager: Finished task 880.0 in
stage 0.0 (TID 613) in 322 ms on sparkup1 (614/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 968.0 in
stage 0.0 (TID 618, sparkup2, partition 968,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 966.0 in
stage 0.0 (TID 615) in 328 ms on sparkup2 (615/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 969.0 in
stage 0.0 (TID 619, sparkup2, partition 969,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 963.0 in
stage 0.0 (TID 614) in 376 ms on sparkup2 (616/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 888.0 in
stage 0.0 (TID 620, sparkup1, partition 888,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 884.0 in
stage 0.0 (TID 616) in 330 ms on sparkup1 (617/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 891.0 in
stage 0.0 (TID 621, sparkup1, partition 891,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 885.0 in
stage 0.0 (TID 617) in 342 ms on sparkup1 (618/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 970.0 in
stage 0.0 (TID 622, sparkup2, partition 970,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 968.0 in
stage 0.0 (TID 618) in 395 ms on sparkup2 (619/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 974.0 in
stage 0.0 (TID 623, sparkup2, partition 974,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 969.0 in
stage 0.0 (TID 619) in 371 ms on sparkup2 (620/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 893.0 in
stage 0.0 (TID 624, sparkup1, partition 893,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 888.0 in
stage 0.0 (TID 620) in 354 ms on sparkup1 (621/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 896.0 in
stage 0.0 (TID 625, sparkup1, partition 896,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 891.0 in
stage 0.0 (TID 621) in 352 ms on sparkup1 (622/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 975.0 in
stage 0.0 (TID 626, sparkup2, partition 975,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 970.0 in
stage 0.0 (TID 622) in 313 ms on sparkup2 (623/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 976.0 in
stage 0.0 (TID 627, sparkup2, partition 976,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 974.0 in
stage 0.0 (TID 623) in 318 ms on sparkup2 (624/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 900.0 in
stage 0.0 (TID 628, sparkup1, partition 900,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 896.0 in
stage 0.0 (TID 625) in 309 ms on sparkup1 (625/1024)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Starting task 906.0 in
stage 0.0 (TID 629, sparkup1, partition 906,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:23 INFO scheduler.TaskSetManager: Finished task 893.0 in
stage 0.0 (TID 624) in 350 ms on sparkup1 (626/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 979.0 in
stage 0.0 (TID 630, sparkup2, partition 979,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 975.0 in
stage 0.0 (TID 626) in 307 ms on sparkup2 (627/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 980.0 in
stage 0.0 (TID 631, sparkup2, partition 980,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 976.0 in
stage 0.0 (TID 627) in 303 ms on sparkup2 (628/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 908.0 in
stage 0.0 (TID 632, sparkup1, partition 908,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 900.0 in
stage 0.0 (TID 628) in 325 ms on sparkup1 (629/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 909.0 in
stage 0.0 (TID 633, sparkup1, partition 909,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 906.0 in
stage 0.0 (TID 629) in 318 ms on sparkup1 (630/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 986.0 in
stage 0.0 (TID 634, sparkup2, partition 986,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 979.0 in
stage 0.0 (TID 630) in 291 ms on sparkup2 (631/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 988.0 in
stage 0.0 (TID 635, sparkup2, partition 988,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 980.0 in
stage 0.0 (TID 631) in 289 ms on sparkup2 (632/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 914.0 in
stage 0.0 (TID 636, sparkup1, partition 914,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 908.0 in
stage 0.0 (TID 632) in 305 ms on sparkup1 (633/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 915.0 in
stage 0.0 (TID 637, sparkup1, partition 915,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 909.0 in
stage 0.0 (TID 633) in 313 ms on sparkup1 (634/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 986.0 in
stage 0.0 (TID 634) in 300 ms on sparkup2 (635/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 989.0 in
stage 0.0 (TID 638, sparkup2, partition 989,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 990.0 in
stage 0.0 (TID 639, sparkup2, partition 990,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 988.0 in
stage 0.0 (TID 635) in 323 ms on sparkup2 (636/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 920.0 in
stage 0.0 (TID 640, sparkup1, partition 920,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 914.0 in
stage 0.0 (TID 636) in 310 ms on sparkup1 (637/1024)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Starting task 921.0 in
stage 0.0 (TID 641, sparkup1, partition 921,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:24 INFO scheduler.TaskSetManager: Finished task 915.0 in
stage 0.0 (TID 637) in 313 ms on sparkup1 (638/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 994.0 in
stage 0.0 (TID 642, sparkup2, partition 994,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 989.0 in
stage 0.0 (TID 638) in 305 ms on sparkup2 (639/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 996.0 in
stage 0.0 (TID 643, sparkup2, partition 996,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 990.0 in
stage 0.0 (TID 639) in 305 ms on sparkup2 (640/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 923.0 in
stage 0.0 (TID 644, sparkup1, partition 923,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 920.0 in
stage 0.0 (TID 640) in 344 ms on sparkup1 (641/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 924.0 in
stage 0.0 (TID 645, sparkup1, partition 924,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 921.0 in
stage 0.0 (TID 641) in 336 ms on sparkup1 (642/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 999.0 in
stage 0.0 (TID 646, sparkup2, partition 999,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 994.0 in
stage 0.0 (TID 642) in 303 ms on sparkup2 (643/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 1001.0 in
stage 0.0 (TID 647, sparkup2, partition 1001,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 996.0 in
stage 0.0 (TID 643) in 297 ms on sparkup2 (644/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 927.0 in
stage 0.0 (TID 648, sparkup1, partition 927,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 923.0 in
stage 0.0 (TID 644) in 302 ms on sparkup1 (645/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 930.0 in
stage 0.0 (TID 649, sparkup1, partition 930,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 924.0 in
stage 0.0 (TID 645) in 307 ms on sparkup1 (646/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 1010.0 in
stage 0.0 (TID 650, sparkup2, partition 1010,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 999.0 in
stage 0.0 (TID 646) in 298 ms on sparkup2 (647/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 1015.0 in
stage 0.0 (TID 651, sparkup2, partition 1015,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 1001.0 in
stage 0.0 (TID 647) in 296 ms on sparkup2 (648/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 932.0 in
stage 0.0 (TID 652, sparkup1, partition 932,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 927.0 in
stage 0.0 (TID 648) in 293 ms on sparkup1 (649/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 936.0 in
stage 0.0 (TID 653, sparkup1, partition 936,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 930.0 in
stage 0.0 (TID 649) in 307 ms on sparkup1 (650/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 1018.0 in
stage 0.0 (TID 654, sparkup2, partition 1018,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 1010.0 in
stage 0.0 (TID 650) in 299 ms on sparkup2 (651/1024)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Starting task 1021.0 in
stage 0.0 (TID 655, sparkup2, partition 1021,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:25 INFO scheduler.TaskSetManager: Finished task 1015.0 in
stage 0.0 (TID 651) in 298 ms on sparkup2 (652/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 946.0 in
stage 0.0 (TID 656, sparkup1, partition 946,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 932.0 in
stage 0.0 (TID 652) in 299 ms on sparkup1 (653/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 947.0 in
stage 0.0 (TID 657, sparkup1, partition 947,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 936.0 in
stage 0.0 (TID 653) in 290 ms on sparkup1 (654/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 1023.0 in
stage 0.0 (TID 658, sparkup2, partition 1023,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 1021.0 in
stage 0.0 (TID 655) in 293 ms on sparkup2 (655/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 1018.0 in
stage 0.0 (TID 654) in 337 ms on sparkup2 (656/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 952.0 in
stage 0.0 (TID 659, sparkup1, partition 952,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 946.0 in
stage 0.0 (TID 656) in 299 ms on sparkup1 (657/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 947.0 in
stage 0.0 (TID 657) in 309 ms on sparkup1 (658/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 954.0 in
stage 0.0 (TID 660, sparkup1, partition 954,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 1023.0 in
stage 0.0 (TID 658) in 302 ms on sparkup2 (659/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 958.0 in
stage 0.0 (TID 661, sparkup1, partition 958,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 952.0 in
stage 0.0 (TID 659) in 316 ms on sparkup1 (660/1024)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Starting task 960.0 in
stage 0.0 (TID 662, sparkup1, partition 960,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:26 INFO scheduler.TaskSetManager: Finished task 954.0 in
stage 0.0 (TID 660) in 319 ms on sparkup1 (661/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 967.0 in
stage 0.0 (TID 663, sparkup1, partition 967,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 960.0 in
stage 0.0 (TID 662) in 300 ms on sparkup1 (662/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 971.0 in
stage 0.0 (TID 664, sparkup1, partition 971,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 958.0 in
stage 0.0 (TID 661) in 351 ms on sparkup1 (663/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 972.0 in
stage 0.0 (TID 665, sparkup1, partition 972,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 967.0 in
stage 0.0 (TID 663) in 305 ms on sparkup1 (664/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 978.0 in
stage 0.0 (TID 666, sparkup1, partition 978,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 971.0 in
stage 0.0 (TID 664) in 322 ms on sparkup1 (665/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 981.0 in
stage 0.0 (TID 667, sparkup1, partition 981,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 972.0 in
stage 0.0 (TID 665) in 299 ms on sparkup1 (666/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 982.0 in
stage 0.0 (TID 668, sparkup1, partition 982,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 978.0 in
stage 0.0 (TID 666) in 305 ms on sparkup1 (667/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 983.0 in
stage 0.0 (TID 669, sparkup1, partition 983,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 981.0 in
stage 0.0 (TID 667) in 291 ms on sparkup1 (668/1024)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Starting task 985.0 in
stage 0.0 (TID 670, sparkup1, partition 985,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:27 INFO scheduler.TaskSetManager: Finished task 982.0 in
stage 0.0 (TID 668) in 293 ms on sparkup1 (669/1024)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Starting task 987.0 in
stage 0.0 (TID 671, sparkup1, partition 987,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Finished task 983.0 in
stage 0.0 (TID 669) in 299 ms on sparkup1 (670/1024)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Starting task 998.0 in
stage 0.0 (TID 672, sparkup1, partition 998,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Finished task 985.0 in
stage 0.0 (TID 670) in 298 ms on sparkup1 (671/1024)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Starting task 1004.0 in
stage 0.0 (TID 673, sparkup1, partition 1004,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Finished task 987.0 in
stage 0.0 (TID 671) in 320 ms on sparkup1 (672/1024)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Starting task 1005.0 in
stage 0.0 (TID 674, sparkup1, partition 1005,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Finished task 998.0 in
stage 0.0 (TID 672) in 355 ms on sparkup1 (673/1024)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Starting task 1008.0 in
stage 0.0 (TID 675, sparkup1, partition 1008,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Finished task 1004.0 in
stage 0.0 (TID 673) in 313 ms on sparkup1 (674/1024)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Starting task 1009.0 in
stage 0.0 (TID 676, sparkup1, partition 1009,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:28 INFO scheduler.TaskSetManager: Finished task 1005.0 in
stage 0.0 (TID 674) in 383 ms on sparkup1 (675/1024)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Starting task 1012.0 in
stage 0.0 (TID 677, sparkup1, partition 1012,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Finished task 1008.0 in
stage 0.0 (TID 675) in 310 ms on sparkup1 (676/1024)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Starting task 1014.0 in
stage 0.0 (TID 678, sparkup1, partition 1014,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Finished task 1009.0 in
stage 0.0 (TID 676) in 376 ms on sparkup1 (677/1024)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Starting task 1016.0 in
stage 0.0 (TID 679, sparkup1, partition 1016,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Finished task 1012.0 in
stage 0.0 (TID 677) in 316 ms on sparkup1 (678/1024)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Starting task 1017.0 in
stage 0.0 (TID 680, sparkup1, partition 1017,NODE_LOCAL, 1967 bytes)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Finished task 1014.0 in
stage 0.0 (TID 678) in 308 ms on sparkup1 (679/1024)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Finished task 1016.0 in
stage 0.0 (TID 679) in 289 ms on sparkup1 (680/1024)
16/08/22 06:08:29 INFO scheduler.TaskSetManager: Finished task 1017.0 in
stage 0.0 (TID 680) in 301 ms on sparkup1 (681/1024)
16/08/22 06:08:32 INFO scheduler.TaskSetManager: Starting task 0.0 in stage
0.0 (TID 681, sparkup2, partition 0,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:32 INFO scheduler.TaskSetManager: Starting task 2.0 in stage
0.0 (TID 682, sparkup1, partition 2,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:32 INFO scheduler.TaskSetManager: Starting task 5.0 in stage
0.0 (TID 683, sparkup2, partition 5,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:32 INFO scheduler.TaskSetManager: Starting task 9.0 in stage
0.0 (TID 684, sparkup1, partition 9,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 15.0 in stage
0.0 (TID 685, sparkup1, partition 15,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 9.0 in stage
0.0 (TID 684) in 312 ms on sparkup1 (682/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 19.0 in stage
0.0 (TID 686, sparkup1, partition 19,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 2.0 in stage
0.0 (TID 682) in 334 ms on sparkup1 (683/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 22.0 in stage
0.0 (TID 687, sparkup1, partition 22,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 19.0 in stage
0.0 (TID 686) in 297 ms on sparkup1 (684/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 24.0 in stage
0.0 (TID 688, sparkup1, partition 24,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 15.0 in stage
0.0 (TID 685) in 331 ms on sparkup1 (685/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 26.0 in stage
0.0 (TID 689, sparkup1, partition 26,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 24.0 in stage
0.0 (TID 688) in 317 ms on sparkup1 (686/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 28.0 in stage
0.0 (TID 690, sparkup2, partition 28,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 5.0 in stage
0.0 (TID 683) in 980 ms on sparkup2 (687/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 29.0 in stage
0.0 (TID 691, sparkup2, partition 29,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 0.0 in stage
0.0 (TID 681) in 1003 ms on sparkup2 (688/1024)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Starting task 33.0 in stage
0.0 (TID 692, sparkup1, partition 33,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:33 INFO scheduler.TaskSetManager: Finished task 22.0 in stage
0.0 (TID 687) in 536 ms on sparkup1 (689/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 34.0 in stage
0.0 (TID 693, sparkup1, partition 34,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 26.0 in stage
0.0 (TID 689) in 333 ms on sparkup1 (690/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 37.0 in stage
0.0 (TID 694, sparkup2, partition 37,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 29.0 in stage
0.0 (TID 691) in 354 ms on sparkup2 (691/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 28.0 in stage
0.0 (TID 690) in 363 ms on sparkup2 (692/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 39.0 in stage
0.0 (TID 695, sparkup2, partition 39,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 49.0 in stage
0.0 (TID 696, sparkup1, partition 49,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 34.0 in stage
0.0 (TID 693) in 323 ms on sparkup1 (693/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 51.0 in stage
0.0 (TID 697, sparkup2, partition 51,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 54.0 in stage
0.0 (TID 698, sparkup2, partition 54,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 39.0 in stage
0.0 (TID 695) in 311 ms on sparkup2 (694/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 37.0 in stage
0.0 (TID 694) in 318 ms on sparkup2 (695/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 55.0 in stage
0.0 (TID 699, sparkup1, partition 55,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 49.0 in stage
0.0 (TID 696) in 320 ms on sparkup1 (696/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 58.0 in stage
0.0 (TID 700, sparkup2, partition 58,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 54.0 in stage
0.0 (TID 698) in 321 ms on sparkup2 (697/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 61.0 in stage
0.0 (TID 701, sparkup2, partition 61,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 51.0 in stage
0.0 (TID 697) in 337 ms on sparkup2 (698/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 69.0 in stage
0.0 (TID 702, sparkup1, partition 69,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 33.0 in stage
0.0 (TID 692) in 940 ms on sparkup1 (699/1024)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Starting task 70.0 in stage
0.0 (TID 703, sparkup1, partition 70,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:34 INFO scheduler.TaskSetManager: Finished task 55.0 in stage
0.0 (TID 699) in 324 ms on sparkup1 (700/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 71.0 in stage
0.0 (TID 704, sparkup2, partition 71,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 58.0 in stage
0.0 (TID 700) in 309 ms on sparkup2 (701/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 78.0 in stage
0.0 (TID 705, sparkup2, partition 78,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 61.0 in stage
0.0 (TID 701) in 314 ms on sparkup2 (702/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 79.0 in stage
0.0 (TID 706, sparkup1, partition 79,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 69.0 in stage
0.0 (TID 702) in 334 ms on sparkup1 (703/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 81.0 in stage
0.0 (TID 707, sparkup1, partition 81,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 70.0 in stage
0.0 (TID 703) in 321 ms on sparkup1 (704/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 82.0 in stage
0.0 (TID 708, sparkup2, partition 82,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 71.0 in stage
0.0 (TID 704) in 313 ms on sparkup2 (705/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 87.0 in stage
0.0 (TID 709, sparkup2, partition 87,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 78.0 in stage
0.0 (TID 705) in 317 ms on sparkup2 (706/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 90.0 in stage
0.0 (TID 710, sparkup1, partition 90,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 79.0 in stage
0.0 (TID 706) in 318 ms on sparkup1 (707/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 91.0 in stage
0.0 (TID 711, sparkup1, partition 91,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 81.0 in stage
0.0 (TID 707) in 295 ms on sparkup1 (708/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 92.0 in stage
0.0 (TID 712, sparkup2, partition 92,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 82.0 in stage
0.0 (TID 708) in 320 ms on sparkup2 (709/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 94.0 in stage
0.0 (TID 713, sparkup2, partition 94,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 87.0 in stage
0.0 (TID 709) in 331 ms on sparkup2 (710/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 96.0 in stage
0.0 (TID 714, sparkup1, partition 96,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 90.0 in stage
0.0 (TID 710) in 292 ms on sparkup1 (711/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 98.0 in stage
0.0 (TID 715, sparkup1, partition 98,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 91.0 in stage
0.0 (TID 711) in 313 ms on sparkup1 (712/1024)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Starting task 101.0 in
stage 0.0 (TID 716, sparkup2, partition 101,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:35 INFO scheduler.TaskSetManager: Finished task 92.0 in stage
0.0 (TID 712) in 326 ms on sparkup2 (713/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 103.0 in
stage 0.0 (TID 717, sparkup2, partition 103,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 94.0 in stage
0.0 (TID 713) in 327 ms on sparkup2 (714/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 106.0 in
stage 0.0 (TID 718, sparkup1, partition 106,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 96.0 in stage
0.0 (TID 714) in 291 ms on sparkup1 (715/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 114.0 in
stage 0.0 (TID 719, sparkup1, partition 114,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 98.0 in stage
0.0 (TID 715) in 300 ms on sparkup1 (716/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 115.0 in
stage 0.0 (TID 720, sparkup2, partition 115,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 101.0 in
stage 0.0 (TID 716) in 324 ms on sparkup2 (717/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 128.0 in
stage 0.0 (TID 721, sparkup2, partition 128,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 103.0 in
stage 0.0 (TID 717) in 318 ms on sparkup2 (718/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 130.0 in
stage 0.0 (TID 722, sparkup1, partition 130,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 106.0 in
stage 0.0 (TID 718) in 323 ms on sparkup1 (719/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 133.0 in
stage 0.0 (TID 723, sparkup1, partition 133,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 114.0 in
stage 0.0 (TID 719) in 295 ms on sparkup1 (720/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 136.0 in
stage 0.0 (TID 724, sparkup2, partition 136,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 115.0 in
stage 0.0 (TID 720) in 323 ms on sparkup2 (721/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 137.0 in
stage 0.0 (TID 725, sparkup2, partition 137,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 128.0 in
stage 0.0 (TID 721) in 324 ms on sparkup2 (722/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 138.0 in
stage 0.0 (TID 726, sparkup1, partition 138,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 130.0 in
stage 0.0 (TID 722) in 317 ms on sparkup1 (723/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 142.0 in
stage 0.0 (TID 727, sparkup1, partition 142,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 133.0 in
stage 0.0 (TID 723) in 294 ms on sparkup1 (724/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 143.0 in
stage 0.0 (TID 728, sparkup2, partition 143,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 136.0 in
stage 0.0 (TID 724) in 327 ms on sparkup2 (725/1024)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Starting task 146.0 in
stage 0.0 (TID 729, sparkup2, partition 146,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:36 INFO scheduler.TaskSetManager: Finished task 137.0 in
stage 0.0 (TID 725) in 324 ms on sparkup2 (726/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 147.0 in
stage 0.0 (TID 730, sparkup1, partition 147,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 138.0 in
stage 0.0 (TID 726) in 306 ms on sparkup1 (727/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 154.0 in
stage 0.0 (TID 731, sparkup1, partition 154,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 142.0 in
stage 0.0 (TID 727) in 299 ms on sparkup1 (728/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 155.0 in
stage 0.0 (TID 732, sparkup2, partition 155,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 143.0 in
stage 0.0 (TID 728) in 325 ms on sparkup2 (729/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 156.0 in
stage 0.0 (TID 733, sparkup2, partition 156,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 146.0 in
stage 0.0 (TID 729) in 323 ms on sparkup2 (730/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 163.0 in
stage 0.0 (TID 734, sparkup1, partition 163,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 147.0 in
stage 0.0 (TID 730) in 307 ms on sparkup1 (731/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 168.0 in
stage 0.0 (TID 735, sparkup1, partition 168,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 154.0 in
stage 0.0 (TID 731) in 302 ms on sparkup1 (732/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 175.0 in
stage 0.0 (TID 736, sparkup2, partition 175,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 155.0 in
stage 0.0 (TID 732) in 332 ms on sparkup2 (733/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 176.0 in
stage 0.0 (TID 737, sparkup2, partition 176,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 156.0 in
stage 0.0 (TID 733) in 335 ms on sparkup2 (734/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 178.0 in
stage 0.0 (TID 738, sparkup1, partition 178,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 163.0 in
stage 0.0 (TID 734) in 333 ms on sparkup1 (735/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 179.0 in
stage 0.0 (TID 739, sparkup1, partition 179,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 168.0 in
stage 0.0 (TID 735) in 298 ms on sparkup1 (736/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 185.0 in
stage 0.0 (TID 740, sparkup2, partition 185,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 175.0 in
stage 0.0 (TID 736) in 324 ms on sparkup2 (737/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 188.0 in
stage 0.0 (TID 741, sparkup2, partition 188,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 176.0 in
stage 0.0 (TID 737) in 330 ms on sparkup2 (738/1024)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Starting task 190.0 in
stage 0.0 (TID 742, sparkup1, partition 190,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:37 INFO scheduler.TaskSetManager: Finished task 178.0 in
stage 0.0 (TID 738) in 332 ms on sparkup1 (739/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 193.0 in
stage 0.0 (TID 743, sparkup1, partition 193,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 179.0 in
stage 0.0 (TID 739) in 329 ms on sparkup1 (740/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 194.0 in
stage 0.0 (TID 744, sparkup2, partition 194,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 185.0 in
stage 0.0 (TID 740) in 332 ms on sparkup2 (741/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 198.0 in
stage 0.0 (TID 745, sparkup2, partition 198,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 188.0 in
stage 0.0 (TID 741) in 337 ms on sparkup2 (742/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 200.0 in
stage 0.0 (TID 746, sparkup1, partition 200,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 190.0 in
stage 0.0 (TID 742) in 329 ms on sparkup1 (743/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 204.0 in
stage 0.0 (TID 747, sparkup1, partition 204,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 193.0 in
stage 0.0 (TID 743) in 493 ms on sparkup1 (744/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 205.0 in
stage 0.0 (TID 748, sparkup2, partition 205,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 194.0 in
stage 0.0 (TID 744) in 340 ms on sparkup2 (745/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 210.0 in
stage 0.0 (TID 749, sparkup1, partition 210,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 200.0 in
stage 0.0 (TID 746) in 309 ms on sparkup1 (746/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 214.0 in
stage 0.0 (TID 750, sparkup2, partition 214,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 198.0 in
stage 0.0 (TID 745) in 336 ms on sparkup2 (747/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 217.0 in
stage 0.0 (TID 751, sparkup1, partition 217,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 219.0 in
stage 0.0 (TID 752, sparkup2, partition 219,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 205.0 in
stage 0.0 (TID 748) in 334 ms on sparkup2 (748/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 210.0 in
stage 0.0 (TID 749) in 313 ms on sparkup1 (749/1024)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Starting task 220.0 in
stage 0.0 (TID 753, sparkup2, partition 220,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:38 INFO scheduler.TaskSetManager: Finished task 214.0 in
stage 0.0 (TID 750) in 334 ms on sparkup2 (750/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 224.0 in
stage 0.0 (TID 754, sparkup1, partition 224,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 204.0 in
stage 0.0 (TID 747) in 506 ms on sparkup1 (751/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 225.0 in
stage 0.0 (TID 755, sparkup1, partition 225,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 217.0 in
stage 0.0 (TID 751) in 300 ms on sparkup1 (752/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 232.0 in
stage 0.0 (TID 756, sparkup2, partition 232,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 220.0 in
stage 0.0 (TID 753) in 325 ms on sparkup2 (753/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 240.0 in
stage 0.0 (TID 757, sparkup1, partition 240,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 224.0 in
stage 0.0 (TID 754) in 289 ms on sparkup1 (754/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 242.0 in
stage 0.0 (TID 758, sparkup2, partition 242,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 219.0 in
stage 0.0 (TID 752) in 592 ms on sparkup2 (755/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 244.0 in
stage 0.0 (TID 759, sparkup1, partition 244,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 225.0 in
stage 0.0 (TID 755) in 304 ms on sparkup1 (756/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 252.0 in
stage 0.0 (TID 760, sparkup2, partition 252,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 232.0 in
stage 0.0 (TID 756) in 318 ms on sparkup2 (757/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 254.0 in
stage 0.0 (TID 761, sparkup1, partition 254,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 244.0 in
stage 0.0 (TID 759) in 297 ms on sparkup1 (758/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 256.0 in
stage 0.0 (TID 762, sparkup2, partition 256,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 242.0 in
stage 0.0 (TID 758) in 335 ms on sparkup2 (759/1024)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Starting task 260.0 in
stage 0.0 (TID 763, sparkup2, partition 260,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:39 INFO scheduler.TaskSetManager: Finished task 252.0 in
stage 0.0 (TID 760) in 321 ms on sparkup2 (760/1024)
16/08/22 06:08:40 INFO scheduler.TaskSetManager: Starting task 262.0 in
stage 0.0 (TID 764, sparkup2, partition 262,RACK_LOCAL, 1967 bytes)
16/08/22 06:08:40 INFO scheduler.TaskSetManager: Finished task 256.0 in
stage 0.0 (TID 762) in 327 ms on sparkup2 (761/1024)
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Yarn-deployment-for-static-TcpDiscoverySpi-issues-Urgent-In-Production-tp7205p7208.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.