You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Wenmin Wu (JIRA)" <ji...@apache.org> on 2015/09/15 16:22:46 UTC
[jira] [Commented] (SPARK-10616) GradientBoostedTrees stuck with
2958359 features train data
[ https://issues.apache.org/jira/browse/SPARK-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14745525#comment-14745525 ]
Wenmin Wu commented on SPARK-10616:
-----------------------------------
Dear Mr Owen,
I'm sorry. I didn't narrow the logs, because I didn't know where is the problem. I test with a smaller data, it works well. However, it get stuck when I use a bigger data.
I have searched the JIRA and didn't find any similar problem like this. Can you give a link of the similar problem.
I will be grateful for anything you can help me on this matter!
Thank you!
wu_wenmin@126.com
From: Sean Owen (JIRA)
Date: 2015-09-15 20:01
To: wu_wenmin
Subject: [jira] [Resolved] (SPARK-10616) GradientBoostedTrees stuck with 2958359 features train data
[ https://issues.apache.org/jira/browse/SPARK-10616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved SPARK-10616.
-------------------------------
Resolution: Duplicate
[~Vimin_Wu] Please search JIRA first, as this is almost certainly a duplicate of the issue I mentioned. Also, it's great that you try to provide log info, but you should probably narrow this down to the relevant info that focuses on what you believe the problem is.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
> GradientBoostedTrees stuck with 2958359 features train data
> -----------------------------------------------------------
>
> Key: SPARK-10616
> URL: https://issues.apache.org/jira/browse/SPARK-10616
> Project: Spark
> Issue Type: Bug
> Components: MLlib
> Affects Versions: 1.4.1
> Reporter: Wenmin Wu
>
> I run a job to train a Gradient Boosting Decision Tree. The code works well on a small part where the features is about 20 thousands. But, when I run it on one data data where there are 2958359 features in total. The job get stuck after finished "collect at DecisionTree.scala:977".
> Here is the statistics of my enviorment and logs, from the logs you can see it stop working at 15/09/15 18:50:57, 2 hours has passed no process at all, and I'm sure the memory is enough for this job. I hope someone can help me with this problem, thanks!
> Storage
> RDD Name Storage Level Cached Partitions Fraction Cached Size in Memory Size in ExternalBlockStore Size on Disk
> MapPartitionsRDD Memory Deserialized 1x Replicated 200 100% 771.7 MB 0.0 B 0.0 B
> MapPartitionsRDD Memory Deserialized 1x Replicated 200 100% 771.7 MB 0.0 B 0.0 B
> Environment
> Runtime Information
> Name Value
> Java Home /opt/jdk1.8.0_60/jre
> Java Version 1.8.0_60 (Oracle Corporation)
> Scala Version version 2.10.4
> Spark Properties
> Name Value
> spark.akka.frameSize 100
> spark.akka.threads 4
> spark.app.id application_1442215126745_0068
> spark.app.name GBDT_MODEL
> spark.broadcast.compress true
> spark.broadcast.factory org.apache.spark.broadcast.TorrentBroadcastFactory
> spark.closure.serializer org.apache.spark.serializer.JavaSerializer
> spark.driver.extraJavaOptions -Xmn2G -Xms4G -XX:MaxPermSize=200m -XX:+UseConcMarkSweepGC -XX:+PrintGC -XX:+PrintGCDetails -Xloggc:/tmp/spark.driver.gc.log -XX:+HeapDumpOnOutOfMemoryError -XX:HeapDumpPath=/tmp
> spark.driver.extraLibraryPath /usr/lib/hadoop/lib/native
> spark.driver.host 10.47.1.38
> spark.driver.memory 32g
> spark.driver.port 29651
> spark.dynamicAllocation.enabled false
> spark.dynamicAllocation.executorIdleTimeout 120
> spark.dynamicAllocation.initialExecutors 10
> spark.dynamicAllocation.maxExecutors 500
> spark.dynamicAllocation.minExecutors 10
> spark.dynamicAllocation.schedulerBacklogTimeout 5
> spark.dynamicAllocation.sustainedSchedulerBacklogTimeout 5
> spark.eventLog.compress true
> spark.eventLog.dir hdfs:///data/spark/logs/1.4
> spark.eventLog.enabled true
> spark.executor.extraJavaOptions -Xmn1G -XX:+UseG1GC
> spark.executor.extraLibraryPath /usr/lib/hadoop/lib/native
> spark.executor.heartbeatInterval 10000
> spark.executor.id driver
> spark.executor.instances 300
> spark.executor.memory 16g
> spark.externalBlockStore.folderName spark-ff489341-5ce7-47bc-b0d3-a3011300f3fc
> spark.file.transferTo false
> spark.fileserver.uri http://10.47.1.38:42401
> spark.io.compression.codec org.apache.spark.io.LZFCompressionCodec
> spark.master yarn-cluster
> spark.org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.param.PROXY_HOST jt4dg.prod.mediav.com
> spark.org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter.param.PROXY_URI_BASE http://jt4dg.prod.mediav.com:9099/proxy/application_1442215126745_0068
> spark.rdd.compress true
> spark.rpc.askTimeout 60
> spark.rpc.retry.wait 3000
> spark.rpc.timeout 300
> spark.scheduler.maxRegisteredResourcesWaitingTime 3s
> spark.scheduler.mode FAIR
> spark.serializer org.apache.spark.serializer.KryoSerializer
> spark.shuffle.service.enabled true
> spark.speculation false
> spark.sql.autoBroadcastJoinThreshold 104857600
> spark.sql.codegen false
> spark.sql.hive.convertMetastoreParquet true
> spark.sql.inMemoryColumnarStorage.batchSize 1000
> spark.sql.inMemoryColumnarStorage.compressed true
> spark.sql.parquet.binaryAsString true
> spark.sql.parquet.cacheMetadata true
> spark.sql.parquet.compression.codec lzo
> spark.sql.parquet.filterPushdown false
> spark.sql.parquet.useDataSourceApi true
> spark.sql.shuffle.partitions 200
> spark.storage.blockManagerHeartBeatMs 120
> spark.storage.memoryFraction 0.6
> spark.storage.unrollFraction 0.2
> spark.task.cpus 1
> spark.task.maxFailures 8
> spark.ui.filters org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
> spark.ui.killEnabled true
> spark.ui.port 0
> spark.ui.retainedStages 1000
> spark.yarn.am.extraJavaOptions -Xmn1G -XX:+UseG1GC
> spark.yarn.am.extraLibraryPath /usr/lib/hadoop/lib/native
> spark.yarn.am.memory 3G
> spark.yarn.am.memoryOverhead 1024
> spark.yarn.am.waitTime 300000
> spark.yarn.app.attemptId 1
> spark.yarn.app.container.log.dir /hadoopdir13/yarn/logs/application_1442215126745_0068/container_1442215126745_0068_01_000001
> spark.yarn.app.id application_1442215126745_0068
> spark.yarn.executor.memoryOverhead 1024
> spark.yarn.historyServer.address jt1dg.prod.mediav.com:18080
> spark.yarn.report.interval 1000
> Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=200m; support was removed in 8.0
> 15/09/15 18:50:12 INFO yarn.ApplicationMaster: Registered signal handlers for [TERM, HUP, INT]
> 15/09/15 18:50:13 INFO yarn.ApplicationMaster: ApplicationAttemptId: appattempt_1442215126745_0068_000001
> 15/09/15 18:50:13 INFO spark.SecurityManager: Changing view acls to: yarn,wuwm
> 15/09/15 18:50:13 INFO spark.SecurityManager: Changing modify acls to: yarn,wuwm
> 15/09/15 18:50:13 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, wuwm); users with modify permissions: Set(yarn, wuwm)
> 15/09/15 18:50:14 INFO yarn.ApplicationMaster: Starting the user application in a separate Thread
> 15/09/15 18:50:14 INFO yarn.ApplicationMaster: Waiting for spark context initialization
> 15/09/15 18:50:14 INFO yarn.ApplicationMaster: Waiting for spark context initialization ...
> 15/09/15 18:50:14 INFO spark.SparkContext: Running Spark version 1.4.1
> 15/09/15 18:50:14 INFO spark.SecurityManager: Changing view acls to: yarn,wuwm
> 15/09/15 18:50:14 INFO spark.SecurityManager: Changing modify acls to: yarn,wuwm
> 15/09/15 18:50:14 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(yarn, wuwm); users with modify permissions: Set(yarn, wuwm)
> 15/09/15 18:50:14 INFO slf4j.Slf4jLogger: Slf4jLogger started
> 15/09/15 18:50:14 INFO Remoting: Starting remoting
> 15/09/15 18:50:15 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkDriver@10.47.1.38:29651]
> 15/09/15 18:50:15 INFO util.Utils: Successfully started service 'sparkDriver' on port 29651.
> 15/09/15 18:50:15 INFO spark.SparkEnv: Registering MapOutputTracker
> 15/09/15 18:50:15 INFO spark.SparkEnv: Registering BlockManagerMaster
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir1/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-355c7a06-a8a1-406e-a2c1-fd0b48763e75
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir2/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-7c209d1d-f00f-4bd5-85b2-c636bdb631af
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir3/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-d81047b7-c58f-40df-9bfc-b6a5b024c4c5
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir4/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-4a71d2e3-72a3-4622-9d40-69943cc1cc80
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir5/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-1a94d11f-b6df-4c69-a971-08702bb97808
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir6/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-2c944d2c-24f4-49f5-90bf-56121419a059
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir7/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-b3a82a9b-5703-49b3-976e-70ccb5d43b0d
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir8/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-96e20bee-4ed0-4907-be62-1dc511484797
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir9/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-6129c0b6-c05d-417a-95c0-148e708686ee
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir10/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-d625fd54-3982-4b08-baf2-a2b5946f5954
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir11/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-504bb240-017e-4caa-89d0-81d60c38af4e
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir12/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-c17183b4-9ee6-4e1b-877e-cd78d96fefb8
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir13/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-75c6de8a-d443-47ae-9a7b-ad0a91a6ff2d
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir14/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-2b9ea7fb-7a24-4229-af58-43c5a511e2f0
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir15/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-17a6904a-7637-44ad-ad6c-c042d96617c3
> 15/09/15 18:50:15 INFO storage.DiskBlockManager: Created local directory at /hadoopdir16/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/blockmgr-fc2372bb-f6d2-4bf6-987c-84c3271024d8
> 15/09/15 18:50:15 INFO storage.MemoryStore: MemoryStore started with capacity 17.2 GB
> 15/09/15 18:50:15 INFO spark.HttpFileServer: HTTP File server directory is /hadoopdir1/yarn/local/usercache/wuwm/appcache/application_1442215126745_0068/httpd-812c9f01-8931-4fbc-a93a-685ed2619fe9
> 15/09/15 18:50:15 INFO spark.HttpServer: Starting HTTP Server
> 15/09/15 18:50:15 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 15/09/15 18:50:15 INFO server.AbstractConnector: Started SocketConnector@0.0.0.0:42401
> 15/09/15 18:50:15 INFO util.Utils: Successfully started service 'HTTP file server' on port 42401.
> 15/09/15 18:50:15 INFO spark.SparkEnv: Registering OutputCommitCoordinator
> 15/09/15 18:50:15 INFO ui.JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
> 15/09/15 18:50:15 INFO server.Server: jetty-8.y.z-SNAPSHOT
> 15/09/15 18:50:15 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:8925
> 15/09/15 18:50:15 INFO util.Utils: Successfully started service 'SparkUI' on port 8925.
> 15/09/15 18:50:15 INFO ui.SparkUI: Started SparkUI at http://10.47.1.38:8925
> 15/09/15 18:50:15 INFO cluster.YarnClusterScheduler: Created YarnClusterScheduler
> 15/09/15 18:50:15 INFO scheduler.FairSchedulableBuilder: Created default pool default, schedulingMode: FIFO, minShare: 0, weight: 1
> 15/09/15 18:50:16 INFO util.Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 18554.
> 15/09/15 18:50:16 INFO netty.NettyBlockTransferService: Server created on 18554
> 15/09/15 18:50:16 INFO storage.BlockManagerMaster: Trying to register BlockManager
> 15/09/15 18:50:16 INFO storage.BlockManagerMasterEndpoint: Registering block manager 10.47.1.38:18554 with 17.2 GB RAM, BlockManagerId(driver, 10.47.1.38, 18554)
> 15/09/15 18:50:16 INFO storage.BlockManagerMaster: Registered BlockManager
> 15/09/15 18:50:16 INFO scheduler.EventLoggingListener: Logging events to hdfs:///data/spark/logs/1.4/application_1442215126745_0068_1.lzf
> 15/09/15 18:50:17 INFO cluster.YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as AkkaRpcEndpointRef(Actor[akka://sparkDriver/user/YarnAM#308423925])
> 15/09/15 18:50:17 INFO yarn.YarnRMClient: Registering the ApplicationMaster
> 15/09/15 18:50:17 INFO yarn.YarnRMClient: Connecting to ResourceManager at jt5dg.prod.mediav.com/10.47.1.103:8030
> 15/09/15 18:50:17 INFO yarn.YarnAllocator: Will allocate 300 executor containers, each with 17408 MB memory including 1024 MB overhead
> 15/09/15 18:50:17 INFO yarn.YarnAllocator: Allocating 300 executor containers with 17408 of memory each.
> 15/09/15 18:50:17 INFO yarn.YarnAllocator: ResourceRequest (host : *, num containers: 300, priority = 1 , capability : <memory:17408, vCores:1>)
> 15/09/15 18:50:17 INFO yarn.ApplicationMaster: Started progress reporter thread - sleep time : 5000
> 15/09/15 18:50:18 INFO cluster.YarnClusterSchedulerBackend: SchedulerBackend is ready for scheduling beginning after waiting maxRegisteredResourcesWaitingTime: 3000(ms)
> 15/09/15 18:50:18 INFO cluster.YarnClusterScheduler: YarnClusterScheduler.postStartHook done
> 15/09/15 18:50:19 INFO storage.MemoryStore: ensureFreeSpace(179816) called with curMem=0, maxMem=18438322913
> 15/09/15 18:50:19 INFO storage.MemoryStore: Block broadcast_0 stored as values in memory (estimated size 175.6 KB, free 17.2 GB)
> 15/09/15 18:50:19 INFO storage.MemoryStore: ensureFreeSpace(16266) called with curMem=179816, maxMem=18438322913
> 15/09/15 18:50:19 INFO storage.MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 15.9 KB, free 17.2 GB)
> 15/09/15 18:50:19 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on 10.47.1.38:18554 (size: 15.9 KB, free: 17.2 GB)
> 15/09/15 18:50:19 INFO spark.SparkContext: Created broadcast 0 from textFile at MLUtils.scala:73
> 15/09/15 18:50:19 INFO lzo.GPLNativeCodeLoader: Loaded native gpl library
> 15/09/15 18:50:19 INFO lzo.LzoCodec: Successfully loaded & initialized native-lzo library [hadoop-lzo rev 49753b4b5a029410c3bd91278c360c2241328387]
> 15/09/15 18:50:19 INFO mapred.FileInputFormat: Total input paths to process : 200
> 15/09/15 18:50:20 INFO spark.SparkContext: Starting job: reduce at MLUtils.scala:95
> 15/09/15 18:50:20 INFO scheduler.DAGScheduler: Got job 0 (reduce at MLUtils.scala:95) with 200 output partitions (allowLocal=false)
> 15/09/15 18:50:20 INFO scheduler.DAGScheduler: Final stage: ResultStage 0(reduce at MLUtils.scala:95)
> 15/09/15 18:50:20 INFO scheduler.DAGScheduler: Parents of final stage: List()
> 15/09/15 18:50:20 INFO scheduler.DAGScheduler: Missing parents: List()
> 15/09/15 18:50:20 INFO scheduler.DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[5] at map at MLUtils.scala:93), which has no missing parents
> 15/09/15 18:50:20 INFO storage.MemoryStore: ensureFreeSpace(3872) called with curMem=196082, maxMem=18438322913
> 15/09/15 18:50:20 INFO storage.MemoryStore: Block broadcast_1 stored as values in memory (estimated size 3.8 KB, free 17.2 GB)
> 15/09/15 18:50:20 INFO storage.MemoryStore: ensureFreeSpace(2064) called with curMem=199954, maxMem=18438322913
> 15/09/15 18:50:20 INFO storage.MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 2.0 KB, free 17.2 GB)
> 15/09/15 18:50:20 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on 10.47.1.38:18554 (size: 2.0 KB, free: 17.2 GB)
> 15/09/15 18:50:20 INFO spark.SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:874
> 15/09/15 18:50:20 INFO scheduler.DAGScheduler: Submitting 200 missing tasks from ResultStage 0 (MapPartitionsRDD[5] at map at MLUtils.scala:93)
> 15/09/15 18:50:20 INFO cluster.YarnClusterScheduler: Adding task set 0.0 with 200 tasks
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000032 for on host hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000014 for on host hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000078 for on host hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000162 for on host hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd261dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd274dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd277dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000198 for on host hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd282dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000020 for on host hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd255dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000044 for on host hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd286dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000204 for on host hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd260dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000008 for on host hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd273dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000062 for on host hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd291dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000180 for on host hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd264dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000174 for on host hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd272dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000132 for on host hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd285dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000186 for on host hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd258dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000156 for on host hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd290dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000084 for on host hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd263dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000102 for on host hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd289dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000068 for on host hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd276dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000108 for on host hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd281dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000114 for on host hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd254dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000038 for on host hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd257dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000002 for on host hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd288dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000096 for on host hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd275dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000210 for on host hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd280dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000168 for on host hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd279dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000050 for on host hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd293dg.prod.mediav.com:8041
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000144 for on host hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000192 for on host hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000090 for on host hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000138 for on host hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000056 for on host hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000150 for on host hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000120 for on host hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000126 for on host hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000026 for on host hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000074 for on host hd287dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd287dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000033 for on host hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000015 for on host hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000079 for on host hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000163 for on host hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000199 for on host hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000021 for on host hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000045 for on host hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000205 for on host hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000009 for on host hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000063 for on host hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000181 for on host hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000175 for on host hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000133 for on host hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000187 for on host hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000157 for on host hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000085 for on host hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000103 for on host hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000069 for on host hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000109 for on host hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000115 for on host hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000039 for on host hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000003 for on host hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000097 for on host hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000211 for on host hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000169 for on host hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000051 for on host hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000145 for on host hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000193 for on host hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000091 for on host hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000139 for on host hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000057 for on host hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000151 for on host hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000121 for on host hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000127 for on host hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000027 for on host hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000075 for on host hd287dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd287dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000034 for on host hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000016 for on host hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000080 for on host hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000164 for on host hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000200 for on host hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000022 for on host hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000046 for on host hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000206 for on host hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000010 for on host hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000064 for on host hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000182 for on host hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000176 for on host hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000134 for on host hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000188 for on host hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000158 for on host hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000086 for on host hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000104 for on host hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000070 for on host hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000110 for on host hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000116 for on host hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000040 for on host hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000004 for on host hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000098 for on host hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000212 for on host hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000170 for on host hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000052 for on host hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000146 for on host hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000194 for on host hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000092 for on host hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000140 for on host hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000058 for on host hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000152 for on host hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000122 for on host hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000128 for on host hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000028 for on host hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000076 for on host hd287dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd287dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000035 for on host hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000017 for on host hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000081 for on host hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000165 for on host hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000201 for on host hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000023 for on host hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000047 for on host hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000207 for on host hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000011 for on host hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000065 for on host hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000183 for on host hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000177 for on host hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000135 for on host hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000189 for on host hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000159 for on host hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000087 for on host hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000105 for on host hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000071 for on host hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000111 for on host hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000117 for on host hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000041 for on host hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000005 for on host hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000099 for on host hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000213 for on host hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000171 for on host hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000053 for on host hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000147 for on host hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000195 for on host hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000093 for on host hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000141 for on host hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000059 for on host hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000153 for on host hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000123 for on host hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000129 for on host hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000029 for on host hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000036 for on host hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd274dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000018 for on host hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd261dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000082 for on host hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd277dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000166 for on host hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd282dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000202 for on host hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd255dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000024 for on host hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd286dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000048 for on host hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd260dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000208 for on host hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd273dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000012 for on host hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd291dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000066 for on host hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd264dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000184 for on host hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd272dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000178 for on host hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd285dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000136 for on host hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd258dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000190 for on host hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd290dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000160 for on host hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd263dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000088 for on host hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd289dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000106 for on host hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd276dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000072 for on host hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd281dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000112 for on host hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd254dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000118 for on host hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd257dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000042 for on host hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd288dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000006 for on host hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd275dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000100 for on host hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd280dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000214 for on host hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd279dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000172 for on host hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd293dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000054 for on host hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd266dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000148 for on host hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd271dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000196 for on host hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd284dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000094 for on host hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd262dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000142 for on host hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd278dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000060 for on host hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd292dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000154 for on host hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd265dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000124 for on host hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd270dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000130 for on host hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd283dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching container container_1442215126745_0068_01_000030 for on host hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.YarnAllocator: Launching ExecutorRunnable. driverUrl: akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, executorHostname: hd256dg.prod.mediav.com
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000186/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000186/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000014/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000014/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000162/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000162/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000210/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000210/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000068/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000068/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 4, --hostname, hd282dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000044/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000044/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000132/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000132/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000180/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000180/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000002/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000002/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000078/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000078/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000008/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000008/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000032/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000032/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000114/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000114/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000038/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000038/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 20, --hostname, hd257dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 1, --hostname, hd274dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 9, --hostname, hd291dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 3, --hostname, hd277dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 22, --hostname, hd275dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 11, --hostname, hd272dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 13, --hostname, hd258dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 7, --hostname, hd260dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 18, --hostname, hd281dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 14, --hostname, hd290dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 2, --hostname, hd261dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 24, --hostname, hd279dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000168/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000168/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000198/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000198/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000084/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000084/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000156/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000156/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000020/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000020/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000062/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000062/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000096/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000096/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000174/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000174/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000102/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000102/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000204/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000204/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000108/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000108/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 8, --hostname, hd273dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 17, --hostname, hd276dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 12, --hostname, hd285dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 23, --hostname, hd280dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 10, --hostname, hd264dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 6, --hostname, hd286dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 15, --hostname, hd263dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 16, --hostname, hd289dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 5, --hostname, hd255dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 25, --hostname, hd293dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 21, --hostname, hd288dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:22 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 19, --hostname, hd254dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd271dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd274dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd283dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd261dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd270dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd287dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd256dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd278dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd265dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd262dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd282dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd255dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd286dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd284dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd260dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd272dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd264dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd292dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd273dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd291dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd277dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd266dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd285dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd258dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000021/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000021/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 42, --hostname, hd286dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000163/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000163/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 40, --hostname, hd282dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000015/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000015/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 38, --hostname, hd261dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000120/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000120/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 33, --hostname, hd270dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000144/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000144/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000181/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000181/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 27, --hostname, hd271dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 47, --hostname, hd272dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000090/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000090/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 29, --hostname, hd262dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000026/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000026/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000045/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000045/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd287dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000074/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd287dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000074/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000079/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000079/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd290dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 36, --hostname, hd287dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 43, --hostname, hd260dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 35, --hostname, hd256dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000150/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000150/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 39, --hostname, hd277dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000133/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000133/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 49, --hostname, hd258dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 32, --hostname, hd265dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000033/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000033/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000056/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000056/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 31, --hostname, hd292dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000009/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000009/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000192/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000192/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 45, --hostname, hd291dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000175/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000175/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 37, --hostname, hd274dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000199/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000199/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000126/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000126/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 41, --hostname, hd255dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000063/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000063/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000138/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000138/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 48, --hostname, hd285dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000050/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000050/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 28, --hostname, hd284dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 26, --hostname, hd266dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000205/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000205/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 30, --hostname, hd278dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 46, --hostname, hd264dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 34, --hostname, hd283dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 44, --hostname, hd273dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd263dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd289dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd276dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd281dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd275dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd288dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd293dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd279dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd254dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd280dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000187/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000187/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd266dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd257dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 50, --hostname, hd290dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd262dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd284dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd270dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd271dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000157/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000157/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000211/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000211/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000109/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000109/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000103/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000103/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000085/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000085/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd278dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd292dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd265dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000039/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000039/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 57, --hostname, hd288dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000091/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000091/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 52, --hostname, hd289dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd283dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 53, --hostname, hd276dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000097/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000097/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000069/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000069/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 55, --hostname, hd254dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 60, --hostname, hd279dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 51, --hostname, hd263dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd277dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 54, --hostname, hd281dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 59, --hostname, hd280dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd261dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 65, --hostname, hd262dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000193/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000193/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd287dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd256dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd274dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 64, --hostname, hd284dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000051/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000051/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 62, --hostname, hd266dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd255dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000115/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000115/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000121/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000121/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 69, --hostname, hd270dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd260dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd282dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 56, --hostname, hd257dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd286dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd273dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000169/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000169/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 61, --hostname, hd293dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000016/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000016/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000003/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000003/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 58, --hostname, hd275dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 74, --hostname, hd261dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000145/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000145/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 63, --hostname, hd271dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000151/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000151/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000057/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000057/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000139/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000139/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 66, --hostname, hd278dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd287dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000075/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd287dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000075/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 72, --hostname, hd287dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000080/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000080/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 68, --hostname, hd265dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000127/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000127/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd291dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 75, --hostname, hd277dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000034/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000034/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000027/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000027/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 67, --hostname, hd292dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 71, --hostname, hd256dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 73, --hostname, hd274dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 70, --hostname, hd283dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000022/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000022/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 78, --hostname, hd286dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000206/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000206/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000046/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000046/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 80, --hostname, hd273dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 79, --hostname, hd260dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000164/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000164/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000200/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000200/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 76, --hostname, hd282dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 77, --hostname, hd255dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000010/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000010/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 81, --hostname, hd291dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd264dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd285dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd272dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd258dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd290dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd289dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd263dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd276dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd281dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd254dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd257dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd275dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd288dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd280dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000064/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000064/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 82, --hostname, hd264dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd266dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd279dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd271dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000176/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000176/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000188/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000188/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000110/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000110/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000182/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000182/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 83, --hostname, hd272dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd293dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000134/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000134/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000086/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000086/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 91, --hostname, hd254dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000070/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000070/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 90, --hostname, hd281dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000104/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000104/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 86, --hostname, hd290dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd284dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd262dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000004/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000004/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 84, --hostname, hd285dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 94, --hostname, hd275dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd278dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000040/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000040/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000158/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000158/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 89, --hostname, hd276dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 85, --hostname, hd258dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 88, --hostname, hd289dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000146/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000146/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 87, --hostname, hd263dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 93, --hostname, hd288dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000212/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000212/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000116/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000116/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000194/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000194/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 96, --hostname, hd279dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 99, --hostname, hd271dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 100, --hostname, hd284dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 92, --hostname, hd257dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000092/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000092/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 101, --hostname, hd262dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000098/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000098/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 95, --hostname, hd280dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000052/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000052/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 98, --hostname, hd266dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd292dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd265dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd270dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000140/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000140/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 102, --hostname, hd278dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd283dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000170/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000170/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 97, --hostname, hd293dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd256dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000058/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000058/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000122/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000122/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 105, --hostname, hd270dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 103, --hostname, hd292dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000152/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000152/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 104, --hostname, hd265dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000128/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000128/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 106, --hostname, hd283dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000028/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000028/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 107, --hostname, hd256dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd287dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd274dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd261dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd277dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd282dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd255dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd286dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd260dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000017/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000017/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 110, --hostname, hd261dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd287dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000076/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd287dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000076/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 108, --hostname, hd287dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000081/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000081/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000035/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000035/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000165/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000165/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 111, --hostname, hd277dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 112, --hostname, hd282dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 109, --hostname, hd274dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000201/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000201/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 113, --hostname, hd255dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd273dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000047/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000047/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 115, --hostname, hd260dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000023/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000023/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 114, --hostname, hd286dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd291dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000207/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000207/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 116, --hostname, hd273dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000011/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000011/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 117, --hostname, hd291dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd264dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd272dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd285dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd258dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd290dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd263dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd289dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd276dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000065/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000065/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000183/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000183/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 118, --hostname, hd264dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000177/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000177/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 120, --hostname, hd285dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 119, --hostname, hd272dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd281dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd254dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd257dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000087/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000087/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 124, --hostname, hd289dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000159/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000159/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000189/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000189/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000135/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000135/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 122, --hostname, hd290dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 123, --hostname, hd263dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 121, --hostname, hd258dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000105/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000105/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 125, --hostname, hd276dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd288dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd275dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000117/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000117/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 128, --hostname, hd257dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000111/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000111/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 127, --hostname, hd254dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000071/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000071/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 126, --hostname, hd281dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd280dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd279dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd293dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000041/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000041/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd266dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 129, --hostname, hd288dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000005/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000005/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd271dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 130, --hostname, hd275dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd278dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd265dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd292dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd262dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd270dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000099/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000099/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 131, --hostname, hd280dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000053/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000053/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000147/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000147/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000123/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000123/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 141, --hostname, hd270dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd283dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000171/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000171/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 133, --hostname, hd293dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000059/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000059/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd284dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000153/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000153/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 139, --hostname, hd292dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 135, --hostname, hd271dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 134, --hostname, hd266dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 140, --hostname, hd265dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000213/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000213/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 132, --hostname, hd279dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000129/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000129/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 142, --hostname, hd283dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000093/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000093/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 137, --hostname, hd262dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000195/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000195/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 136, --hostname, hd284dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000141/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000141/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 138, --hostname, hd278dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd256dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd274dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd261dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd286dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd255dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd282dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd277dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd273dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd260dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd291dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000029/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000029/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 143, --hostname, hd256dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000024/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd286dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000024/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000036/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd274dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000036/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000018/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd261dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000018/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 145, --hostname, hd261dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000202/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd255dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000202/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 144, --hostname, hd274dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd272dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 149, --hostname, hd286dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 148, --hostname, hd255dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd264dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd285dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd258dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000048/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd260dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000048/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 150, --hostname, hd260dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000208/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd273dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000208/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000012/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd291dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000012/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 151, --hostname, hd273dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000166/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd282dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000166/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000082/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd277dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000082/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 147, --hostname, hd282dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 152, --hostname, hd291dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 146, --hostname, hd277dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000184/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd272dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000184/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 154, --hostname, hd272dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000178/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd285dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000178/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 155, --hostname, hd285dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000066/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd264dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000066/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 153, --hostname, hd264dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd290dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000136/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd258dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000136/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 156, --hostname, hd258dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd263dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd289dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd276dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd281dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd254dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000190/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd290dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000190/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd257dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 157, --hostname, hd290dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd288dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd275dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd280dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd279dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000160/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd263dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000160/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 158, --hostname, hd263dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd293dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000072/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd281dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000072/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 161, --hostname, hd281dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd266dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000088/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd289dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000088/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000118/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd257dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000118/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000042/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd288dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000042/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 163, --hostname, hd257dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 164, --hostname, hd288dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000106/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd276dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000106/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000112/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd254dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000112/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 159, --hostname, hd289dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 162, --hostname, hd254dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 160, --hostname, hd276dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000100/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd280dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000100/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000214/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd279dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000214/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 166, --hostname, hd280dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000006/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd275dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000006/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000172/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd293dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000172/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 167, --hostname, hd279dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 168, --hostname, hd293dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 165, --hostname, hd275dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd271dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd284dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd262dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd278dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000054/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd266dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000054/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 169, --hostname, hd266dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd292dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000196/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd284dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000196/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 171, --hostname, hd284dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000148/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd271dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000148/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 170, --hostname, hd271dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd265dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000142/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd278dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000142/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 173, --hostname, hd278dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000094/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd262dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000094/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 172, --hostname, hd262dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000060/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd292dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000060/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 174, --hostname, hd292dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd270dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd283dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000154/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd265dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000154/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 175, --hostname, hd265dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Starting Executor Container
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Connecting to ContainerManager at hd256dg.prod.mediav.com:8041
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up ContainerLaunchContext
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Preparing Local resources
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000130/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd283dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000130/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Prepared Local resources Map(__app__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar", }, size: 453950, timestamp: 1442314210903, type: FILE, visibility: PRIVATE, , __spark__.jar -> resource {, scheme: "hdfs", host: "prod-hadoop", port: -1, file: "/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar", }, size: 129464792, timestamp: 1437055796697, type: FILE, visibility: PUBLIC, )
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000124/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd270dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000124/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 177, --hostname, hd283dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 176, --hostname, hd270dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with environment: Map(CLASSPATH -> $PWD:$PWD/__spark__.jar:$HADOOP_CONF_DIR:$HADOOP_COMMON_HOME/*:$HADOOP_COMMON_HOME/lib/*:$HADOOP_HDFS_HOME/*:$HADOOP_HDFS_HOME/lib/*:$HADOOP_MAPRED_HOME/*:$HADOOP_MAPRED_HOME/lib/*:$YARN_HOME/*:$YARN_HOME/lib/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/*:$HADOOP_MAPRED_HOME/share/hadoop/mapreduce/lib/*, SPARK_LOG_URL_STDERR -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000030/wuwm/stderr?start=0, SPARK_YARN_STAGING_DIR -> .sparkStaging/application_1442215126745_0068, SPARK_YARN_CACHE_FILES_FILE_SIZES -> 129464792,453950, SPARK_USER -> wuwm, SPARK_YARN_CACHE_FILES_VISIBILITIES -> PUBLIC,PRIVATE, SPARK_YARN_MODE -> true, SPARK_YARN_CACHE_FILES_TIME_STAMPS -> 1437055796697,1442314210903, SPARK_LOG_URL_STDOUT -> http://hd256dg.prod.mediav.com:8042/node/containerlogs/container_1442215126745_0068_01_000030/wuwm/stdout?start=0, SPARK_YARN_CACHE_FILES -> hdfs://prod-hadoop/data/spark/lib/spark-assembly-1.4.1-hadoop2.0.0-cdh4.6.0.jar#__spark__.jar,hdfs://prod-hadoop/user/wuwm/.sparkStaging/application_1442215126745_0068/gbdt-training.jar#__app__.jar)
> 15/09/15 18:50:23 INFO yarn.ExecutorRunnable: Setting up executor with commands: List(LD_LIBRARY_PATH="/usr/lib/hadoop/lib/native:$LD_LIBRARY_PATH", $JAVA_HOME/bin/java, -server, -XX:OnOutOfMemoryError='kill %p', -Xms16384m, -Xmx16384m, '-Xmn1G', '-XX:+UseG1GC', -Djava.io.tmpdir=$PWD/tmp, '-Dspark.akka.threads=4', '-Dspark.driver.port=29651', '-Dspark.akka.frameSize=100', '-Dspark.ui.port=0', -Dspark.yarn.app.container.log.dir=<LOG_DIR>, org.apache.spark.executor.CoarseGrainedExecutorBackend, --driver-url, akka.tcp://sparkDriver@10.47.1.38:29651/user/CoarseGrainedScheduler, --executor-id, 178, --hostname, hd256dg.prod.mediav.com, --cores, 1, --app-id, application_1442215126745_0068, --user-class-path, file:$PWD/__app__.jar, 1>, <LOG_DIR>/stdout, 2>, <LOG_DIR>/stderr)
> 15/09/15 18:50:23 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_0 tasks to pool default
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd262dg.prod.mediav.com:3830
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd262dg.prod.mediav.com:34647
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd262dg.prod.mediav.com:48884
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd287dg.prod.mediav.com:23635
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd262dg.prod.mediav.com:22149
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd287dg.prod.mediav.com:28432
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd287dg.prod.mediav.com:55051
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd262dg.prod.mediav.com:11335
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd274dg.prod.mediav.com:30615
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd282dg.prod.mediav.com:5903
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd280dg.prod.mediav.com:38789
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd260dg.prod.mediav.com:37968
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd283dg.prod.mediav.com:30374
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd285dg.prod.mediav.com:47533
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd266dg.prod.mediav.com:55432
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd281dg.prod.mediav.com:62732
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd276dg.prod.mediav.com:43506
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd289dg.prod.mediav.com:12002
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd291dg.prod.mediav.com:32064
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd254dg.prod.mediav.com:36047
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd254dg.prod.mediav.com:5455
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd293dg.prod.mediav.com:60875
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd263dg.prod.mediav.com:2024
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd280dg.prod.mediav.com:54638
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd291dg.prod.mediav.com:39476
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd254dg.prod.mediav.com:14354
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd263dg.prod.mediav.com:5166
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd276dg.prod.mediav.com:40605
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd274dg.prod.mediav.com:11509
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd257dg.prod.mediav.com:35637
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd275dg.prod.mediav.com:2951
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd291dg.prod.mediav.com:49805
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd271dg.prod.mediav.com:51820
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd263dg.prod.mediav.com:23530
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd257dg.prod.mediav.com:57061
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd289dg.prod.mediav.com:32369
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd285dg.prod.mediav.com:64379
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd286dg.prod.mediav.com:14816
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd260dg.prod.mediav.com:32507
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd290dg.prod.mediav.com:31700
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd266dg.prod.mediav.com:16527
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd274dg.prod.mediav.com:12494
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd270dg.prod.mediav.com:64118
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd261dg.prod.mediav.com:46185
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd256dg.prod.mediav.com:9450
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd282dg.prod.mediav.com:37937
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd281dg.prod.mediav.com:10572
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd286dg.prod.mediav.com:40534
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd281dg.prod.mediav.com:25805
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd272dg.prod.mediav.com:51683
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd290dg.prod.mediav.com:21427
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd288dg.prod.mediav.com:4310
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd276dg.prod.mediav.com:6017
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd288dg.prod.mediav.com:17573
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd291dg.prod.mediav.com:29129
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd264dg.prod.mediav.com:12486
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd266dg.prod.mediav.com:19604
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd260dg.prod.mediav.com:60231
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd290dg.prod.mediav.com:6912
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd280dg.prod.mediav.com:40712
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd271dg.prod.mediav.com:53888
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd291dg.prod.mediav.com:20478
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd263dg.prod.mediav.com:61076
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd272dg.prod.mediav.com:46483
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd286dg.prod.mediav.com:57085
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd293dg.prod.mediav.com:11460
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd257dg.prod.mediav.com:30094
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd277dg.prod.mediav.com:5858
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd277dg.prod.mediav.com:60897
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd288dg.prod.mediav.com:32710
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd286dg.prod.mediav.com:12029
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd285dg.prod.mediav.com:22098
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd284dg.prod.mediav.com:3035
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd293dg.prod.mediav.com:19872
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd281dg.prod.mediav.com:12851
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd285dg.prod.mediav.com:25660
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd293dg.prod.mediav.com:16205
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd257dg.prod.mediav.com:47823
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd275dg.prod.mediav.com:35975
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd288dg.prod.mediav.com:52666
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd284dg.prod.mediav.com:1972
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd271dg.prod.mediav.com:12931
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd257dg.prod.mediav.com:2562
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd293dg.prod.mediav.com:25481
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd278dg.prod.mediav.com:57571
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd289dg.prod.mediav.com:61642
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd278dg.prod.mediav.com:50569
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd280dg.prod.mediav.com:37371
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd261dg.prod.mediav.com:21889
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd274dg.prod.mediav.com:42061
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd260dg.prod.mediav.com:16173
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd270dg.prod.mediav.com:24041
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd261dg.prod.mediav.com:56035
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd288dg.prod.mediav.com:49791
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd286dg.prod.mediav.com:2049
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd282dg.prod.mediav.com:30963
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd292dg.prod.mediav.com:31151
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd254dg.prod.mediav.com:30831
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd292dg.prod.mediav.com:54990
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd285dg.prod.mediav.com:63413
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd284dg.prod.mediav.com:4464
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd282dg.prod.mediav.com:29682
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd274dg.prod.mediav.com:42220
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd276dg.prod.mediav.com:27249
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd263dg.prod.mediav.com:30436
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd256dg.prod.mediav.com:30685
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd280dg.prod.mediav.com:5202
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd292dg.prod.mediav.com:2998
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd270dg.prod.mediav.com:45694
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd272dg.prod.mediav.com:11955
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd278dg.prod.mediav.com:56400
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd283dg.prod.mediav.com:44832
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd260dg.prod.mediav.com:20191
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd270dg.prod.mediav.com:10424
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd283dg.prod.mediav.com:33605
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd272dg.prod.mediav.com:25956
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd278dg.prod.mediav.com:63429
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd292dg.prod.mediav.com:30225
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd290dg.prod.mediav.com:28198
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd271dg.prod.mediav.com:12279
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd281dg.prod.mediav.com:4984
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd261dg.prod.mediav.com:12084
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd278dg.prod.mediav.com:25951
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd284dg.prod.mediav.com:27309
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd266dg.prod.mediav.com:31919
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd282dg.prod.mediav.com:28707
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd277dg.prod.mediav.com:56279
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd264dg.prod.mediav.com:59144
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd255dg.prod.mediav.com:28208
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd289dg.prod.mediav.com:38334
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd255dg.prod.mediav.com:40821
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd264dg.prod.mediav.com:64319
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd264dg.prod.mediav.com:29625
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd284dg.prod.mediav.com:12548
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd273dg.prod.mediav.com:49607
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd283dg.prod.mediav.com:49114
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd256dg.prod.mediav.com:13206
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd261dg.prod.mediav.com:51965
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd276dg.prod.mediav.com:44290
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd273dg.prod.mediav.com:35956
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd272dg.prod.mediav.com:37308
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd277dg.prod.mediav.com:63909
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd254dg.prod.mediav.com:23106
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd256dg.prod.mediav.com:22458
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd271dg.prod.mediav.com:33696
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd275dg.prod.mediav.com:16058
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd264dg.prod.mediav.com:31093
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd273dg.prod.mediav.com:1051
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd275dg.prod.mediav.com:43976
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd270dg.prod.mediav.com:59108
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd266dg.prod.mediav.com:34492
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd292dg.prod.mediav.com:28918
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd256dg.prod.mediav.com:10140
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd289dg.prod.mediav.com:60813
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd283dg.prod.mediav.com:38130
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd290dg.prod.mediav.com:60980
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd255dg.prod.mediav.com:38603
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd273dg.prod.mediav.com:3269
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd277dg.prod.mediav.com:4052
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd255dg.prod.mediav.com:18667
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd275dg.prod.mediav.com:49526
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd273dg.prod.mediav.com:54387
> 15/09/15 18:50:26 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd262dg.prod.mediav.com:44599/user/Executor#-286579772]) with ID 65
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd265dg.prod.mediav.com:33962
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd279dg.prod.mediav.com:47156
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd279dg.prod.mediav.com:35543
> 15/09/15 18:50:26 INFO scheduler.TaskSetManager: Starting task 23.0 in stage 0.0 (TID 0, hd262dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd265dg.prod.mediav.com:59562
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd265dg.prod.mediav.com:37224
> 15/09/15 18:50:26 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd262dg.prod.mediav.com:46024/user/Executor#305996166]) with ID 101
> 15/09/15 18:50:26 INFO scheduler.TaskSetManager: Starting task 44.0 in stage 0.0 (TID 1, hd262dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:26 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd262dg.prod.mediav.com:9343/user/Executor#-1261226495]) with ID 172
> 15/09/15 18:50:26 INFO scheduler.TaskSetManager: Starting task 47.0 in stage 0.0 (TID 2, hd262dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:26 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd262dg.prod.mediav.com:34712/user/Executor#-240213204]) with ID 137
> 15/09/15 18:50:26 INFO scheduler.TaskSetManager: Starting task 112.0 in stage 0.0 (TID 3, hd262dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd258dg.prod.mediav.com:42541
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd258dg.prod.mediav.com:48564
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd279dg.prod.mediav.com:64784
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd279dg.prod.mediav.com:51620
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd279dg.prod.mediav.com:2891
> 15/09/15 18:50:26 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd265dg.prod.mediav.com:39926
> 15/09/15 18:50:27 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd258dg.prod.mediav.com:37599
> 15/09/15 18:50:27 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd265dg.prod.mediav.com:22169
> 15/09/15 18:50:27 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd258dg.prod.mediav.com:58582
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd262dg.prod.mediav.com:26036/user/Executor#-631528468]) with ID 29
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 129.0 in stage 0.0 (TID 4, hd262dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd258dg.prod.mediav.com:30052
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd291dg.prod.mediav.com:42873/user/Executor#1927004066]) with ID 45
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 19.0 in stage 0.0 (TID 5, hd291dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd287dg.prod.mediav.com:31412/user/Executor#1843642847]) with ID 72
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 60.0 in stage 0.0 (TID 6, hd287dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd281dg.prod.mediav.com:9842/user/Executor#1438294067]) with ID 54
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 137.0 in stage 0.0 (TID 7, hd281dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd287dg.prod.mediav.com:26691/user/Executor#2035640422]) with ID 108
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 104.0 in stage 0.0 (TID 8, hd287dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd282dg.prod.mediav.com:33258/user/Executor#-860497541]) with ID 76
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd280dg.prod.mediav.com:7297/user/Executor#-1826500061]) with ID 23
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 97.0 in stage 0.0 (TID 9, hd280dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd262dg.prod.mediav.com:35030 with 8.6 GB RAM, BlockManagerId(65, hd262dg.prod.mediav.com, 35030)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd287dg.prod.mediav.com:34921/user/Executor#-1444132110]) with ID 36
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd276dg.prod.mediav.com:53875/user/Executor#1844843451]) with ID 53
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 98.0 in stage 0.0 (TID 10, hd276dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd266dg.prod.mediav.com:61595/user/Executor#-1260960556]) with ID 62
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd262dg.prod.mediav.com:49994 with 8.6 GB RAM, BlockManagerId(101, hd262dg.prod.mediav.com, 49994)
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 139.0 in stage 0.0 (TID 11, hd266dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd260dg.prod.mediav.com:54790/user/Executor#-1525659401]) with ID 115
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd262dg.prod.mediav.com:40567 with 8.6 GB RAM, BlockManagerId(137, hd262dg.prod.mediav.com, 40567)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd285dg.prod.mediav.com:24488/user/Executor#681770952]) with ID 48
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd274dg.prod.mediav.com:5264/user/Executor#850594699]) with ID 1
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd283dg.prod.mediav.com:52786/user/Executor#375260350]) with ID 70
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd254dg.prod.mediav.com:39685/user/Executor#836663559]) with ID 55
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd289dg.prod.mediav.com:3993/user/Executor#-948255953]) with ID 52
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 115.0 in stage 0.0 (TID 12, hd289dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd254dg.prod.mediav.com:10583/user/Executor#-98105974]) with ID 91
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd287dg.prod.mediav.com:53041 with 8.6 GB RAM, BlockManagerId(108, hd287dg.prod.mediav.com, 53041)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd281dg.prod.mediav.com:2395 with 8.6 GB RAM, BlockManagerId(54, hd281dg.prod.mediav.com, 2395)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd280dg.prod.mediav.com:27479/user/Executor#806593419]) with ID 59
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd291dg.prod.mediav.com:31861 with 8.6 GB RAM, BlockManagerId(45, hd291dg.prod.mediav.com, 31861)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd287dg.prod.mediav.com:2547 with 8.6 GB RAM, BlockManagerId(36, hd287dg.prod.mediav.com, 2547)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd280dg.prod.mediav.com:1897 with 8.6 GB RAM, BlockManagerId(23, hd280dg.prod.mediav.com, 1897)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd276dg.prod.mediav.com:15025 with 8.6 GB RAM, BlockManagerId(53, hd276dg.prod.mediav.com, 15025)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd263dg.prod.mediav.com:36001/user/Executor#2015724387]) with ID 51
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd275dg.prod.mediav.com:59448/user/Executor#-743696016]) with ID 58
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd291dg.prod.mediav.com:14296/user/Executor#-322939320]) with ID 9
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd282dg.prod.mediav.com:47145 with 8.6 GB RAM, BlockManagerId(76, hd282dg.prod.mediav.com, 47145)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd293dg.prod.mediav.com:29486/user/Executor#355235889]) with ID 133
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd260dg.prod.mediav.com:20879 with 8.6 GB RAM, BlockManagerId(115, hd260dg.prod.mediav.com, 20879)
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 80.0 in stage 0.0 (TID 13, hd293dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd281dg.prod.mediav.com:19222/user/Executor#1443010090]) with ID 18
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd255dg.prod.mediav.com:53875/user/Executor#1153505479]) with ID 148
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd266dg.prod.mediav.com:60772 with 8.6 GB RAM, BlockManagerId(62, hd266dg.prod.mediav.com, 60772)
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 161.0 in stage 0.0 (TID 14, hd255dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd254dg.prod.mediav.com:14758/user/Executor#1639815949]) with ID 19
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd263dg.prod.mediav.com:16348/user/Executor#-819445026]) with ID 87
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd277dg.prod.mediav.com:59038/user/Executor#-481874934]) with ID 39
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd257dg.prod.mediav.com:48419/user/Executor#1277173238]) with ID 163
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd285dg.prod.mediav.com:15847/user/Executor#-759973001]) with ID 84
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd285dg.prod.mediav.com:7398 with 8.6 GB RAM, BlockManagerId(48, hd285dg.prod.mediav.com, 7398)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd274dg.prod.mediav.com:51526/user/Executor#2096899220]) with ID 37
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd291dg.prod.mediav.com:54651/user/Executor#-820252343]) with ID 152
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd290dg.prod.mediav.com:30012/user/Executor#-985909148]) with ID 157
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 102.0 in stage 0.0 (TID 15, hd290dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd266dg.prod.mediav.com:61823/user/Executor#-76787639]) with ID 98
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd272dg.prod.mediav.com:56601/user/Executor#-1282343332]) with ID 83
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd278dg.prod.mediav.com:57953/user/Executor#841437709]) with ID 66
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd256dg.prod.mediav.com:33466/user/Executor#1420351428]) with ID 71
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd255dg.prod.mediav.com:60243/user/Executor#-821655411]) with ID 41
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd261dg.prod.mediav.com:44258/user/Executor#-995187360]) with ID 110
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd254dg.prod.mediav.com:6401 with 8.6 GB RAM, BlockManagerId(55, hd254dg.prod.mediav.com, 6401)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd272dg.prod.mediav.com:7533/user/Executor#1797351652]) with ID 154
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd282dg.prod.mediav.com:48893/user/Executor#-193254225]) with ID 4
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd283dg.prod.mediav.com:19668 with 8.6 GB RAM, BlockManagerId(70, hd283dg.prod.mediav.com, 19668)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd256dg.prod.mediav.com:52901/user/Executor#-188708289]) with ID 143
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd274dg.prod.mediav.com:16654 with 8.6 GB RAM, BlockManagerId(1, hd274dg.prod.mediav.com, 16654)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd263dg.prod.mediav.com:1269/user/Executor#1162424859]) with ID 15
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd260dg.prod.mediav.com:35472/user/Executor#-1190050621]) with ID 150
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd271dg.prod.mediav.com:41012/user/Executor#1558950039]) with ID 135
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd270dg.prod.mediav.com:59921/user/Executor#1245200195]) with ID 176
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd288dg.prod.mediav.com:21820/user/Executor#1876535355]) with ID 129
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd289dg.prod.mediav.com:20447 with 8.6 GB RAM, BlockManagerId(52, hd289dg.prod.mediav.com, 20447)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd292dg.prod.mediav.com:10933/user/Executor#-1656233336]) with ID 174
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd255dg.prod.mediav.com:39363/user/Executor#-1938044900]) with ID 113
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd263dg.prod.mediav.com:41078/user/Executor#1676182649]) with ID 123
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd288dg.prod.mediav.com:41802/user/Executor#-243366962]) with ID 164
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd292dg.prod.mediav.com:38034/user/Executor#1250459028]) with ID 103
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd290dg.prod.mediav.com:36613/user/Executor#-1061372242]) with ID 50
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 133.0 in stage 0.0 (TID 16, hd290dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd275dg.prod.mediav.com:33978/user/Executor#1408606544]) with ID 94
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd264dg.prod.mediav.com:34852/user/Executor#884086869]) with ID 153
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd271dg.prod.mediav.com:12188/user/Executor#-1543984782]) with ID 27
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd293dg.prod.mediav.com:19339/user/Executor#-1057603292]) with ID 168
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd263dg.prod.mediav.com:58533/user/Executor#1477691403]) with ID 158
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd261dg.prod.mediav.com:63793/user/Executor#776697979]) with ID 145
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd289dg.prod.mediav.com:24623/user/Executor#-1241605049]) with ID 124
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd254dg.prod.mediav.com:14962 with 8.6 GB RAM, BlockManagerId(91, hd254dg.prod.mediav.com, 14962)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd286dg.prod.mediav.com:34890/user/Executor#577108799]) with ID 78
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd283dg.prod.mediav.com:55766/user/Executor#-2042900033]) with ID 177
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd271dg.prod.mediav.com:61387/user/Executor#492981340]) with ID 63
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd286dg.prod.mediav.com:49420/user/Executor#-448174640]) with ID 114
> 15/09/15 18:50:27 INFO yarn.ApplicationMaster$AMEndpoint: Driver terminated or disconnected! Shutting down. hd255dg.prod.mediav.com:32501
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd277dg.prod.mediav.com:62893/user/Executor#1381264528]) with ID 75
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd288dg.prod.mediav.com:19666/user/Executor#1512148061]) with ID 93
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd276dg.prod.mediav.com:40655/user/Executor#1011208267]) with ID 17
> 15/09/15 18:50:27 INFO scheduler.TaskSetManager: Starting task 169.0 in stage 0.0 (TID 17, hd276dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd256dg.prod.mediav.com:7308/user/Executor#-1108086900]) with ID 35
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd277dg.prod.mediav.com:64994/user/Executor#1615019822]) with ID 146
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd283dg.prod.mediav.com:34645/user/Executor#35388606]) with ID 142
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd290dg.prod.mediav.com:9588/user/Executor#-1202363980]) with ID 122
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd280dg.prod.mediav.com:6093 with 8.6 GB RAM, BlockManagerId(59, hd280dg.prod.mediav.com, 6093)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd276dg.prod.mediav.com:64837/user/Executor#-1955977938]) with ID 125
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd291dg.prod.mediav.com:37581/user/Executor#-846661087]) with ID 117
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd261dg.prod.mediav.com:62093/user/Executor#-228862337]) with ID 2
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd262dg.prod.mediav.com:40567 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd262dg.prod.mediav.com:35030 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd262dg.prod.mediav.com:49994 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd282dg.prod.mediav.com:3334/user/Executor#1355572708]) with ID 112
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd271dg.prod.mediav.com:59456/user/Executor#-826749893]) with ID 99
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd257dg.prod.mediav.com:45022/user/Executor#1279638718]) with ID 20
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd255dg.prod.mediav.com:13770/user/Executor#1591652082]) with ID 5
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd288dg.prod.mediav.com:35894/user/Executor#434023115]) with ID 21
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd263dg.prod.mediav.com:57200 with 8.6 GB RAM, BlockManagerId(51, hd263dg.prod.mediav.com, 57200)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd275dg.prod.mediav.com:33761/user/Executor#1974679179]) with ID 130
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd261dg.prod.mediav.com:48615/user/Executor#1551458319]) with ID 74
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd271dg.prod.mediav.com:5327/user/Executor#-1603374292]) with ID 170
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd293dg.prod.mediav.com:25809 with 8.6 GB RAM, BlockManagerId(133, hd293dg.prod.mediav.com, 25809)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd275dg.prod.mediav.com:7744 with 8.6 GB RAM, BlockManagerId(58, hd275dg.prod.mediav.com, 7744)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd292dg.prod.mediav.com:59726/user/Executor#1169598787]) with ID 139
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd264dg.prod.mediav.com:44245/user/Executor#-2106606855]) with ID 118
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd287dg.prod.mediav.com:2270 with 8.6 GB RAM, BlockManagerId(72, hd287dg.prod.mediav.com, 2270)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd284dg.prod.mediav.com:48439/user/Executor#-1254065602]) with ID 136
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd293dg.prod.mediav.com:11946/user/Executor#37098678]) with ID 97
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd289dg.prod.mediav.com:43879/user/Executor#1063313186]) with ID 16
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd260dg.prod.mediav.com:12398/user/Executor#18063718]) with ID 7
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd257dg.prod.mediav.com:6403 with 8.6 GB RAM, BlockManagerId(163, hd257dg.prod.mediav.com, 6403)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd270dg.prod.mediav.com:21056/user/Executor#-223070665]) with ID 105
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd257dg.prod.mediav.com:13474/user/Executor#55288937]) with ID 128
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd291dg.prod.mediav.com:15183/user/Executor#959662111]) with ID 81
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd290dg.prod.mediav.com:48698 with 8.6 GB RAM, BlockManagerId(157, hd290dg.prod.mediav.com, 48698)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd285dg.prod.mediav.com:20373/user/Executor#-1912327117]) with ID 120
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd257dg.prod.mediav.com:41407/user/Executor#1413018663]) with ID 56
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd274dg.prod.mediav.com:58299 with 8.6 GB RAM, BlockManagerId(37, hd274dg.prod.mediav.com, 58299)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd280dg.prod.mediav.com:19459/user/Executor#635192475]) with ID 166
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd270dg.prod.mediav.com:58654/user/Executor#-83694677]) with ID 69
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd274dg.prod.mediav.com:42844/user/Executor#1398346558]) with ID 144
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd276dg.prod.mediav.com:44102/user/Executor#-1483544095]) with ID 160
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd260dg.prod.mediav.com:39810/user/Executor#775515676]) with ID 43
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd280dg.prod.mediav.com:21984/user/Executor#-658808002]) with ID 95
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd281dg.prod.mediav.com:24432 with 8.6 GB RAM, BlockManagerId(18, hd281dg.prod.mediav.com, 24432)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd284dg.prod.mediav.com:57715/user/Executor#-545500019]) with ID 100
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd286dg.prod.mediav.com:34161/user/Executor#-110331883]) with ID 149
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd291dg.prod.mediav.com:9728 with 8.6 GB RAM, BlockManagerId(152, hd291dg.prod.mediav.com, 9728)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd286dg.prod.mediav.com:42269/user/Executor#1224563203]) with ID 42
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd263dg.prod.mediav.com:19616 with 8.6 GB RAM, BlockManagerId(87, hd263dg.prod.mediav.com, 19616)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd285dg.prod.mediav.com:65268/user/Executor#1498262927]) with ID 12
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd281dg.prod.mediav.com:17354/user/Executor#-946460307]) with ID 126
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd255dg.prod.mediav.com:62882 with 8.6 GB RAM, BlockManagerId(148, hd255dg.prod.mediav.com, 62882)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd278dg.prod.mediav.com:16567 with 8.6 GB RAM, BlockManagerId(66, hd278dg.prod.mediav.com, 16567)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd283dg.prod.mediav.com:60344/user/Executor#854187994]) with ID 106
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd291dg.prod.mediav.com:47717 with 8.6 GB RAM, BlockManagerId(9, hd291dg.prod.mediav.com, 47717)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd254dg.prod.mediav.com:40888/user/Executor#-1008311359]) with ID 127
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd285dg.prod.mediav.com:15892 with 8.6 GB RAM, BlockManagerId(84, hd285dg.prod.mediav.com, 15892)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd277dg.prod.mediav.com:60781 with 8.6 GB RAM, BlockManagerId(39, hd277dg.prod.mediav.com, 60781)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd277dg.prod.mediav.com:50809/user/Executor#415495995]) with ID 3
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd266dg.prod.mediav.com:27698 with 8.6 GB RAM, BlockManagerId(98, hd266dg.prod.mediav.com, 27698)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd263dg.prod.mediav.com:28737 with 8.6 GB RAM, BlockManagerId(15, hd263dg.prod.mediav.com, 28737)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd284dg.prod.mediav.com:23204/user/Executor#-1401695663]) with ID 64
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd270dg.prod.mediav.com:64691/user/Executor#1005216395]) with ID 33
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd261dg.prod.mediav.com:18064/user/Executor#-481596015]) with ID 38
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd272dg.prod.mediav.com:13836 with 8.6 GB RAM, BlockManagerId(83, hd272dg.prod.mediav.com, 13836)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd288dg.prod.mediav.com:53123/user/Executor#-507858527]) with ID 57
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd280dg.prod.mediav.com:61771/user/Executor#484402847]) with ID 131
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd288dg.prod.mediav.com:64716 with 8.6 GB RAM, BlockManagerId(129, hd288dg.prod.mediav.com, 64716)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd256dg.prod.mediav.com:4157 with 8.6 GB RAM, BlockManagerId(143, hd256dg.prod.mediav.com, 4157)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd272dg.prod.mediav.com:63317 with 8.6 GB RAM, BlockManagerId(154, hd272dg.prod.mediav.com, 63317)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd270dg.prod.mediav.com:32108/user/Executor#-1783453245]) with ID 141
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd255dg.prod.mediav.com:8336 with 8.6 GB RAM, BlockManagerId(41, hd255dg.prod.mediav.com, 8336)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd264dg.prod.mediav.com:41047/user/Executor#-328929010]) with ID 82
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd271dg.prod.mediav.com:45534 with 8.6 GB RAM, BlockManagerId(135, hd271dg.prod.mediav.com, 45534)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd278dg.prod.mediav.com:39877/user/Executor#-578202831]) with ID 30
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd256dg.prod.mediav.com:5214 with 8.6 GB RAM, BlockManagerId(71, hd256dg.prod.mediav.com, 5214)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd281dg.prod.mediav.com:63392/user/Executor#282533120]) with ID 161
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd283dg.prod.mediav.com:52335/user/Executor#530828928]) with ID 34
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd270dg.prod.mediav.com:5548 with 8.6 GB RAM, BlockManagerId(176, hd270dg.prod.mediav.com, 5548)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd261dg.prod.mediav.com:16786 with 8.6 GB RAM, BlockManagerId(110, hd261dg.prod.mediav.com, 16786)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd281dg.prod.mediav.com:53462/user/Executor#-291312463]) with ID 90
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd260dg.prod.mediav.com:7955 with 8.6 GB RAM, BlockManagerId(150, hd260dg.prod.mediav.com, 7955)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd275dg.prod.mediav.com:37869 with 8.6 GB RAM, BlockManagerId(94, hd275dg.prod.mediav.com, 37869)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd293dg.prod.mediav.com:40882/user/Executor#-442822794]) with ID 61
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd257dg.prod.mediav.com:18954/user/Executor#193835535]) with ID 92
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd275dg.prod.mediav.com:47140/user/Executor#-134333072]) with ID 165
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd272dg.prod.mediav.com:42770/user/Executor#-1955345389]) with ID 119
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd271dg.prod.mediav.com:63849 with 8.6 GB RAM, BlockManagerId(27, hd271dg.prod.mediav.com, 63849)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd256dg.prod.mediav.com:31292/user/Executor#2134863987]) with ID 107
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd282dg.prod.mediav.com:42230/user/Executor#-707246617]) with ID 40
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd274dg.prod.mediav.com:40430/user/Executor#-14696554]) with ID 73
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd260dg.prod.mediav.com:23318/user/Executor#-1051712968]) with ID 79
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd282dg.prod.mediav.com:42292 with 8.6 GB RAM, BlockManagerId(4, hd282dg.prod.mediav.com, 42292)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd278dg.prod.mediav.com:36645/user/Executor#1481710153]) with ID 173
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd292dg.prod.mediav.com:45417/user/Executor#-880594536]) with ID 67
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd293dg.prod.mediav.com:23628 with 8.6 GB RAM, BlockManagerId(168, hd293dg.prod.mediav.com, 23628)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd264dg.prod.mediav.com:6701/user/Executor#-587248355]) with ID 10
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd256dg.prod.mediav.com:16697/user/Executor#1872173882]) with ID 178
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd292dg.prod.mediav.com:18520/user/Executor#1822675287]) with ID 31
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd292dg.prod.mediav.com:9515 with 8.6 GB RAM, BlockManagerId(174, hd292dg.prod.mediav.com, 9515)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd285dg.prod.mediav.com:45503/user/Executor#1635268644]) with ID 155
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd293dg.prod.mediav.com:55071/user/Executor#132595206]) with ID 25
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd292dg.prod.mediav.com:31959 with 8.6 GB RAM, BlockManagerId(103, hd292dg.prod.mediav.com, 31959)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd286dg.prod.mediav.com:22509 with 8.6 GB RAM, BlockManagerId(114, hd286dg.prod.mediav.com, 22509)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd286dg.prod.mediav.com:64735/user/Executor#960436890]) with ID 6
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd273dg.prod.mediav.com:46229/user/Executor#-621682693]) with ID 80
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd278dg.prod.mediav.com:60479/user/Executor#-752308431]) with ID 102
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd288dg.prod.mediav.com:58225 with 8.6 GB RAM, BlockManagerId(164, hd288dg.prod.mediav.com, 58225)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd261dg.prod.mediav.com:17918 with 8.6 GB RAM, BlockManagerId(145, hd261dg.prod.mediav.com, 17918)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd289dg.prod.mediav.com:48417 with 8.6 GB RAM, BlockManagerId(124, hd289dg.prod.mediav.com, 48417)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd288dg.prod.mediav.com:3459 with 8.6 GB RAM, BlockManagerId(93, hd288dg.prod.mediav.com, 3459)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd266dg.prod.mediav.com:10664/user/Executor#60318011]) with ID 26
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd290dg.prod.mediav.com:27328/user/Executor#230661053]) with ID 14
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd284dg.prod.mediav.com:41874/user/Executor#953855936]) with ID 171
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd283dg.prod.mediav.com:15357 with 8.6 GB RAM, BlockManagerId(177, hd283dg.prod.mediav.com, 15357)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd275dg.prod.mediav.com:41770/user/Executor#1426814105]) with ID 22
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd264dg.prod.mediav.com:38843 with 8.6 GB RAM, BlockManagerId(153, hd264dg.prod.mediav.com, 38843)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd266dg.prod.mediav.com:8634/user/Executor#974371141]) with ID 169
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd254dg.prod.mediav.com:60094/user/Executor#1965647154]) with ID 162
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd276dg.prod.mediav.com:65222 with 8.6 GB RAM, BlockManagerId(17, hd276dg.prod.mediav.com, 65222)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd291dg.prod.mediav.com:31861 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd281dg.prod.mediav.com:2395 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd286dg.prod.mediav.com:64184 with 8.6 GB RAM, BlockManagerId(78, hd286dg.prod.mediav.com, 64184)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd277dg.prod.mediav.com:50355/user/Executor#2016822248]) with ID 111
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd274dg.prod.mediav.com:39271/user/Executor#811706269]) with ID 109
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd290dg.prod.mediav.com:1034 with 8.6 GB RAM, BlockManagerId(50, hd290dg.prod.mediav.com, 1034)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd278dg.prod.mediav.com:12406/user/Executor#-1637512681]) with ID 138
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd289dg.prod.mediav.com:33137/user/Executor#977911863]) with ID 159
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd282dg.prod.mediav.com:10051/user/Executor#-2063918040]) with ID 147
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd289dg.prod.mediav.com:58218/user/Executor#-792536670]) with ID 88
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd273dg.prod.mediav.com:7925/user/Executor#-4635176]) with ID 44
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd283dg.prod.mediav.com:62866 with 8.6 GB RAM, BlockManagerId(142, hd283dg.prod.mediav.com, 62866)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd290dg.prod.mediav.com:58202/user/Executor#1446968348]) with ID 86
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd266dg.prod.mediav.com:47658/user/Executor#175417760]) with ID 134
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd261dg.prod.mediav.com:48502 with 8.6 GB RAM, BlockManagerId(74, hd261dg.prod.mediav.com, 48502)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd276dg.prod.mediav.com:45572/user/Executor#1487470075]) with ID 89
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd273dg.prod.mediav.com:36978/user/Executor#-1049030074]) with ID 116
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd257dg.prod.mediav.com:13672 with 8.6 GB RAM, BlockManagerId(20, hd257dg.prod.mediav.com, 13672)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd272dg.prod.mediav.com:16824/user/Executor#-1793400714]) with ID 11
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd284dg.prod.mediav.com:25270/user/Executor#654396108]) with ID 28
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd256dg.prod.mediav.com:65180 with 8.6 GB RAM, BlockManagerId(35, hd256dg.prod.mediav.com, 65180)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd271dg.prod.mediav.com:11439 with 8.6 GB RAM, BlockManagerId(63, hd271dg.prod.mediav.com, 11439)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd264dg.prod.mediav.com:50679/user/Executor#685270151]) with ID 46
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd277dg.prod.mediav.com:27612 with 8.6 GB RAM, BlockManagerId(75, hd277dg.prod.mediav.com, 27612)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd272dg.prod.mediav.com:32595/user/Executor#-599498795]) with ID 47
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd280dg.prod.mediav.com:1897 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd276dg.prod.mediav.com:21872 with 8.6 GB RAM, BlockManagerId(125, hd276dg.prod.mediav.com, 21872)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd273dg.prod.mediav.com:36509/user/Executor#1606966554]) with ID 8
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd282dg.prod.mediav.com:57776 with 8.6 GB RAM, BlockManagerId(112, hd282dg.prod.mediav.com, 57776)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd266dg.prod.mediav.com:60772 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd273dg.prod.mediav.com:22967/user/Executor#1775881363]) with ID 151
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd287dg.prod.mediav.com:53041 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd265dg.prod.mediav.com:60697/user/Executor#-33490033]) with ID 104
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd265dg.prod.mediav.com:26927/user/Executor#1748242505]) with ID 32
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd285dg.prod.mediav.com:52469 with 8.6 GB RAM, BlockManagerId(120, hd285dg.prod.mediav.com, 52469)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd262dg.prod.mediav.com:24194 with 8.6 GB RAM, BlockManagerId(172, hd262dg.prod.mediav.com, 24194)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd270dg.prod.mediav.com:3332 with 8.6 GB RAM, BlockManagerId(105, hd270dg.prod.mediav.com, 3332)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd265dg.prod.mediav.com:30493/user/Executor#1869772801]) with ID 175
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd264dg.prod.mediav.com:48358 with 8.6 GB RAM, BlockManagerId(118, hd264dg.prod.mediav.com, 48358)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd265dg.prod.mediav.com:45554/user/Executor#-839041598]) with ID 140
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd274dg.prod.mediav.com:25030 with 8.6 GB RAM, BlockManagerId(144, hd274dg.prod.mediav.com, 25030)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd258dg.prod.mediav.com:31985/user/Executor#1803292015]) with ID 121
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd284dg.prod.mediav.com:46214 with 8.6 GB RAM, BlockManagerId(100, hd284dg.prod.mediav.com, 46214)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd284dg.prod.mediav.com:33099 with 8.6 GB RAM, BlockManagerId(136, hd284dg.prod.mediav.com, 33099)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd279dg.prod.mediav.com:44656/user/Executor#1814026786]) with ID 167
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd281dg.prod.mediav.com:12163 with 8.6 GB RAM, BlockManagerId(126, hd281dg.prod.mediav.com, 12163)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd258dg.prod.mediav.com:56446/user/Executor#-1058219905]) with ID 49
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd276dg.prod.mediav.com:46848 with 8.6 GB RAM, BlockManagerId(160, hd276dg.prod.mediav.com, 46848)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd279dg.prod.mediav.com:52572/user/Executor#1274095730]) with ID 24
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd279dg.prod.mediav.com:1403/user/Executor#2094018840]) with ID 60
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd258dg.prod.mediav.com:27227/user/Executor#1584872503]) with ID 156
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd258dg.prod.mediav.com:59526/user/Executor#-1207197872]) with ID 13
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd265dg.prod.mediav.com:35269/user/Executor#997557489]) with ID 68
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd258dg.prod.mediav.com:52760/user/Executor#870980249]) with ID 85
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd279dg.prod.mediav.com:38410/user/Executor#1995283686]) with ID 132
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd279dg.prod.mediav.com:24917/user/Executor#-892212294]) with ID 96
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd264dg.prod.mediav.com:49664 with 8.6 GB RAM, BlockManagerId(82, hd264dg.prod.mediav.com, 49664)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd278dg.prod.mediav.com:1380 with 8.6 GB RAM, BlockManagerId(173, hd278dg.prod.mediav.com, 1380)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd289dg.prod.mediav.com:20447 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd276dg.prod.mediav.com:15025 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd278dg.prod.mediav.com:9221 with 8.6 GB RAM, BlockManagerId(30, hd278dg.prod.mediav.com, 9221)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd266dg.prod.mediav.com:7561 with 8.6 GB RAM, BlockManagerId(26, hd266dg.prod.mediav.com, 7561)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd291dg.prod.mediav.com:54360 with 8.6 GB RAM, BlockManagerId(117, hd291dg.prod.mediav.com, 54360)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd272dg.prod.mediav.com:63093 with 8.6 GB RAM, BlockManagerId(119, hd272dg.prod.mediav.com, 63093)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd275dg.prod.mediav.com:3649 with 8.6 GB RAM, BlockManagerId(22, hd275dg.prod.mediav.com, 3649)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd285dg.prod.mediav.com:57578 with 8.6 GB RAM, BlockManagerId(12, hd285dg.prod.mediav.com, 57578)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd273dg.prod.mediav.com:4400 with 8.6 GB RAM, BlockManagerId(80, hd273dg.prod.mediav.com, 4400)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd261dg.prod.mediav.com:35424 with 8.6 GB RAM, BlockManagerId(2, hd261dg.prod.mediav.com, 35424)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd272dg.prod.mediav.com:47434 with 8.6 GB RAM, BlockManagerId(11, hd272dg.prod.mediav.com, 47434)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd277dg.prod.mediav.com:17325 with 8.6 GB RAM, BlockManagerId(111, hd277dg.prod.mediav.com, 17325)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd292dg.prod.mediav.com:24852 with 8.6 GB RAM, BlockManagerId(139, hd292dg.prod.mediav.com, 24852)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd290dg.prod.mediav.com:48698 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd273dg.prod.mediav.com:51855 with 8.6 GB RAM, BlockManagerId(44, hd273dg.prod.mediav.com, 51855)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd256dg.prod.mediav.com:54569 with 8.6 GB RAM, BlockManagerId(178, hd256dg.prod.mediav.com, 54569)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd265dg.prod.mediav.com:65261 with 8.6 GB RAM, BlockManagerId(104, hd265dg.prod.mediav.com, 65261)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd273dg.prod.mediav.com:19800 with 8.6 GB RAM, BlockManagerId(116, hd273dg.prod.mediav.com, 19800)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd264dg.prod.mediav.com:28057 with 8.6 GB RAM, BlockManagerId(10, hd264dg.prod.mediav.com, 28057)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd265dg.prod.mediav.com:15593 with 8.6 GB RAM, BlockManagerId(175, hd265dg.prod.mediav.com, 15593)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd282dg.prod.mediav.com:54259 with 8.6 GB RAM, BlockManagerId(40, hd282dg.prod.mediav.com, 54259)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd262dg.prod.mediav.com:49994 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd293dg.prod.mediav.com:25809 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd265dg.prod.mediav.com:62939 with 8.6 GB RAM, BlockManagerId(32, hd265dg.prod.mediav.com, 62939)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd262dg.prod.mediav.com:35030 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd290dg.prod.mediav.com:1034 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd287dg.prod.mediav.com:2270 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO cluster.YarnClusterSchedulerBackend: Registered executor: AkkaRpcEndpointRef(Actor[akka.tcp://sparkExecutor@hd255dg.prod.mediav.com:59546/user/Executor#-58897741]) with ID 77
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd262dg.prod.mediav.com:40567 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd292dg.prod.mediav.com:8313 with 8.6 GB RAM, BlockManagerId(67, hd292dg.prod.mediav.com, 8313)
> 15/09/15 18:50:27 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd255dg.prod.mediav.com:62882 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd258dg.prod.mediav.com:3750 with 8.6 GB RAM, BlockManagerId(121, hd258dg.prod.mediav.com, 3750)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd258dg.prod.mediav.com:44194 with 8.6 GB RAM, BlockManagerId(13, hd258dg.prod.mediav.com, 44194)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd258dg.prod.mediav.com:8532 with 8.6 GB RAM, BlockManagerId(85, hd258dg.prod.mediav.com, 8532)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd258dg.prod.mediav.com:30778 with 8.6 GB RAM, BlockManagerId(49, hd258dg.prod.mediav.com, 30778)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd280dg.prod.mediav.com:8788 with 8.6 GB RAM, BlockManagerId(166, hd280dg.prod.mediav.com, 8788)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd258dg.prod.mediav.com:61558 with 8.6 GB RAM, BlockManagerId(156, hd258dg.prod.mediav.com, 61558)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd289dg.prod.mediav.com:5555 with 8.6 GB RAM, BlockManagerId(16, hd289dg.prod.mediav.com, 5555)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd279dg.prod.mediav.com:49996 with 8.6 GB RAM, BlockManagerId(24, hd279dg.prod.mediav.com, 49996)
> 15/09/15 18:50:27 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd279dg.prod.mediav.com:34291 with 8.6 GB RAM, BlockManagerId(167, hd279dg.prod.mediav.com, 34291)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd279dg.prod.mediav.com:11149 with 8.6 GB RAM, BlockManagerId(132, hd279dg.prod.mediav.com, 11149)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd279dg.prod.mediav.com:34009 with 8.6 GB RAM, BlockManagerId(96, hd279dg.prod.mediav.com, 34009)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd279dg.prod.mediav.com:12678 with 8.6 GB RAM, BlockManagerId(60, hd279dg.prod.mediav.com, 12678)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd288dg.prod.mediav.com:30986 with 8.6 GB RAM, BlockManagerId(57, hd288dg.prod.mediav.com, 30986)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd276dg.prod.mediav.com:65222 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd254dg.prod.mediav.com:50339 with 8.6 GB RAM, BlockManagerId(162, hd254dg.prod.mediav.com, 50339)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd265dg.prod.mediav.com:41028 with 8.6 GB RAM, BlockManagerId(68, hd265dg.prod.mediav.com, 41028)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd262dg.prod.mediav.com:24194 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd255dg.prod.mediav.com:29011 with 8.6 GB RAM, BlockManagerId(5, hd255dg.prod.mediav.com, 29011)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd291dg.prod.mediav.com:31861 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd280dg.prod.mediav.com:1897 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd266dg.prod.mediav.com:60772 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd273dg.prod.mediav.com:6601 with 8.6 GB RAM, BlockManagerId(151, hd273dg.prod.mediav.com, 6601)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd257dg.prod.mediav.com:11991 with 8.6 GB RAM, BlockManagerId(128, hd257dg.prod.mediav.com, 11991)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd281dg.prod.mediav.com:2395 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd287dg.prod.mediav.com:53041 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd276dg.prod.mediav.com:15025 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd256dg.prod.mediav.com:22567 with 8.6 GB RAM, BlockManagerId(107, hd256dg.prod.mediav.com, 22567)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd270dg.prod.mediav.com:35197 with 8.6 GB RAM, BlockManagerId(141, hd270dg.prod.mediav.com, 35197)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd284dg.prod.mediav.com:55335 with 8.6 GB RAM, BlockManagerId(28, hd284dg.prod.mediav.com, 55335)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd289dg.prod.mediav.com:20447 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd281dg.prod.mediav.com:61667 with 8.6 GB RAM, BlockManagerId(90, hd281dg.prod.mediav.com, 61667)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd286dg.prod.mediav.com:20786 with 8.6 GB RAM, BlockManagerId(149, hd286dg.prod.mediav.com, 20786)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd285dg.prod.mediav.com:25860 with 8.6 GB RAM, BlockManagerId(155, hd285dg.prod.mediav.com, 25860)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd290dg.prod.mediav.com:48698 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd283dg.prod.mediav.com:5777 with 8.6 GB RAM, BlockManagerId(106, hd283dg.prod.mediav.com, 5777)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd293dg.prod.mediav.com:46714 with 8.6 GB RAM, BlockManagerId(97, hd293dg.prod.mediav.com, 46714)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd260dg.prod.mediav.com:38400 with 8.6 GB RAM, BlockManagerId(79, hd260dg.prod.mediav.com, 38400)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd266dg.prod.mediav.com:60871 with 8.6 GB RAM, BlockManagerId(169, hd266dg.prod.mediav.com, 60871)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd290dg.prod.mediav.com:6793 with 8.6 GB RAM, BlockManagerId(14, hd290dg.prod.mediav.com, 6793)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd290dg.prod.mediav.com:1034 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd282dg.prod.mediav.com:51731 with 8.6 GB RAM, BlockManagerId(147, hd282dg.prod.mediav.com, 51731)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd287dg.prod.mediav.com:2270 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd293dg.prod.mediav.com:25809 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd278dg.prod.mediav.com:27239 with 8.6 GB RAM, BlockManagerId(138, hd278dg.prod.mediav.com, 27239)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd291dg.prod.mediav.com:3890 with 8.6 GB RAM, BlockManagerId(81, hd291dg.prod.mediav.com, 3890)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd275dg.prod.mediav.com:52956 with 8.6 GB RAM, BlockManagerId(130, hd275dg.prod.mediav.com, 52956)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd262dg.prod.mediav.com:24194 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd255dg.prod.mediav.com:62882 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd276dg.prod.mediav.com:65222 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd257dg.prod.mediav.com:23974 with 8.6 GB RAM, BlockManagerId(92, hd257dg.prod.mediav.com, 23974)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd289dg.prod.mediav.com:22644 with 8.6 GB RAM, BlockManagerId(159, hd289dg.prod.mediav.com, 22644)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd272dg.prod.mediav.com:36193 with 8.6 GB RAM, BlockManagerId(47, hd272dg.prod.mediav.com, 36193)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd280dg.prod.mediav.com:29265 with 8.6 GB RAM, BlockManagerId(131, hd280dg.prod.mediav.com, 29265)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd276dg.prod.mediav.com:62943 with 8.6 GB RAM, BlockManagerId(89, hd276dg.prod.mediav.com, 62943)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd263dg.prod.mediav.com:5872 with 8.6 GB RAM, BlockManagerId(123, hd263dg.prod.mediav.com, 5872)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd288dg.prod.mediav.com:15935 with 8.6 GB RAM, BlockManagerId(21, hd288dg.prod.mediav.com, 15935)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd286dg.prod.mediav.com:5189 with 8.6 GB RAM, BlockManagerId(42, hd286dg.prod.mediav.com, 5189)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd292dg.prod.mediav.com:5167 with 8.6 GB RAM, BlockManagerId(31, hd292dg.prod.mediav.com, 5167)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd274dg.prod.mediav.com:44964 with 8.6 GB RAM, BlockManagerId(109, hd274dg.prod.mediav.com, 44964)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd265dg.prod.mediav.com:38596 with 8.6 GB RAM, BlockManagerId(140, hd265dg.prod.mediav.com, 38596)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd277dg.prod.mediav.com:27951 with 8.6 GB RAM, BlockManagerId(146, hd277dg.prod.mediav.com, 27951)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd262dg.prod.mediav.com:5957 with 8.6 GB RAM, BlockManagerId(29, hd262dg.prod.mediav.com, 5957)
> 15/09/15 18:50:28 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd290dg.prod.mediav.com:48176 with 8.6 GB RAM, BlockManagerId(86, hd290dg.prod.mediav.com, 48176)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd280dg.prod.mediav.com:4198 with 8.6 GB RAM, BlockManagerId(95, hd280dg.prod.mediav.com, 4198)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd271dg.prod.mediav.com:16160 with 8.6 GB RAM, BlockManagerId(99, hd271dg.prod.mediav.com, 16160)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd255dg.prod.mediav.com:22114 with 8.6 GB RAM, BlockManagerId(113, hd255dg.prod.mediav.com, 22114)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd257dg.prod.mediav.com:50217 with 8.6 GB RAM, BlockManagerId(56, hd257dg.prod.mediav.com, 50217)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd293dg.prod.mediav.com:18866 with 8.6 GB RAM, BlockManagerId(61, hd293dg.prod.mediav.com, 18866)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd266dg.prod.mediav.com:18054 with 8.6 GB RAM, BlockManagerId(134, hd266dg.prod.mediav.com, 18054)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd273dg.prod.mediav.com:35935 with 8.6 GB RAM, BlockManagerId(8, hd273dg.prod.mediav.com, 35935)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd270dg.prod.mediav.com:33090 with 8.6 GB RAM, BlockManagerId(33, hd270dg.prod.mediav.com, 33090)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd263dg.prod.mediav.com:30335 with 8.6 GB RAM, BlockManagerId(158, hd263dg.prod.mediav.com, 30335)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd254dg.prod.mediav.com:37252 with 8.6 GB RAM, BlockManagerId(127, hd254dg.prod.mediav.com, 37252)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd261dg.prod.mediav.com:51708 with 8.6 GB RAM, BlockManagerId(38, hd261dg.prod.mediav.com, 51708)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd264dg.prod.mediav.com:48038 with 8.6 GB RAM, BlockManagerId(46, hd264dg.prod.mediav.com, 48038)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd262dg.prod.mediav.com:5957 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd281dg.prod.mediav.com:2780 with 8.6 GB RAM, BlockManagerId(161, hd281dg.prod.mediav.com, 2780)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd284dg.prod.mediav.com:65293 with 8.6 GB RAM, BlockManagerId(171, hd284dg.prod.mediav.com, 65293)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd278dg.prod.mediav.com:27815 with 8.6 GB RAM, BlockManagerId(102, hd278dg.prod.mediav.com, 27815)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd275dg.prod.mediav.com:27702 with 8.6 GB RAM, BlockManagerId(165, hd275dg.prod.mediav.com, 27702)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd283dg.prod.mediav.com:27671 with 8.6 GB RAM, BlockManagerId(34, hd283dg.prod.mediav.com, 27671)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd286dg.prod.mediav.com:15531 with 8.6 GB RAM, BlockManagerId(6, hd286dg.prod.mediav.com, 15531)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd262dg.prod.mediav.com:5957 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd289dg.prod.mediav.com:48937 with 8.6 GB RAM, BlockManagerId(88, hd289dg.prod.mediav.com, 48937)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd270dg.prod.mediav.com:6944 with 8.6 GB RAM, BlockManagerId(69, hd270dg.prod.mediav.com, 6944)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_97 in memory on hd280dg.prod.mediav.com:1897 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_19 in memory on hd291dg.prod.mediav.com:31861 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_137 in memory on hd281dg.prod.mediav.com:2395 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_139 in memory on hd266dg.prod.mediav.com:60772 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO scheduler.TaskSetManager: Finished task 19.0 in stage 0.0 (TID 5) in 2807 ms on hd291dg.prod.mediav.com (1/200)
> 15/09/15 18:50:29 INFO scheduler.TaskSetManager: Finished task 97.0 in stage 0.0 (TID 9) in 2785 ms on hd280dg.prod.mediav.com (2/200)
> 15/09/15 18:50:29 INFO scheduler.TaskSetManager: Finished task 137.0 in stage 0.0 (TID 7) in 2813 ms on hd281dg.prod.mediav.com (3/200)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd290dg.prod.mediav.com:25045 with 8.6 GB RAM, BlockManagerId(122, hd290dg.prod.mediav.com, 25045)
> 15/09/15 18:50:29 INFO scheduler.TaskSetManager: Finished task 139.0 in stage 0.0 (TID 11) in 2770 ms on hd266dg.prod.mediav.com (4/200)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd260dg.prod.mediav.com:45170 with 8.6 GB RAM, BlockManagerId(7, hd260dg.prod.mediav.com, 45170)
> 15/09/15 18:50:29 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd274dg.prod.mediav.com:50461 with 8.6 GB RAM, BlockManagerId(73, hd274dg.prod.mediav.com, 50461)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_115 in memory on hd289dg.prod.mediav.com:20447 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_98 in memory on hd276dg.prod.mediav.com:15025 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_112 in memory on hd262dg.prod.mediav.com:40567 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:29 INFO scheduler.TaskSetManager: Finished task 115.0 in stage 0.0 (TID 12) in 2805 ms on hd289dg.prod.mediav.com (5/200)
> 15/09/15 18:50:29 INFO storage.BlockManagerInfo: Added rdd_4_44 in memory on hd262dg.prod.mediav.com:49994 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 112.0 in stage 0.0 (TID 3) in 3016 ms on hd262dg.prod.mediav.com (6/200)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 98.0 in stage 0.0 (TID 10) in 2883 ms on hd276dg.prod.mediav.com (7/200)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 44.0 in stage 0.0 (TID 1) in 3050 ms on hd262dg.prod.mediav.com (8/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd255dg.prod.mediav.com:24822 with 8.6 GB RAM, BlockManagerId(77, hd255dg.prod.mediav.com, 24822)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd271dg.prod.mediav.com:33037 with 8.6 GB RAM, BlockManagerId(170, hd271dg.prod.mediav.com, 33037)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd293dg.prod.mediav.com:60417 with 8.6 GB RAM, BlockManagerId(25, hd293dg.prod.mediav.com, 60417)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_133 in memory on hd290dg.prod.mediav.com:1034 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_102 in memory on hd290dg.prod.mediav.com:48698 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 133.0 in stage 0.0 (TID 16) in 2733 ms on hd290dg.prod.mediav.com (9/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_104 in memory on hd287dg.prod.mediav.com:53041 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 102.0 in stage 0.0 (TID 15) in 2824 ms on hd290dg.prod.mediav.com (10/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_80 in memory on hd293dg.prod.mediav.com:25809 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_23 in memory on hd262dg.prod.mediav.com:35030 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 104.0 in stage 0.0 (TID 8) in 3127 ms on hd287dg.prod.mediav.com (11/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd254dg.prod.mediav.com:28306 with 8.6 GB RAM, BlockManagerId(19, hd254dg.prod.mediav.com, 28306)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 80.0 in stage 0.0 (TID 13) in 2905 ms on hd293dg.prod.mediav.com (12/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_161 in memory on hd255dg.prod.mediav.com:62882 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 23.0 in stage 0.0 (TID 0) in 3278 ms on hd262dg.prod.mediav.com (13/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_60 in memory on hd287dg.prod.mediav.com:2270 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_169 in memory on hd276dg.prod.mediav.com:65222 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 161.0 in stage 0.0 (TID 14) in 2961 ms on hd255dg.prod.mediav.com (14/200)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 60.0 in stage 0.0 (TID 6) in 3245 ms on hd287dg.prod.mediav.com (15/200)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 169.0 in stage 0.0 (TID 17) in 2876 ms on hd276dg.prod.mediav.com (16/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerInfo: Added rdd_4_47 in memory on hd262dg.prod.mediav.com:24194 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Finished task 47.0 in stage 0.0 (TID 2) in 3441 ms on hd262dg.prod.mediav.com (17/200)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd277dg.prod.mediav.com:6547 with 8.6 GB RAM, BlockManagerId(3, hd277dg.prod.mediav.com, 6547)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd260dg.prod.mediav.com:34432 with 8.6 GB RAM, BlockManagerId(43, hd260dg.prod.mediav.com, 34432)
> 15/09/15 18:50:30 INFO storage.BlockManagerMasterEndpoint: Registering block manager hd284dg.prod.mediav.com:39393 with 8.6 GB RAM, BlockManagerId(64, hd284dg.prod.mediav.com, 39393)
> 15/09/15 18:50:30 INFO scheduler.TaskSetManager: Starting task 174.0 in stage 0.0 (TID 18, hd293dg.prod.mediav.com, RACK_LOCAL, 1425 bytes)
> 15/09/15 18:50:31 INFO storage.BlockManagerInfo: Added rdd_4_129 in memory on hd262dg.prod.mediav.com:5957 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:31 INFO scheduler.TaskSetManager: Finished task 129.0 in stage 0.0 (TID 4) in 4431 ms on hd262dg.prod.mediav.com (18/200)
> 15/09/15 18:50:31 INFO storage.BlockManagerInfo: Added rdd_4_174 in memory on hd293dg.prod.mediav.com:25809 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:31 INFO scheduler.TaskSetManager: Finished task 174.0 in stage 0.0 (TID 18) in 927 ms on hd293dg.prod.mediav.com (19/200)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 0.0 (TID 19, hd292dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 0.0 (TID 20, hd287dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 2.0 in stage 0.0 (TID 21, hd288dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 3.0 in stage 0.0 (TID 22, hd292dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 4.0 in stage 0.0 (TID 23, hd258dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 5.0 in stage 0.0 (TID 24, hd254dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 6.0 in stage 0.0 (TID 25, hd262dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 7.0 in stage 0.0 (TID 26, hd291dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 8.0 in stage 0.0 (TID 27, hd282dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 9.0 in stage 0.0 (TID 28, hd262dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 10.0 in stage 0.0 (TID 29, hd261dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 11.0 in stage 0.0 (TID 30, hd290dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 12.0 in stage 0.0 (TID 31, hd265dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 13.0 in stage 0.0 (TID 32, hd262dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 14.0 in stage 0.0 (TID 33, hd274dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 15.0 in stage 0.0 (TID 34, hd285dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 16.0 in stage 0.0 (TID 35, hd285dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 17.0 in stage 0.0 (TID 36, hd260dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 18.0 in stage 0.0 (TID 37, hd270dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 20.0 in stage 0.0 (TID 38, hd266dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 21.0 in stage 0.0 (TID 39, hd284dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 22.0 in stage 0.0 (TID 40, hd293dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 24.0 in stage 0.0 (TID 41, hd271dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 25.0 in stage 0.0 (TID 42, hd291dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 26.0 in stage 0.0 (TID 43, hd278dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 27.0 in stage 0.0 (TID 44, hd271dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 28.0 in stage 0.0 (TID 45, hd266dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 29.0 in stage 0.0 (TID 46, hd287dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 30.0 in stage 0.0 (TID 47, hd283dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 31.0 in stage 0.0 (TID 48, hd277dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 32.0 in stage 0.0 (TID 49, hd293dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 33.0 in stage 0.0 (TID 50, hd274dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 34.0 in stage 0.0 (TID 51, hd288dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 35.0 in stage 0.0 (TID 52, hd263dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 36.0 in stage 0.0 (TID 53, hd257dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 37.0 in stage 0.0 (TID 54, hd256dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 38.0 in stage 0.0 (TID 55, hd260dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 39.0 in stage 0.0 (TID 56, hd279dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 40.0 in stage 0.0 (TID 57, hd283dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 41.0 in stage 0.0 (TID 58, hd262dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 42.0 in stage 0.0 (TID 59, hd289dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 43.0 in stage 0.0 (TID 60, hd291dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 45.0 in stage 0.0 (TID 61, hd289dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 46.0 in stage 0.0 (TID 62, hd282dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 48.0 in stage 0.0 (TID 63, hd256dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 49.0 in stage 0.0 (TID 64, hd293dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 50.0 in stage 0.0 (TID 65, hd291dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 51.0 in stage 0.0 (TID 66, hd286dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 52.0 in stage 0.0 (TID 67, hd257dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 53.0 in stage 0.0 (TID 68, hd275dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 54.0 in stage 0.0 (TID 69, hd272dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 55.0 in stage 0.0 (TID 70, hd278dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 56.0 in stage 0.0 (TID 71, hd276dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 57.0 in stage 0.0 (TID 72, hd266dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 58.0 in stage 0.0 (TID 73, hd287dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 59.0 in stage 0.0 (TID 74, hd280dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 61.0 in stage 0.0 (TID 75, hd270dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 62.0 in stage 0.0 (TID 76, hd289dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 63.0 in stage 0.0 (TID 77, hd270dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 64.0 in stage 0.0 (TID 78, hd278dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 65.0 in stage 0.0 (TID 79, hd285dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 66.0 in stage 0.0 (TID 80, hd292dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 67.0 in stage 0.0 (TID 81, hd266dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 68.0 in stage 0.0 (TID 82, hd293dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 69.0 in stage 0.0 (TID 83, hd264dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 70.0 in stage 0.0 (TID 84, hd284dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 71.0 in stage 0.0 (TID 85, hd288dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 72.0 in stage 0.0 (TID 86, hd265dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 73.0 in stage 0.0 (TID 87, hd278dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 74.0 in stage 0.0 (TID 88, hd254dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 75.0 in stage 0.0 (TID 89, hd264dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 76.0 in stage 0.0 (TID 90, hd261dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 77.0 in stage 0.0 (TID 91, hd279dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 78.0 in stage 0.0 (TID 92, hd270dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 79.0 in stage 0.0 (TID 93, hd292dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 81.0 in stage 0.0 (TID 94, hd265dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 82.0 in stage 0.0 (TID 95, hd261dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 83.0 in stage 0.0 (TID 96, hd288dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 84.0 in stage 0.0 (TID 97, hd266dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 85.0 in stage 0.0 (TID 98, hd286dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 86.0 in stage 0.0 (TID 99, hd275dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 87.0 in stage 0.0 (TID 100, hd281dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 88.0 in stage 0.0 (TID 101, hd262dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 89.0 in stage 0.0 (TID 102, hd274dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 90.0 in stage 0.0 (TID 103, hd273dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 91.0 in stage 0.0 (TID 104, hd290dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 92.0 in stage 0.0 (TID 105, hd254dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 93.0 in stage 0.0 (TID 106, hd271dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 94.0 in stage 0.0 (TID 107, hd284dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 95.0 in stage 0.0 (TID 108, hd289dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 96.0 in stage 0.0 (TID 109, hd260dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 99.0 in stage 0.0 (TID 110, hd274dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 100.0 in stage 0.0 (TID 111, hd285dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 101.0 in stage 0.0 (TID 112, hd261dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 103.0 in stage 0.0 (TID 113, hd271dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 105.0 in stage 0.0 (TID 114, hd288dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 106.0 in stage 0.0 (TID 115, hd281dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 107.0 in stage 0.0 (TID 116, hd261dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 108.0 in stage 0.0 (TID 117, hd286dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 109.0 in stage 0.0 (TID 118, hd280dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 110.0 in stage 0.0 (TID 119, hd284dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 111.0 in stage 0.0 (TID 120, hd264dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 113.0 in stage 0.0 (TID 121, hd255dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 114.0 in stage 0.0 (TID 122, hd280dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 116.0 in stage 0.0 (TID 123, hd272dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 117.0 in stage 0.0 (TID 124, hd279dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 118.0 in stage 0.0 (TID 125, hd271dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 119.0 in stage 0.0 (TID 126, hd279dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 120.0 in stage 0.0 (TID 127, hd273dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 121.0 in stage 0.0 (TID 128, hd290dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 122.0 in stage 0.0 (TID 129, hd280dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 123.0 in stage 0.0 (TID 130, hd272dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 124.0 in stage 0.0 (TID 131, hd257dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 125.0 in stage 0.0 (TID 132, hd263dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 126.0 in stage 0.0 (TID 133, hd276dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 127.0 in stage 0.0 (TID 134, hd278dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 128.0 in stage 0.0 (TID 135, hd260dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 130.0 in stage 0.0 (TID 136, hd256dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 131.0 in stage 0.0 (TID 137, hd290dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 132.0 in stage 0.0 (TID 138, hd256dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 134.0 in stage 0.0 (TID 139, hd255dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 135.0 in stage 0.0 (TID 140, hd260dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 136.0 in stage 0.0 (TID 141, hd276dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 138.0 in stage 0.0 (TID 142, hd272dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 140.0 in stage 0.0 (TID 143, hd270dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 141.0 in stage 0.0 (TID 144, hd286dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 142.0 in stage 0.0 (TID 145, hd275dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 143.0 in stage 0.0 (TID 146, hd283dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 144.0 in stage 0.0 (TID 147, hd281dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 145.0 in stage 0.0 (TID 148, hd282dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 146.0 in stage 0.0 (TID 149, hd273dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 147.0 in stage 0.0 (TID 150, hd283dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 148.0 in stage 0.0 (TID 151, hd279dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 149.0 in stage 0.0 (TID 152, hd255dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 150.0 in stage 0.0 (TID 153, hd265dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 151.0 in stage 0.0 (TID 154, hd277dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 152.0 in stage 0.0 (TID 155, hd280dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 153.0 in stage 0.0 (TID 156, hd263dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 154.0 in stage 0.0 (TID 157, hd283dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 155.0 in stage 0.0 (TID 158, hd275dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 156.0 in stage 0.0 (TID 159, hd281dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 157.0 in stage 0.0 (TID 160, hd281dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 158.0 in stage 0.0 (TID 161, hd274dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 159.0 in stage 0.0 (TID 162, hd292dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 160.0 in stage 0.0 (TID 163, hd257dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 162.0 in stage 0.0 (TID 164, hd258dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 163.0 in stage 0.0 (TID 165, hd263dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 164.0 in stage 0.0 (TID 166, hd264dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 165.0 in stage 0.0 (TID 167, hd282dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 166.0 in stage 0.0 (TID 168, hd293dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 167.0 in stage 0.0 (TID 169, hd265dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 168.0 in stage 0.0 (TID 170, hd257dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 170.0 in stage 0.0 (TID 171, hd263dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 171.0 in stage 0.0 (TID 172, hd272dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 172.0 in stage 0.0 (TID 173, hd256dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 173.0 in stage 0.0 (TID 174, hd276dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 175.0 in stage 0.0 (TID 175, hd255dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 176.0 in stage 0.0 (TID 176, hd286dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 177.0 in stage 0.0 (TID 177, hd273dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 178.0 in stage 0.0 (TID 178, hd290dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 179.0 in stage 0.0 (TID 179, hd282dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 180.0 in stage 0.0 (TID 180, hd285dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 181.0 in stage 0.0 (TID 181, hd284dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 182.0 in stage 0.0 (TID 182, hd254dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 183.0 in stage 0.0 (TID 183, hd277dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 184.0 in stage 0.0 (TID 184, hd258dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 185.0 in stage 0.0 (TID 185, hd254dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 186.0 in stage 0.0 (TID 186, hd291dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 187.0 in stage 0.0 (TID 187, hd289dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 188.0 in stage 0.0 (TID 188, hd275dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 189.0 in stage 0.0 (TID 189, hd277dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 190.0 in stage 0.0 (TID 190, hd255dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 191.0 in stage 0.0 (TID 191, hd276dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 192.0 in stage 0.0 (TID 192, hd258dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 193.0 in stage 0.0 (TID 193, hd277dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 194.0 in stage 0.0 (TID 194, hd264dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 195.0 in stage 0.0 (TID 195, hd273dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:33 INFO scheduler.TaskSetManager: Starting task 196.0 in stage 0.0 (TID 196, hd258dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd260dg.prod.mediav.com:7955 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd285dg.prod.mediav.com:7398 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd280dg.prod.mediav.com:6093 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd290dg.prod.mediav.com:6793 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd280dg.prod.mediav.com:4198 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd290dg.prod.mediav.com:48176 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd282dg.prod.mediav.com:42292 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd285dg.prod.mediav.com:15892 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd260dg.prod.mediav.com:20879 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd271dg.prod.mediav.com:11439 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd278dg.prod.mediav.com:16567 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd274dg.prod.mediav.com:58299 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd257dg.prod.mediav.com:23974 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd261dg.prod.mediav.com:17918 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd291dg.prod.mediav.com:9728 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd257dg.prod.mediav.com:50217 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd278dg.prod.mediav.com:1380 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd272dg.prod.mediav.com:63093 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd270dg.prod.mediav.com:33090 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd261dg.prod.mediav.com:16786 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd282dg.prod.mediav.com:51731 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd254dg.prod.mediav.com:28306 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd276dg.prod.mediav.com:21872 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd284dg.prod.mediav.com:39393 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd274dg.prod.mediav.com:16654 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd293dg.prod.mediav.com:60417 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd271dg.prod.mediav.com:16160 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd290dg.prod.mediav.com:25045 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd274dg.prod.mediav.com:50461 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd288dg.prod.mediav.com:58225 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd288dg.prod.mediav.com:64716 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd292dg.prod.mediav.com:31959 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd266dg.prod.mediav.com:18054 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd272dg.prod.mediav.com:36193 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd286dg.prod.mediav.com:64184 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd283dg.prod.mediav.com:62866 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd291dg.prod.mediav.com:47717 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd277dg.prod.mediav.com:17325 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd285dg.prod.mediav.com:57578 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd275dg.prod.mediav.com:52956 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd283dg.prod.mediav.com:19668 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd254dg.prod.mediav.com:6401 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd271dg.prod.mediav.com:63849 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd264dg.prod.mediav.com:38843 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd291dg.prod.mediav.com:54360 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd261dg.prod.mediav.com:51708 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd284dg.prod.mediav.com:46214 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd289dg.prod.mediav.com:48417 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd284dg.prod.mediav.com:33099 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd261dg.prod.mediav.com:35424 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd278dg.prod.mediav.com:27239 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd289dg.prod.mediav.com:48937 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd266dg.prod.mediav.com:60871 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd285dg.prod.mediav.com:52469 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd282dg.prod.mediav.com:47145 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd255dg.prod.mediav.com:22114 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd260dg.prod.mediav.com:34432 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd286dg.prod.mediav.com:22509 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd277dg.prod.mediav.com:6547 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd271dg.prod.mediav.com:33037 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd282dg.prod.mediav.com:57776 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd292dg.prod.mediav.com:24852 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd288dg.prod.mediav.com:30986 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd257dg.prod.mediav.com:11991 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd266dg.prod.mediav.com:27698 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd286dg.prod.mediav.com:5189 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd281dg.prod.mediav.com:12163 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd271dg.prod.mediav.com:45534 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd283dg.prod.mediav.com:15357 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd260dg.prod.mediav.com:38400 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd270dg.prod.mediav.com:35197 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd264dg.prod.mediav.com:48358 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd254dg.prod.mediav.com:37252 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd275dg.prod.mediav.com:37869 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd256dg.prod.mediav.com:22567 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd289dg.prod.mediav.com:5555 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd260dg.prod.mediav.com:45170 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd263dg.prod.mediav.com:30335 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd292dg.prod.mediav.com:8313 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd277dg.prod.mediav.com:60781 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd286dg.prod.mediav.com:15531 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd293dg.prod.mediav.com:18866 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd255dg.prod.mediav.com:24822 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd266dg.prod.mediav.com:7561 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd270dg.prod.mediav.com:3332 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd263dg.prod.mediav.com:19616 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd293dg.prod.mediav.com:23628 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd280dg.prod.mediav.com:29265 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd264dg.prod.mediav.com:48038 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd255dg.prod.mediav.com:8336 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd264dg.prod.mediav.com:49664 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd264dg.prod.mediav.com:28057 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd293dg.prod.mediav.com:46714 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd276dg.prod.mediav.com:62943 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd288dg.prod.mediav.com:15935 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd263dg.prod.mediav.com:28737 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd275dg.prod.mediav.com:7744 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd275dg.prod.mediav.com:3649 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd263dg.prod.mediav.com:5872 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd273dg.prod.mediav.com:35935 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd281dg.prod.mediav.com:24432 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd279dg.prod.mediav.com:34291 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd272dg.prod.mediav.com:47434 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd275dg.prod.mediav.com:27702 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd279dg.prod.mediav.com:49996 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd273dg.prod.mediav.com:6601 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd256dg.prod.mediav.com:65180 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd289dg.prod.mediav.com:22644 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd273dg.prod.mediav.com:51855 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd273dg.prod.mediav.com:19800 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd263dg.prod.mediav.com:57200 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd257dg.prod.mediav.com:13672 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd292dg.prod.mediav.com:9515 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd279dg.prod.mediav.com:11149 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd279dg.prod.mediav.com:12678 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd276dg.prod.mediav.com:46848 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd284dg.prod.mediav.com:65293 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd285dg.prod.mediav.com:25860 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd283dg.prod.mediav.com:5777 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd279dg.prod.mediav.com:34009 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd286dg.prod.mediav.com:20786 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd277dg.prod.mediav.com:27951 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd274dg.prod.mediav.com:25030 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd292dg.prod.mediav.com:5167 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd270dg.prod.mediav.com:6944 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd283dg.prod.mediav.com:27671 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd257dg.prod.mediav.com:6403 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd261dg.prod.mediav.com:48502 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd277dg.prod.mediav.com:27612 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd274dg.prod.mediav.com:44964 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd278dg.prod.mediav.com:27815 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd272dg.prod.mediav.com:63317 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd256dg.prod.mediav.com:54569 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd254dg.prod.mediav.com:50339 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd273dg.prod.mediav.com:4400 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd288dg.prod.mediav.com:3459 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd281dg.prod.mediav.com:2780 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd284dg.prod.mediav.com:55335 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd254dg.prod.mediav.com:14962 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd281dg.prod.mediav.com:61667 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd291dg.prod.mediav.com:3890 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd256dg.prod.mediav.com:5214 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd270dg.prod.mediav.com:5548 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd282dg.prod.mediav.com:54259 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd256dg.prod.mediav.com:4157 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd272dg.prod.mediav.com:13836 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd265dg.prod.mediav.com:62939 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd258dg.prod.mediav.com:3750 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd258dg.prod.mediav.com:61558 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd258dg.prod.mediav.com:30778 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd258dg.prod.mediav.com:44194 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd265dg.prod.mediav.com:65261 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd258dg.prod.mediav.com:8532 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd265dg.prod.mediav.com:38596 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd265dg.prod.mediav.com:15593 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd265dg.prod.mediav.com:41028 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd287dg.prod.mediav.com:2547 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd280dg.prod.mediav.com:8788 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd293dg.prod.mediav.com:23628 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd260dg.prod.mediav.com:7955 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd290dg.prod.mediav.com:6793 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd282dg.prod.mediav.com:42292 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd290dg.prod.mediav.com:48176 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd271dg.prod.mediav.com:11439 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd278dg.prod.mediav.com:1380 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd280dg.prod.mediav.com:29265 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd280dg.prod.mediav.com:6093 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd285dg.prod.mediav.com:7398 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd278dg.prod.mediav.com:27239 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd288dg.prod.mediav.com:58225 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd278dg.prod.mediav.com:16567 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd255dg.prod.mediav.com:24822 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd293dg.prod.mediav.com:18866 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd282dg.prod.mediav.com:57776 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd289dg.prod.mediav.com:48417 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd281dg.prod.mediav.com:12163 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd284dg.prod.mediav.com:46214 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd260dg.prod.mediav.com:45170 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd254dg.prod.mediav.com:28306 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd275dg.prod.mediav.com:27702 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd260dg.prod.mediav.com:38400 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd285dg.prod.mediav.com:57578 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd291dg.prod.mediav.com:54360 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd288dg.prod.mediav.com:64716 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd271dg.prod.mediav.com:45534 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd270dg.prod.mediav.com:35197 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd275dg.prod.mediav.com:37869 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd260dg.prod.mediav.com:34432 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd284dg.prod.mediav.com:65293 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd291dg.prod.mediav.com:47717 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd263dg.prod.mediav.com:5872 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd286dg.prod.mediav.com:22509 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd266dg.prod.mediav.com:18054 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd292dg.prod.mediav.com:9515 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd290dg.prod.mediav.com:25045 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd257dg.prod.mediav.com:6403 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd286dg.prod.mediav.com:20786 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd274dg.prod.mediav.com:44964 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd266dg.prod.mediav.com:60871 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd264dg.prod.mediav.com:48358 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd266dg.prod.mediav.com:27698 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd270dg.prod.mediav.com:3332 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd284dg.prod.mediav.com:33099 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd284dg.prod.mediav.com:39393 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd277dg.prod.mediav.com:17325 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd274dg.prod.mediav.com:50461 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd282dg.prod.mediav.com:51731 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_22 in memory on hd293dg.prod.mediav.com:25809 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd261dg.prod.mediav.com:17918 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd273dg.prod.mediav.com:6601 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd257dg.prod.mediav.com:13672 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd283dg.prod.mediav.com:62866 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd278dg.prod.mediav.com:27815 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd272dg.prod.mediav.com:47434 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd291dg.prod.mediav.com:3890 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd263dg.prod.mediav.com:19616 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd275dg.prod.mediav.com:3649 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd272dg.prod.mediav.com:63317 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd277dg.prod.mediav.com:27951 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd256dg.prod.mediav.com:54569 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd270dg.prod.mediav.com:33090 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd271dg.prod.mediav.com:63849 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd274dg.prod.mediav.com:58299 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd261dg.prod.mediav.com:35424 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd264dg.prod.mediav.com:49664 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd286dg.prod.mediav.com:5189 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd266dg.prod.mediav.com:7561 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd293dg.prod.mediav.com:46714 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd274dg.prod.mediav.com:25030 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd288dg.prod.mediav.com:15935 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Starting task 197.0 in stage 0.0 (TID 197, hd293dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd254dg.prod.mediav.com:6401 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd274dg.prod.mediav.com:16654 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd292dg.prod.mediav.com:8313 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Finished task 22.0 in stage 0.0 (TID 40) in 813 ms on hd293dg.prod.mediav.com (20/200)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd257dg.prod.mediav.com:23974 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd286dg.prod.mediav.com:15531 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd283dg.prod.mediav.com:27671 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd277dg.prod.mediav.com:60781 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd276dg.prod.mediav.com:46848 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd276dg.prod.mediav.com:62943 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd281dg.prod.mediav.com:61667 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd289dg.prod.mediav.com:48937 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd281dg.prod.mediav.com:24432 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd292dg.prod.mediav.com:5167 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd283dg.prod.mediav.com:5777 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd272dg.prod.mediav.com:36193 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd256dg.prod.mediav.com:22567 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd263dg.prod.mediav.com:28737 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd292dg.prod.mediav.com:24852 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd271dg.prod.mediav.com:33037 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd273dg.prod.mediav.com:51855 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd283dg.prod.mediav.com:19668 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd261dg.prod.mediav.com:16786 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd293dg.prod.mediav.com:60417 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd286dg.prod.mediav.com:64184 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd292dg.prod.mediav.com:31959 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd270dg.prod.mediav.com:6944 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd271dg.prod.mediav.com:16160 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd277dg.prod.mediav.com:6547 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd288dg.prod.mediav.com:30986 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd291dg.prod.mediav.com:9728 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd275dg.prod.mediav.com:52956 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd289dg.prod.mediav.com:22644 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd257dg.prod.mediav.com:11991 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd282dg.prod.mediav.com:47145 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd254dg.prod.mediav.com:37252 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd256dg.prod.mediav.com:65180 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd288dg.prod.mediav.com:3459 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd275dg.prod.mediav.com:7744 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd273dg.prod.mediav.com:19800 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd273dg.prod.mediav.com:4400 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd287dg.prod.mediav.com:2547 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd264dg.prod.mediav.com:28057 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd256dg.prod.mediav.com:5214 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd263dg.prod.mediav.com:57200 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd258dg.prod.mediav.com:30778 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd261dg.prod.mediav.com:51708 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd272dg.prod.mediav.com:13836 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd282dg.prod.mediav.com:54259 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd276dg.prod.mediav.com:21872 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd283dg.prod.mediav.com:15357 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd261dg.prod.mediav.com:48502 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd285dg.prod.mediav.com:52469 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd255dg.prod.mediav.com:8336 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd277dg.prod.mediav.com:27612 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd284dg.prod.mediav.com:55335 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd281dg.prod.mediav.com:2780 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd264dg.prod.mediav.com:48038 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd279dg.prod.mediav.com:34009 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd280dg.prod.mediav.com:4198 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd258dg.prod.mediav.com:61558 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd265dg.prod.mediav.com:65261 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd258dg.prod.mediav.com:44194 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd258dg.prod.mediav.com:3750 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd258dg.prod.mediav.com:8532 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd279dg.prod.mediav.com:12678 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd285dg.prod.mediav.com:15892 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd265dg.prod.mediav.com:38596 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd279dg.prod.mediav.com:49996 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd265dg.prod.mediav.com:15593 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd260dg.prod.mediav.com:20879 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd279dg.prod.mediav.com:34291 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd265dg.prod.mediav.com:62939 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd279dg.prod.mediav.com:11149 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd264dg.prod.mediav.com:38843 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd270dg.prod.mediav.com:5548 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd265dg.prod.mediav.com:41028 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd257dg.prod.mediav.com:50217 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd254dg.prod.mediav.com:50339 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd273dg.prod.mediav.com:35935 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_41 in memory on hd262dg.prod.mediav.com:24194 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd256dg.prod.mediav.com:4157 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd272dg.prod.mediav.com:63093 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd280dg.prod.mediav.com:8788 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd285dg.prod.mediav.com:25860 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Starting task 198.0 in stage 0.0 (TID 198, hd262dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Finished task 41.0 in stage 0.0 (TID 58) in 1035 ms on hd262dg.prod.mediav.com (21/200)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_131 in memory on hd290dg.prod.mediav.com:1034 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Starting task 199.0 in stage 0.0 (TID 199, hd290dg.prod.mediav.com, ANY, 1425 bytes)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_106 in memory on hd281dg.prod.mediav.com:2395 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Finished task 131.0 in stage 0.0 (TID 137) in 1045 ms on hd290dg.prod.mediav.com (22/200)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_186 in memory on hd291dg.prod.mediav.com:31861 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_6 in memory on hd262dg.prod.mediav.com:35030 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO storage.BlockManagerInfo: Added rdd_4_152 in memory on hd280dg.prod.mediav.com:1897 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Finished task 106.0 in stage 0.0 (TID 115) in 1069 ms on hd281dg.prod.mediav.com (23/200)
> 15/09/15 18:50:34 INFO scheduler.TaskSetManager: Finished task 6.0 in stage 0.0 (TID 25) in 1095 ms on hd262dg.prod.mediav.com (24/200)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 152.0 in stage 0.0 (TID 155) in 1070 ms on hd280dg.prod.mediav.com (25/200)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 186.0 in stage 0.0 (TID 186) in 1065 ms on hd291dg.prod.mediav.com (26/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_88 in memory on hd262dg.prod.mediav.com:5957 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 88.0 in stage 0.0 (TID 101) in 1129 ms on hd262dg.prod.mediav.com (27/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd255dg.prod.mediav.com:22114 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_13 in memory on hd262dg.prod.mediav.com:40567 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_42 in memory on hd289dg.prod.mediav.com:20447 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_67 in memory on hd266dg.prod.mediav.com:60772 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 13.0 in stage 0.0 (TID 32) in 1198 ms on hd262dg.prod.mediav.com (28/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_56 in memory on hd276dg.prod.mediav.com:15025 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 42.0 in stage 0.0 (TID 59) in 1198 ms on hd289dg.prod.mediav.com (29/200)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 67.0 in stage 0.0 (TID 81) in 1201 ms on hd266dg.prod.mediav.com (30/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_91 in memory on hd290dg.prod.mediav.com:48698 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_126 in memory on hd276dg.prod.mediav.com:65222 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 56.0 in stage 0.0 (TID 71) in 1230 ms on hd276dg.prod.mediav.com (31/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_29 in memory on hd287dg.prod.mediav.com:2270 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 91.0 in stage 0.0 (TID 104) in 1231 ms on hd290dg.prod.mediav.com (32/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd278dg.prod.mediav.com:9221 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 126.0 in stage 0.0 (TID 133) in 1232 ms on hd276dg.prod.mediav.com (33/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_1_piece0 in memory on hd255dg.prod.mediav.com:29011 (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 29.0 in stage 0.0 (TID 46) in 1265 ms on hd287dg.prod.mediav.com (34/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_1 in memory on hd287dg.prod.mediav.com:53041 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_9 in memory on hd262dg.prod.mediav.com:49994 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 1.0 in stage 0.0 (TID 20) in 1298 ms on hd287dg.prod.mediav.com (35/200)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 9.0 in stage 0.0 (TID 28) in 1307 ms on hd262dg.prod.mediav.com (36/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_197 in memory on hd293dg.prod.mediav.com:25809 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 197.0 in stage 0.0 (TID 197) in 584 ms on hd293dg.prod.mediav.com (37/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_113 in memory on hd255dg.prod.mediav.com:62882 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 113.0 in stage 0.0 (TID 121) in 1441 ms on hd255dg.prod.mediav.com (38/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_198 in memory on hd262dg.prod.mediav.com:24194 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 198.0 in stage 0.0 (TID 198) in 548 ms on hd262dg.prod.mediav.com (39/200)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd278dg.prod.mediav.com:9221 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd255dg.prod.mediav.com:29011 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd263dg.prod.mediav.com:30335 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd289dg.prod.mediav.com:5555 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added broadcast_0_piece0 in memory on hd254dg.prod.mediav.com:14962 (size: 15.9 KB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO storage.BlockManagerInfo: Added rdd_4_199 in memory on hd290dg.prod.mediav.com:1034 (size: 3.6 MB, free: 8.6 GB)
> 15/09/15 18:50:35 INFO scheduler.TaskSetManager: Finished task 199.0 in stage 0.0 (TID 199) in 869 ms on hd290dg.prod.mediav.com (40/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_121 in memory on hd290dg.prod.mediav.com:6793 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 121.0 in stage 0.0 (TID 128) in 2687 ms on hd290dg.prod.mediav.com (41/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_59 in memory on hd280dg.prod.mediav.com:6093 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_156 in memory on hd281dg.prod.mediav.com:12163 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 59.0 in stage 0.0 (TID 74) in 2824 ms on hd280dg.prod.mediav.com (42/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_109 in memory on hd280dg.prod.mediav.com:29265 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_65 in memory on hd285dg.prod.mediav.com:7398 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 156.0 in stage 0.0 (TID 159) in 2821 ms on hd281dg.prod.mediav.com (43/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_11 in memory on hd290dg.prod.mediav.com:48176 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 65.0 in stage 0.0 (TID 79) in 2866 ms on hd285dg.prod.mediav.com (44/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 109.0 in stage 0.0 (TID 118) in 2864 ms on hd280dg.prod.mediav.com (45/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_17 in memory on hd260dg.prod.mediav.com:7955 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_178 in memory on hd290dg.prod.mediav.com:25045 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 11.0 in stage 0.0 (TID 30) in 2893 ms on hd290dg.prod.mediav.com (46/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_95 in memory on hd289dg.prod.mediav.com:48417 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_58 in memory on hd287dg.prod.mediav.com:2547 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_57 in memory on hd266dg.prod.mediav.com:7561 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_7 in memory on hd291dg.prod.mediav.com:54360 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 178.0 in stage 0.0 (TID 178) in 2893 ms on hd290dg.prod.mediav.com (47/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_34 in memory on hd288dg.prod.mediav.com:58225 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_89 in memory on hd274dg.prod.mediav.com:44964 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 17.0 in stage 0.0 (TID 36) in 2933 ms on hd260dg.prod.mediav.com (48/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_28 in memory on hd266dg.prod.mediav.com:18054 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 95.0 in stage 0.0 (TID 108) in 2925 ms on hd289dg.prod.mediav.com (49/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 58.0 in stage 0.0 (TID 73) in 2933 ms on hd287dg.prod.mediav.com (50/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 57.0 in stage 0.0 (TID 72) in 2933 ms on hd266dg.prod.mediav.com (51/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_20 in memory on hd266dg.prod.mediav.com:27698 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_164 in memory on hd264dg.prod.mediav.com:48358 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_166 in memory on hd293dg.prod.mediav.com:18866 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 89.0 in stage 0.0 (TID 102) in 2949 ms on hd274dg.prod.mediav.com (52/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 7.0 in stage 0.0 (TID 26) in 2971 ms on hd291dg.prod.mediav.com (53/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 34.0 in stage 0.0 (TID 51) in 2966 ms on hd288dg.prod.mediav.com (54/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_157 in memory on hd281dg.prod.mediav.com:2780 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 28.0 in stage 0.0 (TID 45) in 2978 ms on hd266dg.prod.mediav.com (55/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_49 in memory on hd293dg.prod.mediav.com:23628 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 20.0 in stage 0.0 (TID 38) in 2993 ms on hd266dg.prod.mediav.com (56/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 166.0 in stage 0.0 (TID 168) in 2973 ms on hd293dg.prod.mediav.com (57/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_85 in memory on hd286dg.prod.mediav.com:20786 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_5 in memory on hd254dg.prod.mediav.com:28306 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_144 in memory on hd281dg.prod.mediav.com:24432 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 164.0 in stage 0.0 (TID 166) in 2976 ms on hd264dg.prod.mediav.com (58/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 157.0 in stage 0.0 (TID 160) in 2992 ms on hd281dg.prod.mediav.com (59/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_87 in memory on hd281dg.prod.mediav.com:61667 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_27 in memory on hd271dg.prod.mediav.com:11439 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_168 in memory on hd257dg.prod.mediav.com:23974 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_45 in memory on hd289dg.prod.mediav.com:22644 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_100 in memory on hd285dg.prod.mediav.com:57578 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_73 in memory on hd278dg.prod.mediav.com:27815 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_64 in memory on hd278dg.prod.mediav.com:27239 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 49.0 in stage 0.0 (TID 64) in 3025 ms on hd293dg.prod.mediav.com (60/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_18 in memory on hd270dg.prod.mediav.com:6944 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 144.0 in stage 0.0 (TID 147) in 3016 ms on hd281dg.prod.mediav.com (61/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_50 in memory on hd291dg.prod.mediav.com:3890 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_127 in memory on hd278dg.prod.mediav.com:1380 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 85.0 in stage 0.0 (TID 98) in 3033 ms on hd286dg.prod.mediav.com (62/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_114 in memory on hd280dg.prod.mediav.com:4198 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_182 in memory on hd254dg.prod.mediav.com:6401 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 5.0 in stage 0.0 (TID 24) in 3060 ms on hd254dg.prod.mediav.com (63/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_62 in memory on hd289dg.prod.mediav.com:48937 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_151 in memory on hd277dg.prod.mediav.com:27951 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 87.0 in stage 0.0 (TID 100) in 3050 ms on hd281dg.prod.mediav.com (64/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 27.0 in stage 0.0 (TID 44) in 3066 ms on hd271dg.prod.mediav.com (65/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_55 in memory on hd278dg.prod.mediav.com:16567 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_70 in memory on hd284dg.prod.mediav.com:46214 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_3 in memory on hd292dg.prod.mediav.com:8313 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_191 in memory on hd276dg.prod.mediav.com:46848 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_0 in memory on hd292dg.prod.mediav.com:5167 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_83 in memory on hd288dg.prod.mediav.com:30986 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_82 in memory on hd261dg.prod.mediav.com:16786 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_118 in memory on hd271dg.prod.mediav.com:16160 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_159 in memory on hd292dg.prod.mediav.com:31959 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 100.0 in stage 0.0 (TID 111) in 3058 ms on hd285dg.prod.mediav.com (66/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 168.0 in stage 0.0 (TID 170) in 3049 ms on hd257dg.prod.mediav.com (67/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 18.0 in stage 0.0 (TID 37) in 3080 ms on hd270dg.prod.mediav.com (68/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_143 in memory on hd283dg.prod.mediav.com:15357 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 64.0 in stage 0.0 (TID 78) in 3071 ms on hd278dg.prod.mediav.com (69/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_53 in memory on hd275dg.prod.mediav.com:27702 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 45.0 in stage 0.0 (TID 61) in 3077 ms on hd289dg.prod.mediav.com (70/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_43 in memory on hd291dg.prod.mediav.com:9728 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 73.0 in stage 0.0 (TID 87) in 3073 ms on hd278dg.prod.mediav.com (71/200)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 50.0 in stage 0.0 (TID 65) in 3080 ms on hd291dg.prod.mediav.com (72/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_153 in memory on hd263dg.prod.mediav.com:5872 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_84 in memory on hd266dg.prod.mediav.com:60871 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 114.0 in stage 0.0 (TID 122) in 3071 ms on hd280dg.prod.mediav.com (73/200)
> 15/09/15 18:50:36 INFO storage.BlockManagerInfo: Added rdd_4_2 in memory on hd288dg.prod.mediav.com:15935 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:36 INFO scheduler.TaskSetManager: Finished task 182.0 in stage 0.0 (TID 182) in 3059 ms on hd254dg.prod.mediav.com (74/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_32 in memory on hd293dg.prod.mediav.com:60417 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_170 in memory on hd263dg.prod.mediav.com:28737 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_25 in memory on hd291dg.prod.mediav.com:47717 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_165 in memory on hd282dg.prod.mediav.com:57776 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_123 in memory on hd272dg.prod.mediav.com:63317 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_108 in memory on hd286dg.prod.mediav.com:22509 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 62.0 in stage 0.0 (TID 76) in 3090 ms on hd289dg.prod.mediav.com (75/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 151.0 in stage 0.0 (TID 154) in 3075 ms on hd277dg.prod.mediav.com (76/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_183 in memory on hd277dg.prod.mediav.com:60781 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_185 in memory on hd254dg.prod.mediav.com:37252 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 127.0 in stage 0.0 (TID 134) in 3084 ms on hd278dg.prod.mediav.com (77/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 70.0 in stage 0.0 (TID 84) in 3095 ms on hd284dg.prod.mediav.com (78/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 82.0 in stage 0.0 (TID 95) in 3096 ms on hd261dg.prod.mediav.com (79/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 83.0 in stage 0.0 (TID 96) in 3097 ms on hd288dg.prod.mediav.com (80/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 55.0 in stage 0.0 (TID 70) in 3103 ms on hd278dg.prod.mediav.com (81/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_158 in memory on hd274dg.prod.mediav.com:50461 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 118.0 in stage 0.0 (TID 125) in 3093 ms on hd271dg.prod.mediav.com (82/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_188 in memory on hd275dg.prod.mediav.com:3649 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_66 in memory on hd292dg.prod.mediav.com:24852 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_79 in memory on hd292dg.prod.mediav.com:9515 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_176 in memory on hd286dg.prod.mediav.com:15531 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_46 in memory on hd282dg.prod.mediav.com:42292 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_99 in memory on hd274dg.prod.mediav.com:25030 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 143.0 in stage 0.0 (TID 146) in 3096 ms on hd283dg.prod.mediav.com (83/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 159.0 in stage 0.0 (TID 162) in 3093 ms on hd292dg.prod.mediav.com (84/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 191.0 in stage 0.0 (TID 191) in 3087 ms on hd276dg.prod.mediav.com (85/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 53.0 in stage 0.0 (TID 68) in 3113 ms on hd275dg.prod.mediav.com (86/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 3.0 in stage 0.0 (TID 22) in 3128 ms on hd292dg.prod.mediav.com (87/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_94 in memory on hd284dg.prod.mediav.com:55335 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 43.0 in stage 0.0 (TID 60) in 3120 ms on hd291dg.prod.mediav.com (88/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 84.0 in stage 0.0 (TID 97) in 3112 ms on hd266dg.prod.mediav.com (89/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_189 in memory on hd277dg.prod.mediav.com:17325 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 0.0 (TID 19) in 3137 ms on hd292dg.prod.mediav.com (90/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_101 in memory on hd261dg.prod.mediav.com:35424 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_96 in memory on hd260dg.prod.mediav.com:34432 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 2.0 in stage 0.0 (TID 21) in 3141 ms on hd288dg.prod.mediav.com (91/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 32.0 in stage 0.0 (TID 49) in 3133 ms on hd293dg.prod.mediav.com (92/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 183.0 in stage 0.0 (TID 183) in 3105 ms on hd277dg.prod.mediav.com (93/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 123.0 in stage 0.0 (TID 130) in 3117 ms on hd272dg.prod.mediav.com (94/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 170.0 in stage 0.0 (TID 171) in 3112 ms on hd263dg.prod.mediav.com (95/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 153.0 in stage 0.0 (TID 156) in 3115 ms on hd263dg.prod.mediav.com (96/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_141 in memory on hd286dg.prod.mediav.com:5189 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 165.0 in stage 0.0 (TID 167) in 3115 ms on hd282dg.prod.mediav.com (97/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 25.0 in stage 0.0 (TID 42) in 3143 ms on hd291dg.prod.mediav.com (98/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_135 in memory on hd260dg.prod.mediav.com:45170 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 185.0 in stage 0.0 (TID 185) in 3114 ms on hd254dg.prod.mediav.com (99/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 108.0 in stage 0.0 (TID 117) in 3128 ms on hd286dg.prod.mediav.com (100/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_136 in memory on hd276dg.prod.mediav.com:21872 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 188.0 in stage 0.0 (TID 188) in 3117 ms on hd275dg.prod.mediav.com (101/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 158.0 in stage 0.0 (TID 161) in 3122 ms on hd274dg.prod.mediav.com (102/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_68 in memory on hd293dg.prod.mediav.com:46714 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 79.0 in stage 0.0 (TID 93) in 3144 ms on hd292dg.prod.mediav.com (103/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 66.0 in stage 0.0 (TID 80) in 3147 ms on hd292dg.prod.mediav.com (104/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_147 in memory on hd283dg.prod.mediav.com:27671 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 99.0 in stage 0.0 (TID 110) in 3142 ms on hd274dg.prod.mediav.com (105/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_194 in memory on hd264dg.prod.mediav.com:28057 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 189.0 in stage 0.0 (TID 189) in 3133 ms on hd277dg.prod.mediav.com (106/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 176.0 in stage 0.0 (TID 176) in 3135 ms on hd286dg.prod.mediav.com (107/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 101.0 in stage 0.0 (TID 112) in 3150 ms on hd261dg.prod.mediav.com (108/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 46.0 in stage 0.0 (TID 62) in 3166 ms on hd282dg.prod.mediav.com (109/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_36 in memory on hd257dg.prod.mediav.com:11991 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_33 in memory on hd274dg.prod.mediav.com:16654 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 94.0 in stage 0.0 (TID 107) in 3159 ms on hd284dg.prod.mediav.com (110/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_37 in memory on hd256dg.prod.mediav.com:5214 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 96.0 in stage 0.0 (TID 109) in 3161 ms on hd260dg.prod.mediav.com (111/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_105 in memory on hd288dg.prod.mediav.com:64716 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_122 in memory on hd280dg.prod.mediav.com:8788 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_40 in memory on hd283dg.prod.mediav.com:5777 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_71 in memory on hd288dg.prod.mediav.com:3459 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_171 in memory on hd272dg.prod.mediav.com:13836 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 141.0 in stage 0.0 (TID 144) in 3165 ms on hd286dg.prod.mediav.com (112/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 135.0 in stage 0.0 (TID 140) in 3167 ms on hd260dg.prod.mediav.com (113/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 136.0 in stage 0.0 (TID 141) in 3167 ms on hd276dg.prod.mediav.com (114/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_173 in memory on hd276dg.prod.mediav.com:62943 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_86 in memory on hd275dg.prod.mediav.com:37869 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 68.0 in stage 0.0 (TID 82) in 3184 ms on hd293dg.prod.mediav.com (115/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_35 in memory on hd263dg.prod.mediav.com:19616 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_69 in memory on hd264dg.prod.mediav.com:49664 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_30 in memory on hd283dg.prod.mediav.com:62866 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_15 in memory on hd285dg.prod.mediav.com:15892 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 147.0 in stage 0.0 (TID 150) in 3182 ms on hd283dg.prod.mediav.com (116/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 33.0 in stage 0.0 (TID 50) in 3207 ms on hd274dg.prod.mediav.com (117/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 194.0 in stage 0.0 (TID 194) in 3175 ms on hd264dg.prod.mediav.com (118/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 36.0 in stage 0.0 (TID 53) in 3210 ms on hd257dg.prod.mediav.com (119/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 37.0 in stage 0.0 (TID 54) in 3210 ms on hd256dg.prod.mediav.com (120/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_14 in memory on hd274dg.prod.mediav.com:58299 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 40.0 in stage 0.0 (TID 57) in 3214 ms on hd283dg.prod.mediav.com (121/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_111 in memory on hd264dg.prod.mediav.com:48038 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_132 in memory on hd256dg.prod.mediav.com:65180 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 122.0 in stage 0.0 (TID 129) in 3201 ms on hd280dg.prod.mediav.com (122/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_48 in memory on hd256dg.prod.mediav.com:22567 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_180 in memory on hd285dg.prod.mediav.com:52469 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 105.0 in stage 0.0 (TID 114) in 3208 ms on hd288dg.prod.mediav.com (123/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_21 in memory on hd284dg.prod.mediav.com:39393 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_124 in memory on hd257dg.prod.mediav.com:6403 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 171.0 in stage 0.0 (TID 172) in 3200 ms on hd272dg.prod.mediav.com (124/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 71.0 in stage 0.0 (TID 85) in 3218 ms on hd288dg.prod.mediav.com (125/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 86.0 in stage 0.0 (TID 99) in 3219 ms on hd275dg.prod.mediav.com (126/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 69.0 in stage 0.0 (TID 83) in 3226 ms on hd264dg.prod.mediav.com (127/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_103 in memory on hd271dg.prod.mediav.com:33037 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_154 in memory on hd283dg.prod.mediav.com:19668 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 30.0 in stage 0.0 (TID 47) in 3239 ms on hd283dg.prod.mediav.com (128/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 35.0 in stage 0.0 (TID 52) in 3237 ms on hd263dg.prod.mediav.com (129/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_31 in memory on hd277dg.prod.mediav.com:6547 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_128 in memory on hd260dg.prod.mediav.com:38400 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_93 in memory on hd271dg.prod.mediav.com:45534 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 173.0 in stage 0.0 (TID 174) in 3214 ms on hd276dg.prod.mediav.com (130/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_51 in memory on hd286dg.prod.mediav.com:64184 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 15.0 in stage 0.0 (TID 34) in 3249 ms on hd285dg.prod.mediav.com (131/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_181 in memory on hd284dg.prod.mediav.com:65293 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_63 in memory on hd270dg.prod.mediav.com:3332 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_54 in memory on hd272dg.prod.mediav.com:36193 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 111.0 in stage 0.0 (TID 120) in 3233 ms on hd264dg.prod.mediav.com (132/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 14.0 in stage 0.0 (TID 33) in 3255 ms on hd274dg.prod.mediav.com (133/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_116 in memory on hd272dg.prod.mediav.com:47434 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_184 in memory on hd258dg.prod.mediav.com:44194 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 132.0 in stage 0.0 (TID 138) in 3242 ms on hd256dg.prod.mediav.com (134/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 180.0 in stage 0.0 (TID 180) in 3233 ms on hd285dg.prod.mediav.com (135/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 21.0 in stage 0.0 (TID 39) in 3266 ms on hd284dg.prod.mediav.com (136/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 124.0 in stage 0.0 (TID 131) in 3246 ms on hd257dg.prod.mediav.com (137/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 48.0 in stage 0.0 (TID 63) in 3264 ms on hd256dg.prod.mediav.com (138/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 154.0 in stage 0.0 (TID 157) in 3252 ms on hd283dg.prod.mediav.com (139/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 103.0 in stage 0.0 (TID 113) in 3262 ms on hd271dg.prod.mediav.com (140/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 31.0 in stage 0.0 (TID 48) in 3279 ms on hd277dg.prod.mediav.com (141/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 128.0 in stage 0.0 (TID 135) in 3260 ms on hd260dg.prod.mediav.com (142/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_125 in memory on hd263dg.prod.mediav.com:57200 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_10 in memory on hd261dg.prod.mediav.com:48502 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_110 in memory on hd284dg.prod.mediav.com:33099 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 51.0 in stage 0.0 (TID 66) in 3280 ms on hd286dg.prod.mediav.com (143/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 181.0 in stage 0.0 (TID 181) in 3261 ms on hd284dg.prod.mediav.com (144/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 54.0 in stage 0.0 (TID 69) in 3286 ms on hd272dg.prod.mediav.com (145/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 63.0 in stage 0.0 (TID 77) in 3283 ms on hd270dg.prod.mediav.com (146/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 93.0 in stage 0.0 (TID 106) in 3278 ms on hd271dg.prod.mediav.com (147/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_74 in memory on hd254dg.prod.mediav.com:50339 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_172 in memory on hd256dg.prod.mediav.com:4157 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 116.0 in stage 0.0 (TID 123) in 3280 ms on hd272dg.prod.mediav.com (148/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_4 in memory on hd258dg.prod.mediav.com:30778 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_155 in memory on hd275dg.prod.mediav.com:7744 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_145 in memory on hd282dg.prod.mediav.com:54259 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_38 in memory on hd260dg.prod.mediav.com:20879 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_195 in memory on hd273dg.prod.mediav.com:51855 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 184.0 in stage 0.0 (TID 184) in 3279 ms on hd258dg.prod.mediav.com (149/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_193 in memory on hd277dg.prod.mediav.com:27612 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 110.0 in stage 0.0 (TID 119) in 3302 ms on hd284dg.prod.mediav.com (150/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_179 in memory on hd282dg.prod.mediav.com:51731 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_130 in memory on hd256dg.prod.mediav.com:54569 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 10.0 in stage 0.0 (TID 29) in 3326 ms on hd261dg.prod.mediav.com (151/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_78 in memory on hd270dg.prod.mediav.com:35197 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 125.0 in stage 0.0 (TID 132) in 3302 ms on hd263dg.prod.mediav.com (152/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_142 in memory on hd275dg.prod.mediav.com:52956 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 172.0 in stage 0.0 (TID 173) in 3304 ms on hd256dg.prod.mediav.com (153/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 74.0 in stage 0.0 (TID 88) in 3322 ms on hd254dg.prod.mediav.com (154/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_61 in memory on hd270dg.prod.mediav.com:5548 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 4.0 in stage 0.0 (TID 23) in 3349 ms on hd258dg.prod.mediav.com (155/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_8 in memory on hd282dg.prod.mediav.com:47145 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 38.0 in stage 0.0 (TID 55) in 3343 ms on hd260dg.prod.mediav.com (156/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_75 in memory on hd264dg.prod.mediav.com:38843 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 155.0 in stage 0.0 (TID 158) in 3322 ms on hd275dg.prod.mediav.com (157/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 145.0 in stage 0.0 (TID 148) in 3328 ms on hd282dg.prod.mediav.com (158/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 195.0 in stage 0.0 (TID 195) in 3320 ms on hd273dg.prod.mediav.com (159/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 130.0 in stage 0.0 (TID 136) in 3332 ms on hd256dg.prod.mediav.com (160/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 193.0 in stage 0.0 (TID 193) in 3323 ms on hd277dg.prod.mediav.com (161/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_192 in memory on hd258dg.prod.mediav.com:61558 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_196 in memory on hd258dg.prod.mediav.com:8532 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 142.0 in stage 0.0 (TID 145) in 3337 ms on hd275dg.prod.mediav.com (162/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 179.0 in stage 0.0 (TID 179) in 3333 ms on hd282dg.prod.mediav.com (163/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 78.0 in stage 0.0 (TID 92) in 3353 ms on hd270dg.prod.mediav.com (164/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_90 in memory on hd273dg.prod.mediav.com:4400 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_117 in memory on hd279dg.prod.mediav.com:34009 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_119 in memory on hd279dg.prod.mediav.com:49996 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 61.0 in stage 0.0 (TID 75) in 3370 ms on hd270dg.prod.mediav.com (165/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 8.0 in stage 0.0 (TID 27) in 3389 ms on hd282dg.prod.mediav.com (166/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 75.0 in stage 0.0 (TID 89) in 3373 ms on hd264dg.prod.mediav.com (167/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_16 in memory on hd285dg.prod.mediav.com:25860 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_162 in memory on hd258dg.prod.mediav.com:3750 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_146 in memory on hd273dg.prod.mediav.com:19800 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 192.0 in stage 0.0 (TID 192) in 3368 ms on hd258dg.prod.mediav.com (168/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 196.0 in stage 0.0 (TID 196) in 3367 ms on hd258dg.prod.mediav.com (169/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_120 in memory on hd273dg.prod.mediav.com:35935 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 90.0 in stage 0.0 (TID 103) in 3394 ms on hd273dg.prod.mediav.com (170/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_39 in memory on hd279dg.prod.mediav.com:11149 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_52 in memory on hd257dg.prod.mediav.com:13672 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 117.0 in stage 0.0 (TID 124) in 3400 ms on hd279dg.prod.mediav.com (171/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 119.0 in stage 0.0 (TID 126) in 3402 ms on hd279dg.prod.mediav.com (172/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 16.0 in stage 0.0 (TID 35) in 3432 ms on hd285dg.prod.mediav.com (173/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_138 in memory on hd272dg.prod.mediav.com:63093 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 146.0 in stage 0.0 (TID 149) in 3415 ms on hd273dg.prod.mediav.com (174/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_167 in memory on hd265dg.prod.mediav.com:41028 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 162.0 in stage 0.0 (TID 164) in 3411 ms on hd258dg.prod.mediav.com (175/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 120.0 in stage 0.0 (TID 127) in 3434 ms on hd273dg.prod.mediav.com (176/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 39.0 in stage 0.0 (TID 56) in 3450 ms on hd279dg.prod.mediav.com (177/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 52.0 in stage 0.0 (TID 67) in 3451 ms on hd257dg.prod.mediav.com (178/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_148 in memory on hd279dg.prod.mediav.com:34291 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_77 in memory on hd279dg.prod.mediav.com:12678 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_150 in memory on hd265dg.prod.mediav.com:65261 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 138.0 in stage 0.0 (TID 142) in 3457 ms on hd272dg.prod.mediav.com (179/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 167.0 in stage 0.0 (TID 169) in 3451 ms on hd265dg.prod.mediav.com (180/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_76 in memory on hd261dg.prod.mediav.com:51708 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_81 in memory on hd265dg.prod.mediav.com:38596 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 148.0 in stage 0.0 (TID 151) in 3475 ms on hd279dg.prod.mediav.com (181/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 77.0 in stage 0.0 (TID 91) in 3490 ms on hd279dg.prod.mediav.com (182/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_107 in memory on hd261dg.prod.mediav.com:17918 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 76.0 in stage 0.0 (TID 90) in 3508 ms on hd261dg.prod.mediav.com (183/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 150.0 in stage 0.0 (TID 153) in 3497 ms on hd265dg.prod.mediav.com (184/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_24 in memory on hd271dg.prod.mediav.com:63849 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 81.0 in stage 0.0 (TID 94) in 3515 ms on hd265dg.prod.mediav.com (185/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_12 in memory on hd265dg.prod.mediav.com:15593 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 107.0 in stage 0.0 (TID 116) in 3528 ms on hd261dg.prod.mediav.com (186/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 24.0 in stage 0.0 (TID 41) in 3572 ms on hd271dg.prod.mediav.com (187/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_160 in memory on hd257dg.prod.mediav.com:50217 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 12.0 in stage 0.0 (TID 31) in 3585 ms on hd265dg.prod.mediav.com (188/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 160.0 in stage 0.0 (TID 163) in 3596 ms on hd257dg.prod.mediav.com (189/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_177 in memory on hd273dg.prod.mediav.com:6601 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 177.0 in stage 0.0 (TID 177) in 3655 ms on hd273dg.prod.mediav.com (190/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_149 in memory on hd255dg.prod.mediav.com:22114 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_187 in memory on hd289dg.prod.mediav.com:5555 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 149.0 in stage 0.0 (TID 152) in 3760 ms on hd255dg.prod.mediav.com (191/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 187.0 in stage 0.0 (TID 187) in 3794 ms on hd289dg.prod.mediav.com (192/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_26 in memory on hd278dg.prod.mediav.com:9221 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_190 in memory on hd255dg.prod.mediav.com:24822 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 26.0 in stage 0.0 (TID 43) in 3876 ms on hd278dg.prod.mediav.com (193/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 190.0 in stage 0.0 (TID 190) in 3848 ms on hd255dg.prod.mediav.com (194/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_140 in memory on hd270dg.prod.mediav.com:33090 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_163 in memory on hd263dg.prod.mediav.com:30335 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_72 in memory on hd265dg.prod.mediav.com:62939 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 140.0 in stage 0.0 (TID 143) in 3971 ms on hd270dg.prod.mediav.com (195/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 163.0 in stage 0.0 (TID 165) in 3966 ms on hd263dg.prod.mediav.com (196/200)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 72.0 in stage 0.0 (TID 86) in 4026 ms on hd265dg.prod.mediav.com (197/200)
> 15/09/15 18:50:37 INFO storage.BlockManagerInfo: Added rdd_4_175 in memory on hd255dg.prod.mediav.com:8336 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:37 INFO scheduler.TaskSetManager: Finished task 175.0 in stage 0.0 (TID 175) in 4056 ms on hd255dg.prod.mediav.com (198/200)
> 15/09/15 18:50:38 INFO storage.BlockManagerInfo: Added rdd_4_92 in memory on hd254dg.prod.mediav.com:14962 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:38 INFO scheduler.TaskSetManager: Finished task 92.0 in stage 0.0 (TID 105) in 4159 ms on hd254dg.prod.mediav.com (199/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_4_134 in memory on hd255dg.prod.mediav.com:29011 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 134.0 in stage 0.0 (TID 139) in 5506 ms on hd255dg.prod.mediav.com (200/200)
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: ResultStage 0 (reduce at MLUtils.scala:95) finished in 15.745 s
> 15/09/15 18:50:39 INFO cluster.YarnClusterScheduler: Removed TaskSet 0.0, whose tasks have all completed, from pool default
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Job 0 finished: reduce at MLUtils.scala:95, took 19.436039 s
> 15/09/15 18:50:39 INFO gbdt.GBDTModelTrainingJob: Number of Iteration: 3
> 15/09/15 18:50:39 INFO gbdt.GBDTModelTrainingJob: Max Depth: 3
> 15/09/15 18:50:39 INFO gbdt.GBDTModelTrainingJob: ======================== GBDT Training Begin ===============================
> 15/09/15 18:50:39 INFO spark.SparkContext: Starting job: take at DecisionTreeMetadata.scala:110
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Got job 1 (take at DecisionTreeMetadata.scala:110) with 1 output partitions (allowLocal=true)
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Final stage: ResultStage 1(take at DecisionTreeMetadata.scala:110)
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Parents of final stage: List()
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Missing parents: List()
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Submitting ResultStage 1 (MapPartitionsRDD[8] at retag at RandomForest.scala:137), which has no missing parents
> 15/09/15 18:50:39 INFO storage.MemoryStore: ensureFreeSpace(4312) called with curMem=202018, maxMem=18438322913
> 15/09/15 18:50:39 INFO storage.MemoryStore: Block broadcast_2 stored as values in memory (estimated size 4.2 KB, free 17.2 GB)
> 15/09/15 18:50:39 INFO storage.MemoryStore: ensureFreeSpace(2255) called with curMem=206330, maxMem=18438322913
> 15/09/15 18:50:39 INFO storage.MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 2.2 KB, free 17.2 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_2_piece0 in memory on 10.47.1.38:18554 (size: 2.2 KB, free: 17.2 GB)
> 15/09/15 18:50:39 INFO spark.SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:874
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Submitting 1 missing tasks from ResultStage 1 (MapPartitionsRDD[8] at retag at RandomForest.scala:137)
> 15/09/15 18:50:39 INFO cluster.YarnClusterScheduler: Adding task set 1.0 with 1 tasks
> 15/09/15 18:50:39 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_1 tasks to pool default
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 1.0 (TID 200, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_2_piece0 in memory on hd292dg.prod.mediav.com:5167 (size: 2.2 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_0 in memory on hd292dg.prod.mediav.com:5167 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 1.0 (TID 200) in 181 ms on hd292dg.prod.mediav.com (1/1)
> 15/09/15 18:50:39 INFO cluster.YarnClusterScheduler: Removed TaskSet 1.0, whose tasks have all completed, from pool default
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: ResultStage 1 (take at DecisionTreeMetadata.scala:110) finished in 0.182 s
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Job 1 finished: take at DecisionTreeMetadata.scala:110, took 0.201751 s
> 15/09/15 18:50:39 INFO spark.SparkContext: Starting job: count at DecisionTreeMetadata.scala:111
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Got job 2 (count at DecisionTreeMetadata.scala:111) with 200 output partitions (allowLocal=false)
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Final stage: ResultStage 2(count at DecisionTreeMetadata.scala:111)
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Parents of final stage: List()
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Missing parents: List()
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[8] at retag at RandomForest.scala:137), which has no missing parents
> 15/09/15 18:50:39 INFO storage.MemoryStore: ensureFreeSpace(4152) called with curMem=208585, maxMem=18438322913
> 15/09/15 18:50:39 INFO storage.MemoryStore: Block broadcast_3 stored as values in memory (estimated size 4.1 KB, free 17.2 GB)
> 15/09/15 18:50:39 INFO storage.MemoryStore: ensureFreeSpace(2171) called with curMem=212737, maxMem=18438322913
> 15/09/15 18:50:39 INFO storage.MemoryStore: Block broadcast_3_piece0 stored as bytes in memory (estimated size 2.1 KB, free 17.2 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on 10.47.1.38:18554 (size: 2.1 KB, free: 17.2 GB)
> 15/09/15 18:50:39 INFO spark.SparkContext: Created broadcast 3 from broadcast at DAGScheduler.scala:874
> 15/09/15 18:50:39 INFO scheduler.DAGScheduler: Submitting 200 missing tasks from ResultStage 2 (MapPartitionsRDD[8] at retag at RandomForest.scala:137)
> 15/09/15 18:50:39 INFO cluster.YarnClusterScheduler: Adding task set 2.0 with 200 tasks
> 15/09/15 18:50:39 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_2 tasks to pool default
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 56.0 in stage 2.0 (TID 201, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 106.0 in stage 2.0 (TID 202, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 13.0 in stage 2.0 (TID 203, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 165.0 in stage 2.0 (TID 204, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 68.0 in stage 2.0 (TID 205, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 54.0 in stage 2.0 (TID 206, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 105.0 in stage 2.0 (TID 207, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 157.0 in stage 2.0 (TID 208, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 37.0 in stage 2.0 (TID 209, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 34.0 in stage 2.0 (TID 210, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 32.0 in stage 2.0 (TID 211, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 135.0 in stage 2.0 (TID 212, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 172.0 in stage 2.0 (TID 213, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 24.0 in stage 2.0 (TID 214, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 40.0 in stage 2.0 (TID 215, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 193.0 in stage 2.0 (TID 216, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 164.0 in stage 2.0 (TID 217, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 123.0 in stage 2.0 (TID 218, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 11.0 in stage 2.0 (TID 219, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 22.0 in stage 2.0 (TID 220, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 86.0 in stage 2.0 (TID 221, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 18.0 in stage 2.0 (TID 222, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 30.0 in stage 2.0 (TID 223, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 45.0 in stage 2.0 (TID 224, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 150.0 in stage 2.0 (TID 225, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 14.0 in stage 2.0 (TID 226, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 70.0 in stage 2.0 (TID 227, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 31.0 in stage 2.0 (TID 228, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 128.0 in stage 2.0 (TID 229, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 177.0 in stage 2.0 (TID 230, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 173.0 in stage 2.0 (TID 231, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 91.0 in stage 2.0 (TID 232, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 84.0 in stage 2.0 (TID 233, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 156.0 in stage 2.0 (TID 234, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 12.0 in stage 2.0 (TID 235, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 109.0 in stage 2.0 (TID 236, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 35.0 in stage 2.0 (TID 237, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 131.0 in stage 2.0 (TID 238, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 66.0 in stage 2.0 (TID 239, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 179.0 in stage 2.0 (TID 240, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 132.0 in stage 2.0 (TID 241, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 26.0 in stage 2.0 (TID 242, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 48.0 in stage 2.0 (TID 243, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 160.0 in stage 2.0 (TID 244, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 107.0 in stage 2.0 (TID 245, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 89.0 in stage 2.0 (TID 246, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 126.0 in stage 2.0 (TID 247, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 116.0 in stage 2.0 (TID 248, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 78.0 in stage 2.0 (TID 249, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 65.0 in stage 2.0 (TID 250, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 16.0 in stage 2.0 (TID 251, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 122.0 in stage 2.0 (TID 252, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 113.0 in stage 2.0 (TID 253, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 7.0 in stage 2.0 (TID 254, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 159.0 in stage 2.0 (TID 255, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 103.0 in stage 2.0 (TID 256, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 154.0 in stage 2.0 (TID 257, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 95.0 in stage 2.0 (TID 258, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 146.0 in stage 2.0 (TID 259, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 71.0 in stage 2.0 (TID 260, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 136.0 in stage 2.0 (TID 261, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 38.0 in stage 2.0 (TID 262, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 88.0 in stage 2.0 (TID 263, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 25.0 in stage 2.0 (TID 264, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 191.0 in stage 2.0 (TID 265, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 29.0 in stage 2.0 (TID 266, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 3.0 in stage 2.0 (TID 267, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 85.0 in stage 2.0 (TID 268, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 175.0 in stage 2.0 (TID 269, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 99.0 in stage 2.0 (TID 270, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 81.0 in stage 2.0 (TID 271, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 170.0 in stage 2.0 (TID 272, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 27.0 in stage 2.0 (TID 273, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 9.0 in stage 2.0 (TID 274, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 147.0 in stage 2.0 (TID 275, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 183.0 in stage 2.0 (TID 276, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 178.0 in stage 2.0 (TID 277, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 168.0 in stage 2.0 (TID 278, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 2.0 (TID 279, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 100.0 in stage 2.0 (TID 280, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 39.0 in stage 2.0 (TID 281, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 41.0 in stage 2.0 (TID 282, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 51.0 in stage 2.0 (TID 283, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 171.0 in stage 2.0 (TID 284, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 92.0 in stage 2.0 (TID 285, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 82.0 in stage 2.0 (TID 286, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 124.0 in stage 2.0 (TID 287, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 182.0 in stage 2.0 (TID 288, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 20.0 in stage 2.0 (TID 289, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 73.0 in stage 2.0 (TID 290, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 10.0 in stage 2.0 (TID 291, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 162.0 in stage 2.0 (TID 292, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 190.0 in stage 2.0 (TID 293, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 188.0 in stage 2.0 (TID 294, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 194.0 in stage 2.0 (TID 295, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 187.0 in stage 2.0 (TID 296, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 97.0 in stage 2.0 (TID 297, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 96.0 in stage 2.0 (TID 298, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 52.0 in stage 2.0 (TID 299, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 63.0 in stage 2.0 (TID 300, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 145.0 in stage 2.0 (TID 301, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 142.0 in stage 2.0 (TID 302, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 192.0 in stage 2.0 (TID 303, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 76.0 in stage 2.0 (TID 304, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 53.0 in stage 2.0 (TID 305, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 141.0 in stage 2.0 (TID 306, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 87.0 in stage 2.0 (TID 307, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 77.0 in stage 2.0 (TID 308, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 49.0 in stage 2.0 (TID 309, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 57.0 in stage 2.0 (TID 310, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 130.0 in stage 2.0 (TID 311, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 94.0 in stage 2.0 (TID 312, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 72.0 in stage 2.0 (TID 313, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 6.0 in stage 2.0 (TID 314, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 120.0 in stage 2.0 (TID 315, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 163.0 in stage 2.0 (TID 316, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 43.0 in stage 2.0 (TID 317, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 148.0 in stage 2.0 (TID 318, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 15.0 in stage 2.0 (TID 319, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 101.0 in stage 2.0 (TID 320, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 143.0 in stage 2.0 (TID 321, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 125.0 in stage 2.0 (TID 322, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 21.0 in stage 2.0 (TID 323, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 79.0 in stage 2.0 (TID 324, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 74.0 in stage 2.0 (TID 325, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 110.0 in stage 2.0 (TID 326, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 184.0 in stage 2.0 (TID 327, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 69.0 in stage 2.0 (TID 328, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 4.0 in stage 2.0 (TID 329, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 67.0 in stage 2.0 (TID 330, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 140.0 in stage 2.0 (TID 331, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 118.0 in stage 2.0 (TID 332, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 50.0 in stage 2.0 (TID 333, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 108.0 in stage 2.0 (TID 334, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 17.0 in stage 2.0 (TID 335, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 180.0 in stage 2.0 (TID 336, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 119.0 in stage 2.0 (TID 337, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 8.0 in stage 2.0 (TID 338, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 2.0 (TID 339, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 138.0 in stage 2.0 (TID 340, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 33.0 in stage 2.0 (TID 341, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 149.0 in stage 2.0 (TID 342, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 42.0 in stage 2.0 (TID 343, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 195.0 in stage 2.0 (TID 344, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 121.0 in stage 2.0 (TID 345, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 93.0 in stage 2.0 (TID 346, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 166.0 in stage 2.0 (TID 347, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 59.0 in stage 2.0 (TID 348, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 19.0 in stage 2.0 (TID 349, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 2.0 in stage 2.0 (TID 350, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 75.0 in stage 2.0 (TID 351, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 58.0 in stage 2.0 (TID 352, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 176.0 in stage 2.0 (TID 353, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 158.0 in stage 2.0 (TID 354, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 196.0 in stage 2.0 (TID 355, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 64.0 in stage 2.0 (TID 356, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 144.0 in stage 2.0 (TID 357, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 83.0 in stage 2.0 (TID 358, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 62.0 in stage 2.0 (TID 359, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 185.0 in stage 2.0 (TID 360, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 167.0 in stage 2.0 (TID 361, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 36.0 in stage 2.0 (TID 362, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 153.0 in stage 2.0 (TID 363, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 134.0 in stage 2.0 (TID 364, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 90.0 in stage 2.0 (TID 365, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 111.0 in stage 2.0 (TID 366, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 151.0 in stage 2.0 (TID 367, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 61.0 in stage 2.0 (TID 368, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 117.0 in stage 2.0 (TID 369, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 46.0 in stage 2.0 (TID 370, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 55.0 in stage 2.0 (TID 371, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 189.0 in stage 2.0 (TID 372, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 114.0 in stage 2.0 (TID 373, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 5.0 in stage 2.0 (TID 374, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 181.0 in stage 2.0 (TID 375, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 155.0 in stage 2.0 (TID 376, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 28.0 in stage 2.0 (TID 377, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 127.0 in stage 2.0 (TID 378, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd288dg.prod.mediav.com:64716 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd281dg.prod.mediav.com:2780 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd261dg.prod.mediav.com:48502 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd263dg.prod.mediav.com:19616 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd261dg.prod.mediav.com:17918 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd290dg.prod.mediav.com:1034 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd270dg.prod.mediav.com:6944 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd272dg.prod.mediav.com:47434 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd262dg.prod.mediav.com:49994 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd293dg.prod.mediav.com:25809 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd272dg.prod.mediav.com:36193 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd256dg.prod.mediav.com:5214 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd281dg.prod.mediav.com:2395 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd260dg.prod.mediav.com:34432 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd290dg.prod.mediav.com:48698 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd262dg.prod.mediav.com:40567 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd271dg.prod.mediav.com:33037 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd280dg.prod.mediav.com:29265 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd276dg.prod.mediav.com:62943 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd283dg.prod.mediav.com:5777 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd262dg.prod.mediav.com:35030 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd256dg.prod.mediav.com:65180 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd287dg.prod.mediav.com:2270 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd261dg.prod.mediav.com:35424 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd288dg.prod.mediav.com:58225 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd255dg.prod.mediav.com:24822 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd293dg.prod.mediav.com:18866 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd286dg.prod.mediav.com:5189 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd271dg.prod.mediav.com:11439 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd278dg.prod.mediav.com:27239 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd292dg.prod.mediav.com:5167 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd254dg.prod.mediav.com:28306 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd291dg.prod.mediav.com:47717 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd280dg.prod.mediav.com:8788 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd278dg.prod.mediav.com:1380 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd257dg.prod.mediav.com:23974 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd263dg.prod.mediav.com:5872 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd258dg.prod.mediav.com:8532 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd273dg.prod.mediav.com:4400 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 2.0 (TID 279) in 128 ms on hd292dg.prod.mediav.com (1/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_22 in memory on hd293dg.prod.mediav.com:25809 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_131 in memory on hd290dg.prod.mediav.com:1034 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_96 in memory on hd260dg.prod.mediav.com:34432 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_91 in memory on hd290dg.prod.mediav.com:48698 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 80.0 in stage 2.0 (TID 379, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_9 in memory on hd262dg.prod.mediav.com:49994 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 22.0 in stage 2.0 (TID 220) in 199 ms on hd293dg.prod.mediav.com (2/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_18 in memory on hd270dg.prod.mediav.com:6944 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_105 in memory on hd288dg.prod.mediav.com:64716 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_107 in memory on hd261dg.prod.mediav.com:17918 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_35 in memory on hd263dg.prod.mediav.com:19616 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 133.0 in stage 2.0 (TID 380, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 131.0 in stage 2.0 (TID 238) in 200 ms on hd290dg.prod.mediav.com (3/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 102.0 in stage 2.0 (TID 381, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_37 in memory on hd256dg.prod.mediav.com:5214 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 91.0 in stage 2.0 (TID 232) in 205 ms on hd290dg.prod.mediav.com (4/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_27 in memory on hd271dg.prod.mediav.com:11439 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_141 in memory on hd286dg.prod.mediav.com:5189 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 44.0 in stage 2.0 (TID 382, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_157 in memory on hd281dg.prod.mediav.com:2780 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_166 in memory on hd293dg.prod.mediav.com:18866 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 9.0 in stage 2.0 (TID 274) in 199 ms on hd262dg.prod.mediav.com (5/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_190 in memory on hd255dg.prod.mediav.com:24822 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 96.0 in stage 2.0 (TID 298) in 195 ms on hd260dg.prod.mediav.com (6/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_122 in memory on hd280dg.prod.mediav.com:8788 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_103 in memory on hd271dg.prod.mediav.com:33037 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_168 in memory on hd257dg.prod.mediav.com:23974 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_54 in memory on hd272dg.prod.mediav.com:36193 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 18.0 in stage 2.0 (TID 222) in 214 ms on hd270dg.prod.mediav.com (7/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 105.0 in stage 2.0 (TID 207) in 220 ms on hd288dg.prod.mediav.com (8/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 107.0 in stage 2.0 (TID 245) in 210 ms on hd261dg.prod.mediav.com (9/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_5 in memory on hd254dg.prod.mediav.com:28306 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_40 in memory on hd283dg.prod.mediav.com:5777 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_173 in memory on hd276dg.prod.mediav.com:62943 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 35.0 in stage 2.0 (TID 237) in 214 ms on hd263dg.prod.mediav.com (10/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 37.0 in stage 2.0 (TID 209) in 222 ms on hd256dg.prod.mediav.com (11/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_90 in memory on hd273dg.prod.mediav.com:4400 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_10 in memory on hd261dg.prod.mediav.com:48502 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 157.0 in stage 2.0 (TID 208) in 227 ms on hd281dg.prod.mediav.com (12/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_101 in memory on hd261dg.prod.mediav.com:35424 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_132 in memory on hd256dg.prod.mediav.com:65180 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 190.0 in stage 2.0 (TID 293) in 209 ms on hd255dg.prod.mediav.com (13/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 27.0 in stage 2.0 (TID 273) in 212 ms on hd271dg.prod.mediav.com (14/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 166.0 in stage 2.0 (TID 347) in 201 ms on hd293dg.prod.mediav.com (15/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 141.0 in stage 2.0 (TID 306) in 208 ms on hd286dg.prod.mediav.com (16/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_34 in memory on hd288dg.prod.mediav.com:58225 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_153 in memory on hd263dg.prod.mediav.com:5872 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 122.0 in stage 2.0 (TID 252) in 218 ms on hd280dg.prod.mediav.com (17/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_127 in memory on hd278dg.prod.mediav.com:1380 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_64 in memory on hd278dg.prod.mediav.com:27239 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_106 in memory on hd281dg.prod.mediav.com:2395 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 54.0 in stage 2.0 (TID 206) in 232 ms on hd272dg.prod.mediav.com (18/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 103.0 in stage 2.0 (TID 256) in 219 ms on hd271dg.prod.mediav.com (19/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 168.0 in stage 2.0 (TID 278) in 216 ms on hd257dg.prod.mediav.com (20/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 40.0 in stage 2.0 (TID 215) in 230 ms on hd283dg.prod.mediav.com (21/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd275dg.prod.mediav.com:37869 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 5.0 in stage 2.0 (TID 374) in 203 ms on hd254dg.prod.mediav.com (22/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 90.0 in stage 2.0 (TID 365) in 205 ms on hd273dg.prod.mediav.com (23/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_6 in memory on hd262dg.prod.mediav.com:35030 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 173.0 in stage 2.0 (TID 231) in 228 ms on hd276dg.prod.mediav.com (24/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_13 in memory on hd262dg.prod.mediav.com:40567 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_25 in memory on hd291dg.prod.mediav.com:47717 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_109 in memory on hd280dg.prod.mediav.com:29265 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 132.0 in stage 2.0 (TID 241) in 231 ms on hd256dg.prod.mediav.com (25/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_29 in memory on hd287dg.prod.mediav.com:2270 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 64.0 in stage 2.0 (TID 356) in 214 ms on hd278dg.prod.mediav.com (26/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 101.0 in stage 2.0 (TID 320) in 220 ms on hd261dg.prod.mediav.com (27/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_116 in memory on hd272dg.prod.mediav.com:47434 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 10.0 in stage 2.0 (TID 291) in 225 ms on hd261dg.prod.mediav.com (28/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 127.0 in stage 2.0 (TID 378) in 212 ms on hd278dg.prod.mediav.com (29/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_80 in memory on hd293dg.prod.mediav.com:25809 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 137.0 in stage 2.0 (TID 383, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 34.0 in stage 2.0 (TID 210) in 245 ms on hd288dg.prod.mediav.com (30/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 106.0 in stage 2.0 (TID 202) in 249 ms on hd281dg.prod.mediav.com (31/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 153.0 in stage 2.0 (TID 363) in 217 ms on hd263dg.prod.mediav.com (32/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 112.0 in stage 2.0 (TID 384, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 23.0 in stage 2.0 (TID 385, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 25.0 in stage 2.0 (TID 264) in 236 ms on hd291dg.prod.mediav.com (33/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 13.0 in stage 2.0 (TID 203) in 251 ms on hd262dg.prod.mediav.com (34/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 6.0 in stage 2.0 (TID 314) in 229 ms on hd262dg.prod.mediav.com (35/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 109.0 in stage 2.0 (TID 236) in 242 ms on hd280dg.prod.mediav.com (36/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 60.0 in stage 2.0 (TID 386, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 174.0 in stage 2.0 (TID 387, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 29.0 in stage 2.0 (TID 266) in 240 ms on hd287dg.prod.mediav.com (37/200)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 80.0 in stage 2.0 (TID 379) in 53 ms on hd293dg.prod.mediav.com (38/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_133 in memory on hd290dg.prod.mediav.com:1034 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Finished task 116.0 in stage 2.0 (TID 248) in 246 ms on hd272dg.prod.mediav.com (39/200)
> 15/09/15 18:50:39 INFO storage.BlockManagerInfo: Added rdd_7_44 in memory on hd262dg.prod.mediav.com:49994 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:39 INFO scheduler.TaskSetManager: Starting task 199.0 in stage 2.0 (TID 388, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 133.0 in stage 2.0 (TID 380) in 60 ms on hd290dg.prod.mediav.com (40/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 44.0 in stage 2.0 (TID 382) in 56 ms on hd262dg.prod.mediav.com (41/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_102 in memory on hd290dg.prod.mediav.com:48698 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 102.0 in stage 2.0 (TID 381) in 72 ms on hd290dg.prod.mediav.com (42/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_112 in memory on hd262dg.prod.mediav.com:40567 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd260dg.prod.mediav.com:45170 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_23 in memory on hd262dg.prod.mediav.com:35030 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_137 in memory on hd281dg.prod.mediav.com:2395 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_196 in memory on hd258dg.prod.mediav.com:8532 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_174 in memory on hd293dg.prod.mediav.com:25809 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_60 in memory on hd287dg.prod.mediav.com:2270 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 112.0 in stage 2.0 (TID 384) in 56 ms on hd262dg.prod.mediav.com (43/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 23.0 in stage 2.0 (TID 385) in 56 ms on hd262dg.prod.mediav.com (44/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 137.0 in stage 2.0 (TID 383) in 62 ms on hd281dg.prod.mediav.com (45/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_199 in memory on hd290dg.prod.mediav.com:1034 (size: 3.6 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Starting task 197.0 in stage 2.0 (TID 389, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 196.0 in stage 2.0 (TID 355) in 285 ms on hd258dg.prod.mediav.com (46/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 60.0 in stage 2.0 (TID 386) in 62 ms on hd287dg.prod.mediav.com (47/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 174.0 in stage 2.0 (TID 387) in 62 ms on hd293dg.prod.mediav.com (48/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd283dg.prod.mediav.com:27671 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd289dg.prod.mediav.com:5555 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd285dg.prod.mediav.com:7398 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd291dg.prod.mediav.com:54360 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd255dg.prod.mediav.com:8336 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 199.0 in stage 2.0 (TID 388) in 59 ms on hd290dg.prod.mediav.com (49/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd282dg.prod.mediav.com:42292 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_86 in memory on hd275dg.prod.mediav.com:37869 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 86.0 in stage 2.0 (TID 221) in 345 ms on hd275dg.prod.mediav.com (50/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_197 in memory on hd293dg.prod.mediav.com:25809 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 197.0 in stage 2.0 (TID 389) in 65 ms on hd293dg.prod.mediav.com (51/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_135 in memory on hd260dg.prod.mediav.com:45170 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_65 in memory on hd285dg.prod.mediav.com:7398 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 135.0 in stage 2.0 (TID 212) in 412 ms on hd260dg.prod.mediav.com (52/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_147 in memory on hd283dg.prod.mediav.com:27671 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_187 in memory on hd289dg.prod.mediav.com:5555 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_7 in memory on hd291dg.prod.mediav.com:54360 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 65.0 in stage 2.0 (TID 250) in 415 ms on hd285dg.prod.mediav.com (53/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 147.0 in stage 2.0 (TID 275) in 411 ms on hd283dg.prod.mediav.com (54/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_46 in memory on hd282dg.prod.mediav.com:42292 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 7.0 in stage 2.0 (TID 254) in 423 ms on hd291dg.prod.mediav.com (55/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 187.0 in stage 2.0 (TID 296) in 416 ms on hd289dg.prod.mediav.com (56/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_175 in memory on hd255dg.prod.mediav.com:8336 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 46.0 in stage 2.0 (TID 370) in 418 ms on hd282dg.prod.mediav.com (57/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 175.0 in stage 2.0 (TID 269) in 440 ms on hd255dg.prod.mediav.com (58/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd281dg.prod.mediav.com:12163 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_156 in memory on hd281dg.prod.mediav.com:12163 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 156.0 in stage 2.0 (TID 234) in 836 ms on hd281dg.prod.mediav.com (59/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd282dg.prod.mediav.com:57776 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd284dg.prod.mediav.com:46214 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd272dg.prod.mediav.com:63317 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd262dg.prod.mediav.com:5957 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd283dg.prod.mediav.com:62866 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd261dg.prod.mediav.com:16786 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd293dg.prod.mediav.com:46714 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd283dg.prod.mediav.com:19668 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd289dg.prod.mediav.com:22644 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd290dg.prod.mediav.com:48176 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd289dg.prod.mediav.com:48417 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd254dg.prod.mediav.com:6401 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd288dg.prod.mediav.com:3459 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd261dg.prod.mediav.com:51708 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd256dg.prod.mediav.com:4157 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd293dg.prod.mediav.com:60417 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd276dg.prod.mediav.com:15025 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd283dg.prod.mediav.com:15357 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd266dg.prod.mediav.com:60871 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd263dg.prod.mediav.com:30335 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd263dg.prod.mediav.com:28737 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd292dg.prod.mediav.com:9515 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd276dg.prod.mediav.com:46848 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd284dg.prod.mediav.com:33099 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd270dg.prod.mediav.com:33090 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd273dg.prod.mediav.com:35935 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd280dg.prod.mediav.com:6093 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd257dg.prod.mediav.com:50217 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd285dg.prod.mediav.com:52469 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd273dg.prod.mediav.com:51855 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd279dg.prod.mediav.com:49996 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd266dg.prod.mediav.com:60772 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd274dg.prod.mediav.com:16654 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd291dg.prod.mediav.com:9728 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd288dg.prod.mediav.com:30986 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd266dg.prod.mediav.com:7561 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd279dg.prod.mediav.com:34009 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd288dg.prod.mediav.com:15935 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd254dg.prod.mediav.com:37252 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd270dg.prod.mediav.com:5548 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd275dg.prod.mediav.com:7744 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd265dg.prod.mediav.com:41028 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd280dg.prod.mediav.com:4198 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd274dg.prod.mediav.com:50461 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd289dg.prod.mediav.com:48937 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd266dg.prod.mediav.com:18054 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd277dg.prod.mediav.com:17325 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd284dg.prod.mediav.com:65293 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd264dg.prod.mediav.com:48038 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd278dg.prod.mediav.com:16567 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd255dg.prod.mediav.com:29011 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_70 in memory on hd284dg.prod.mediav.com:46214 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_165 in memory on hd282dg.prod.mediav.com:57776 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_56 in memory on hd276dg.prod.mediav.com:15025 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_71 in memory on hd288dg.prod.mediav.com:3459 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_123 in memory on hd272dg.prod.mediav.com:63317 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_76 in memory on hd261dg.prod.mediav.com:51708 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_45 in memory on hd289dg.prod.mediav.com:22644 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_11 in memory on hd290dg.prod.mediav.com:48176 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_30 in memory on hd283dg.prod.mediav.com:62866 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_185 in memory on hd254dg.prod.mediav.com:37252 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_154 in memory on hd283dg.prod.mediav.com:19668 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_68 in memory on hd293dg.prod.mediav.com:46714 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 70.0 in stage 2.0 (TID 227) in 1202 ms on hd284dg.prod.mediav.com (60/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_143 in memory on hd283dg.prod.mediav.com:15357 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_172 in memory on hd256dg.prod.mediav.com:4157 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_191 in memory on hd276dg.prod.mediav.com:46848 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Starting task 98.0 in stage 2.0 (TID 390, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 165.0 in stage 2.0 (TID 204) in 1213 ms on hd282dg.prod.mediav.com (61/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 56.0 in stage 2.0 (TID 201) in 1217 ms on hd276dg.prod.mediav.com (62/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_79 in memory on hd292dg.prod.mediav.com:9515 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_114 in memory on hd280dg.prod.mediav.com:4198 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_59 in memory on hd280dg.prod.mediav.com:6093 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_95 in memory on hd289dg.prod.mediav.com:48417 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_110 in memory on hd284dg.prod.mediav.com:33099 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 45.0 in stage 2.0 (TID 224) in 1211 ms on hd289dg.prod.mediav.com (63/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 71.0 in stage 2.0 (TID 260) in 1204 ms on hd288dg.prod.mediav.com (64/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_140 in memory on hd270dg.prod.mediav.com:33090 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 76.0 in stage 2.0 (TID 304) in 1197 ms on hd261dg.prod.mediav.com (65/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 123.0 in stage 2.0 (TID 218) in 1214 ms on hd272dg.prod.mediav.com (66/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_82 in memory on hd261dg.prod.mediav.com:16786 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_181 in memory on hd284dg.prod.mediav.com:65293 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_160 in memory on hd257dg.prod.mediav.com:50217 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_61 in memory on hd270dg.prod.mediav.com:5548 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 185.0 in stage 2.0 (TID 360) in 1191 ms on hd254dg.prod.mediav.com (67/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_195 in memory on hd273dg.prod.mediav.com:51855 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_55 in memory on hd278dg.prod.mediav.com:16567 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_182 in memory on hd254dg.prod.mediav.com:6401 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 154.0 in stage 2.0 (TID 257) in 1209 ms on hd283dg.prod.mediav.com (68/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_120 in memory on hd273dg.prod.mediav.com:35935 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_33 in memory on hd274dg.prod.mediav.com:16654 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 68.0 in stage 2.0 (TID 205) in 1224 ms on hd293dg.prod.mediav.com (69/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 11.0 in stage 2.0 (TID 219) in 1220 ms on hd290dg.prod.mediav.com (70/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 30.0 in stage 2.0 (TID 223) in 1218 ms on hd283dg.prod.mediav.com (71/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_158 in memory on hd274dg.prod.mediav.com:50461 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_43 in memory on hd291dg.prod.mediav.com:9728 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_88 in memory on hd262dg.prod.mediav.com:5957 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 143.0 in stage 2.0 (TID 321) in 1201 ms on hd283dg.prod.mediav.com (72/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_111 in memory on hd264dg.prod.mediav.com:48038 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 191.0 in stage 2.0 (TID 265) in 1213 ms on hd276dg.prod.mediav.com (73/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 172.0 in stage 2.0 (TID 213) in 1225 ms on hd256dg.prod.mediav.com (74/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 95.0 in stage 2.0 (TID 258) in 1216 ms on hd289dg.prod.mediav.com (75/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_32 in memory on hd293dg.prod.mediav.com:60417 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 114.0 in stage 2.0 (TID 373) in 1197 ms on hd280dg.prod.mediav.com (76/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 59.0 in stage 2.0 (TID 348) in 1201 ms on hd280dg.prod.mediav.com (77/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 110.0 in stage 2.0 (TID 326) in 1206 ms on hd284dg.prod.mediav.com (78/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_180 in memory on hd285dg.prod.mediav.com:52469 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 140.0 in stage 2.0 (TID 331) in 1206 ms on hd270dg.prod.mediav.com (79/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 82.0 in stage 2.0 (TID 286) in 1213 ms on hd261dg.prod.mediav.com (80/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 79.0 in stage 2.0 (TID 324) in 1207 ms on hd292dg.prod.mediav.com (81/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_62 in memory on hd289dg.prod.mediav.com:48937 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 61.0 in stage 2.0 (TID 368) in 1202 ms on hd270dg.prod.mediav.com (82/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 181.0 in stage 2.0 (TID 375) in 1202 ms on hd284dg.prod.mediav.com (83/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Starting task 129.0 in stage 2.0 (TID 391, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_163 in memory on hd263dg.prod.mediav.com:30335 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 160.0 in stage 2.0 (TID 244) in 1225 ms on hd257dg.prod.mediav.com (84/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 55.0 in stage 2.0 (TID 371) in 1205 ms on hd278dg.prod.mediav.com (85/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 33.0 in stage 2.0 (TID 341) in 1209 ms on hd274dg.prod.mediav.com (86/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 88.0 in stage 2.0 (TID 263) in 1222 ms on hd262dg.prod.mediav.com (87/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 195.0 in stage 2.0 (TID 344) in 1210 ms on hd273dg.prod.mediav.com (88/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_155 in memory on hd275dg.prod.mediav.com:7744 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_134 in memory on hd255dg.prod.mediav.com:29011 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 43.0 in stage 2.0 (TID 317) in 1214 ms on hd291dg.prod.mediav.com (89/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 120.0 in stage 2.0 (TID 315) in 1215 ms on hd273dg.prod.mediav.com (90/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_189 in memory on hd277dg.prod.mediav.com:17325 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 158.0 in stage 2.0 (TID 354) in 1209 ms on hd274dg.prod.mediav.com (91/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 182.0 in stage 2.0 (TID 288) in 1220 ms on hd254dg.prod.mediav.com (92/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_83 in memory on hd288dg.prod.mediav.com:30986 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 111.0 in stage 2.0 (TID 366) in 1208 ms on hd264dg.prod.mediav.com (93/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_84 in memory on hd266dg.prod.mediav.com:60871 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 32.0 in stage 2.0 (TID 211) in 1240 ms on hd293dg.prod.mediav.com (94/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 180.0 in stage 2.0 (TID 336) in 1219 ms on hd285dg.prod.mediav.com (95/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_170 in memory on hd263dg.prod.mediav.com:28737 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 62.0 in stage 2.0 (TID 359) in 1217 ms on hd289dg.prod.mediav.com (96/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_2 in memory on hd288dg.prod.mediav.com:15935 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 163.0 in stage 2.0 (TID 316) in 1224 ms on hd263dg.prod.mediav.com (97/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 155.0 in stage 2.0 (TID 376) in 1217 ms on hd275dg.prod.mediav.com (98/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 83.0 in stage 2.0 (TID 358) in 1222 ms on hd288dg.prod.mediav.com (99/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 134.0 in stage 2.0 (TID 364) in 1221 ms on hd255dg.prod.mediav.com (100/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 189.0 in stage 2.0 (TID 372) in 1221 ms on hd277dg.prod.mediav.com (101/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_57 in memory on hd266dg.prod.mediav.com:7561 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 84.0 in stage 2.0 (TID 233) in 1246 ms on hd266dg.prod.mediav.com (102/200)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 170.0 in stage 2.0 (TID 272) in 1241 ms on hd263dg.prod.mediav.com (103/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_67 in memory on hd266dg.prod.mediav.com:60772 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_28 in memory on hd266dg.prod.mediav.com:18054 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 2.0 in stage 2.0 (TID 350) in 1235 ms on hd288dg.prod.mediav.com (104/200)
> 15/09/15 18:50:40 INFO storage.BlockManagerInfo: Added rdd_7_98 in memory on hd276dg.prod.mediav.com:15025 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:40 INFO scheduler.TaskSetManager: Finished task 57.0 in stage 2.0 (TID 310) in 1245 ms on hd266dg.prod.mediav.com (105/200)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Starting task 139.0 in stage 2.0 (TID 392, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 67.0 in stage 2.0 (TID 330) in 1246 ms on hd266dg.prod.mediav.com (106/200)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 28.0 in stage 2.0 (TID 377) in 1243 ms on hd266dg.prod.mediav.com (107/200)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 98.0 in stage 2.0 (TID 390) in 66 ms on hd276dg.prod.mediav.com (108/200)
> 15/09/15 18:50:41 INFO storage.BlockManagerInfo: Added rdd_7_129 in memory on hd262dg.prod.mediav.com:5957 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 129.0 in stage 2.0 (TID 391) in 57 ms on hd262dg.prod.mediav.com (109/200)
> 15/09/15 18:50:41 INFO storage.BlockManagerInfo: Added rdd_7_119 in memory on hd279dg.prod.mediav.com:49996 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:41 INFO storage.BlockManagerInfo: Added rdd_7_117 in memory on hd279dg.prod.mediav.com:34009 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 119.0 in stage 2.0 (TID 337) in 1280 ms on hd279dg.prod.mediav.com (110/200)
> 15/09/15 18:50:41 INFO storage.BlockManagerInfo: Added rdd_7_167 in memory on hd265dg.prod.mediav.com:41028 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:41 INFO storage.BlockManagerInfo: Added rdd_7_139 in memory on hd266dg.prod.mediav.com:60772 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 117.0 in stage 2.0 (TID 369) in 1284 ms on hd279dg.prod.mediav.com (111/200)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 167.0 in stage 2.0 (TID 361) in 1292 ms on hd265dg.prod.mediav.com (112/200)
> 15/09/15 18:50:41 INFO scheduler.TaskSetManager: Finished task 139.0 in stage 2.0 (TID 392) in 57 ms on hd266dg.prod.mediav.com (113/200)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd280dg.prod.mediav.com:1897 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd275dg.prod.mediav.com:52956 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd275dg.prod.mediav.com:3649 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd282dg.prod.mediav.com:47145 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd272dg.prod.mediav.com:63093 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd293dg.prod.mediav.com:23628 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd284dg.prod.mediav.com:39393 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd285dg.prod.mediav.com:15892 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_188 in memory on hd275dg.prod.mediav.com:3649 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_15 in memory on hd285dg.prod.mediav.com:15892 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_142 in memory on hd275dg.prod.mediav.com:52956 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_8 in memory on hd282dg.prod.mediav.com:47145 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_138 in memory on hd272dg.prod.mediav.com:63093 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_49 in memory on hd293dg.prod.mediav.com:23628 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 188.0 in stage 2.0 (TID 294) in 4206 ms on hd275dg.prod.mediav.com (114/200)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_21 in memory on hd284dg.prod.mediav.com:39393 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 15.0 in stage 2.0 (TID 319) in 4211 ms on hd285dg.prod.mediav.com (115/200)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 8.0 in stage 2.0 (TID 338) in 4209 ms on hd282dg.prod.mediav.com (116/200)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 142.0 in stage 2.0 (TID 302) in 4214 ms on hd275dg.prod.mediav.com (117/200)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 49.0 in stage 2.0 (TID 309) in 4215 ms on hd293dg.prod.mediav.com (118/200)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 138.0 in stage 2.0 (TID 340) in 4212 ms on hd272dg.prod.mediav.com (119/200)
> 15/09/15 18:50:43 INFO scheduler.TaskSetManager: Finished task 21.0 in stage 2.0 (TID 323) in 4220 ms on hd284dg.prod.mediav.com (120/200)
> 15/09/15 18:50:43 INFO storage.BlockManagerInfo: Added rdd_7_97 in memory on hd280dg.prod.mediav.com:1897 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:44 INFO scheduler.TaskSetManager: Starting task 152.0 in stage 2.0 (TID 393, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1425 bytes)
> 15/09/15 18:50:44 INFO scheduler.TaskSetManager: Finished task 97.0 in stage 2.0 (TID 297) in 4255 ms on hd280dg.prod.mediav.com (121/200)
> 15/09/15 18:50:44 INFO storage.BlockManagerInfo: Added rdd_7_152 in memory on hd280dg.prod.mediav.com:1897 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:44 INFO scheduler.TaskSetManager: Finished task 152.0 in stage 2.0 (TID 393) in 61 ms on hd280dg.prod.mediav.com (122/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd277dg.prod.mediav.com:27612 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd262dg.prod.mediav.com:24194 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd260dg.prod.mediav.com:38400 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd260dg.prod.mediav.com:20879 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd265dg.prod.mediav.com:38596 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd285dg.prod.mediav.com:25860 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd292dg.prod.mediav.com:24852 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd265dg.prod.mediav.com:65261 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd292dg.prod.mediav.com:31959 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd255dg.prod.mediav.com:62882 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd271dg.prod.mediav.com:63849 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd275dg.prod.mediav.com:27702 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd272dg.prod.mediav.com:13836 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd286dg.prod.mediav.com:20786 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd256dg.prod.mediav.com:22567 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd282dg.prod.mediav.com:51731 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd258dg.prod.mediav.com:44194 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd254dg.prod.mediav.com:50339 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd256dg.prod.mediav.com:54569 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd287dg.prod.mediav.com:53041 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd281dg.prod.mediav.com:24432 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd276dg.prod.mediav.com:65222 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd286dg.prod.mediav.com:22509 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd274dg.prod.mediav.com:25030 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd286dg.prod.mediav.com:15531 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd291dg.prod.mediav.com:3890 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd287dg.prod.mediav.com:2547 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd277dg.prod.mediav.com:27951 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 47.0 in stage 2.0 (TID 394, hd262dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 161.0 in stage 2.0 (TID 395, hd255dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 186.0 in stage 2.0 (TID 396, hd291dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 115.0 in stage 2.0 (TID 397, hd289dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 169.0 in stage 2.0 (TID 398, hd276dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 104.0 in stage 2.0 (TID 399, hd287dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd291dg.prod.mediav.com:31861 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Starting task 198.0 in stage 2.0 (TID 400, hd262dg.prod.mediav.com, NODE_LOCAL, 1425 bytes)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_41 in memory on hd262dg.prod.mediav.com:24194 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_130 in memory on hd256dg.prod.mediav.com:54569 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_1 in memory on hd287dg.prod.mediav.com:53041 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_24 in memory on hd271dg.prod.mediav.com:63849 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_66 in memory on hd292dg.prod.mediav.com:24852 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 41.0 in stage 2.0 (TID 282) in 8209 ms on hd262dg.prod.mediav.com (123/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_159 in memory on hd292dg.prod.mediav.com:31959 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_74 in memory on hd254dg.prod.mediav.com:50339 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_193 in memory on hd277dg.prod.mediav.com:27612 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_171 in memory on hd272dg.prod.mediav.com:13836 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 130.0 in stage 2.0 (TID 311) in 8211 ms on hd256dg.prod.mediav.com (124/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_38 in memory on hd260dg.prod.mediav.com:20879 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_179 in memory on hd282dg.prod.mediav.com:51731 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_144 in memory on hd281dg.prod.mediav.com:24432 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_58 in memory on hd287dg.prod.mediav.com:2547 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 24.0 in stage 2.0 (TID 214) in 8234 ms on hd271dg.prod.mediav.com (125/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_184 in memory on hd258dg.prod.mediav.com:44194 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 66.0 in stage 2.0 (TID 239) in 8231 ms on hd292dg.prod.mediav.com (126/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_48 in memory on hd256dg.prod.mediav.com:22567 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 1.0 in stage 2.0 (TID 339) in 8216 ms on hd287dg.prod.mediav.com (127/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_128 in memory on hd260dg.prod.mediav.com:38400 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 159.0 in stage 2.0 (TID 255) in 8229 ms on hd292dg.prod.mediav.com (128/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_16 in memory on hd285dg.prod.mediav.com:25860 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 74.0 in stage 2.0 (TID 325) in 8219 ms on hd254dg.prod.mediav.com (129/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_176 in memory on hd286dg.prod.mediav.com:15531 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 171.0 in stage 2.0 (TID 284) in 8226 ms on hd272dg.prod.mediav.com (130/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_85 in memory on hd286dg.prod.mediav.com:20786 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 193.0 in stage 2.0 (TID 216) in 8241 ms on hd277dg.prod.mediav.com (131/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_151 in memory on hd277dg.prod.mediav.com:27951 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 38.0 in stage 2.0 (TID 262) in 8231 ms on hd260dg.prod.mediav.com (132/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 179.0 in stage 2.0 (TID 240) in 8239 ms on hd282dg.prod.mediav.com (133/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_99 in memory on hd274dg.prod.mediav.com:25030 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 144.0 in stage 2.0 (TID 357) in 8219 ms on hd281dg.prod.mediav.com (134/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 58.0 in stage 2.0 (TID 352) in 8222 ms on hd287dg.prod.mediav.com (135/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 184.0 in stage 2.0 (TID 327) in 8227 ms on hd258dg.prod.mediav.com (136/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_150 in memory on hd265dg.prod.mediav.com:65261 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 48.0 in stage 2.0 (TID 243) in 8242 ms on hd256dg.prod.mediav.com (137/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 128.0 in stage 2.0 (TID 229) in 8246 ms on hd260dg.prod.mediav.com (138/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 16.0 in stage 2.0 (TID 251) in 8243 ms on hd285dg.prod.mediav.com (139/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_19 in memory on hd291dg.prod.mediav.com:31861 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 151.0 in stage 2.0 (TID 367) in 8225 ms on hd277dg.prod.mediav.com (140/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 85.0 in stage 2.0 (TID 268) in 8241 ms on hd286dg.prod.mediav.com (141/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_108 in memory on hd286dg.prod.mediav.com:22509 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_81 in memory on hd265dg.prod.mediav.com:38596 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 176.0 in stage 2.0 (TID 353) in 8231 ms on hd286dg.prod.mediav.com (142/200)
> 15/09/15 18:50:47 INFO storage.BlockManagerInfo: Added rdd_7_53 in memory on hd275dg.prod.mediav.com:27702 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 99.0 in stage 2.0 (TID 270) in 8248 ms on hd274dg.prod.mediav.com (143/200)
> 15/09/15 18:50:47 INFO scheduler.TaskSetManager: Finished task 150.0 in stage 2.0 (TID 225) in 8259 ms on hd265dg.prod.mediav.com (144/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_113 in memory on hd255dg.prod.mediav.com:62882 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_50 in memory on hd291dg.prod.mediav.com:3890 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 81.0 in stage 2.0 (TID 271) in 8254 ms on hd265dg.prod.mediav.com (145/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 108.0 in stage 2.0 (TID 334) in 8244 ms on hd286dg.prod.mediav.com (146/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 19.0 in stage 2.0 (TID 349) in 8246 ms on hd291dg.prod.mediav.com (147/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_126 in memory on hd276dg.prod.mediav.com:65222 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 53.0 in stage 2.0 (TID 305) in 8257 ms on hd275dg.prod.mediav.com (148/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 113.0 in stage 2.0 (TID 253) in 8274 ms on hd255dg.prod.mediav.com (149/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 50.0 in stage 2.0 (TID 333) in 8261 ms on hd291dg.prod.mediav.com (150/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 126.0 in stage 2.0 (TID 247) in 8284 ms on hd276dg.prod.mediav.com (151/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd292dg.prod.mediav.com:8313 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd278dg.prod.mediav.com:9221 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd279dg.prod.mediav.com:12678 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd264dg.prod.mediav.com:49664 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd290dg.prod.mediav.com:6793 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd266dg.prod.mediav.com:27698 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_104 in memory on hd287dg.prod.mediav.com:2270 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_115 in memory on hd289dg.prod.mediav.com:48937 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_186 in memory on hd291dg.prod.mediav.com:9728 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 104.0 in stage 2.0 (TID 399) in 248 ms on hd287dg.prod.mediav.com (152/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 115.0 in stage 2.0 (TID 397) in 255 ms on hd289dg.prod.mediav.com (153/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 186.0 in stage 2.0 (TID 396) in 255 ms on hd291dg.prod.mediav.com (154/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_121 in memory on hd290dg.prod.mediav.com:6793 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_47 in memory on hd262dg.prod.mediav.com:49994 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_198 in memory on hd262dg.prod.mediav.com:5957 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_77 in memory on hd279dg.prod.mediav.com:12678 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_26 in memory on hd278dg.prod.mediav.com:9221 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_20 in memory on hd266dg.prod.mediav.com:27698 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_161 in memory on hd255dg.prod.mediav.com:29011 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_69 in memory on hd264dg.prod.mediav.com:49664 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_3 in memory on hd292dg.prod.mediav.com:8313 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 121.0 in stage 2.0 (TID 345) in 8421 ms on hd290dg.prod.mediav.com (155/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_169 in memory on hd276dg.prod.mediav.com:15025 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 198.0 in stage 2.0 (TID 400) in 280 ms on hd262dg.prod.mediav.com (156/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 47.0 in stage 2.0 (TID 394) in 283 ms on hd262dg.prod.mediav.com (157/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 26.0 in stage 2.0 (TID 242) in 8439 ms on hd278dg.prod.mediav.com (158/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 77.0 in stage 2.0 (TID 308) in 8428 ms on hd279dg.prod.mediav.com (159/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 161.0 in stage 2.0 (TID 395) in 291 ms on hd255dg.prod.mediav.com (160/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 20.0 in stage 2.0 (TID 289) in 8438 ms on hd266dg.prod.mediav.com (161/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 3.0 in stage 2.0 (TID 267) in 8444 ms on hd292dg.prod.mediav.com (162/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 169.0 in stage 2.0 (TID 398) in 292 ms on hd276dg.prod.mediav.com (163/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 69.0 in stage 2.0 (TID 328) in 8434 ms on hd264dg.prod.mediav.com (164/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd273dg.prod.mediav.com:6601 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd258dg.prod.mediav.com:3750 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd278dg.prod.mediav.com:27815 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd265dg.prod.mediav.com:15593 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd290dg.prod.mediav.com:25045 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd264dg.prod.mediav.com:48358 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd279dg.prod.mediav.com:11149 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd270dg.prod.mediav.com:3332 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd270dg.prod.mediav.com:35197 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd279dg.prod.mediav.com:34291 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd277dg.prod.mediav.com:6547 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd265dg.prod.mediav.com:62939 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd257dg.prod.mediav.com:11991 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd254dg.prod.mediav.com:14962 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd274dg.prod.mediav.com:44964 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd264dg.prod.mediav.com:38843 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd271dg.prod.mediav.com:45534 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_164 in memory on hd264dg.prod.mediav.com:48358 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_178 in memory on hd290dg.prod.mediav.com:25045 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_75 in memory on hd264dg.prod.mediav.com:38843 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_148 in memory on hd279dg.prod.mediav.com:34291 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_63 in memory on hd270dg.prod.mediav.com:3332 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_162 in memory on hd258dg.prod.mediav.com:3750 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_12 in memory on hd265dg.prod.mediav.com:15593 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_92 in memory on hd254dg.prod.mediav.com:14962 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_31 in memory on hd277dg.prod.mediav.com:6547 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_89 in memory on hd274dg.prod.mediav.com:44964 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_72 in memory on hd265dg.prod.mediav.com:62939 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_73 in memory on hd278dg.prod.mediav.com:27815 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 178.0 in stage 2.0 (TID 277) in 9219 ms on hd290dg.prod.mediav.com (165/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 164.0 in stage 2.0 (TID 217) in 9232 ms on hd264dg.prod.mediav.com (166/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_39 in memory on hd279dg.prod.mediav.com:11149 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 75.0 in stage 2.0 (TID 351) in 9211 ms on hd264dg.prod.mediav.com (167/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_93 in memory on hd271dg.prod.mediav.com:45534 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 63.0 in stage 2.0 (TID 300) in 9221 ms on hd270dg.prod.mediav.com (168/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 148.0 in stage 2.0 (TID 318) in 9218 ms on hd279dg.prod.mediav.com (169/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 162.0 in stage 2.0 (TID 292) in 9222 ms on hd258dg.prod.mediav.com (170/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 12.0 in stage 2.0 (TID 235) in 9233 ms on hd265dg.prod.mediav.com (171/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_177 in memory on hd273dg.prod.mediav.com:6601 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 31.0 in stage 2.0 (TID 228) in 9238 ms on hd277dg.prod.mediav.com (172/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 92.0 in stage 2.0 (TID 285) in 9227 ms on hd254dg.prod.mediav.com (173/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_78 in memory on hd270dg.prod.mediav.com:35197 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 89.0 in stage 2.0 (TID 246) in 9236 ms on hd274dg.prod.mediav.com (174/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 72.0 in stage 2.0 (TID 313) in 9225 ms on hd265dg.prod.mediav.com (175/200)
> 15/09/15 18:50:48 INFO storage.BlockManagerInfo: Added rdd_7_36 in memory on hd257dg.prod.mediav.com:11991 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 73.0 in stage 2.0 (TID 290) in 9231 ms on hd278dg.prod.mediav.com (176/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 93.0 in stage 2.0 (TID 346) in 9224 ms on hd271dg.prod.mediav.com (177/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 39.0 in stage 2.0 (TID 281) in 9236 ms on hd279dg.prod.mediav.com (178/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 177.0 in stage 2.0 (TID 230) in 9251 ms on hd273dg.prod.mediav.com (179/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 78.0 in stage 2.0 (TID 249) in 9251 ms on hd270dg.prod.mediav.com (180/200)
> 15/09/15 18:50:48 INFO scheduler.TaskSetManager: Finished task 36.0 in stage 2.0 (TID 362) in 9232 ms on hd257dg.prod.mediav.com (181/200)
> 15/09/15 18:50:51 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd260dg.prod.mediav.com:7955 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:51 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd286dg.prod.mediav.com:64184 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:51 INFO storage.BlockManagerInfo: Added rdd_7_17 in memory on hd260dg.prod.mediav.com:7955 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:51 INFO storage.BlockManagerInfo: Added rdd_7_51 in memory on hd286dg.prod.mediav.com:64184 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:51 INFO scheduler.TaskSetManager: Finished task 17.0 in stage 2.0 (TID 335) in 12222 ms on hd260dg.prod.mediav.com (182/200)
> 15/09/15 18:50:51 INFO scheduler.TaskSetManager: Finished task 51.0 in stage 2.0 (TID 283) in 12236 ms on hd286dg.prod.mediav.com (183/200)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd274dg.prod.mediav.com:58299 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd276dg.prod.mediav.com:21872 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd277dg.prod.mediav.com:60781 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd271dg.prod.mediav.com:16160 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd255dg.prod.mediav.com:22114 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd289dg.prod.mediav.com:20447 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd281dg.prod.mediav.com:61667 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_42 in memory on hd289dg.prod.mediav.com:20447 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_136 in memory on hd276dg.prod.mediav.com:21872 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_14 in memory on hd274dg.prod.mediav.com:58299 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_118 in memory on hd271dg.prod.mediav.com:16160 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_183 in memory on hd277dg.prod.mediav.com:60781 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO scheduler.TaskSetManager: Finished task 42.0 in stage 2.0 (TID 343) in 15211 ms on hd289dg.prod.mediav.com (184/200)
> 15/09/15 18:50:54 INFO scheduler.TaskSetManager: Finished task 136.0 in stage 2.0 (TID 261) in 15231 ms on hd276dg.prod.mediav.com (185/200)
> 15/09/15 18:50:54 INFO scheduler.TaskSetManager: Finished task 14.0 in stage 2.0 (TID 226) in 15242 ms on hd274dg.prod.mediav.com (186/200)
> 15/09/15 18:50:54 INFO scheduler.TaskSetManager: Finished task 183.0 in stage 2.0 (TID 276) in 15234 ms on hd277dg.prod.mediav.com (187/200)
> 15/09/15 18:50:54 INFO scheduler.TaskSetManager: Finished task 118.0 in stage 2.0 (TID 332) in 15226 ms on hd271dg.prod.mediav.com (188/200)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_87 in memory on hd281dg.prod.mediav.com:61667 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:54 INFO storage.BlockManagerInfo: Added rdd_7_149 in memory on hd255dg.prod.mediav.com:22114 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 87.0 in stage 2.0 (TID 307) in 15248 ms on hd281dg.prod.mediav.com (189/200)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 149.0 in stage 2.0 (TID 342) in 15250 ms on hd255dg.prod.mediav.com (190/200)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd257dg.prod.mediav.com:13672 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd257dg.prod.mediav.com:6403 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd273dg.prod.mediav.com:19800 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd282dg.prod.mediav.com:54259 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd258dg.prod.mediav.com:61558 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd264dg.prod.mediav.com:28057 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added rdd_7_52 in memory on hd257dg.prod.mediav.com:13672 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added rdd_7_124 in memory on hd257dg.prod.mediav.com:6403 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added rdd_7_146 in memory on hd273dg.prod.mediav.com:19800 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added rdd_7_194 in memory on hd264dg.prod.mediav.com:28057 (size: 3.7 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added rdd_7_192 in memory on hd258dg.prod.mediav.com:61558 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO storage.BlockManagerInfo: Added rdd_7_145 in memory on hd282dg.prod.mediav.com:54259 (size: 3.8 MB, free: 8.6 GB)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 52.0 in stage 2.0 (TID 299) in 16222 ms on hd257dg.prod.mediav.com (191/200)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 124.0 in stage 2.0 (TID 287) in 16228 ms on hd257dg.prod.mediav.com (192/200)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 146.0 in stage 2.0 (TID 259) in 16234 ms on hd273dg.prod.mediav.com (193/200)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 194.0 in stage 2.0 (TID 295) in 16231 ms on hd264dg.prod.mediav.com (194/200)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 192.0 in stage 2.0 (TID 303) in 16230 ms on hd258dg.prod.mediav.com (195/200)
> 15/09/15 18:50:55 INFO scheduler.TaskSetManager: Finished task 145.0 in stage 2.0 (TID 301) in 16232 ms on hd282dg.prod.mediav.com (196/200)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd285dg.prod.mediav.com:57578 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added rdd_7_100 in memory on hd285dg.prod.mediav.com:57578 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO scheduler.TaskSetManager: Finished task 100.0 in stage 2.0 (TID 280) in 16442 ms on hd285dg.prod.mediav.com (197/200)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd284dg.prod.mediav.com:55335 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd258dg.prod.mediav.com:30778 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added broadcast_3_piece0 in memory on hd263dg.prod.mediav.com:57200 (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added rdd_7_94 in memory on hd284dg.prod.mediav.com:55335 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added rdd_7_125 in memory on hd263dg.prod.mediav.com:57200 (size: 3.9 MB, free: 8.6 GB)
> 15/09/15 18:50:56 INFO scheduler.TaskSetManager: Finished task 94.0 in stage 2.0 (TID 312) in 17227 ms on hd284dg.prod.mediav.com (198/200)
> 15/09/15 18:50:56 INFO scheduler.TaskSetManager: Finished task 125.0 in stage 2.0 (TID 322) in 17227 ms on hd263dg.prod.mediav.com (199/200)
> 15/09/15 18:50:56 INFO storage.BlockManagerInfo: Added rdd_7_4 in memory on hd258dg.prod.mediav.com:30778 (size: 4.0 MB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 4.0 in stage 2.0 (TID 329) in 17246 ms on hd258dg.prod.mediav.com (200/200)
> 15/09/15 18:50:57 INFO cluster.YarnClusterScheduler: Removed TaskSet 2.0, whose tasks have all completed, from pool default
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: ResultStage 2 (count at DecisionTreeMetadata.scala:111) finished in 17.275 s
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Job 2 finished: count at DecisionTreeMetadata.scala:111, took 17.302142 s
> 15/09/15 18:50:57 INFO spark.SparkContext: Starting job: collect at DecisionTree.scala:977
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Got job 3 (collect at DecisionTree.scala:977) with 200 output partitions (allowLocal=false)
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Final stage: ResultStage 3(collect at DecisionTree.scala:977)
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Parents of final stage: List()
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Missing parents: List()
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Submitting ResultStage 3 (PartitionwiseSampledRDD[9] at sample at DecisionTree.scala:977), which has no missing parents
> 15/09/15 18:50:57 INFO storage.MemoryStore: ensureFreeSpace(4880) called with curMem=214908, maxMem=18438322913
> 15/09/15 18:50:57 INFO storage.MemoryStore: Block broadcast_4 stored as values in memory (estimated size 4.8 KB, free 17.2 GB)
> 15/09/15 18:50:57 INFO storage.MemoryStore: ensureFreeSpace(2503) called with curMem=219788, maxMem=18438322913
> 15/09/15 18:50:57 INFO storage.MemoryStore: Block broadcast_4_piece0 stored as bytes in memory (estimated size 2.4 KB, free 17.2 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on 10.47.1.38:18554 (size: 2.4 KB, free: 17.2 GB)
> 15/09/15 18:50:57 INFO spark.SparkContext: Created broadcast 4 from broadcast at DAGScheduler.scala:874
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Submitting 200 missing tasks from ResultStage 3 (PartitionwiseSampledRDD[9] at sample at DecisionTree.scala:977)
> 15/09/15 18:50:57 INFO cluster.YarnClusterScheduler: Adding task set 3.0 with 200 tasks
> 15/09/15 18:50:57 INFO scheduler.FairSchedulableBuilder: Added task set TaskSet_3 tasks to pool default
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 30.0 in stage 3.0 (TID 401, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 41.0 in stage 3.0 (TID 402, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 58.0 in stage 3.0 (TID 403, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 83.0 in stage 3.0 (TID 404, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 193.0 in stage 3.0 (TID 405, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 113.0 in stage 3.0 (TID 406, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 77.0 in stage 3.0 (TID 407, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 122.0 in stage 3.0 (TID 408, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 43.0 in stage 3.0 (TID 409, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 18.0 in stage 3.0 (TID 410, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 56.0 in stage 3.0 (TID 411, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 12.0 in stage 3.0 (TID 412, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 123.0 in stage 3.0 (TID 413, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 145.0 in stage 3.0 (TID 414, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 84.0 in stage 3.0 (TID 415, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 120.0 in stage 3.0 (TID 416, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 6.0 in stage 3.0 (TID 417, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 28.0 in stage 3.0 (TID 418, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 179.0 in stage 3.0 (TID 419, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 19.0 in stage 3.0 (TID 420, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 132.0 in stage 3.0 (TID 421, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 175.0 in stage 3.0 (TID 422, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 192.0 in stage 3.0 (TID 423, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 15.0 in stage 3.0 (TID 424, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 183.0 in stage 3.0 (TID 425, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 13.0 in stage 3.0 (TID 426, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 130.0 in stage 3.0 (TID 427, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 189.0 in stage 3.0 (TID 428, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 1.0 in stage 3.0 (TID 429, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 155.0 in stage 3.0 (TID 430, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 164.0 in stage 3.0 (TID 431, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 71.0 in stage 3.0 (TID 432, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 74.0 in stage 3.0 (TID 433, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 188.0 in stage 3.0 (TID 434, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 24.0 in stage 3.0 (TID 435, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 165.0 in stage 3.0 (TID 436, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 36.0 in stage 3.0 (TID 437, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 97.0 in stage 3.0 (TID 438, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 33.0 in stage 3.0 (TID 439, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 37.0 in stage 3.0 (TID 440, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 111.0 in stage 3.0 (TID 441, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 55.0 in stage 3.0 (TID 442, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 21.0 in stage 3.0 (TID 443, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 75.0 in stage 3.0 (TID 444, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 127.0 in stage 3.0 (TID 445, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 103.0 in stage 3.0 (TID 446, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 140.0 in stage 3.0 (TID 447, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 70.0 in stage 3.0 (TID 448, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 3.0 in stage 3.0 (TID 449, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 172.0 in stage 3.0 (TID 450, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 92.0 in stage 3.0 (TID 451, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 119.0 in stage 3.0 (TID 452, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 26.0 in stage 3.0 (TID 453, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 167.0 in stage 3.0 (TID 454, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 66.0 in stage 3.0 (TID 455, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 73.0 in stage 3.0 (TID 456, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 96.0 in stage 3.0 (TID 457, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 50.0 in stage 3.0 (TID 458, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 149.0 in stage 3.0 (TID 459, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 93.0 in stage 3.0 (TID 460, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 64.0 in stage 3.0 (TID 461, hd278dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 53.0 in stage 3.0 (TID 462, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 39.0 in stage 3.0 (TID 463, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 88.0 in stage 3.0 (TID 464, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 65.0 in stage 3.0 (TID 465, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 185.0 in stage 3.0 (TID 466, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 187.0 in stage 3.0 (TID 467, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 121.0 in stage 3.0 (TID 468, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 194.0 in stage 3.0 (TID 469, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 31.0 in stage 3.0 (TID 470, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 106.0 in stage 3.0 (TID 471, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 173.0 in stage 3.0 (TID 472, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 116.0 in stage 3.0 (TID 473, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 63.0 in stage 3.0 (TID 474, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 125.0 in stage 3.0 (TID 475, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 184.0 in stage 3.0 (TID 476, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 144.0 in stage 3.0 (TID 477, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 62.0 in stage 3.0 (TID 478, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 89.0 in stage 3.0 (TID 479, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 166.0 in stage 3.0 (TID 480, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 126.0 in stage 3.0 (TID 481, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 5.0 in stage 3.0 (TID 482, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 105.0 in stage 3.0 (TID 483, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 142.0 in stage 3.0 (TID 484, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 11.0 in stage 3.0 (TID 485, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 177.0 in stage 3.0 (TID 486, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 160.0 in stage 3.0 (TID 487, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 59.0 in stage 3.0 (TID 488, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 141.0 in stage 3.0 (TID 489, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 131.0 in stage 3.0 (TID 490, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 48.0 in stage 3.0 (TID 491, hd256dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 17.0 in stage 3.0 (TID 492, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 72.0 in stage 3.0 (TID 493, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 134.0 in stage 3.0 (TID 494, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 34.0 in stage 3.0 (TID 495, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 117.0 in stage 3.0 (TID 496, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 128.0 in stage 3.0 (TID 497, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 94.0 in stage 3.0 (TID 498, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 178.0 in stage 3.0 (TID 499, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 110.0 in stage 3.0 (TID 500, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 45.0 in stage 3.0 (TID 501, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 154.0 in stage 3.0 (TID 502, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 190.0 in stage 3.0 (TID 503, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 54.0 in stage 3.0 (TID 504, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 22.0 in stage 3.0 (TID 505, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 2.0 in stage 3.0 (TID 506, hd288dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 67.0 in stage 3.0 (TID 507, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 90.0 in stage 3.0 (TID 508, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 51.0 in stage 3.0 (TID 509, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 57.0 in stage 3.0 (TID 510, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 20.0 in stage 3.0 (TID 511, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 9.0 in stage 3.0 (TID 512, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 69.0 in stage 3.0 (TID 513, hd264dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 150.0 in stage 3.0 (TID 514, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 35.0 in stage 3.0 (TID 515, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 38.0 in stage 3.0 (TID 516, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 81.0 in stage 3.0 (TID 517, hd265dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 138.0 in stage 3.0 (TID 518, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 32.0 in stage 3.0 (TID 519, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 76.0 in stage 3.0 (TID 520, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 40.0 in stage 3.0 (TID 521, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 99.0 in stage 3.0 (TID 522, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 82.0 in stage 3.0 (TID 523, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 118.0 in stage 3.0 (TID 524, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 100.0 in stage 3.0 (TID 525, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 95.0 in stage 3.0 (TID 526, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 156.0 in stage 3.0 (TID 527, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 108.0 in stage 3.0 (TID 528, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 153.0 in stage 3.0 (TID 529, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 29.0 in stage 3.0 (TID 530, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 176.0 in stage 3.0 (TID 531, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 157.0 in stage 3.0 (TID 532, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 195.0 in stage 3.0 (TID 533, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 91.0 in stage 3.0 (TID 534, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 49.0 in stage 3.0 (TID 535, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 79.0 in stage 3.0 (TID 536, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 85.0 in stage 3.0 (TID 537, hd286dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 78.0 in stage 3.0 (TID 538, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 107.0 in stage 3.0 (TID 539, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 124.0 in stage 3.0 (TID 540, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 136.0 in stage 3.0 (TID 541, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 171.0 in stage 3.0 (TID 542, hd272dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 68.0 in stage 3.0 (TID 543, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 4.0 in stage 3.0 (TID 544, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 42.0 in stage 3.0 (TID 545, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 10.0 in stage 3.0 (TID 546, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 0.0 in stage 3.0 (TID 547, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 163.0 in stage 3.0 (TID 548, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 143.0 in stage 3.0 (TID 549, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 191.0 in stage 3.0 (TID 550, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 14.0 in stage 3.0 (TID 551, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 162.0 in stage 3.0 (TID 552, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 168.0 in stage 3.0 (TID 553, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 147.0 in stage 3.0 (TID 554, hd283dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 148.0 in stage 3.0 (TID 555, hd279dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 180.0 in stage 3.0 (TID 556, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 182.0 in stage 3.0 (TID 557, hd254dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 25.0 in stage 3.0 (TID 558, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 46.0 in stage 3.0 (TID 559, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 61.0 in stage 3.0 (TID 560, hd270dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 170.0 in stage 3.0 (TID 561, hd263dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 86.0 in stage 3.0 (TID 562, hd275dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 151.0 in stage 3.0 (TID 563, hd277dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 158.0 in stage 3.0 (TID 564, hd274dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 7.0 in stage 3.0 (TID 565, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 87.0 in stage 3.0 (TID 566, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 101.0 in stage 3.0 (TID 567, hd261dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 8.0 in stage 3.0 (TID 568, hd282dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 16.0 in stage 3.0 (TID 569, hd285dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 181.0 in stage 3.0 (TID 570, hd284dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 114.0 in stage 3.0 (TID 571, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 135.0 in stage 3.0 (TID 572, hd260dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 27.0 in stage 3.0 (TID 573, hd271dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 159.0 in stage 3.0 (TID 574, hd292dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 196.0 in stage 3.0 (TID 575, hd258dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 109.0 in stage 3.0 (TID 576, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 146.0 in stage 3.0 (TID 577, hd273dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 52.0 in stage 3.0 (TID 578, hd257dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd278dg.prod.mediav.com:27239 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd287dg.prod.mediav.com:2547 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd256dg.prod.mediav.com:65180 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd278dg.prod.mediav.com:1380 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd276dg.prod.mediav.com:62943 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd278dg.prod.mediav.com:27815 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd284dg.prod.mediav.com:39393 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd262dg.prod.mediav.com:5957 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd282dg.prod.mediav.com:57776 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd288dg.prod.mediav.com:64716 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd279dg.prod.mediav.com:49996 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd256dg.prod.mediav.com:5214 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd262dg.prod.mediav.com:40567 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd254dg.prod.mediav.com:14962 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd275dg.prod.mediav.com:3649 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd290dg.prod.mediav.com:1034 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd291dg.prod.mediav.com:47717 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd288dg.prod.mediav.com:58225 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd272dg.prod.mediav.com:47434 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd278dg.prod.mediav.com:9221 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd285dg.prod.mediav.com:15892 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd270dg.prod.mediav.com:33090 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd284dg.prod.mediav.com:46214 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd256dg.prod.mediav.com:22567 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd256dg.prod.mediav.com:4157 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd274dg.prod.mediav.com:16654 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd290dg.prod.mediav.com:6793 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd254dg.prod.mediav.com:37252 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd270dg.prod.mediav.com:6944 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd287dg.prod.mediav.com:53041 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd255dg.prod.mediav.com:62882 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd276dg.prod.mediav.com:65222 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd291dg.prod.mediav.com:31861 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd284dg.prod.mediav.com:55335 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd286dg.prod.mediav.com:64184 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd274dg.prod.mediav.com:25030 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd255dg.prod.mediav.com:24822 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd254dg.prod.mediav.com:28306 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd279dg.prod.mediav.com:34009 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd266dg.prod.mediav.com:60772 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd272dg.prod.mediav.com:36193 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd290dg.prod.mediav.com:48176 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd264dg.prod.mediav.com:48038 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd265dg.prod.mediav.com:15593 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd288dg.prod.mediav.com:30986 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd276dg.prod.mediav.com:15025 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd270dg.prod.mediav.com:3332 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd291dg.prod.mediav.com:9728 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd260dg.prod.mediav.com:20879 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd289dg.prod.mediav.com:22644 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd272dg.prod.mediav.com:63093 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd279dg.prod.mediav.com:11149 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd287dg.prod.mediav.com:2270 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd254dg.prod.mediav.com:50339 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd278dg.prod.mediav.com:16567 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd255dg.prod.mediav.com:29011 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd275dg.prod.mediav.com:7744 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd275dg.prod.mediav.com:27702 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd285dg.prod.mediav.com:7398 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd290dg.prod.mediav.com:25045 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd293dg.prod.mediav.com:25809 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd271dg.prod.mediav.com:63849 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd280dg.prod.mediav.com:8788 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd258dg.prod.mediav.com:61558 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd258dg.prod.mediav.com:44194 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd262dg.prod.mediav.com:35030 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd283dg.prod.mediav.com:19668 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd262dg.prod.mediav.com:24194 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd270dg.prod.mediav.com:5548 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd276dg.prod.mediav.com:46848 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd276dg.prod.mediav.com:21872 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd283dg.prod.mediav.com:62866 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd289dg.prod.mediav.com:48417 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd273dg.prod.mediav.com:35935 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd293dg.prod.mediav.com:60417 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd274dg.prod.mediav.com:44964 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd279dg.prod.mediav.com:12678 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd289dg.prod.mediav.com:20447 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd281dg.prod.mediav.com:12163 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd289dg.prod.mediav.com:48937 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd281dg.prod.mediav.com:2395 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd271dg.prod.mediav.com:33037 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd255dg.prod.mediav.com:22114 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd265dg.prod.mediav.com:62939 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd264dg.prod.mediav.com:48358 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd261dg.prod.mediav.com:16786 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd264dg.prod.mediav.com:28057 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd277dg.prod.mediav.com:60781 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd279dg.prod.mediav.com:34291 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd260dg.prod.mediav.com:7955 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd257dg.prod.mediav.com:11991 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd256dg.prod.mediav.com:54569 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd271dg.prod.mediav.com:45534 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd281dg.prod.mediav.com:2780 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd265dg.prod.mediav.com:65261 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd275dg.prod.mediav.com:52956 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd282dg.prod.mediav.com:51731 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd282dg.prod.mediav.com:54259 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd270dg.prod.mediav.com:35197 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd289dg.prod.mediav.com:5555 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd266dg.prod.mediav.com:60871 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd285dg.prod.mediav.com:57578 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd265dg.prod.mediav.com:41028 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd257dg.prod.mediav.com:50217 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd254dg.prod.mediav.com:6401 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd284dg.prod.mediav.com:33099 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd260dg.prod.mediav.com:34432 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd265dg.prod.mediav.com:38596 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd293dg.prod.mediav.com:18866 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd271dg.prod.mediav.com:16160 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd266dg.prod.mediav.com:7561 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd260dg.prod.mediav.com:45170 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd288dg.prod.mediav.com:3459 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd273dg.prod.mediav.com:6601 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd286dg.prod.mediav.com:15531 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd286dg.prod.mediav.com:20786 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd257dg.prod.mediav.com:6403 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd258dg.prod.mediav.com:30778 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd275dg.prod.mediav.com:37869 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd292dg.prod.mediav.com:8313 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd263dg.prod.mediav.com:57200 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd263dg.prod.mediav.com:19616 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd292dg.prod.mediav.com:24852 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd263dg.prod.mediav.com:28737 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd286dg.prod.mediav.com:5189 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd264dg.prod.mediav.com:38843 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd266dg.prod.mediav.com:18054 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd261dg.prod.mediav.com:51708 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd277dg.prod.mediav.com:17325 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd263dg.prod.mediav.com:5872 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd255dg.prod.mediav.com:8336 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd263dg.prod.mediav.com:30335 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd261dg.prod.mediav.com:48502 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd283dg.prod.mediav.com:5777 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd260dg.prod.mediav.com:38400 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd277dg.prod.mediav.com:27612 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd272dg.prod.mediav.com:63317 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd258dg.prod.mediav.com:3750 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd280dg.prod.mediav.com:6093 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd285dg.prod.mediav.com:52469 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd277dg.prod.mediav.com:6547 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd286dg.prod.mediav.com:22509 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd280dg.prod.mediav.com:1897 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd273dg.prod.mediav.com:51855 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd264dg.prod.mediav.com:49664 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd290dg.prod.mediav.com:48698 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd273dg.prod.mediav.com:4400 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd281dg.prod.mediav.com:24432 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd292dg.prod.mediav.com:9515 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd282dg.prod.mediav.com:42292 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd274dg.prod.mediav.com:58299 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd283dg.prod.mediav.com:15357 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd257dg.prod.mediav.com:23974 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd291dg.prod.mediav.com:3890 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd293dg.prod.mediav.com:23628 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd266dg.prod.mediav.com:27698 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd261dg.prod.mediav.com:17918 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd262dg.prod.mediav.com:49994 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd273dg.prod.mediav.com:19800 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd283dg.prod.mediav.com:27671 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd272dg.prod.mediav.com:13836 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd292dg.prod.mediav.com:5167 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd257dg.prod.mediav.com:13672 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd288dg.prod.mediav.com:15935 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd284dg.prod.mediav.com:65293 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd282dg.prod.mediav.com:47145 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd261dg.prod.mediav.com:35424 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd293dg.prod.mediav.com:46714 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd258dg.prod.mediav.com:8532 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd291dg.prod.mediav.com:54360 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd281dg.prod.mediav.com:61667 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd280dg.prod.mediav.com:29265 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd277dg.prod.mediav.com:27951 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 112.0 in stage 3.0 (TID 579, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 129.0 in stage 3.0 (TID 580, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 13.0 in stage 3.0 (TID 426) in 130 ms on hd262dg.prod.mediav.com (1/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 23.0 in stage 3.0 (TID 581, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 133.0 in stage 3.0 (TID 582, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 44.0 in stage 3.0 (TID 583, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd274dg.prod.mediav.com:50461 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 60.0 in stage 3.0 (TID 584, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 58.0 in stage 3.0 (TID 403) in 146 ms on hd287dg.prod.mediav.com (2/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 41.0 in stage 3.0 (TID 402) in 147 ms on hd262dg.prod.mediav.com (3/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 88.0 in stage 3.0 (TID 464) in 136 ms on hd262dg.prod.mediav.com (4/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 6.0 in stage 3.0 (TID 417) in 145 ms on hd262dg.prod.mediav.com (5/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd292dg.prod.mediav.com:31959 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 21.0 in stage 3.0 (TID 443) in 147 ms on hd284dg.prod.mediav.com (6/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 127.0 in stage 3.0 (TID 445) in 146 ms on hd278dg.prod.mediav.com (7/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 105.0 in stage 3.0 (TID 483) in 142 ms on hd288dg.prod.mediav.com (8/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 131.0 in stage 3.0 (TID 490) in 141 ms on hd290dg.prod.mediav.com (9/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 102.0 in stage 3.0 (TID 585, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd271dg.prod.mediav.com:11439 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 9.0 in stage 3.0 (TID 512) in 143 ms on hd262dg.prod.mediav.com (10/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 48.0 in stage 3.0 (TID 491) in 148 ms on hd256dg.prod.mediav.com (11/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 29.0 in stage 3.0 (TID 530) in 143 ms on hd287dg.prod.mediav.com (12/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 26.0 in stage 3.0 (TID 453) in 154 ms on hd278dg.prod.mediav.com (13/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 45.0 in stage 3.0 (TID 501) in 151 ms on hd289dg.prod.mediav.com (14/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 34.0 in stage 3.0 (TID 495) in 153 ms on hd288dg.prod.mediav.com (15/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 64.0 in stage 3.0 (TID 461) in 159 ms on hd278dg.prod.mediav.com (16/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 126.0 in stage 3.0 (TID 481) in 158 ms on hd276dg.prod.mediav.com (17/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 15.0 in stage 3.0 (TID 424) in 168 ms on hd285dg.prod.mediav.com (18/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 199.0 in stage 3.0 (TID 586, hd290dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 19.0 in stage 3.0 (TID 420) in 170 ms on hd291dg.prod.mediav.com (19/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 1.0 in stage 3.0 (TID 429) in 169 ms on hd287dg.prod.mediav.com (20/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 104.0 in stage 3.0 (TID 587, hd287dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 47.0 in stage 3.0 (TID 588, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 70.0 in stage 3.0 (TID 448) in 237 ms on hd284dg.prod.mediav.com (21/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 53.0 in stage 3.0 (TID 462) in 241 ms on hd275dg.prod.mediav.com (22/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 178.0 in stage 3.0 (TID 499) in 236 ms on hd290dg.prod.mediav.com (23/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 113.0 in stage 3.0 (TID 406) in 251 ms on hd255dg.prod.mediav.com (24/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 116.0 in stage 3.0 (TID 473) in 245 ms on hd272dg.prod.mediav.com (25/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 30.0 in stage 3.0 (TID 401) in 259 ms on hd283dg.prod.mediav.com (26/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 73.0 in stage 3.0 (TID 456) in 249 ms on hd278dg.prod.mediav.com (27/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 94.0 in stage 3.0 (TID 498) in 243 ms on hd284dg.prod.mediav.com (28/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 2.0 in stage 3.0 (TID 506) in 246 ms on hd288dg.prod.mediav.com (29/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 66.0 in stage 3.0 (TID 455) in 254 ms on hd292dg.prod.mediav.com (30/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 91.0 in stage 3.0 (TID 534) in 244 ms on hd290dg.prod.mediav.com (31/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on 10.47.1.38:18554 in memory (size: 2.1 KB, free: 17.2 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 0.0 in stage 3.0 (TID 547) in 246 ms on hd292dg.prod.mediav.com (32/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 144.0 in stage 3.0 (TID 477) in 257 ms on hd281dg.prod.mediav.com (33/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 8.0 in stage 3.0 (TID 568) in 244 ms on hd282dg.prod.mediav.com (34/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 79.0 in stage 3.0 (TID 536) in 251 ms on hd292dg.prod.mediav.com (35/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd262dg.prod.mediav.com:24194 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 96.0 in stage 3.0 (TID 457) in 265 ms on hd260dg.prod.mediav.com (36/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd262dg.prod.mediav.com:49994 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 109.0 in stage 3.0 (TID 576) in 248 ms on hd280dg.prod.mediav.com (37/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 195.0 in stage 3.0 (TID 533) in 254 ms on hd273dg.prod.mediav.com (38/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd266dg.prod.mediav.com:18054 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd281dg.prod.mediav.com:61667 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd291dg.prod.mediav.com:31861 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd278dg.prod.mediav.com:27239 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd261dg.prod.mediav.com:35424 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd257dg.prod.mediav.com:23974 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd290dg.prod.mediav.com:1034 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd271dg.prod.mediav.com:11439 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd283dg.prod.mediav.com:62866 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd284dg.prod.mediav.com:39393 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd276dg.prod.mediav.com:65222 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd260dg.prod.mediav.com:7955 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd258dg.prod.mediav.com:30778 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd280dg.prod.mediav.com:29265 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd272dg.prod.mediav.com:36193 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd264dg.prod.mediav.com:48038 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 147.0 in stage 3.0 (TID 554) in 254 ms on hd283dg.prod.mediav.com (39/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd261dg.prod.mediav.com:17918 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd257dg.prod.mediav.com:11991 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd257dg.prod.mediav.com:13672 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd292dg.prod.mediav.com:9515 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd254dg.prod.mediav.com:37252 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd292dg.prod.mediav.com:8313 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd284dg.prod.mediav.com:33099 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd258dg.prod.mediav.com:44194 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd288dg.prod.mediav.com:15935 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd274dg.prod.mediav.com:50461 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 150.0 in stage 3.0 (TID 514) in 261 ms on hd265dg.prod.mediav.com (40/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd261dg.prod.mediav.com:51708 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd262dg.prod.mediav.com:35030 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd272dg.prod.mediav.com:47434 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd292dg.prod.mediav.com:5167 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 145.0 in stage 3.0 (TID 414) in 277 ms on hd282dg.prod.mediav.com (41/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd290dg.prod.mediav.com:48698 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd273dg.prod.mediav.com:4400 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 36.0 in stage 3.0 (TID 437) in 273 ms on hd257dg.prod.mediav.com (42/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd287dg.prod.mediav.com:2270 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd290dg.prod.mediav.com:25045 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd282dg.prod.mediav.com:47145 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd254dg.prod.mediav.com:50339 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd286dg.prod.mediav.com:15531 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd275dg.prod.mediav.com:7744 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd285dg.prod.mediav.com:15892 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd273dg.prod.mediav.com:51855 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd261dg.prod.mediav.com:16786 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd278dg.prod.mediav.com:27815 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd281dg.prod.mediav.com:24432 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd258dg.prod.mediav.com:3750 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd284dg.prod.mediav.com:55335 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd260dg.prod.mediav.com:34432 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 82.0 in stage 3.0 (TID 523) in 264 ms on hd261dg.prod.mediav.com (43/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd287dg.prod.mediav.com:53041 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd278dg.prod.mediav.com:1380 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd258dg.prod.mediav.com:8532 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd260dg.prod.mediav.com:45170 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd258dg.prod.mediav.com:61558 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd280dg.prod.mediav.com:1897 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd254dg.prod.mediav.com:28306 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd293dg.prod.mediav.com:18866 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 152.0 in stage 3.0 (TID 589, hd280dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd289dg.prod.mediav.com:22644 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd275dg.prod.mediav.com:27702 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd289dg.prod.mediav.com:48937 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd277dg.prod.mediav.com:60781 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 115.0 in stage 3.0 (TID 590, hd289dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd282dg.prod.mediav.com:54259 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd265dg.prod.mediav.com:15593 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd264dg.prod.mediav.com:38843 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd260dg.prod.mediav.com:20879 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd265dg.prod.mediav.com:65261 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd273dg.prod.mediav.com:6601 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd264dg.prod.mediav.com:28057 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd255dg.prod.mediav.com:8336 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 141.0 in stage 3.0 (TID 489) in 271 ms on hd286dg.prod.mediav.com (44/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 183.0 in stage 3.0 (TID 425) in 281 ms on hd277dg.prod.mediav.com (45/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd287dg.prod.mediav.com:2547 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 76.0 in stage 3.0 (TID 520) in 267 ms on hd261dg.prod.mediav.com (46/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd257dg.prod.mediav.com:6403 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd288dg.prod.mediav.com:58225 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd274dg.prod.mediav.com:25030 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd282dg.prod.mediav.com:51731 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd292dg.prod.mediav.com:31959 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd256dg.prod.mediav.com:22567 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd260dg.prod.mediav.com:38400 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd284dg.prod.mediav.com:46214 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd270dg.prod.mediav.com:33090 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd255dg.prod.mediav.com:62882 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd286dg.prod.mediav.com:5189 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd265dg.prod.mediav.com:62939 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd283dg.prod.mediav.com:27671 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd293dg.prod.mediav.com:46714 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd282dg.prod.mediav.com:42292 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 72.0 in stage 3.0 (TID 493) in 277 ms on hd265dg.prod.mediav.com (47/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd292dg.prod.mediav.com:24852 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 192.0 in stage 3.0 (TID 423) in 287 ms on hd258dg.prod.mediav.com (48/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 52.0 in stage 3.0 (TID 578) in 267 ms on hd257dg.prod.mediav.com (49/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 124.0 in stage 3.0 (TID 540) in 273 ms on hd257dg.prod.mediav.com (50/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 179.0 in stage 3.0 (TID 419) in 291 ms on hd282dg.prod.mediav.com (51/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd278dg.prod.mediav.com:9221 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 177.0 in stage 3.0 (TID 486) in 286 ms on hd273dg.prod.mediav.com (52/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 46.0 in stage 3.0 (TID 559) in 276 ms on hd282dg.prod.mediav.com (53/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 166.0 in stage 3.0 (TID 480) in 288 ms on hd293dg.prod.mediav.com (54/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 54.0 in stage 3.0 (TID 504) in 284 ms on hd272dg.prod.mediav.com (55/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd288dg.prod.mediav.com:64716 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 196.0 in stage 3.0 (TID 575) in 278 ms on hd258dg.prod.mediav.com (56/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 23.0 in stage 3.0 (TID 581) in 164 ms on hd262dg.prod.mediav.com (57/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 75.0 in stage 3.0 (TID 444) in 297 ms on hd264dg.prod.mediav.com (58/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 17.0 in stage 3.0 (TID 492) in 291 ms on hd260dg.prod.mediav.com (59/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 133.0 in stage 3.0 (TID 582) in 166 ms on hd290dg.prod.mediav.com (60/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 101.0 in stage 3.0 (TID 567) in 284 ms on hd261dg.prod.mediav.com (61/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 194.0 in stage 3.0 (TID 469) in 298 ms on hd264dg.prod.mediav.com (62/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 135.0 in stage 3.0 (TID 572) in 284 ms on hd260dg.prod.mediav.com (63/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 12.0 in stage 3.0 (TID 412) in 310 ms on hd265dg.prod.mediav.com (64/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 44.0 in stage 3.0 (TID 583) in 171 ms on hd262dg.prod.mediav.com (65/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 60.0 in stage 3.0 (TID 584) in 174 ms on hd287dg.prod.mediav.com (66/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 162.0 in stage 3.0 (TID 552) in 297 ms on hd258dg.prod.mediav.com (67/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 168.0 in stage 3.0 (TID 553) in 297 ms on hd257dg.prod.mediav.com (68/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 68.0 in stage 3.0 (TID 543) in 299 ms on hd293dg.prod.mediav.com (69/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 4.0 in stage 3.0 (TID 544) in 301 ms on hd258dg.prod.mediav.com (70/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 184.0 in stage 3.0 (TID 476) in 312 ms on hd258dg.prod.mediav.com (71/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 107.0 in stage 3.0 (TID 539) in 304 ms on hd261dg.prod.mediav.com (72/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 102.0 in stage 3.0 (TID 585) in 167 ms on hd290dg.prod.mediav.com (73/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 158.0 in stage 3.0 (TID 564) in 301 ms on hd274dg.prod.mediav.com (74/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 38.0 in stage 3.0 (TID 516) in 311 ms on hd260dg.prod.mediav.com (75/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 159.0 in stage 3.0 (TID 574) in 304 ms on hd292dg.prod.mediav.com (76/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 90.0 in stage 3.0 (TID 508) in 313 ms on hd273dg.prod.mediav.com (77/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 176.0 in stage 3.0 (TID 531) in 312 ms on hd286dg.prod.mediav.com (78/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 110.0 in stage 3.0 (TID 500) in 318 ms on hd284dg.prod.mediav.com (79/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 47.0 in stage 3.0 (TID 588) in 160 ms on hd262dg.prod.mediav.com (80/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 27.0 in stage 3.0 (TID 573) in 309 ms on hd271dg.prod.mediav.com (81/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 199.0 in stage 3.0 (TID 586) in 163 ms on hd290dg.prod.mediav.com (82/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 104.0 in stage 3.0 (TID 587) in 164 ms on hd287dg.prod.mediav.com (83/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 87.0 in stage 3.0 (TID 566) in 314 ms on hd281dg.prod.mediav.com (84/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 74.0 in stage 3.0 (TID 433) in 334 ms on hd254dg.prod.mediav.com (85/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 111.0 in stage 3.0 (TID 441) in 336 ms on hd264dg.prod.mediav.com (86/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 28.0 in stage 3.0 (TID 418) in 339 ms on hd266dg.prod.mediav.com (87/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd289dg.prod.mediav.com:20447 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 185.0 in stage 3.0 (TID 466) in 334 ms on hd254dg.prod.mediav.com (88/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 3.0 in stage 3.0 (TID 449) in 336 ms on hd292dg.prod.mediav.com (89/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd262dg.prod.mediav.com:5957 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 198.0 in stage 3.0 (TID 591, hd262dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd256dg.prod.mediav.com:5214 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd285dg.prod.mediav.com:25860 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd285dg.prod.mediav.com:25860 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd288dg.prod.mediav.com:30986 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 155.0 in stage 3.0 (TID 430) in 341 ms on hd275dg.prod.mediav.com (90/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd291dg.prod.mediav.com:47717 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 5.0 in stage 3.0 (TID 482) in 335 ms on hd254dg.prod.mediav.com (91/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd283dg.prod.mediav.com:19668 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd286dg.prod.mediav.com:64184 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 97.0 in stage 3.0 (TID 438) in 342 ms on hd280dg.prod.mediav.com (92/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd279dg.prod.mediav.com:34009 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd264dg.prod.mediav.com:48358 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd266dg.prod.mediav.com:60772 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd254dg.prod.mediav.com:14962 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 139.0 in stage 3.0 (TID 592, hd266dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Added broadcast_4_piece0 in memory on hd280dg.prod.mediav.com:4198 (size: 2.4 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd280dg.prod.mediav.com:4198 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd281dg.prod.mediav.com:12163 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd291dg.prod.mediav.com:9728 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 186.0 in stage 3.0 (TID 593, hd291dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 175.0 in stage 3.0 (TID 422) in 348 ms on hd255dg.prod.mediav.com (93/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd271dg.prod.mediav.com:33037 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 137.0 in stage 3.0 (TID 594, hd281dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd279dg.prod.mediav.com:49996 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd281dg.prod.mediav.com:2395 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 62.0 in stage 3.0 (TID 478) in 341 ms on hd289dg.prod.mediav.com (94/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 99.0 in stage 3.0 (TID 522) in 334 ms on hd274dg.prod.mediav.com (95/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd285dg.prod.mediav.com:52469 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd285dg.prod.mediav.com:7398 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd275dg.prod.mediav.com:3649 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd256dg.prod.mediav.com:65180 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd277dg.prod.mediav.com:27612 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd270dg.prod.mediav.com:35197 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd289dg.prod.mediav.com:5555 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 128.0 in stage 3.0 (TID 497) in 341 ms on hd260dg.prod.mediav.com (96/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd289dg.prod.mediav.com:48417 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd262dg.prod.mediav.com:40567 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 140.0 in stage 3.0 (TID 447) in 349 ms on hd270dg.prod.mediav.com (97/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd255dg.prod.mediav.com:24822 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 152.0 in stage 3.0 (TID 589) in 75 ms on hd280dg.prod.mediav.com (98/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd261dg.prod.mediav.com:48502 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 115.0 in stage 3.0 (TID 590) in 74 ms on hd289dg.prod.mediav.com (99/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd274dg.prod.mediav.com:16654 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd283dg.prod.mediav.com:5777 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd280dg.prod.mediav.com:8788 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 42.0 in stage 3.0 (TID 545) in 338 ms on hd289dg.prod.mediav.com (100/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd285dg.prod.mediav.com:57578 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd256dg.prod.mediav.com:4157 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd290dg.prod.mediav.com:6793 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd290dg.prod.mediav.com:48176 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 129.0 in stage 3.0 (TID 580) in 238 ms on hd262dg.prod.mediav.com (101/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd293dg.prod.mediav.com:23628 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd271dg.prod.mediav.com:63849 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd274dg.prod.mediav.com:58299 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd264dg.prod.mediav.com:49664 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd291dg.prod.mediav.com:54360 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd277dg.prod.mediav.com:6547 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 83.0 in stage 3.0 (TID 404) in 365 ms on hd288dg.prod.mediav.com (102/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd273dg.prod.mediav.com:35935 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd255dg.prod.mediav.com:29011 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 161.0 in stage 3.0 (TID 595, hd255dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd263dg.prod.mediav.com:19616 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd276dg.prod.mediav.com:46848 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 37.0 in stage 3.0 (TID 440) in 359 ms on hd256dg.prod.mediav.com (103/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd284dg.prod.mediav.com:65293 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd274dg.prod.mediav.com:44964 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 154.0 in stage 3.0 (TID 502) in 351 ms on hd283dg.prod.mediav.com (104/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd281dg.prod.mediav.com:2780 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd293dg.prod.mediav.com:60417 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd265dg.prod.mediav.com:38596 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd272dg.prod.mediav.com:63317 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd276dg.prod.mediav.com:21872 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd271dg.prod.mediav.com:16160 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd279dg.prod.mediav.com:12678 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd291dg.prod.mediav.com:3890 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd275dg.prod.mediav.com:37869 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd263dg.prod.mediav.com:28737 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 25.0 in stage 3.0 (TID 558) in 346 ms on hd291dg.prod.mediav.com (105/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd286dg.prod.mediav.com:22509 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 51.0 in stage 3.0 (TID 509) in 353 ms on hd286dg.prod.mediav.com (106/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd273dg.prod.mediav.com:19800 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd263dg.prod.mediav.com:30335 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd279dg.prod.mediav.com:34291 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd277dg.prod.mediav.com:27951 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd277dg.prod.mediav.com:17325 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd265dg.prod.mediav.com:41028 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 164.0 in stage 3.0 (TID 431) in 367 ms on hd264dg.prod.mediav.com (107/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd283dg.prod.mediav.com:15357 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd263dg.prod.mediav.com:57200 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd266dg.prod.mediav.com:7561 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd271dg.prod.mediav.com:45534 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 117.0 in stage 3.0 (TID 496) in 359 ms on hd279dg.prod.mediav.com (108/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 92.0 in stage 3.0 (TID 451) in 365 ms on hd254dg.prod.mediav.com (109/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd266dg.prod.mediav.com:27698 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd257dg.prod.mediav.com:50217 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 156.0 in stage 3.0 (TID 527) in 358 ms on hd281dg.prod.mediav.com (110/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 103.0 in stage 3.0 (TID 446) in 370 ms on hd271dg.prod.mediav.com (111/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 67.0 in stage 3.0 (TID 507) in 362 ms on hd266dg.prod.mediav.com (112/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 119.0 in stage 3.0 (TID 452) in 373 ms on hd279dg.prod.mediav.com (113/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd282dg.prod.mediav.com:57776 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 80.0 in stage 3.0 (TID 596, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd293dg.prod.mediav.com:25809 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 43.0 in stage 3.0 (TID 409) in 382 ms on hd291dg.prod.mediav.com (114/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 65.0 in stage 3.0 (TID 465) in 374 ms on hd285dg.prod.mediav.com (115/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 106.0 in stage 3.0 (TID 471) in 374 ms on hd281dg.prod.mediav.com (116/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd278dg.prod.mediav.com:16567 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd272dg.prod.mediav.com:63093 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd276dg.prod.mediav.com:62943 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 180.0 in stage 3.0 (TID 556) in 363 ms on hd285dg.prod.mediav.com (117/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 188.0 in stage 3.0 (TID 434) in 382 ms on hd275dg.prod.mediav.com (118/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 193.0 in stage 3.0 (TID 405) in 389 ms on hd277dg.prod.mediav.com (119/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 132.0 in stage 3.0 (TID 421) in 386 ms on hd256dg.prod.mediav.com (120/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd270dg.prod.mediav.com:3332 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd279dg.prod.mediav.com:11149 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd254dg.prod.mediav.com:6401 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd275dg.prod.mediav.com:52956 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 95.0 in stage 3.0 (TID 526) in 373 ms on hd289dg.prod.mediav.com (121/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd272dg.prod.mediav.com:13836 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 187.0 in stage 3.0 (TID 467) in 382 ms on hd289dg.prod.mediav.com (122/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 78.0 in stage 3.0 (TID 538) in 372 ms on hd270dg.prod.mediav.com (123/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd256dg.prod.mediav.com:54569 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 14.0 in stage 3.0 (TID 551) in 374 ms on hd274dg.prod.mediav.com (124/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd266dg.prod.mediav.com:60871 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 10.0 in stage 3.0 (TID 546) in 375 ms on hd261dg.prod.mediav.com (125/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd286dg.prod.mediav.com:20786 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 112.0 in stage 3.0 (TID 579) in 275 ms on hd262dg.prod.mediav.com (126/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 190.0 in stage 3.0 (TID 503) in 382 ms on hd255dg.prod.mediav.com (127/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd263dg.prod.mediav.com:5872 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd255dg.prod.mediav.com:22114 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd270dg.prod.mediav.com:6944 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd288dg.prod.mediav.com:3459 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 33.0 in stage 3.0 (TID 439) in 393 ms on hd274dg.prod.mediav.com (128/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 40.0 in stage 3.0 (TID 521) in 381 ms on hd283dg.prod.mediav.com (129/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 122.0 in stage 3.0 (TID 408) in 400 ms on hd280dg.prod.mediav.com (130/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd270dg.prod.mediav.com:5548 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 172.0 in stage 3.0 (TID 450) in 395 ms on hd256dg.prod.mediav.com (131/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 100.0 in stage 3.0 (TID 525) in 384 ms on hd285dg.prod.mediav.com (132/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 121.0 in stage 3.0 (TID 468) in 393 ms on hd290dg.prod.mediav.com (133/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 49.0 in stage 3.0 (TID 535) in 385 ms on hd293dg.prod.mediav.com (134/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 11.0 in stage 3.0 (TID 485) in 394 ms on hd290dg.prod.mediav.com (135/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 174.0 in stage 3.0 (TID 597, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 69.0 in stage 3.0 (TID 513) in 391 ms on hd264dg.prod.mediav.com (136/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 24.0 in stage 3.0 (TID 435) in 403 ms on hd271dg.prod.mediav.com (137/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 7.0 in stage 3.0 (TID 565) in 385 ms on hd291dg.prod.mediav.com (138/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 120.0 in stage 3.0 (TID 416) in 409 ms on hd273dg.prod.mediav.com (139/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 31.0 in stage 3.0 (TID 470) in 402 ms on hd277dg.prod.mediav.com (140/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 134.0 in stage 3.0 (TID 494) in 398 ms on hd255dg.prod.mediav.com (141/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 35.0 in stage 3.0 (TID 515) in 397 ms on hd263dg.prod.mediav.com (142/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 191.0 in stage 3.0 (TID 550) in 393 ms on hd276dg.prod.mediav.com (143/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 181.0 in stage 3.0 (TID 570) in 392 ms on hd284dg.prod.mediav.com (144/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 89.0 in stage 3.0 (TID 479) in 405 ms on hd274dg.prod.mediav.com (145/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 157.0 in stage 3.0 (TID 532) in 399 ms on hd281dg.prod.mediav.com (146/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 32.0 in stage 3.0 (TID 519) in 401 ms on hd293dg.prod.mediav.com (147/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 136.0 in stage 3.0 (TID 541) in 401 ms on hd276dg.prod.mediav.com (148/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 81.0 in stage 3.0 (TID 517) in 406 ms on hd265dg.prod.mediav.com (149/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 197.0 in stage 3.0 (TID 598, hd293dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 123.0 in stage 3.0 (TID 413) in 422 ms on hd272dg.prod.mediav.com (150/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 77.0 in stage 3.0 (TID 407) in 425 ms on hd279dg.prod.mediav.com (151/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 118.0 in stage 3.0 (TID 524) in 407 ms on hd271dg.prod.mediav.com (152/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 170.0 in stage 3.0 (TID 561) in 406 ms on hd263dg.prod.mediav.com (153/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 86.0 in stage 3.0 (TID 562) in 407 ms on hd275dg.prod.mediav.com (154/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 50.0 in stage 3.0 (TID 458) in 423 ms on hd291dg.prod.mediav.com (155/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 108.0 in stage 3.0 (TID 528) in 412 ms on hd286dg.prod.mediav.com (156/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 146.0 in stage 3.0 (TID 577) in 408 ms on hd273dg.prod.mediav.com (157/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 151.0 in stage 3.0 (TID 563) in 411 ms on hd277dg.prod.mediav.com (158/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 163.0 in stage 3.0 (TID 548) in 415 ms on hd263dg.prod.mediav.com (159/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 148.0 in stage 3.0 (TID 555) in 414 ms on hd279dg.prod.mediav.com (160/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 189.0 in stage 3.0 (TID 428) in 434 ms on hd277dg.prod.mediav.com (161/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 167.0 in stage 3.0 (TID 454) in 431 ms on hd265dg.prod.mediav.com (162/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 57.0 in stage 3.0 (TID 510) in 426 ms on hd266dg.prod.mediav.com (163/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 143.0 in stage 3.0 (TID 549) in 421 ms on hd283dg.prod.mediav.com (164/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 125.0 in stage 3.0 (TID 475) in 433 ms on hd263dg.prod.mediav.com (165/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 93.0 in stage 3.0 (TID 460) in 435 ms on hd271dg.prod.mediav.com (166/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 20.0 in stage 3.0 (TID 511) in 430 ms on hd266dg.prod.mediav.com (167/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 160.0 in stage 3.0 (TID 487) in 435 ms on hd257dg.prod.mediav.com (168/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 186.0 in stage 3.0 (TID 593) in 98 ms on hd291dg.prod.mediav.com (169/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 198.0 in stage 3.0 (TID 591) in 105 ms on hd262dg.prod.mediav.com (170/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 137.0 in stage 3.0 (TID 594) in 100 ms on hd281dg.prod.mediav.com (171/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 139.0 in stage 3.0 (TID 592) in 104 ms on hd266dg.prod.mediav.com (172/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 165.0 in stage 3.0 (TID 436) in 447 ms on hd282dg.prod.mediav.com (173/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 55.0 in stage 3.0 (TID 442) in 449 ms on hd278dg.prod.mediav.com (174/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 22.0 in stage 3.0 (TID 505) in 440 ms on hd293dg.prod.mediav.com (175/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 173.0 in stage 3.0 (TID 472) in 448 ms on hd276dg.prod.mediav.com (176/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 138.0 in stage 3.0 (TID 518) in 441 ms on hd272dg.prod.mediav.com (177/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 63.0 in stage 3.0 (TID 474) in 448 ms on hd270dg.prod.mediav.com (178/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 39.0 in stage 3.0 (TID 463) in 452 ms on hd279dg.prod.mediav.com (179/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 171.0 in stage 3.0 (TID 542) in 441 ms on hd272dg.prod.mediav.com (180/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 142.0 in stage 3.0 (TID 484) in 450 ms on hd275dg.prod.mediav.com (181/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 182.0 in stage 3.0 (TID 557) in 441 ms on hd254dg.prod.mediav.com (182/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 84.0 in stage 3.0 (TID 415) in 463 ms on hd266dg.prod.mediav.com (183/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 130.0 in stage 3.0 (TID 427) in 461 ms on hd256dg.prod.mediav.com (184/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 85.0 in stage 3.0 (TID 537) in 446 ms on hd286dg.prod.mediav.com (185/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 153.0 in stage 3.0 (TID 529) in 449 ms on hd263dg.prod.mediav.com (186/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 149.0 in stage 3.0 (TID 459) in 459 ms on hd255dg.prod.mediav.com (187/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 18.0 in stage 3.0 (TID 410) in 468 ms on hd270dg.prod.mediav.com (188/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 71.0 in stage 3.0 (TID 432) in 465 ms on hd288dg.prod.mediav.com (189/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 61.0 in stage 3.0 (TID 560) in 449 ms on hd270dg.prod.mediav.com (190/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 16.0 in stage 3.0 (TID 569) in 449 ms on hd285dg.prod.mediav.com (191/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 114.0 in stage 3.0 (TID 571) in 448 ms on hd280dg.prod.mediav.com (192/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 80.0 in stage 3.0 (TID 596) in 91 ms on hd293dg.prod.mediav.com (193/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 174.0 in stage 3.0 (TID 597) in 68 ms on hd293dg.prod.mediav.com (194/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd276dg.prod.mediav.com:15025 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 98.0 in stage 3.0 (TID 599, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 197.0 in stage 3.0 (TID 598) in 54 ms on hd293dg.prod.mediav.com (195/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 56.0 in stage 3.0 (TID 411) in 479 ms on hd276dg.prod.mediav.com (196/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_3_piece0 on hd280dg.prod.mediav.com:6093 in memory (size: 2.1 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 59.0 in stage 3.0 (TID 488) in 472 ms on hd280dg.prod.mediav.com (197/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_2_piece0 on 10.47.1.38:18554 in memory (size: 2.2 KB, free: 17.2 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_2_piece0 on hd292dg.prod.mediav.com:5167 in memory (size: 2.2 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Starting task 169.0 in stage 3.0 (TID 600, hd276dg.prod.mediav.com, PROCESS_LOCAL, 1534 bytes)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 98.0 in stage 3.0 (TID 599) in 34 ms on hd276dg.prod.mediav.com (198/200)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 169.0 in stage 3.0 (TID 600) in 26 ms on hd276dg.prod.mediav.com (199/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on 10.47.1.38:18554 in memory (size: 2.0 KB, free: 17.2 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd261dg.prod.mediav.com:35424 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd266dg.prod.mediav.com:18054 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd280dg.prod.mediav.com:4198 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd258dg.prod.mediav.com:30778 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd270dg.prod.mediav.com:5548 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd276dg.prod.mediav.com:15025 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd288dg.prod.mediav.com:3459 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd275dg.prod.mediav.com:37869 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd278dg.prod.mediav.com:27239 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd283dg.prod.mediav.com:15357 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd283dg.prod.mediav.com:62866 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd264dg.prod.mediav.com:48358 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd258dg.prod.mediav.com:44194 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd266dg.prod.mediav.com:60772 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd271dg.prod.mediav.com:33037 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd264dg.prod.mediav.com:48038 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd262dg.prod.mediav.com:49994 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd271dg.prod.mediav.com:45534 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd274dg.prod.mediav.com:44964 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd284dg.prod.mediav.com:65293 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd266dg.prod.mediav.com:27698 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd291dg.prod.mediav.com:31861 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd289dg.prod.mediav.com:20447 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd293dg.prod.mediav.com:18866 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd286dg.prod.mediav.com:15531 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd275dg.prod.mediav.com:7744 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd254dg.prod.mediav.com:37252 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd285dg.prod.mediav.com:25860 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd277dg.prod.mediav.com:27951 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd263dg.prod.mediav.com:57200 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd260dg.prod.mediav.com:7955 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd271dg.prod.mediav.com:11439 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd257dg.prod.mediav.com:11991 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd278dg.prod.mediav.com:9221 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd281dg.prod.mediav.com:12163 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd284dg.prod.mediav.com:33099 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd261dg.prod.mediav.com:17918 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd273dg.prod.mediav.com:19800 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd286dg.prod.mediav.com:22509 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd257dg.prod.mediav.com:50217 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd254dg.prod.mediav.com:50339 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd292dg.prod.mediav.com:9515 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd292dg.prod.mediav.com:8313 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd272dg.prod.mediav.com:36193 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd292dg.prod.mediav.com:5167 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd276dg.prod.mediav.com:62943 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd263dg.prod.mediav.com:19616 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd281dg.prod.mediav.com:61667 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd256dg.prod.mediav.com:5214 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd280dg.prod.mediav.com:29265 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd270dg.prod.mediav.com:35197 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd274dg.prod.mediav.com:16654 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd282dg.prod.mediav.com:47145 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd274dg.prod.mediav.com:50461 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd261dg.prod.mediav.com:48502 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd287dg.prod.mediav.com:2270 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd293dg.prod.mediav.com:46714 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd263dg.prod.mediav.com:5872 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd257dg.prod.mediav.com:23974 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd263dg.prod.mediav.com:30335 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd262dg.prod.mediav.com:24194 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd281dg.prod.mediav.com:2395 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd274dg.prod.mediav.com:58299 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd264dg.prod.mediav.com:49664 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd273dg.prod.mediav.com:51855 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd271dg.prod.mediav.com:63849 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd257dg.prod.mediav.com:13672 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd265dg.prod.mediav.com:41028 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd254dg.prod.mediav.com:6401 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd276dg.prod.mediav.com:46848 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd286dg.prod.mediav.com:20786 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd271dg.prod.mediav.com:16160 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd287dg.prod.mediav.com:53041 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd262dg.prod.mediav.com:5957 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd265dg.prod.mediav.com:15593 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd289dg.prod.mediav.com:48937 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd288dg.prod.mediav.com:15935 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd255dg.prod.mediav.com:62882 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd276dg.prod.mediav.com:65222 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd280dg.prod.mediav.com:1897 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd284dg.prod.mediav.com:39393 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd255dg.prod.mediav.com:22114 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd285dg.prod.mediav.com:15892 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd272dg.prod.mediav.com:63317 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd263dg.prod.mediav.com:28737 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd277dg.prod.mediav.com:60781 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd270dg.prod.mediav.com:3332 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd285dg.prod.mediav.com:52469 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd290dg.prod.mediav.com:48698 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd273dg.prod.mediav.com:6601 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd280dg.prod.mediav.com:6093 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd283dg.prod.mediav.com:27671 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd282dg.prod.mediav.com:42292 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd289dg.prod.mediav.com:48417 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd266dg.prod.mediav.com:7561 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd260dg.prod.mediav.com:34432 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd260dg.prod.mediav.com:45170 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd282dg.prod.mediav.com:54259 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd280dg.prod.mediav.com:8788 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd273dg.prod.mediav.com:35935 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd270dg.prod.mediav.com:6944 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd275dg.prod.mediav.com:52956 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd261dg.prod.mediav.com:51708 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd272dg.prod.mediav.com:63093 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd290dg.prod.mediav.com:1034 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd265dg.prod.mediav.com:65261 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd288dg.prod.mediav.com:58225 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd277dg.prod.mediav.com:17325 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd262dg.prod.mediav.com:40567 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd293dg.prod.mediav.com:60417 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd277dg.prod.mediav.com:27612 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd279dg.prod.mediav.com:49996 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd258dg.prod.mediav.com:8532 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd288dg.prod.mediav.com:30986 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd291dg.prod.mediav.com:47717 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd265dg.prod.mediav.com:38596 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd293dg.prod.mediav.com:25809 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd273dg.prod.mediav.com:4400 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd283dg.prod.mediav.com:5777 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd285dg.prod.mediav.com:57578 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd272dg.prod.mediav.com:47434 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd260dg.prod.mediav.com:20879 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd281dg.prod.mediav.com:2780 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd256dg.prod.mediav.com:4157 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd255dg.prod.mediav.com:29011 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd286dg.prod.mediav.com:5189 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd285dg.prod.mediav.com:7398 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd289dg.prod.mediav.com:22644 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd283dg.prod.mediav.com:19668 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd255dg.prod.mediav.com:8336 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd279dg.prod.mediav.com:12678 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd254dg.prod.mediav.com:14962 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd292dg.prod.mediav.com:31959 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd282dg.prod.mediav.com:57776 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd264dg.prod.mediav.com:28057 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd258dg.prod.mediav.com:61558 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd256dg.prod.mediav.com:22567 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd279dg.prod.mediav.com:34291 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd256dg.prod.mediav.com:54569 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd261dg.prod.mediav.com:16786 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd256dg.prod.mediav.com:65180 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd279dg.prod.mediav.com:34009 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd260dg.prod.mediav.com:38400 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd278dg.prod.mediav.com:16567 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd293dg.prod.mediav.com:23628 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd290dg.prod.mediav.com:25045 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd264dg.prod.mediav.com:38843 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd282dg.prod.mediav.com:51731 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd276dg.prod.mediav.com:21872 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd278dg.prod.mediav.com:27815 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd291dg.prod.mediav.com:9728 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd258dg.prod.mediav.com:3750 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd275dg.prod.mediav.com:3649 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd275dg.prod.mediav.com:27702 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.TaskSetManager: Finished task 161.0 in stage 3.0 (TID 595) in 255 ms on hd255dg.prod.mediav.com (200/200)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd270dg.prod.mediav.com:33090 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO cluster.YarnClusterScheduler: Removed TaskSet 3.0, whose tasks have all completed, from pool default
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: ResultStage 3 (collect at DecisionTree.scala:977) finished in 0.624 s
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd274dg.prod.mediav.com:25030 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd284dg.prod.mediav.com:55335 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO scheduler.DAGScheduler: Job 3 finished: collect at DecisionTree.scala:977, took 0.644801 s
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd262dg.prod.mediav.com:35030 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd287dg.prod.mediav.com:2547 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd289dg.prod.mediav.com:5555 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd266dg.prod.mediav.com:60871 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd288dg.prod.mediav.com:64716 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd277dg.prod.mediav.com:6547 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd254dg.prod.mediav.com:28306 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd290dg.prod.mediav.com:6793 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd278dg.prod.mediav.com:1380 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd291dg.prod.mediav.com:54360 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd286dg.prod.mediav.com:64184 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd281dg.prod.mediav.com:24432 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd257dg.prod.mediav.com:6403 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd265dg.prod.mediav.com:62939 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd255dg.prod.mediav.com:24822 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd279dg.prod.mediav.com:11149 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd291dg.prod.mediav.com:3890 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd292dg.prod.mediav.com:24852 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd290dg.prod.mediav.com:48176 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd284dg.prod.mediav.com:46214 in memory (size: 2.0 KB, free: 8.6 GB)
> 15/09/15 18:50:57 INFO storage.BlockManagerInfo: Removed broadcast_1_piece0 on hd272dg.prod.mediav.com:13836 in memory (size: 2.0 KB, free: 8.6 GB)
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org