You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Bin Wang <wb...@gmail.com> on 2015/07/09 11:29:24 UTC

Spark Streaming Hangs on Start

I'm using spark streaming with Kafka, and submit it to YARN cluster with
mode "yarn-cluster". But it hangs at SparkContext.start(). The Kafka config
is right since it can show some events in "Streaming" tab of web UI.

The attached file is the screen shot of the "Jobs" tab of web UI. The code
in the main class is:

object StatCounter {

  val config = ConfigFactory.load()
  val redisUrl = config.getString("redis.url")
  val redisPort = config.getInt("redis.port")
  val zkQuorum = config.getString("kafka.zkQuorum")
  val group = config.getString("kafka.group")
  val topic = config.getString("kafka.topic")
  val threadNum = config.getInt("kafka.threadNum")

  val cache = new RedisCache(redisUrl, redisPort)

  def main(args: Array[String]): Unit = {
    val conf = new SparkConf()
        .setAppName(config.getString("spark.name"))
        .set("spark.cassandra.connection.host",
config.getString("cassandra.host"))

    val ssc = new StreamingContext(conf,
Seconds(config.getInt("spark.interval")))
    ssc.checkpoint(config.getString("spark.checkpoint"))
    val storage = new CassandraStorage("adhoc_data", ssc)

    val lines = KafkaUtils.createStream(ssc, zkQuorum, group, Map(topic ->
threadNum)).map(_._2)

    val logs = lines.flatMap(line => Parser.parseBody(line, cache))
    Counter.count(logs, storage)

    sys.ShutdownHookThread {
      println("Gracefully stopping Spark Streaming Application")
      ssc.stop(stopSparkContext = true, stopGracefully = true)
      println("Application stopped")
    }

    ssc.start()
    ssc.awaitTermination()
  }
}

Re: Spark Streaming Hangs on Start

Posted by Bin Wang <wb...@gmail.com>.

Thanks for the help. I set  --executor-cores and it works now. I've used
--total-executor-cores and don't realize it changed.

Tathagata Das <td...@databricks.com>于2015年7月10日周五 上午3:11写道：

> 1. There will be a long running job with description "start()" as that is
> the jobs that is running the receivers. It will never end.
>
> 2. You need to set the number of cores given to the Spark executors by the
> YARN container. That is SparkConf spark.executor.cores,  --executor-cores
> in spark-submit. Since it is by default 1, your only container has one core
> which is occupied by the receiver, leaving no cores to run the map tasks.
> So the map stage is blocked
>
> 3.  Note these log lines. Especially "15/07/09 18:29:00 INFO
> receiver.ReceiverSupervisorImpl: Received stop signal" . I think somehow
> your streaming context is being shutdown too early which is causing the
> KafkaReceiver to stop. Something your should debug.
>
>
> 15/07/09 18:27:13 INFO consumer.ConsumerFetcherThread: [ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42], Starting
> 15/07/09 18:27:13 INFO consumer.ConsumerFetcherManager: [ConsumerFetcherManager-1436437633199] Added fetcher for partitions ArrayBuffer([[adhoc_data,0], initOffset 53 to broker id:42,host:szq1.appadhoc.com,port:9092] )
> 15/07/09 18:27:13 INFO storage.MemoryStore: ensureFreeSpace(1680) called with curMem=96628, maxMem=16669841817
> 15/07/09 18:27:13 INFO storage.MemoryStore: Block input-0-1436437633600 stored as bytes in memory (estimated size 1680.0 B, free 15.5 GB)
> 15/07/09 18:27:13 WARN storage.BlockManager: Block input-0-1436437633600 replicated to only 0 peer(s) instead of 1 peers
> 15/07/09 18:27:14 INFO receiver.BlockGenerator: Pushed block input-0-1436437633600*15/07/09 18:29:00 INFO receiver.ReceiverSupervisorImpl: Received stop signal
> *15/07/09 18:29:00 INFO receiver.ReceiverSupervisorImpl: Stopping receiver with message: Stopped by driver:
> 15/07/09 18:29:00 INFO consumer.ZookeeperConsumerConnector: [adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], ZKConsumerConnector shutting down
> 15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager: [ConsumerFetcherManager-1436437633199] Stopping leader finder thread
> 15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager$LeaderFinderThread: [adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread], Shutting down
> 15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager$LeaderFinderThread: [adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread], Stopped
> 15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager$LeaderFinderThread: [adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread], Shutdown completed
> 15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager: [ConsumerFetcherManager-1436437633199] Stopping all fetchers
> 15/07/09 18:29:00 INFO consumer.ConsumerFetcherThread: [ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42], Shutting down
> 15/07/09 18:29:01 INFO consumer.SimpleConsumer: Reconnect due to socket error: java.nio.channels.ClosedByInterruptException
> 15/07/09 18:29:01 INFO consumer.ConsumerFetcherThread: [ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42], Stopped
> 15/07/09 18:29:01 INFO consumer.ConsumerFetcherThread: [ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42], Shutdown completed
> 15/07/09 18:29:01 INFO consumer.ConsumerFetcherManager: [ConsumerFetcherManager-1436437633199] All connections stopped
> 15/07/09 18:29:01 INFO zkclient.ZkEventThread: Terminate ZkClient event thread.
> 15/07/09 18:29:01 INFO zookeeper.ZooKeeper: Session: 0x14e70eedca00315 closed
> 15/07/09 18:29:01 INFO zookeeper.ClientCnxn: EventThread shut down
> 15/07/09 18:29:01 INFO consumer.ZookeeperConsumerConnector: [adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], ZKConsumerConnector shutdown completed in 74 ms
> 15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Called receiver onStop
> 15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Deregistering receiver 0
>
>
>
>

Re: Spark Streaming Hangs on Start

Posted by Tathagata Das <td...@databricks.com>.

1. There will be a long running job with description "start()" as that is
the jobs that is running the receivers. It will never end.

2. You need to set the number of cores given to the Spark executors by the
YARN container. That is SparkConf spark.executor.cores,  --executor-cores
in spark-submit. Since it is by default 1, your only container has one core
which is occupied by the receiver, leaving no cores to run the map tasks.
So the map stage is blocked

3.  Note these log lines. Especially "15/07/09 18:29:00 INFO
receiver.ReceiverSupervisorImpl: Received stop signal" . I think somehow
your streaming context is being shutdown too early which is causing the
KafkaReceiver to stop. Something your should debug.


15/07/09 18:27:13 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Starting
15/07/09 18:27:13 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Added fetcher for partitions
ArrayBuffer([[adhoc_data,0], initOffset 53 to broker
id:42,host:szq1.appadhoc.com,port:9092] )
15/07/09 18:27:13 INFO storage.MemoryStore: ensureFreeSpace(1680)
called with curMem=96628, maxMem=16669841817
15/07/09 18:27:13 INFO storage.MemoryStore: Block
input-0-1436437633600 stored as bytes in memory (estimated size 1680.0
B, free 15.5 GB)
15/07/09 18:27:13 WARN storage.BlockManager: Block
input-0-1436437633600 replicated to only 0 peer(s) instead of 1 peers
15/07/09 18:27:14 INFO receiver.BlockGenerator: Pushed block
input-0-1436437633600*15/07/09 18:29:00 INFO
receiver.ReceiverSupervisorImpl: Received stop signal
*15/07/09 18:29:00 INFO receiver.ReceiverSupervisorImpl: Stopping
receiver with message: Stopped by driver:
15/07/09 18:29:00 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
ZKConsumerConnector shutting down
15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Stopping leader finder thread
15/07/09 18:29:00 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Shutting down
15/07/09 18:29:00 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Stopped
15/07/09 18:29:00 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Shutdown completed
15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Stopping all fetchers
15/07/09 18:29:00 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Shutting down
15/07/09 18:29:01 INFO consumer.SimpleConsumer: Reconnect due to
socket error: java.nio.channels.ClosedByInterruptException
15/07/09 18:29:01 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Stopped
15/07/09 18:29:01 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Shutdown completed
15/07/09 18:29:01 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] All connections stopped
15/07/09 18:29:01 INFO zkclient.ZkEventThread: Terminate ZkClient event thread.
15/07/09 18:29:01 INFO zookeeper.ZooKeeper: Session: 0x14e70eedca00315 closed
15/07/09 18:29:01 INFO zookeeper.ClientCnxn: EventThread shut down
15/07/09 18:29:01 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
ZKConsumerConnector shutdown completed in 74 ms
15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Called receiver onStop
15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Deregistering receiver 0

Re: Spark Streaming Hangs on Start

Posted by Bin Wang <wb...@gmail.com>.

And here is the log:

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/yarn/nm/usercache/root/filecache/3553/spark-assembly-1.4.0-hadoop2.6.0.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/jars/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
15/07/09 18:26:45 INFO executor.CoarseGrainedExecutorBackend:
Registered signal handlers for [TERM, HUP, INT]
15/07/09 18:26:46 INFO spark.SecurityManager: Changing view acls to: yarn,root
15/07/09 18:26:46 INFO spark.SecurityManager: Changing modify acls to: yarn,root
15/07/09 18:26:46 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view
permissions: Set(yarn, root); users with modify permissions: Set(yarn,
root)
15/07/09 18:26:46 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/07/09 18:26:46 INFO Remoting: Starting remoting
15/07/09 18:26:46 INFO Remoting: Remoting started; listening on
addresses :[akka.tcp://driverPropsFetcher@szq1.appadhoc.com:17174]
15/07/09 18:26:46 INFO util.Utils: Successfully started service
'driverPropsFetcher' on port 17174.
15/07/09 18:26:47 INFO
remote.RemoteActorRefProvider$RemotingTerminator: Shutting down remote
daemon.
15/07/09 18:26:47 INFO spark.SecurityManager: Changing view acls to: yarn,root
15/07/09 18:26:47 INFO
remote.RemoteActorRefProvider$RemotingTerminator: Remote daemon shut
down; proceeding with flushing remote transports.
15/07/09 18:26:47 INFO spark.SecurityManager: Changing modify acls to: yarn,root
15/07/09 18:26:47 INFO spark.SecurityManager: SecurityManager:
authentication disabled; ui acls disabled; users with view
permissions: Set(yarn, root); users with modify permissions: Set(yarn,
root)
15/07/09 18:26:47 INFO
remote.RemoteActorRefProvider$RemotingTerminator: Remoting shut down.
15/07/09 18:26:47 INFO slf4j.Slf4jLogger: Slf4jLogger started
15/07/09 18:26:47 INFO Remoting: Starting remoting
15/07/09 18:26:47 INFO Remoting: Remoting started; listening on
addresses :[akka.tcp://sparkExecutor@szq1.appadhoc.com:40186]
15/07/09 18:26:47 INFO util.Utils: Successfully started service
'sparkExecutor' on port 40186.
15/07/09 18:26:47 INFO storage.DiskBlockManager: Created local
directory at /yarn/nm/usercache/root/appcache/application_1436413848353_0021/blockmgr-506f420e-bf6b-4d0b-8f6b-097644cc2556
15/07/09 18:26:47 INFO storage.MemoryStore: MemoryStore started with
capacity 15.5 GB
15/07/09 18:26:47 INFO executor.CoarseGrainedExecutorBackend:
Connecting to driver:
akka.tcp://sparkDriver@192.168.1.1:55989/user/CoarseGrainedScheduler
15/07/09 <http://sparkDriver@192.168.1.1:55989/user/CoarseGrainedScheduler15/07/09>
18:26:47 INFO executor.CoarseGrainedExecutorBackend: Successfully
registered with driver
15/07/09 18:26:47 INFO executor.Executor: Starting executor ID 1 on
host szq1.appadhoc.com
15/07/09 18:26:47 INFO util.Utils: Successfully started service
'org.apache.spark.network.netty.NettyBlockTransferService' on port
8668.
15/07/09 18:26:47 INFO netty.NettyBlockTransferService: Server created on 8668
15/07/09 18:26:47 INFO storage.BlockManagerMaster: Trying to register
BlockManager
15/07/09 18:26:47 INFO storage.BlockManagerMaster: Registered BlockManager
15/07/09 18:27:11 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 0
15/07/09 18:27:11 INFO executor.Executor: Running task 0.0 in stage 0.0 (TID 0)
15/07/09 18:27:11 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 0
15/07/09 18:27:11 INFO storage.MemoryStore: ensureFreeSpace(1697)
called with curMem=0, maxMem=16669841817
15/07/09 18:27:11 INFO storage.MemoryStore: Block broadcast_0_piece0
stored as bytes in memory (estimated size 1697.0 B, free 15.5 GB)
15/07/09 18:27:11 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 0 took 154 ms
15/07/09 18:27:11 INFO storage.MemoryStore: ensureFreeSpace(2872)
called with curMem=1697, maxMem=16669841817
15/07/09 18:27:11 INFO storage.MemoryStore: Block broadcast_0 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:27:11 INFO executor.Executor: Finished task 0.0 in stage
0.0 (TID 0). 909 bytes result sent to driver
15/07/09 18:27:11 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 1
15/07/09 18:27:11 INFO executor.Executor: Running task 1.0 in stage 0.0 (TID 1)
15/07/09 18:27:11 INFO executor.Executor: Finished task 1.0 in stage
0.0 (TID 1). 909 bytes result sent to driver
15/07/09 18:27:11 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 2
15/07/09 18:27:11 INFO executor.Executor: Running task 2.0 in stage 0.0 (TID 2)
15/07/09 18:27:11 INFO executor.Executor: Finished task 2.0 in stage
0.0 (TID 2). 909 bytes result sent to driver
15/07/09 18:27:11 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 3
15/07/09 18:27:11 INFO executor.Executor: Running task 3.0 in stage 0.0 (TID 3)
15/07/09 18:27:11 INFO executor.Executor: Finished task 3.0 in stage
0.0 (TID 3). 909 bytes result sent to driver
15/07/09 18:27:11 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 4
15/07/09 18:27:11 INFO executor.Executor: Running task 4.0 in stage 0.0 (TID 4)
15/07/09 18:27:11 INFO executor.Executor: Finished task 4.0 in stage
0.0 (TID 4). 909 bytes result sent to driver
15/07/09 18:27:11 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 5
15/07/09 18:27:11 INFO executor.Executor: Running task 5.0 in stage 0.0 (TID 5)
15/07/09 18:27:11 INFO executor.Executor: Finished task 5.0 in stage
0.0 (TID 5). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 6
15/07/09 18:27:12 INFO executor.Executor: Running task 6.0 in stage 0.0 (TID 6)
15/07/09 18:27:12 INFO executor.Executor: Finished task 6.0 in stage
0.0 (TID 6). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 7
15/07/09 18:27:12 INFO executor.Executor: Running task 7.0 in stage 0.0 (TID 7)
15/07/09 18:27:12 INFO executor.Executor: Finished task 7.0 in stage
0.0 (TID 7). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 8
15/07/09 18:27:12 INFO executor.Executor: Running task 8.0 in stage 0.0 (TID 8)
15/07/09 18:27:12 INFO executor.Executor: Finished task 8.0 in stage
0.0 (TID 8). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 9
15/07/09 18:27:12 INFO executor.Executor: Running task 9.0 in stage 0.0 (TID 9)
15/07/09 18:27:12 INFO executor.Executor: Finished task 9.0 in stage
0.0 (TID 9). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 10
15/07/09 18:27:12 INFO executor.Executor: Running task 10.0 in stage
0.0 (TID 10)
15/07/09 18:27:12 INFO executor.Executor: Finished task 10.0 in stage
0.0 (TID 10). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 11
15/07/09 18:27:12 INFO executor.Executor: Running task 11.0 in stage
0.0 (TID 11)
15/07/09 18:27:12 INFO executor.Executor: Finished task 11.0 in stage
0.0 (TID 11). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 12
15/07/09 18:27:12 INFO executor.Executor: Running task 12.0 in stage
0.0 (TID 12)
15/07/09 18:27:12 INFO executor.Executor: Finished task 12.0 in stage
0.0 (TID 12). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 13
15/07/09 18:27:12 INFO executor.Executor: Running task 13.0 in stage
0.0 (TID 13)
15/07/09 18:27:12 INFO executor.Executor: Finished task 13.0 in stage
0.0 (TID 13). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 14
15/07/09 18:27:12 INFO executor.Executor: Running task 14.0 in stage
0.0 (TID 14)
15/07/09 18:27:12 INFO executor.Executor: Finished task 14.0 in stage
0.0 (TID 14). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 15
15/07/09 18:27:12 INFO executor.Executor: Running task 15.0 in stage
0.0 (TID 15)
15/07/09 18:27:12 INFO executor.Executor: Finished task 15.0 in stage
0.0 (TID 15). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 16
15/07/09 18:27:12 INFO executor.Executor: Running task 16.0 in stage
0.0 (TID 16)
15/07/09 18:27:12 INFO executor.Executor: Finished task 16.0 in stage
0.0 (TID 16). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 17
15/07/09 18:27:12 INFO executor.Executor: Running task 17.0 in stage
0.0 (TID 17)
15/07/09 18:27:12 INFO executor.Executor: Finished task 17.0 in stage
0.0 (TID 17). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 18
15/07/09 18:27:12 INFO executor.Executor: Running task 18.0 in stage
0.0 (TID 18)
15/07/09 18:27:12 INFO executor.Executor: Finished task 18.0 in stage
0.0 (TID 18). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 19
15/07/09 18:27:12 INFO executor.Executor: Running task 19.0 in stage
0.0 (TID 19)
15/07/09 18:27:12 INFO executor.Executor: Finished task 19.0 in stage
0.0 (TID 19). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 20
15/07/09 18:27:12 INFO executor.Executor: Running task 20.0 in stage
0.0 (TID 20)
15/07/09 18:27:12 INFO executor.Executor: Finished task 20.0 in stage
0.0 (TID 20). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 21
15/07/09 18:27:12 INFO executor.Executor: Running task 21.0 in stage
0.0 (TID 21)
15/07/09 18:27:12 INFO executor.Executor: Finished task 21.0 in stage
0.0 (TID 21). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 22
15/07/09 18:27:12 INFO executor.Executor: Running task 22.0 in stage
0.0 (TID 22)
15/07/09 18:27:12 INFO executor.Executor: Finished task 22.0 in stage
0.0 (TID 22). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 23
15/07/09 18:27:12 INFO executor.Executor: Running task 23.0 in stage
0.0 (TID 23)
15/07/09 18:27:12 INFO executor.Executor: Finished task 23.0 in stage
0.0 (TID 23). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 24
15/07/09 18:27:12 INFO executor.Executor: Running task 24.0 in stage
0.0 (TID 24)
15/07/09 18:27:12 INFO executor.Executor: Finished task 24.0 in stage
0.0 (TID 24). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 25
15/07/09 18:27:12 INFO executor.Executor: Running task 25.0 in stage
0.0 (TID 25)
15/07/09 18:27:12 INFO executor.Executor: Finished task 25.0 in stage
0.0 (TID 25). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 26
15/07/09 18:27:12 INFO executor.Executor: Running task 26.0 in stage
0.0 (TID 26)
15/07/09 18:27:12 INFO executor.Executor: Finished task 26.0 in stage
0.0 (TID 26). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 27
15/07/09 18:27:12 INFO executor.Executor: Running task 27.0 in stage
0.0 (TID 27)
15/07/09 18:27:12 INFO executor.Executor: Finished task 27.0 in stage
0.0 (TID 27). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 28
15/07/09 18:27:12 INFO executor.Executor: Running task 28.0 in stage
0.0 (TID 28)
15/07/09 18:27:12 INFO executor.Executor: Finished task 28.0 in stage
0.0 (TID 28). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 29
15/07/09 18:27:12 INFO executor.Executor: Running task 29.0 in stage
0.0 (TID 29)
15/07/09 18:27:12 INFO executor.Executor: Finished task 29.0 in stage
0.0 (TID 29). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 30
15/07/09 18:27:12 INFO executor.Executor: Running task 30.0 in stage
0.0 (TID 30)
15/07/09 18:27:12 INFO executor.Executor: Finished task 30.0 in stage
0.0 (TID 30). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 31
15/07/09 18:27:12 INFO executor.Executor: Running task 31.0 in stage
0.0 (TID 31)
15/07/09 18:27:12 INFO executor.Executor: Finished task 31.0 in stage
0.0 (TID 31). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 32
15/07/09 18:27:12 INFO executor.Executor: Running task 32.0 in stage
0.0 (TID 32)
15/07/09 18:27:12 INFO executor.Executor: Finished task 32.0 in stage
0.0 (TID 32). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 33
15/07/09 18:27:12 INFO executor.Executor: Running task 33.0 in stage
0.0 (TID 33)
15/07/09 18:27:12 INFO executor.Executor: Finished task 33.0 in stage
0.0 (TID 33). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 34
15/07/09 18:27:12 INFO executor.Executor: Running task 34.0 in stage
0.0 (TID 34)
15/07/09 18:27:12 INFO executor.Executor: Finished task 34.0 in stage
0.0 (TID 34). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 35
15/07/09 18:27:12 INFO executor.Executor: Running task 35.0 in stage
0.0 (TID 35)
15/07/09 18:27:12 INFO executor.Executor: Finished task 35.0 in stage
0.0 (TID 35). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 36
15/07/09 18:27:12 INFO executor.Executor: Running task 36.0 in stage
0.0 (TID 36)
15/07/09 18:27:12 INFO executor.Executor: Finished task 36.0 in stage
0.0 (TID 36). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 37
15/07/09 18:27:12 INFO executor.Executor: Running task 37.0 in stage
0.0 (TID 37)
15/07/09 18:27:12 INFO executor.Executor: Finished task 37.0 in stage
0.0 (TID 37). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 38
15/07/09 18:27:12 INFO executor.Executor: Running task 38.0 in stage
0.0 (TID 38)
15/07/09 18:27:12 INFO executor.Executor: Finished task 38.0 in stage
0.0 (TID 38). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 39
15/07/09 18:27:12 INFO executor.Executor: Running task 39.0 in stage
0.0 (TID 39)
15/07/09 18:27:12 INFO executor.Executor: Finished task 39.0 in stage
0.0 (TID 39). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 40
15/07/09 18:27:12 INFO executor.Executor: Running task 40.0 in stage
0.0 (TID 40)
15/07/09 18:27:12 INFO executor.Executor: Finished task 40.0 in stage
0.0 (TID 40). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 41
15/07/09 18:27:12 INFO executor.Executor: Running task 41.0 in stage
0.0 (TID 41)
15/07/09 18:27:12 INFO executor.Executor: Finished task 41.0 in stage
0.0 (TID 41). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 42
15/07/09 18:27:12 INFO executor.Executor: Running task 42.0 in stage
0.0 (TID 42)
15/07/09 18:27:12 INFO executor.Executor: Finished task 42.0 in stage
0.0 (TID 42). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 43
15/07/09 18:27:12 INFO executor.Executor: Running task 43.0 in stage
0.0 (TID 43)
15/07/09 18:27:12 INFO executor.Executor: Finished task 43.0 in stage
0.0 (TID 43). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 44
15/07/09 18:27:12 INFO executor.Executor: Running task 44.0 in stage
0.0 (TID 44)
15/07/09 18:27:12 INFO executor.Executor: Finished task 44.0 in stage
0.0 (TID 44). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 45
15/07/09 18:27:12 INFO executor.Executor: Running task 45.0 in stage
0.0 (TID 45)
15/07/09 18:27:12 INFO executor.Executor: Finished task 45.0 in stage
0.0 (TID 45). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 46
15/07/09 18:27:12 INFO executor.Executor: Running task 46.0 in stage
0.0 (TID 46)
15/07/09 18:27:12 INFO executor.Executor: Finished task 46.0 in stage
0.0 (TID 46). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 47
15/07/09 18:27:12 INFO executor.Executor: Running task 47.0 in stage
0.0 (TID 47)
15/07/09 18:27:12 INFO executor.Executor: Finished task 47.0 in stage
0.0 (TID 47). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 48
15/07/09 18:27:12 INFO executor.Executor: Running task 48.0 in stage
0.0 (TID 48)
15/07/09 18:27:12 INFO executor.Executor: Finished task 48.0 in stage
0.0 (TID 48). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 49
15/07/09 18:27:12 INFO executor.Executor: Running task 49.0 in stage
0.0 (TID 49)
15/07/09 18:27:12 INFO executor.Executor: Finished task 49.0 in stage
0.0 (TID 49). 909 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 50
15/07/09 18:27:12 INFO executor.Executor: Running task 0.0 in stage 1.0 (TID 50)
15/07/09 18:27:12 INFO spark.MapOutputTrackerWorker: Updating epoch to
1 and clearing cache
15/07/09 18:27:12 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 1
15/07/09 18:27:12 INFO storage.MemoryStore: ensureFreeSpace(1431)
called with curMem=4569, maxMem=16669841817
15/07/09 18:27:12 INFO storage.MemoryStore: Block broadcast_1_piece0
stored as bytes in memory (estimated size 1431.0 B, free 15.5 GB)
15/07/09 18:27:12 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 1 took 12 ms
15/07/09 18:27:12 INFO storage.MemoryStore: ensureFreeSpace(2392)
called with curMem=6000, maxMem=16669841817
15/07/09 18:27:12 INFO storage.MemoryStore: Block broadcast_1 stored
as values in memory (estimated size 2.3 KB, free 15.5 GB)
15/07/09 18:27:12 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 0, fetching them
15/07/09 18:27:12 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:27:12 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 4 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 0.0 in stage
1.0 (TID 50). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 51
15/07/09 18:27:12 INFO executor.Executor: Running task 1.0 in stage 1.0 (TID 51)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 1.0 in stage
1.0 (TID 51). 1089 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 52
15/07/09 18:27:12 INFO executor.Executor: Running task 2.0 in stage 1.0 (TID 52)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 2.0 in stage
1.0 (TID 52). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 53
15/07/09 18:27:12 INFO executor.Executor: Running task 3.0 in stage 1.0 (TID 53)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 3.0 in stage
1.0 (TID 53). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 54
15/07/09 18:27:12 INFO executor.Executor: Running task 4.0 in stage 1.0 (TID 54)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 4.0 in stage
1.0 (TID 54). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 55
15/07/09 18:27:12 INFO executor.Executor: Running task 5.0 in stage 1.0 (TID 55)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 5.0 in stage
1.0 (TID 55). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 56
15/07/09 18:27:12 INFO executor.Executor: Running task 6.0 in stage 1.0 (TID 56)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 6.0 in stage
1.0 (TID 56). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 57
15/07/09 18:27:12 INFO executor.Executor: Running task 7.0 in stage 1.0 (TID 57)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 7.0 in stage
1.0 (TID 57). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 58
15/07/09 18:27:12 INFO executor.Executor: Running task 8.0 in stage 1.0 (TID 58)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 8.0 in stage
1.0 (TID 58). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 59
15/07/09 18:27:12 INFO executor.Executor: Running task 9.0 in stage 1.0 (TID 59)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 9.0 in stage
1.0 (TID 59). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 60
15/07/09 18:27:12 INFO executor.Executor: Running task 10.0 in stage
1.0 (TID 60)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 3
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 10.0 in stage
1.0 (TID 60). 1094 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 61
15/07/09 18:27:12 INFO executor.Executor: Running task 11.0 in stage
1.0 (TID 61)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 11.0 in stage
1.0 (TID 61). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 62
15/07/09 18:27:12 INFO executor.Executor: Running task 12.0 in stage
1.0 (TID 62)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 12.0 in stage
1.0 (TID 62). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 63
15/07/09 18:27:12 INFO executor.Executor: Running task 13.0 in stage
1.0 (TID 63)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 13.0 in stage
1.0 (TID 63). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 64
15/07/09 18:27:12 INFO executor.Executor: Running task 14.0 in stage
1.0 (TID 64)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 14.0 in stage
1.0 (TID 64). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 65
15/07/09 18:27:12 INFO executor.Executor: Running task 15.0 in stage
1.0 (TID 65)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 15.0 in stage
1.0 (TID 65). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 66
15/07/09 18:27:12 INFO executor.Executor: Running task 16.0 in stage
1.0 (TID 66)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 16.0 in stage
1.0 (TID 66). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 67
15/07/09 18:27:12 INFO executor.Executor: Running task 17.0 in stage
1.0 (TID 67)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 17.0 in stage
1.0 (TID 67). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 68
15/07/09 18:27:12 INFO executor.Executor: Running task 18.0 in stage
1.0 (TID 68)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 18.0 in stage
1.0 (TID 68). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 69
15/07/09 18:27:12 INFO executor.Executor: Running task 19.0 in stage
1.0 (TID 69)
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Getting 2
non-empty blocks out of 50 blocks
15/07/09 18:27:12 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:27:12 INFO executor.Executor: Finished task 19.0 in stage
1.0 (TID 69). 1068 bytes result sent to driver
15/07/09 18:27:12 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 70
15/07/09 18:27:12 INFO executor.Executor: Running task 0.0 in stage 2.0 (TID 70)
15/07/09 18:27:12 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 2
15/07/09 18:27:12 INFO storage.MemoryStore: ensureFreeSpace(22468)
called with curMem=8392, maxMem=16669841817
15/07/09 18:27:12 INFO storage.MemoryStore: Block broadcast_2_piece0
stored as bytes in memory (estimated size 21.9 KB, free 15.5 GB)
15/07/09 18:27:12 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 2 took 12 ms
15/07/09 18:27:12 INFO storage.MemoryStore: ensureFreeSpace(65768)
called with curMem=30860, maxMem=16669841817
15/07/09 18:27:12 INFO storage.MemoryStore: Block broadcast_2 stored
as values in memory (estimated size 64.2 KB, free 15.5 GB)
15/07/09 18:27:13 INFO util.RecurringTimer: Started timer for
BlockGenerator at time 1436437633200
15/07/09 18:27:13 INFO receiver.BlockGenerator: Started BlockGenerator
15/07/09 18:27:13 INFO receiver.ReceiverSupervisorImpl: Starting receiver
15/07/09 18:27:13 INFO receiver.BlockGenerator: Started block pushing thread
15/07/09 18:27:13 INFO kafka.KafkaReceiver: Starting Kafka Consumer
Stream with group: adhoc_data_spark
15/07/09 18:27:13 INFO kafka.KafkaReceiver: Connecting to Zookeeper:
szq2.appadhoc.com:2181
15/07/09 18:27:13 INFO utils.VerifiableProperties: Verifying properties
15/07/09 18:27:13 INFO utils.VerifiableProperties: Property group.id
is overridden to adhoc_data_spark
15/07/09 18:27:13 INFO utils.VerifiableProperties: Property
zookeeper.connect is overridden to szq2.appadhoc.com:2181
15/07/09 18:27:13 INFO utils.VerifiableProperties: Property
zookeeper.connection.timeout.ms is overridden to 10000
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
Connecting to zookeeper instance at szq2.appadhoc.com:2181
15/07/09 18:27:13 INFO zkclient.ZkEventThread: Starting ZkClient event thread.
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:zookeeper.version=3.4.6-1569965, built on 02/20/2014 09:09
GMT
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:host.name=szq1.appadhoc.com
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.version=1.7.0_67
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.vendor=Oracle Corporation
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.home=/usr/lib/jvm/java-7-oracle-cloudera/jre
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.class.path=/yarn/nm/usercache/root/appcache/application_1436413848353_0021/container_1436413848353_0021_01_000002:/yarn/nm/usercache/root/appcache/application_1436413848353_0021/container_1436413848353_0021_01_000002/__spark__.jar:/etc/hadoop/conf.cloudera.yarn:/run/cloudera-scm-agent/process/204-yarn-NODEMANAGER:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-nfs-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-common.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-aws-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-generator.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-pig-bundle.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-thrift.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-common.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-avro.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-protobuf.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-nfs.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-format-javadoc.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-tools.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-scala_2.10.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-cascading.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-common-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-encoding.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-auth.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-annotations.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-common-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-aws.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-format-sources.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-test-hadoop2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-pig.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-auth-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-annotations-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-column.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-format.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-hadoop.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-scrooge_2.10.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-jackson.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/hadoop-common-2.6.0-cdh5.4.1-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/parquet-hadoop-bundle.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/logredactor-1.0.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/gson-2.2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/slf4j-log4j12.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/avro.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/hue-plugins-3.7.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/aws-java-sdk-1.7.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/curator-client-2.7.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/slf4j-api-1.7.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/htrace-core-3.0.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/curator-framework-2.7.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/curator-recipes-2.7.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/junit-4.11.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/hadoop-hdfs-nfs.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/hadoop-hdfs-2.6.0-cdh5.4.1-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/hadoop-hdfs-nfs-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/hadoop-hdfs-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/hadoop-hdfs-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/hadoop-hdfs.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-daemon-1.0.13.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/htrace-core-3.0.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-hdfs/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-client.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-nodemanager.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-common-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-api-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-web-proxy-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-tests-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-common-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-common.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-web-proxy.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-api.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-common.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-nodemanager-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-client-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-applicationhistoryservice-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-resourcemanager-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-registry-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-server-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-registry.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/hadoop-yarn-applications-distributedshell.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jersey-client-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/spark-1.3.0-cdh5.4.1-yarn-shuffle.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/zookeeper.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jline-2.11.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-yarn/lib/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/api-util-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-sls-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/xmlenc-0.52.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-datajoin.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jsch-0.1.42.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-ant-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-databind-2.2.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-archives-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-streaming.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/gson-2.2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jsr305-3.0.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-configuration-1.6.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-jaxrs-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jersey-json-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jetty-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jsp-api-2.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-common.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jetty-util-6.1.26.cloudera.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.4.1-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jaxb-impl-2.2.3-1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-beanutils-1.7.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-ant.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-core.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-rumen.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-azure-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jaxb-api-2.2.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-xc-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/avro.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-annotations-2.2.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-sls.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-examples-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-el-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-common-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-nativetask-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-hs-plugins-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-datajoin-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-extras.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-digester-1.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/servlet-api-2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/guava-11.0.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/java-xmlbuilder-0.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/mockito-all-1.8.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/curator-client-2.7.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/apacheds-kerberos-codec-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/api-asn1-api-1.0.0-M20.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/activation-1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-net-3.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-gridmix-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jasper-runtime-5.5.23.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-app-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-app.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/zookeeper.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-auth.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-httpclient-3.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-extras-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/htrace-core-3.0.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/metrics-core-3.0.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-lang-2.6.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-streaming-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-collections-3.2.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/curator-framework-2.7.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-beanutils-core-1.8.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-distcp.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-shuffle-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/stax-api-1.0-2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jackson-core-2.2.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-nativetask.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-azure.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jettison-1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-core-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-cli-1.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-rumen-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jets3t-0.9.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-mapreduce-client-jobclient-tests.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-auth-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/curator-recipes-2.7.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/httpclient-4.2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-distcp-2.6.0-cdh5.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-math3-3.1.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/junit-4.11.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/apacheds-i18n-2.0.0-M15.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-archives.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/httpcore-4.2.5.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/microsoft-windowsazure-storage-sdk-0.6.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/jasper-compiler-5.5.23.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-codec-1.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/commons-logging-1.1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/hadoop-gridmix.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/paranamer-2.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/snappy-java-1.0.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/jackson-core-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/jersey-core-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/guice-servlet-3.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/commons-io-2.4.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/guice-3.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/avro.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/javax.inject-1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/aopalliance-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/log4j-1.2.17.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/jersey-guice-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/leveldbjni-all-1.8.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/commons-compress-1.4.1.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/hamcrest-core-1.3.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/netty-3.6.2.Final.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/jersey-server-1.9.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/protobuf-java-2.5.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/asm-3.2.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/xz-1.0.jar:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop-mapreduce/lib/junit-4.11.jar:
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.library.path=:/opt/cloudera/parcels/CDH-5.4.1-1.cdh5.4.1.p0.6/lib/hadoop/lib/native:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.io.tmpdir=/yarn/nm/usercache/root/appcache/application_1436413848353_0021/container_1436413848353_0021_01_000002/tmp
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:java.compiler=<NA>
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:os.version=3.16.0-30-generic
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client environment:user.name=yarn
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:user.home=/var/lib/hadoop-yarn
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Client
environment:user.dir=/yarn/nm/usercache/root/appcache/application_1436413848353_0021/container_1436413848353_0021_01_000002
15/07/09 18:27:13 INFO zookeeper.ZooKeeper: Initiating client
connection, connectString=szq2.appadhoc.com:2181 sessionTimeout=6000
watcher=org.I0Itec.zkclient.ZkClient@242829c
15/07/09 18:27:13 INFO zookeeper.ClientCnxn: Opening socket connection
to server szq2.appadhoc.com/192.168.1.2:2181. Will not attempt to
authenticate using SASL (unknown error)
15/07/09 18:27:13 INFO zookeeper.ClientCnxn: Socket connection
established to szq2.appadhoc.com/192.168.1.2:2181, initiating session
15/07/09 18:27:13 INFO zookeeper.ClientCnxn: Session establishment
complete on server szq2.appadhoc.com/192.168.1.2:2181, sessionid =
0x14e70eedca00315, negotiated timeout = 6000
15/07/09 18:27:13 INFO zkclient.ZkClient: zookeeper state changed
(SyncConnected)
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], starting
auto committer every 60000 ms
15/07/09 18:27:13 WARN common.AppInfo$: Can't read Kafka version from
MANIFEST.MF. Possible cause: java.lang.NullPointerException
15/07/09 18:27:13 INFO kafka.KafkaReceiver: Connected to szq2.appadhoc.com:2181
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], begin
registering consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201 in ZK
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], end
registering consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201 in ZK
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], starting
watcher executor thread for consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], begin
rebalancing consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201 try #0
15/07/09 18:27:13 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Stopping leader finder thread
15/07/09 18:27:13 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Stopping all fetchers
15/07/09 18:27:13 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] All connections stopped
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], Cleared
all relevant queues for this fetcher
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], Cleared
the data chunks in all the consumer message iterators
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
Committing all offsets after clearing the fetcher queues
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], Releasing
partition ownership
15/07/09 18:27:13 INFO consumer.RangeAssignor: Consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201 rebalancing
the following partitions: ArrayBuffer(0) for topic adhoc_data with
consumers: List(adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0)
15/07/09 18:27:13 INFO consumer.RangeAssignor:
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0 attempting
to claim partition 0
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0
successfully owned partition 0 for topic adhoc_data
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], Consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201 selected
partitions : adhoc_data:0: fetched offset = 53: consumed offset = 53
15/07/09 18:27:13 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Starting
15/07/09 18:27:13 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], end
rebalancing consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201 try #0
15/07/09 18:27:13 INFO receiver.ReceiverSupervisorImpl: Called receiver onStart
15/07/09 18:27:13 INFO kafka.KafkaReceiver: Starting MessageHandler.
15/07/09 18:27:13 INFO utils.VerifiableProperties: Verifying properties
15/07/09 18:27:13 INFO utils.VerifiableProperties: Property client.id
is overridden to adhoc_data_spark
15/07/09 18:27:13 INFO utils.VerifiableProperties: Property
metadata.broker.list is overridden to szq1.appadhoc.com:9092
15/07/09 18:27:13 INFO utils.VerifiableProperties: Property
request.timeout.ms is overridden to 30000
15/07/09 18:27:13 INFO client.ClientUtils$: Fetching metadata from
broker id:42,host:szq1.appadhoc.com,port:9092 with correlation id 0
for 1 topic(s) Set(adhoc_data)
15/07/09 18:27:13 INFO producer.SyncProducer: Connected to
szq1.appadhoc.com:9092 for producing
15/07/09 18:27:13 INFO producer.SyncProducer: Disconnecting from
szq1.appadhoc.com:9092
15/07/09 18:27:13 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Starting
15/07/09 18:27:13 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Added fetcher for partitions
ArrayBuffer([[adhoc_data,0], initOffset 53 to broker
id:42,host:szq1.appadhoc.com,port:9092] )
15/07/09 18:27:13 INFO storage.MemoryStore: ensureFreeSpace(1680)
called with curMem=96628, maxMem=16669841817
15/07/09 18:27:13 INFO storage.MemoryStore: Block
input-0-1436437633600 stored as bytes in memory (estimated size 1680.0
B, free 15.5 GB)
15/07/09 18:27:13 WARN storage.BlockManager: Block
input-0-1436437633600 replicated to only 0 peer(s) instead of 1 peers
15/07/09 18:27:14 INFO receiver.BlockGenerator: Pushed block
input-0-1436437633600
15/07/09 18:29:00 INFO receiver.ReceiverSupervisorImpl: Received stop signal
15/07/09 18:29:00 INFO receiver.ReceiverSupervisorImpl: Stopping
receiver with message: Stopped by driver:
15/07/09 18:29:00 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
ZKConsumerConnector shutting down
15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Stopping leader finder thread
15/07/09 18:29:00 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Shutting down
15/07/09 18:29:00 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Stopped
15/07/09 18:29:00 INFO
consumer.ConsumerFetcherManager$LeaderFinderThread:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-leader-finder-thread],
Shutdown completed
15/07/09 18:29:00 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] Stopping all fetchers
15/07/09 18:29:00 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Shutting down
15/07/09 18:29:01 INFO consumer.SimpleConsumer: Reconnect due to
socket error: java.nio.channels.ClosedByInterruptException
15/07/09 18:29:01 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Stopped
15/07/09 18:29:01 INFO consumer.ConsumerFetcherThread:
[ConsumerFetcherThread-adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201-0-42],
Shutdown completed
15/07/09 18:29:01 INFO consumer.ConsumerFetcherManager:
[ConsumerFetcherManager-1436437633199] All connections stopped
15/07/09 18:29:01 INFO zkclient.ZkEventThread: Terminate ZkClient event thread.
15/07/09 18:29:01 INFO zookeeper.ZooKeeper: Session: 0x14e70eedca00315 closed
15/07/09 18:29:01 INFO zookeeper.ClientCnxn: EventThread shut down
15/07/09 18:29:01 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201],
ZKConsumerConnector shutdown completed in 74 ms
15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Called receiver onStop
15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Deregistering receiver 0
15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Stopped receiver 0
15/07/09 18:29:01 INFO receiver.BlockGenerator: Stopping BlockGenerator
15/07/09 18:29:01 INFO util.RecurringTimer: Stopped timer for
BlockGenerator after time 1436437741200
15/07/09 18:29:01 INFO receiver.BlockGenerator: Waiting for block pushing thread
15/07/09 18:29:01 INFO receiver.BlockGenerator: Pushing out the last 0 blocks
15/07/09 18:29:01 INFO receiver.BlockGenerator: Stopped block pushing thread
15/07/09 18:29:01 INFO receiver.BlockGenerator: Stopped BlockGenerator
15/07/09 18:29:01 INFO receiver.ReceiverSupervisorImpl: Waiting for
executor stop is over
15/07/09 18:29:01 WARN receiver.ReceiverSupervisorImpl: Stopped
executor without error
15/07/09 18:29:01 INFO executor.Executor: Finished task 0.0 in stage
2.0 (TID 70). 628 bytes result sent to driver
15/07/09 18:29:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 71
15/07/09 18:29:01 INFO executor.Executor: Running task 0.0 in stage 8.0 (TID 71)
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 4
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(2045)
called with curMem=98308, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_4_piece0
stored as bytes in memory (estimated size 2045.0 B, free 15.5 GB)
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 4 took 14 ms
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(3696)
called with curMem=100353, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_4 stored
as values in memory (estimated size 3.6 KB, free 15.5 GB)
15/07/09 18:29:01 INFO storage.BlockManager: Found block
input-0-1436437633600 locally
15/07/09 18:29:01 INFO consumer.ZookeeperConsumerConnector:
[adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201], stopping
watcher executor thread for consumer
adhoc_data_spark_szq1.appadhoc.com-1436437633136-a84a7201
15/07/09 18:29:01 INFO executor.Executor: Finished task 0.0 in stage
8.0 (TID 71). 891 bytes result sent to driver
15/07/09 18:29:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 72
15/07/09 18:29:01 INFO executor.Executor: Running task 0.0 in stage 9.0 (TID 72)
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Updating epoch to
2 and clearing cache
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 5
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(3063)
called with curMem=104049, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_5_piece0
stored as bytes in memory (estimated size 3.0 KB, free 15.5 GB)
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 5 took 10 ms
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(6008)
called with curMem=107112, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_5 stored
as values in memory (estimated size 5.9 KB, free 15.5 GB)
15/07/09 18:29:01 INFO spark.CacheManager: Partition rdd_30_0 not
found, computing it
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 8, fetching them
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 1 blocks
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(354)
called with curMem=113120, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block rdd_30_0 stored as
bytes in memory (estimated size 354.0 B, free 15.5 GB)
15/07/09 18:29:01 INFO executor.Executor: Finished task 0.0 in stage
9.0 (TID 72). 1687 bytes result sent to driver
15/07/09 18:29:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 73
15/07/09 18:29:01 INFO executor.Executor: Running task 1.0 in stage 9.0 (TID 73)
15/07/09 18:29:01 INFO spark.CacheManager: Partition rdd_30_1 not
found, computing it
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 1 blocks
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=113474, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block rdd_30_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:01 INFO executor.Executor: Finished task 1.0 in stage
9.0 (TID 73). 1687 bytes result sent to driver
15/07/09 18:29:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 74
15/07/09 18:29:01 INFO executor.Executor: Running task 0.0 in stage
10.0 (TID 74)
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Updating epoch to
3 and clearing cache
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 6
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(1705)
called with curMem=113478, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_6_piece0
stored as bytes in memory (estimated size 1705.0 B, free 15.5 GB)
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 6 took 9 ms
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=115183, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_6 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 7, fetching them
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:01 INFO executor.Executor: Finished task 0.0 in stage
10.0 (TID 74). 1107 bytes result sent to driver
15/07/09 18:29:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 75
15/07/09 18:29:01 INFO executor.Executor: Running task 1.0 in stage
10.0 (TID 75)
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:01 INFO executor.Executor: Finished task 1.0 in stage
10.0 (TID 75). 1107 bytes result sent to driver
15/07/09 18:29:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 76
15/07/09 18:29:01 INFO executor.Executor: Running task 0.0 in stage
12.0 (TID 76)
15/07/09 18:29:01 INFO spark.MapOutputTrackerWorker: Updating epoch to
4 and clearing cache
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 7
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(5529)
called with curMem=118071, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_7_piece0
stored as bytes in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:29:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 7 took 9 ms
15/07/09 18:29:01 INFO storage.MemoryStore: ensureFreeSpace(11400)
called with curMem=123600, maxMem=16669841817
15/07/09 18:29:01 INFO storage.MemoryStore: Block broadcast_7 stored
as values in memory (estimated size 11.1 KB, free 15.5 GB)
15/07/09 18:29:02 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 5, fetching them
15/07/09 18:29:02 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:02 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:02 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:02 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 6, fetching them
15/07/09 18:29:02 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:02 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:02 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:02 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:02 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:02 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:03 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.hourly_results in 1.150 s.
15/07/09 18:29:03 INFO executor.Executor: Finished task 0.0 in stage
12.0 (TID 76). 1836 bytes result sent to driver
15/07/09 18:29:03 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 77
15/07/09 18:29:03 INFO executor.Executor: Running task 1.0 in stage
12.0 (TID 77)
15/07/09 18:29:03 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:03 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:03 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:03 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:03 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.hourly_results in 0.011 s.
15/07/09 18:29:03 INFO executor.Executor: Finished task 1.0 in stage
12.0 (TID 77). 1836 bytes result sent to driver
15/07/09 18:29:03 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 78
15/07/09 18:29:03 INFO executor.Executor: Running task 0.0 in stage
14.0 (TID 78)
15/07/09 18:29:03 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 10
15/07/09 18:29:03 INFO storage.MemoryStore: ensureFreeSpace(3410)
called with curMem=135000, maxMem=16669841817
15/07/09 18:29:03 INFO storage.MemoryStore: Block broadcast_10_piece0
stored as bytes in memory (estimated size 3.3 KB, free 15.5 GB)
15/07/09 18:29:03 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 10 took 10 ms
15/07/09 18:29:03 INFO storage.MemoryStore: ensureFreeSpace(6504)
called with curMem=138410, maxMem=16669841817
15/07/09 18:29:03 INFO storage.MemoryStore: Block broadcast_10 stored
as values in memory (estimated size 6.4 KB, free 15.5 GB)
15/07/09 18:29:03 INFO storage.BlockManager: Found block rdd_30_0 locally
15/07/09 18:29:03 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 8
15/07/09 18:29:03 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=144914, maxMem=16669841817
15/07/09 18:29:03 INFO storage.MemoryStore: Block broadcast_8_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:03 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 8 took 10 ms
15/07/09 18:29:03 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:29:03 INFO storage.MemoryStore: ensureFreeSpace(359112)
called with curMem=166458, maxMem=16669841817
15/07/09 18:29:03 INFO storage.MemoryStore: Block broadcast_8 stored
as values in memory (estimated size 350.7 KB, free 15.5 GB)
15/07/09 18:29:04 INFO executor.Executor: Finished task 0.0 in stage
14.0 (TID 78). 1800 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 79
15/07/09 18:29:04 INFO executor.Executor: Running task 1.0 in stage
14.0 (TID 79)
15/07/09 18:29:04 INFO storage.BlockManager: Found block rdd_30_1 locally
15/07/09 18:29:04 INFO executor.Executor: Finished task 1.0 in stage
14.0 (TID 79). 1800 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 80
15/07/09 18:29:04 INFO executor.Executor: Running task 0.0 in stage
15.0 (TID 80)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 11
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(1734)
called with curMem=525570, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_11_piece0
stored as bytes in memory (estimated size 1734.0 B, free 15.5 GB)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 11 took 10 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(2960)
called with curMem=527304, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_11 stored
as values in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:29:04 INFO storage.BlockManager: Found block
input-0-1436437633600 locally
15/07/09 18:29:04 INFO executor.Executor: Finished task 0.0 in stage
15.0 (TID 80). 891 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 81
15/07/09 18:29:04 INFO executor.Executor: Running task 0.0 in stage
16.0 (TID 81)
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Updating epoch to
5 and clearing cache
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 12
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(1925)
called with curMem=530264, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_12_piece0
stored as bytes in memory (estimated size 1925.0 B, free 15.5 GB)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 12 took 11 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(3496)
called with curMem=532189, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_12 stored
as values in memory (estimated size 3.4 KB, free 15.5 GB)
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 12, fetching them
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 1 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO executor.Executor: Finished task 0.0 in stage
16.0 (TID 81). 1107 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 82
15/07/09 18:29:04 INFO executor.Executor: Running task 1.0 in stage
16.0 (TID 82)
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 1 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO executor.Executor: Finished task 1.0 in stage
16.0 (TID 82). 1107 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 83
15/07/09 18:29:04 INFO executor.Executor: Running task 0.0 in stage
17.0 (TID 83)
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Updating epoch to
6 and clearing cache
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 13
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(3039)
called with curMem=535685, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_13_piece0
stored as bytes in memory (estimated size 3.0 KB, free 15.5 GB)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 13 took 10 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(5848)
called with curMem=538724, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_13 stored
as values in memory (estimated size 5.7 KB, free 15.5 GB)
15/07/09 18:29:04 INFO spark.CacheManager: Partition rdd_43_0 not
found, computing it
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 11, fetching them
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=544572, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block rdd_43_0 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:04 INFO executor.Executor: Finished task 0.0 in stage
17.0 (TID 83). 1687 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 84
15/07/09 18:29:04 INFO executor.Executor: Running task 1.0 in stage
17.0 (TID 84)
15/07/09 18:29:04 INFO spark.CacheManager: Partition rdd_43_1 not
found, computing it
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(264)
called with curMem=544576, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block rdd_43_1 stored as
bytes in memory (estimated size 264.0 B, free 15.5 GB)
15/07/09 18:29:04 INFO executor.Executor: Finished task 1.0 in stage
17.0 (TID 84). 1687 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 85
15/07/09 18:29:04 INFO executor.Executor: Running task 0.0 in stage
19.0 (TID 85)
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Updating epoch to
7 and clearing cache
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 14
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(6522)
called with curMem=544840, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_14_piece0
stored as bytes in memory (estimated size 6.4 KB, free 15.5 GB)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 14 took 13 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(13880)
called with curMem=551362, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_14 stored
as values in memory (estimated size 13.6 KB, free 15.5 GB)
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 9, fetching them
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 10, fetching them
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:04 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:04 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:04 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:04 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.clients in 0.112 s.
15/07/09 18:29:04 INFO executor.Executor: Finished task 0.0 in stage
19.0 (TID 85). 1836 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 86
15/07/09 18:29:04 INFO executor.Executor: Running task 1.0 in stage
19.0 (TID 86)
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:04 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:04 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.clients in 0.008 s.
15/07/09 18:29:04 INFO executor.Executor: Finished task 1.0 in stage
19.0 (TID 86). 1836 bytes result sent to driver
15/07/09 18:29:04 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 87
15/07/09 18:29:04 INFO executor.Executor: Running task 0.0 in stage
22.0 (TID 87)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 17
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(3231)
called with curMem=544840, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_17_piece0
stored as bytes in memory (estimated size 3.2 KB, free 15.5 GB)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 17 took 10 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(6144)
called with curMem=548071, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_17 stored
as values in memory (estimated size 6.0 KB, free 15.5 GB)
15/07/09 18:29:04 INFO storage.BlockManager: Found block rdd_43_0 locally
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 15
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=554215, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_15_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:04 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 15 took 19 ms
15/07/09 18:29:04 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=147553, maxMem=16669841817
15/07/09 18:29:04 INFO storage.MemoryStore: Block broadcast_15 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
22.0 (TID 87). 1800 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 88
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
22.0 (TID 88)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_43_1 locally
15/07/09 18:29:05 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
22.0 (TID 88). 1800 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 89
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
23.0 (TID 89)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 18
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2041)
called with curMem=490413, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_18_piece0
stored as bytes in memory (estimated size 2041.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 18 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(3696)
called with curMem=492454, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_18 stored
as values in memory (estimated size 3.6 KB, free 15.5 GB)
15/07/09 18:29:05 INFO storage.BlockManager: Found block
input-0-1436437633600 locally
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
23.0 (TID 89). 891 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 90
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
24.0 (TID 90)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Updating epoch to
8 and clearing cache
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 19
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(3061)
called with curMem=496150, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_19_piece0
stored as bytes in memory (estimated size 3.0 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 19 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(6008)
called with curMem=499211, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_19 stored
as values in memory (estimated size 5.9 KB, free 15.5 GB)
15/07/09 18:29:05 INFO spark.CacheManager: Partition rdd_52_0 not
found, computing it
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 16, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 1 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(337)
called with curMem=505219, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block rdd_52_0 stored as
bytes in memory (estimated size 337.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
24.0 (TID 90). 1687 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 91
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
24.0 (TID 91)
15/07/09 18:29:05 INFO spark.CacheManager: Partition rdd_52_1 not
found, computing it
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 1 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=505556, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block rdd_52_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
24.0 (TID 91). 1687 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 92
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
25.0 (TID 92)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Updating epoch to
9 and clearing cache
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 20
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(1705)
called with curMem=505560, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_20_piece0
stored as bytes in memory (estimated size 1705.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 20 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=507265, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_20 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 15, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
25.0 (TID 92). 1107 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 93
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
25.0 (TID 93)
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
25.0 (TID 93). 1107 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 94
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
27.0 (TID 94)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Updating epoch to
10 and clearing cache
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 21
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(5452)
called with curMem=510153, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_21_piece0
stored as bytes in memory (estimated size 5.3 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 21 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(11232)
called with curMem=515605, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_21 stored
as values in memory (estimated size 11.0 KB, free 15.5 GB)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 13, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 14, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:05 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:05 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:05 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.results in 0.097 s.
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
27.0 (TID 94). 1836 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 95
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
27.0 (TID 95)
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.results in 0.008 s.
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
27.0 (TID 95). 1836 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 96
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
29.0 (TID 96)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 24
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(3404)
called with curMem=526837, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_24_piece0
stored as bytes in memory (estimated size 3.3 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 24 took 10 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(6504)
called with curMem=530241, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_24 stored
as values in memory (estimated size 6.4 KB, free 15.5 GB)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_52_0 locally
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 22
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=536745, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_22_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 22 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=558289, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_22 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
29.0 (TID 96). 1800 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 97
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
29.0 (TID 97)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_52_1 locally
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
29.0 (TID 97). 1800 bytes result sent to driver
15/07/09 18:29:05 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 98
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
30.0 (TID 98)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 25
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2696)
called with curMem=918849, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_25_piece0
stored as bytes in memory (estimated size 2.6 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 25 took 8 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(4784)
called with curMem=921545, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_25 stored
as values in memory (estimated size 4.7 KB, free 15.5 GB)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_52_0 locally
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
30.0 (TID 98). 2013 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 99
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
30.0 (TID 99)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_52_1 locally
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
30.0 (TID 99). 2013 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 100
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
31.0 (TID 100)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Updating epoch to
11 and clearing cache
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 26
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(1393)
called with curMem=926329, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_26_piece0
stored as bytes in memory (estimated size 1393.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 26 took 8 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2288)
called with curMem=927722, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_26 stored
as values in memory (estimated size 2.2 KB, free 15.5 GB)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 17, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
31.0 (TID 100). 890 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 101
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
31.0 (TID 101)
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
31.0 (TID 101). 1125 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 102
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
32.0 (TID 102)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 27
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2852)
called with curMem=930010, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_27_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 27 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(5008)
called with curMem=932862, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_27 stored
as values in memory (estimated size 4.9 KB, free 15.5 GB)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_52_0 locally
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
32.0 (TID 102). 2013 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 103
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
32.0 (TID 103)
15/07/09 18:29:05 INFO storage.BlockManager: Found block rdd_52_1 locally
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
32.0 (TID 103). 2013 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 104
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
33.0 (TID 104)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Updating epoch to
12 and clearing cache
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 28
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(1708)
called with curMem=931493, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_28_piece0
stored as bytes in memory (estimated size 1708.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 28 took 12 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=928417, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_28 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 20, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
33.0 (TID 104). 1107 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 105
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
33.0 (TID 105)
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
33.0 (TID 105). 1107 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 106
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
35.0 (TID 106)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Updating epoch to
13 and clearing cache
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 29
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(5586)
called with curMem=518016, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_29_piece0
stored as bytes in memory (estimated size 5.5 KB, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 29 took 8 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(11680)
called with curMem=514533, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_29 stored
as values in memory (estimated size 11.4 KB, free 15.5 GB)
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 18, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 19, fetching them
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:05 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:05 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:05 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:05 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.histogram in 0.083 s.
15/07/09 18:29:05 INFO executor.Executor: Finished task 0.0 in stage
35.0 (TID 106). 1836 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 107
15/07/09 18:29:05 INFO executor.Executor: Running task 1.0 in stage
35.0 (TID 107)
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:05 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:05 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.histogram in 0.011 s.
15/07/09 18:29:05 INFO executor.Executor: Finished task 1.0 in stage
35.0 (TID 107). 1836 bytes result sent to driver
15/07/09 18:29:05 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 108
15/07/09 18:29:05 INFO executor.Executor: Running task 0.0 in stage
37.0 (TID 108)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 30
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(1735)
called with curMem=128997, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_30_piece0
stored as bytes in memory (estimated size 1735.0 B, free 15.5 GB)
15/07/09 18:29:05 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 30 took 9 ms
15/07/09 18:29:05 INFO storage.MemoryStore: ensureFreeSpace(2960)
called with curMem=130732, maxMem=16669841817
15/07/09 18:29:05 INFO storage.MemoryStore: Block broadcast_30 stored
as values in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:29:05 INFO storage.BlockManager: Found block
input-0-1436437633600 locally
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
37.0 (TID 108). 891 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 109
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
39.0 (TID 109)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 31
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(1516)
called with curMem=133692, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_31_piece0
stored as bytes in memory (estimated size 1516.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 31 took 10 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(2480)
called with curMem=135208, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_31 stored
as values in memory (estimated size 2.4 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 24, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
39.0 (TID 109). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 110
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
38.0 (TID 110)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
14 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 32
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(1940)
called with curMem=137688, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_32_piece0
stored as bytes in memory (estimated size 1940.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 32 took 9 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(3512)
called with curMem=139628, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_32 stored
as values in memory (estimated size 3.4 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 4, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 1 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
38.0 (TID 110). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 111
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
38.0 (TID 111)
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 1 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
38.0 (TID 111). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 112
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
39.0 (TID 112)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 24, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
39.0 (TID 112). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 113
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
40.0 (TID 113)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
16 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 33
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(3294)
called with curMem=143140, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_33_piece0
stored as bytes in memory (estimated size 3.2 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 33 took 9 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(6608)
called with curMem=146434, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_33 stored
as values in memory (estimated size 6.5 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_80_0 not
found, computing it
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 22, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_22_0 not
found, computing it
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 3, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(305)
called with curMem=153042, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_22_0 stored as
bytes in memory (estimated size 305.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(305)
called with curMem=153347, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_80_0 stored as
bytes in memory (estimated size 305.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
40.0 (TID 113). 1742 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 114
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
40.0 (TID 114)
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_80_1 not
found, computing it
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_22_1 not
found, computing it
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=153652, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_22_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=153656, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_80_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
40.0 (TID 114). 1742 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 115
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
42.0 (TID 115)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
17 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 34
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(6885)
called with curMem=153660, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_34_piece0
stored as bytes in memory (estimated size 6.7 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 34 took 9 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(14840)
called with curMem=160545, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_34 stored
as values in memory (estimated size 14.5 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 21, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 23, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.hourly_clients in 0.012 s.
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
42.0 (TID 115). 1836 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 116
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
42.0 (TID 116)
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.hourly_clients in 0.005 s.
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
42.0 (TID 116). 1836 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 117
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
47.0 (TID 117)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 37
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(3495)
called with curMem=175385, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_37_piece0
stored as bytes in memory (estimated size 3.4 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 37 took 8 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(6904)
called with curMem=178880, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_37 stored
as values in memory (estimated size 6.7 KB, free 15.5 GB)
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_80_0 locally
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 35
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=185784, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_35_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 35 took 8 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=207328, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_35 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
47.0 (TID 117). 1800 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 118
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
47.0 (TID 118)
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_80_1 locally
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
47.0 (TID 118). 1800 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 119
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
49.0 (TID 119)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 38
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(2976)
called with curMem=567888, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_38_piece0
stored as bytes in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 38 took 9 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(5536)
called with curMem=570864, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_38 stored
as values in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_89_0 not
found, computing it
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 28, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_30_0 locally
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(354)
called with curMem=576400, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_89_0 stored as
bytes in memory (estimated size 354.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
49.0 (TID 119). 2809 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 120
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
49.0 (TID 120)
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_89_1 not
found, computing it
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_30_1 locally
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=576754, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_89_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
49.0 (TID 120). 2809 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 121
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
50.0 (TID 121)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
18 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 39
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(1700)
called with curMem=576758, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_39_piece0
stored as bytes in memory (estimated size 1700.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 39 took 7 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=578458, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_39 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 27, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
50.0 (TID 121). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 122
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
50.0 (TID 122)
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
50.0 (TID 122). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 123
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
52.0 (TID 123)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
19 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 40
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(5535)
called with curMem=581346, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_40_piece0
stored as bytes in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 40 took 7 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(11400)
called with curMem=586881, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_40 stored
as values in memory (estimated size 11.1 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 25, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 26, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:06 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:06 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:06 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.hourly_results in 0.073 s.
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
52.0 (TID 123). 1836 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 124
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
52.0 (TID 124)
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:06 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.hourly_results in 0.007 s.
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
52.0 (TID 124). 1836 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 125
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
54.0 (TID 125)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 43
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(2889)
called with curMem=598281, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_43_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 43 took 8 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(5320)
called with curMem=601170, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_43 stored
as values in memory (estimated size 5.2 KB, free 15.5 GB)
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_89_0 locally
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 41
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=606490, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_41_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 41 took 7 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=628034, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_41 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
54.0 (TID 125). 1800 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 126
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
54.0 (TID 126)
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_89_1 locally
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
54.0 (TID 126). 1800 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 127
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
56.0 (TID 127)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 44
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(1515)
called with curMem=980734, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_44_piece0
stored as bytes in memory (estimated size 1515.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 44 took 10 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(2480)
called with curMem=982249, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_44 stored
as values in memory (estimated size 2.4 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 32, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
56.0 (TID 127). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 128
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
56.0 (TID 128)
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
56.0 (TID 128). 1107 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 129
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
57.0 (TID 129)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
20 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 45
15/07/09 18:29:06 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(3023)
called with curMem=569917, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_45_piece0
stored as bytes in memory (estimated size 3.0 KB, free 15.5 GB)
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 45 took 10 ms
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(5600)
called with curMem=567404, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block broadcast_45 stored
as values in memory (estimated size 5.5 KB, free 15.5 GB)
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_103_0 not
found, computing it
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 30, fetching them
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_43_0 locally
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=562605, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_103_0 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 0.0 in stage
57.0 (TID 129). 2809 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 130
15/07/09 18:29:06 INFO executor.Executor: Running task 1.0 in stage
57.0 (TID 130)
15/07/09 18:29:06 INFO spark.CacheManager: Partition rdd_103_1 not
found, computing it
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:06 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:06 INFO storage.BlockManager: Found block rdd_43_1 locally
15/07/09 18:29:06 INFO storage.MemoryStore: ensureFreeSpace(264)
called with curMem=158780, maxMem=16669841817
15/07/09 18:29:06 INFO storage.MemoryStore: Block rdd_103_1 stored as
bytes in memory (estimated size 264.0 B, free 15.5 GB)
15/07/09 18:29:06 INFO executor.Executor: Finished task 1.0 in stage
57.0 (TID 130). 2809 bytes result sent to driver
15/07/09 18:29:06 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 131
15/07/09 18:29:06 INFO executor.Executor: Running task 0.0 in stage
59.0 (TID 131)
15/07/09 18:29:06 INFO spark.MapOutputTrackerWorker: Updating epoch to
21 and clearing cache
15/07/09 18:29:06 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 46
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(6524)
called with curMem=139694, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_46_piece0
stored as bytes in memory (estimated size 6.4 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 46 took 10 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(13632)
called with curMem=144483, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_46 stored
as values in memory (estimated size 13.3 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 29, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 31, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:07 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:07 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:07 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.clients in 0.058 s.
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
59.0 (TID 131). 1836 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 132
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
59.0 (TID 132)
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.clients in 0.005 s.
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
59.0 (TID 132). 1836 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 133
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
62.0 (TID 133)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 49
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2892)
called with curMem=133293, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_49_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 49 took 8 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(5320)
called with curMem=136185, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_49 stored
as values in memory (estimated size 5.2 KB, free 15.5 GB)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_103_0 locally
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 47
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=141505, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_47_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 47 took 9 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=163049, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_47 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
62.0 (TID 133). 1800 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 134
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
62.0 (TID 134)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_103_1 locally
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
62.0 (TID 134). 1800 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 135
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
64.0 (TID 135)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 50
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2975)
called with curMem=523609, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_50_piece0
stored as bytes in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 50 took 7 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(5536)
called with curMem=526584, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_50 stored
as values in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.CacheManager: Partition rdd_113_0 not
found, computing it
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 36, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_52_0 locally
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(337)
called with curMem=532120, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block rdd_113_0 stored as
bytes in memory (estimated size 337.0 B, free 15.5 GB)
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
64.0 (TID 135). 2809 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 136
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
64.0 (TID 136)
15/07/09 18:29:07 INFO spark.CacheManager: Partition rdd_113_1 not
found, computing it
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_52_1 locally
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=532457, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block rdd_113_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
64.0 (TID 136). 2809 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 137
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
65.0 (TID 137)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Updating epoch to
22 and clearing cache
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 51
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(1709)
called with curMem=532461, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_51_piece0
stored as bytes in memory (estimated size 1709.0 B, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 51 took 9 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=534170, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_51 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 35, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
65.0 (TID 137). 1107 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 138
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
65.0 (TID 138)
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
65.0 (TID 138). 1107 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 139
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
67.0 (TID 139)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Updating epoch to
23 and clearing cache
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 52
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(5449)
called with curMem=537058, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_52_piece0
stored as bytes in memory (estimated size 5.3 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 52 took 7 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(11232)
called with curMem=542507, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_52 stored
as values in memory (estimated size 11.0 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 33, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 34, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.results in 0.009 s.
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
67.0 (TID 139). 1836 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 140
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
67.0 (TID 140)
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.results in 0.009 s.
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
67.0 (TID 140). 1836 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 141
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
69.0 (TID 141)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 55
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2887)
called with curMem=553739, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_55_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 55 took 8 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(5320)
called with curMem=556626, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_55 stored
as values in memory (estimated size 5.2 KB, free 15.5 GB)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_113_0 locally
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 53
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=561946, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_53_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 53 took 8 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=583490, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_53 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
69.0 (TID 141). 1800 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 142
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
69.0 (TID 142)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_113_1 locally
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
69.0 (TID 142). 1800 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 143
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
70.0 (TID 143)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 56
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2688)
called with curMem=944050, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_56_piece0
stored as bytes in memory (estimated size 2.6 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 56 took 10 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(4784)
called with curMem=946738, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_56 stored
as values in memory (estimated size 4.7 KB, free 15.5 GB)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_113_0 locally
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
70.0 (TID 143). 2013 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 144
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
70.0 (TID 144)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_113_1 locally
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
70.0 (TID 144). 2013 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 145
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
71.0 (TID 145)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Updating epoch to
24 and clearing cache
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 57
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(1393)
called with curMem=951522, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_57_piece0
stored as bytes in memory (estimated size 1393.0 B, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 57 took 8 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2288)
called with curMem=952915, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_57 stored
as values in memory (estimated size 2.2 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 37, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
71.0 (TID 145). 890 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 146
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
71.0 (TID 146)
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
71.0 (TID 146). 1125 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 147
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
72.0 (TID 147)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 58
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2843)
called with curMem=955203, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_58_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 58 took 7 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(5008)
called with curMem=958046, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_58 stored
as values in memory (estimated size 4.9 KB, free 15.5 GB)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_113_0 locally
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
72.0 (TID 147). 2013 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 148
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
72.0 (TID 148)
15/07/09 18:29:07 INFO storage.BlockManager: Found block rdd_113_1 locally
15/07/09 18:29:07 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
72.0 (TID 148). 2013 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 149
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
73.0 (TID 149)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Updating epoch to
25 and clearing cache
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 59
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(1708)
called with curMem=963054, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_59_piece0
stored as bytes in memory (estimated size 1708.0 B, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 59 took 7 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=964762, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_59 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 40, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
73.0 (TID 149). 1107 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 150
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
73.0 (TID 150)
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
73.0 (TID 150). 1107 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 151
15/07/09 18:29:07 INFO executor.Executor: Running task 0.0 in stage
75.0 (TID 151)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Updating epoch to
26 and clearing cache
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 60
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(5588)
called with curMem=967650, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_60_piece0
stored as bytes in memory (estimated size 5.5 KB, free 15.5 GB)
15/07/09 18:29:07 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 60 took 7 ms
15/07/09 18:29:07 INFO storage.MemoryStore: ensureFreeSpace(11680)
called with curMem=973238, maxMem=16669841817
15/07/09 18:29:07 INFO storage.MemoryStore: Block broadcast_60 stored
as values in memory (estimated size 11.4 KB, free 15.5 GB)
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 38, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 39, fetching them
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:29:07 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:29:07 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:29:07 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:29:07 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.histogram in 0.062 s.
15/07/09 18:29:07 INFO executor.Executor: Finished task 0.0 in stage
75.0 (TID 151). 1836 bytes result sent to driver
15/07/09 18:29:07 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 152
15/07/09 18:29:07 INFO executor.Executor: Running task 1.0 in stage
75.0 (TID 152)
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:29:07 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:29:07 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.histogram in 0.007 s.
15/07/09 18:29:07 INFO executor.Executor: Finished task 1.0 in stage
75.0 (TID 152). 1836 bytes result sent to driver
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 28
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 38
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 27
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 37
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 32
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 31
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 60
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 59
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 53
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 48
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 54
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 49
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 62
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 64
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 61
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 70
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 63
15/07/09 18:29:07 INFO storage.BlockManager: Removing RDD 69
15/07/09 18:29:08 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 153
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
77.0 (TID 153)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 61
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(1512)
called with curMem=100860, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_61_piece0
stored as bytes in memory (estimated size 1512.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 61 took 8 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2480)
called with curMem=102372, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_61 stored
as values in memory (estimated size 2.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 44, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
77.0 (TID 153). 1107 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 154
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
77.0 (TID 154)
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
77.0 (TID 154). 1107 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 155
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
78.0 (TID 155)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Updating epoch to
27 and clearing cache
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 62
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(3012)
called with curMem=104852, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_62_piece0
stored as bytes in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 62 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5504)
called with curMem=107864, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_62 stored
as values in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.CacheManager: Partition rdd_148_0 not
found, computing it
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 42, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_80_0 locally
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(305)
called with curMem=113368, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block rdd_148_0 stored as
bytes in memory (estimated size 305.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
78.0 (TID 155). 2809 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 156
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
78.0 (TID 156)
15/07/09 18:30:00 INFO spark.CacheManager: Partition rdd_148_1 not
found, computing it
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_80_1 locally
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=113673, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block rdd_148_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
78.0 (TID 156). 2809 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 157
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
80.0 (TID 157)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Updating epoch to
28 and clearing cache
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 63
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(6623)
called with curMem=113677, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_63_piece0
stored as bytes in memory (estimated size 6.5 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 63 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(13736)
called with curMem=120300, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_63 stored
as values in memory (estimated size 13.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 41, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 43, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:30:00 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:30:00 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:30:00 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.hourly_clients in 0.054 s.
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
80.0 (TID 157). 1836 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 158
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
80.0 (TID 158)
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.hourly_clients in 0.004 s.
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
80.0 (TID 158). 1836 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 159
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
83.0 (TID 159)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 66
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2871)
called with curMem=134036, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_66_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 66 took 8 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5224)
called with curMem=136907, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_66 stored
as values in memory (estimated size 5.1 KB, free 15.5 GB)
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_148_0 locally
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 64
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=142131, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_64_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 64 took 8 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=163675, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_64 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
83.0 (TID 159). 1800 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 160
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
83.0 (TID 160)
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_148_1 locally
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
83.0 (TID 160). 1800 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 161
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
85.0 (TID 161)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 67
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2965)
called with curMem=524235, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_67_piece0
stored as bytes in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 67 took 14 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5448)
called with curMem=527200, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_67 stored
as values in memory (estimated size 5.3 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.CacheManager: Partition rdd_157_0 not
found, computing it
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 48, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_89_0 locally
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(354)
called with curMem=532648, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block rdd_157_0 stored as
bytes in memory (estimated size 354.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
85.0 (TID 161). 2809 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 162
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
85.0 (TID 162)
15/07/09 18:30:00 INFO spark.CacheManager: Partition rdd_157_1 not
found, computing it
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_89_1 locally
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=533002, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block rdd_157_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
85.0 (TID 162). 2809 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 163
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
86.0 (TID 163)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Updating epoch to
29 and clearing cache
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 68
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(1705)
called with curMem=533006, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_68_piece0
stored as bytes in memory (estimated size 1705.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 68 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=534711, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_68 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 47, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
86.0 (TID 163). 1107 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 164
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
86.0 (TID 164)
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
86.0 (TID 164). 1107 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 165
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
88.0 (TID 165)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Updating epoch to
30 and clearing cache
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 69
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5528)
called with curMem=537599, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_69_piece0
stored as bytes in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 69 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(11400)
called with curMem=543127, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_69 stored
as values in memory (estimated size 11.1 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 45, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 46, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.hourly_results in 0.013 s.
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
88.0 (TID 165). 1836 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 166
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
88.0 (TID 166)
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.hourly_results in 0.006 s.
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
88.0 (TID 166). 1836 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 167
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
90.0 (TID 167)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 72
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2871)
called with curMem=554527, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_72_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 72 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5224)
called with curMem=557398, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_72 stored
as values in memory (estimated size 5.1 KB, free 15.5 GB)
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_157_0 locally
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 70
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=562622, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_70_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 70 took 8 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=584166, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_70 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
90.0 (TID 167). 1800 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 168
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
90.0 (TID 168)
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_157_1 locally
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
90.0 (TID 168). 1800 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 169
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
92.0 (TID 169)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 73
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(1516)
called with curMem=944726, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_73_piece0
stored as bytes in memory (estimated size 1516.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 73 took 8 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2480)
called with curMem=946242, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_73 stored
as values in memory (estimated size 2.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 52, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
92.0 (TID 169). 1107 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 170
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
92.0 (TID 170)
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
92.0 (TID 170). 1107 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 171
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
93.0 (TID 171)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Updating epoch to
31 and clearing cache
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 74
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(3005)
called with curMem=948722, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_74_piece0
stored as bytes in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 74 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5504)
called with curMem=951727, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_74 stored
as values in memory (estimated size 5.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.CacheManager: Partition rdd_171_0 not
found, computing it
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 50, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_103_0 locally
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=957231, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block rdd_171_0 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
93.0 (TID 171). 2809 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 172
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
93.0 (TID 172)
15/07/09 18:30:00 INFO spark.CacheManager: Partition rdd_171_1 not
found, computing it
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_103_1 locally
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(264)
called with curMem=957235, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block rdd_171_1 stored as
bytes in memory (estimated size 264.0 B, free 15.5 GB)
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
93.0 (TID 172). 2809 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 173
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
95.0 (TID 173)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Updating epoch to
32 and clearing cache
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 75
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(6515)
called with curMem=957499, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_75_piece0
stored as bytes in memory (estimated size 6.4 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 75 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(13536)
called with curMem=964014, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_75 stored
as values in memory (estimated size 13.2 KB, free 15.5 GB)
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 49, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 51, fetching them
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:00 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.clients in 0.005 s.
15/07/09 18:30:00 INFO executor.Executor: Finished task 0.0 in stage
95.0 (TID 173). 1836 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 174
15/07/09 18:30:00 INFO executor.Executor: Running task 1.0 in stage
95.0 (TID 174)
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:00 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:00 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.clients in 0.005 s.
15/07/09 18:30:00 INFO executor.Executor: Finished task 1.0 in stage
95.0 (TID 174). 1836 bytes result sent to driver
15/07/09 18:30:00 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 175
15/07/09 18:30:00 INFO executor.Executor: Running task 0.0 in stage
98.0 (TID 175)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 78
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(2866)
called with curMem=944994, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_78_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 78 took 8 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(5224)
called with curMem=947860, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_78 stored
as values in memory (estimated size 5.1 KB, free 15.5 GB)
15/07/09 18:30:00 INFO storage.BlockManager: Found block rdd_171_0 locally
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 76
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=944989, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_76_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:30:00 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 76 took 7 ms
15/07/09 18:30:00 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=966533, maxMem=16669841817
15/07/09 18:30:00 INFO storage.MemoryStore: Block broadcast_76 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:30:01 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
98.0 (TID 175). 1800 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 176
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
98.0 (TID 176)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_171_1 locally
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
98.0 (TID 176). 1800 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 177
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
100.0 (TID 177)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 79
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(2960)
called with curMem=491989, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_79_piece0
stored as bytes in memory (estimated size 2.9 KB, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 79 took 11 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(5448)
called with curMem=494949, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_79 stored
as values in memory (estimated size 5.3 KB, free 15.5 GB)
15/07/09 18:30:01 INFO spark.CacheManager: Partition rdd_181_0 not
found, computing it
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 56, fetching them
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_113_0 locally
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(337)
called with curMem=500397, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block rdd_181_0 stored as
bytes in memory (estimated size 337.0 B, free 15.5 GB)
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
100.0 (TID 177). 2809 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 178
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
100.0 (TID 178)
15/07/09 18:30:01 INFO spark.CacheManager: Partition rdd_181_1 not
found, computing it
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_113_1 locally
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(4) called
with curMem=500734, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block rdd_181_1 stored as
bytes in memory (estimated size 4.0 B, free 15.5 GB)
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
100.0 (TID 178). 2809 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 179
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
101.0 (TID 179)
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Updating epoch to
33 and clearing cache
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 80
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(1710)
called with curMem=500738, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_80_piece0
stored as bytes in memory (estimated size 1710.0 B, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 80 took 9 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=502448, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_80 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 55, fetching them
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
101.0 (TID 179). 1107 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 180
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
101.0 (TID 180)
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
101.0 (TID 180). 1107 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 181
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
103.0 (TID 181)
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Updating epoch to
34 and clearing cache
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 81
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(5455)
called with curMem=505336, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_81_piece0
stored as bytes in memory (estimated size 5.3 KB, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 81 took 8 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(11232)
called with curMem=510791, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_81 stored
as values in memory (estimated size 11.0 KB, free 15.5 GB)
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 53, fetching them
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 54, fetching them
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:30:01 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:30:01 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:30:01 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.results in 0.055 s.
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
103.0 (TID 181). 1836 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 182
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
103.0 (TID 182)
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 1 ms
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.results in 0.013 s.
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
103.0 (TID 182). 1836 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 183
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
105.0 (TID 183)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 84
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(2864)
called with curMem=522023, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_84_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 84 took 8 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(5224)
called with curMem=524887, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_84 stored
as values in memory (estimated size 5.1 KB, free 15.5 GB)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_181_0 locally
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 82
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(21544)
called with curMem=530111, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_82_piece0
stored as bytes in memory (estimated size 21.0 KB, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 82 took 9 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(360560)
called with curMem=551655, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_82 stored
as values in memory (estimated size 352.1 KB, free 15.5 GB)
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
105.0 (TID 183). 1800 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 184
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
105.0 (TID 184)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_181_1 locally
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
105.0 (TID 184). 1800 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 185
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
106.0 (TID 185)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 85
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(2690)
called with curMem=912215, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_85_piece0
stored as bytes in memory (estimated size 2.6 KB, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 85 took 8 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(4784)
called with curMem=914905, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_85 stored
as values in memory (estimated size 4.7 KB, free 15.5 GB)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_181_0 locally
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
106.0 (TID 185). 2013 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 186
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
106.0 (TID 186)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_181_1 locally
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
106.0 (TID 186). 2013 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 187
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
107.0 (TID 187)
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Updating epoch to
35 and clearing cache
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 86
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(1393)
called with curMem=919689, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_86_piece0
stored as bytes in memory (estimated size 1393.0 B, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 86 took 8 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(2288)
called with curMem=921082, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_86 stored
as values in memory (estimated size 2.2 KB, free 15.5 GB)
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 57, fetching them
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:01 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
107.0 (TID 187). 890 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 188
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
107.0 (TID 188)
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:01 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
107.0 (TID 188). 1125 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 189
15/07/09 18:30:01 INFO executor.Executor: Running task 0.0 in stage
108.0 (TID 189)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 87
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(2846)
called with curMem=923370, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_87_piece0
stored as bytes in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:01 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 87 took 8 ms
15/07/09 18:30:01 INFO storage.MemoryStore: ensureFreeSpace(5008)
called with curMem=926216, maxMem=16669841817
15/07/09 18:30:01 INFO storage.MemoryStore: Block broadcast_87 stored
as values in memory (estimated size 4.9 KB, free 15.5 GB)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_181_0 locally
15/07/09 18:30:01 INFO executor.Executor: Finished task 0.0 in stage
108.0 (TID 189). 2013 bytes result sent to driver
15/07/09 18:30:01 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 190
15/07/09 18:30:01 INFO executor.Executor: Running task 1.0 in stage
108.0 (TID 190)
15/07/09 18:30:01 INFO storage.BlockManager: Found block rdd_181_1 locally
15/07/09 18:30:01 INFO executor.Executor: Finished task 1.0 in stage
108.0 (TID 190). 2013 bytes result sent to driver
15/07/09 18:30:02 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 191
15/07/09 18:30:02 INFO executor.Executor: Running task 0.0 in stage
109.0 (TID 191)
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Updating epoch to
36 and clearing cache
15/07/09 18:30:02 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 88
15/07/09 18:30:02 INFO storage.MemoryStore: ensureFreeSpace(1708)
called with curMem=931224, maxMem=16669841817
15/07/09 18:30:02 INFO storage.MemoryStore: Block broadcast_88_piece0
stored as bytes in memory (estimated size 1708.0 B, free 15.5 GB)
15/07/09 18:30:02 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 88 took 7 ms
15/07/09 18:30:02 INFO storage.MemoryStore: ensureFreeSpace(2888)
called with curMem=932932, maxMem=16669841817
15/07/09 18:30:02 INFO storage.MemoryStore: Block broadcast_88 stored
as values in memory (estimated size 2.8 KB, free 15.5 GB)
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 60, fetching them
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 2 blocks
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:02 INFO executor.Executor: Finished task 0.0 in stage
109.0 (TID 191). 1107 bytes result sent to driver
15/07/09 18:30:02 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 192
15/07/09 18:30:02 INFO executor.Executor: Running task 1.0 in stage
109.0 (TID 192)
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:02 INFO executor.Executor: Finished task 1.0 in stage
109.0 (TID 192). 1107 bytes result sent to driver
15/07/09 18:30:02 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster
15/07/09 18:30:02 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 193
15/07/09 18:30:02 INFO executor.Executor: Running task 0.0 in stage
111.0 (TID 193)
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Updating epoch to
37 and clearing cache
15/07/09 18:30:02 INFO broadcast.TorrentBroadcast: Started reading
broadcast variable 89
15/07/09 18:30:02 INFO storage.MemoryStore: ensureFreeSpace(5589)
called with curMem=935820, maxMem=16669841817
15/07/09 18:30:02 INFO storage.MemoryStore: Block broadcast_89_piece0
stored as bytes in memory (estimated size 5.5 KB, free 15.5 GB)
15/07/09 18:30:02 INFO broadcast.TorrentBroadcast: Reading broadcast
variable 89 took 6 ms
15/07/09 18:30:02 INFO storage.MemoryStore: ensureFreeSpace(11680)
called with curMem=941409, maxMem=16669841817
15/07/09 18:30:02 INFO storage.MemoryStore: Block broadcast_89 stored
as values in memory (estimated size 11.4 KB, free 15.5 GB)
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 58, fetching them
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Don't have map
outputs for shuffle 59, fetching them
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Doing the fetch;
tracker endpoint =
AkkaRpcEndpointRef(Actor[akka.tcp://sparkDriver@192.168.1.1:55989/user/MapOutputTracker#585457432])
15/07/09 18:30:02 INFO spark.MapOutputTrackerWorker: Got the output locations
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:02 INFO core.Cluster: New Cassandra host
szq2.appadhoc.com/192.168.1.2:9042 added
15/07/09 18:30:02 INFO core.Cluster: New Cassandra host /192.168.1.1:9042 added
15/07/09 18:30:02 INFO cql.CassandraConnector: Connected to Cassandra
cluster: Test Cluster
15/07/09 18:30:02 INFO writer.TableWriter: Wrote 0 rows to
adhoc_data.histogram in 0.055 s.
15/07/09 18:30:02 INFO executor.Executor: Finished task 0.0 in stage
111.0 (TID 193). 1836 bytes result sent to driver
15/07/09 18:30:02 INFO executor.CoarseGrainedExecutorBackend: Got
assigned task 194
15/07/09 18:30:02 INFO executor.Executor: Running task 1.0 in stage
111.0 (TID 194)
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Getting 1
non-empty blocks out of 2 blocks
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Getting 0
non-empty blocks out of 0 blocks
15/07/09 18:30:02 INFO storage.ShuffleBlockFetcherIterator: Started 0
remote fetches in 0 ms
15/07/09 18:30:02 INFO writer.TableWriter: Wrote 1 rows to
adhoc_data.histogram in 0.006 s.
15/07/09 18:30:02 INFO executor.Executor: Finished task 1.0 in stage
111.0 (TID 194). 1836 bytes result sent to driver
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 86
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 85
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 22
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 20
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 19
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 18
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 17
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 16
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 15
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 14
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 97
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 96
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 91
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 90
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 30
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 109
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 108
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 43
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 40
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 41
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 39
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 120
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 115
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 121
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 114
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 52
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 50
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 123
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 122
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 131
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 130
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 125
15/07/09 18:30:02 INFO storage.BlockManager: Removing RDD 124
15/07/09 18:30:02 INFO cql.CassandraConnector: Disconnected from
Cassandra cluster: Test Cluster


Bin Wang <wb...@gmail.com>于2015年7月9日周四 下午7:13写道：

>
> "yarn.nodemanager.resource.cpu-vcores" is configured to 4 (I have only 4
> cores).
>
> And I realize that it is the "map" stage of DStream blocking. DAG image is
> attached. After I kill this stage, it runs and gets stream from Kafka.
> However, after it run all the pending batches, it shutdown the Kafka
> consumer and never get the stream again.
>
>
>
> Tathagata Das <td...@databricks.com>于2015年7月9日周四 下午6:52写道：
>
>> Do you have enough cores in the configured number of executors in YARN?
>>
>>
>>
>> On Thu, Jul 9, 2015 at 2:29 AM, Bin Wang <wb...@gmail.com> wrote:
>>
>>> I'm using spark streaming with Kafka, and submit it to YARN cluster with
>>> mode "yarn-cluster". But it hangs at SparkContext.start(). The Kafka config
>>> is right since it can show some events in "Streaming" tab of web UI.
>>>
>>> The attached file is the screen shot of the "Jobs" tab of web UI. The
>>> code in the main class is:
>>>
>>> object StatCounter {
>>>
>>>   val config = ConfigFactory.load()
>>>   val redisUrl = config.getString("redis.url")
>>>   val redisPort = config.getInt("redis.port")
>>>   val zkQuorum = config.getString("kafka.zkQuorum")
>>>   val group = config.getString("kafka.group")
>>>   val topic = config.getString("kafka.topic")
>>>   val threadNum = config.getInt("kafka.threadNum")
>>>
>>>   val cache = new RedisCache(redisUrl, redisPort)
>>>
>>>   def main(args: Array[String]): Unit = {
>>>     val conf = new SparkConf()
>>>         .setAppName(config.getString("spark.name"))
>>>         .set("spark.cassandra.connection.host",
>>> config.getString("cassandra.host"))
>>>
>>>     val ssc = new StreamingContext(conf,
>>> Seconds(config.getInt("spark.interval")))
>>>     ssc.checkpoint(config.getString("spark.checkpoint"))
>>>     val storage = new CassandraStorage("adhoc_data", ssc)
>>>
>>>     val lines = KafkaUtils.createStream(ssc, zkQuorum, group, Map(topic
>>> -> threadNum)).map(_._2)
>>>
>>>     val logs = lines.flatMap(line => Parser.parseBody(line, cache))
>>>     Counter.count(logs, storage)
>>>
>>>     sys.ShutdownHookThread {
>>>       println("Gracefully stopping Spark Streaming Application")
>>>       ssc.stop(stopSparkContext = true, stopGracefully = true)
>>>       println("Application stopped")
>>>     }
>>>
>>>     ssc.start()
>>>     ssc.awaitTermination()
>>>   }
>>> }
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>>> For additional commands, e-mail: user-help@spark.apache.org
>>>
>>
>>

Re: Spark Streaming Hangs on Start

Posted by Bin Wang <wb...@gmail.com>.

"yarn.nodemanager.resource.cpu-vcores" is configured to 4 (I have only 4
cores).

And I realize that it is the "map" stage of DStream blocking. DAG image is
attached. After I kill this stage, it runs and gets stream from Kafka.
However, after it run all the pending batches, it shutdown the Kafka
consumer and never get the stream again.



Tathagata Das <td...@databricks.com>于2015年7月9日周四 下午6:52写道：

> Do you have enough cores in the configured number of executors in YARN?
>
>
>
> On Thu, Jul 9, 2015 at 2:29 AM, Bin Wang <wb...@gmail.com> wrote:
>
>> I'm using spark streaming with Kafka, and submit it to YARN cluster with
>> mode "yarn-cluster". But it hangs at SparkContext.start(). The Kafka config
>> is right since it can show some events in "Streaming" tab of web UI.
>>
>> The attached file is the screen shot of the "Jobs" tab of web UI. The
>> code in the main class is:
>>
>> object StatCounter {
>>
>>   val config = ConfigFactory.load()
>>   val redisUrl = config.getString("redis.url")
>>   val redisPort = config.getInt("redis.port")
>>   val zkQuorum = config.getString("kafka.zkQuorum")
>>   val group = config.getString("kafka.group")
>>   val topic = config.getString("kafka.topic")
>>   val threadNum = config.getInt("kafka.threadNum")
>>
>>   val cache = new RedisCache(redisUrl, redisPort)
>>
>>   def main(args: Array[String]): Unit = {
>>     val conf = new SparkConf()
>>         .setAppName(config.getString("spark.name"))
>>         .set("spark.cassandra.connection.host",
>> config.getString("cassandra.host"))
>>
>>     val ssc = new StreamingContext(conf,
>> Seconds(config.getInt("spark.interval")))
>>     ssc.checkpoint(config.getString("spark.checkpoint"))
>>     val storage = new CassandraStorage("adhoc_data", ssc)
>>
>>     val lines = KafkaUtils.createStream(ssc, zkQuorum, group, Map(topic
>> -> threadNum)).map(_._2)
>>
>>     val logs = lines.flatMap(line => Parser.parseBody(line, cache))
>>     Counter.count(logs, storage)
>>
>>     sys.ShutdownHookThread {
>>       println("Gracefully stopping Spark Streaming Application")
>>       ssc.stop(stopSparkContext = true, stopGracefully = true)
>>       println("Application stopped")
>>     }
>>
>>     ssc.start()
>>     ssc.awaitTermination()
>>   }
>> }
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
>> For additional commands, e-mail: user-help@spark.apache.org
>>
>
>

Re: Spark Streaming Hangs on Start

Posted by Tathagata Das <td...@databricks.com>.

Do you have enough cores in the configured number of executors in YARN?



On Thu, Jul 9, 2015 at 2:29 AM, Bin Wang <wb...@gmail.com> wrote:

> I'm using spark streaming with Kafka, and submit it to YARN cluster with
> mode "yarn-cluster". But it hangs at SparkContext.start(). The Kafka config
> is right since it can show some events in "Streaming" tab of web UI.
>
> The attached file is the screen shot of the "Jobs" tab of web UI. The code
> in the main class is:
>
> object StatCounter {
>
>   val config = ConfigFactory.load()
>   val redisUrl = config.getString("redis.url")
>   val redisPort = config.getInt("redis.port")
>   val zkQuorum = config.getString("kafka.zkQuorum")
>   val group = config.getString("kafka.group")
>   val topic = config.getString("kafka.topic")
>   val threadNum = config.getInt("kafka.threadNum")
>
>   val cache = new RedisCache(redisUrl, redisPort)
>
>   def main(args: Array[String]): Unit = {
>     val conf = new SparkConf()
>         .setAppName(config.getString("spark.name"))
>         .set("spark.cassandra.connection.host",
> config.getString("cassandra.host"))
>
>     val ssc = new StreamingContext(conf,
> Seconds(config.getInt("spark.interval")))
>     ssc.checkpoint(config.getString("spark.checkpoint"))
>     val storage = new CassandraStorage("adhoc_data", ssc)
>
>     val lines = KafkaUtils.createStream(ssc, zkQuorum, group, Map(topic ->
> threadNum)).map(_._2)
>
>     val logs = lines.flatMap(line => Parser.parseBody(line, cache))
>     Counter.count(logs, storage)
>
>     sys.ShutdownHookThread {
>       println("Gracefully stopping Spark Streaming Application")
>       ssc.stop(stopSparkContext = true, stopGracefully = true)
>       println("Application stopped")
>     }
>
>     ssc.start()
>     ssc.awaitTermination()
>   }
> }
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>