You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "huangkj (Jira)" <ji...@apache.org> on 2020/06/12 02:50:00 UTC
[jira] [Created] (KYLIN-4562) build cube with spark error
huangkj created KYLIN-4562:
------------------------------
Summary: build cube with spark error
Key: KYLIN-4562
URL: https://issues.apache.org/jira/browse/KYLIN-4562
Project: Kylin
Issue Type: Bug
Components: Spark Engine
Affects Versions: v3.0.2, v3.0.1
Environment: my environment
hdp 2.6.3.0.235
kylin 3.0.2
hive 1.2.1000
hbase 1.1.2
spark2 2.2.0
Reporter: huangkj
i build club with spark, but in the #4 Step Name: Build Dimension Dictionary with Spark, it appers a java run time exception as bellow, it seems connect the hive failed, but kylin searched the hive-site.xml successful!
[hadoop@swcares bin]$ cat cached-hive-dependency.sh
export hive_dependency=/usr/hdp/2.6.3.0-235/hive/conf:/usr/hdp/2.6.3.0-235/hive/lib/jcommander-1.32.jar:/usr/hdp/2.6.3.0-235/hive/lib/ojdbc6.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/eclipselink-2.5.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/gson-2.2.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/httpclient-4.5.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/httpcore-4.4.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/httpmime-4.5.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/javax.persistence-2.1.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/noggit-0.6.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/ranger-hive-plugin-0.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/ranger-plugins-audit-0.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/ranger-plugins-common-0.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/ranger-plugins-cred-0.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-impl/solr-solrj-5.5.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-dbcp-1.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-hbase-handler.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-hive-plugin-shim-0.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-httpclient-3.0.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/jdo-api-3.0.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/ranger-plugin-classloader-0.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-ant-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-logging-1.1.3.jar:/usr/hdp/2.6.3.0-235/hive/lib/curator-client-2.6.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-exec-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/curator-framework-2.6.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-jdbc-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-io-2.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/jline-2.12.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-metastore-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/curator-recipes-2.6.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-serde-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-math-2.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/joda-time-2.8.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-service-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-hwi.jar:/usr/hdp/2.6.3.0-235/hive/lib/libfb303-0.9.3.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-jdbc.jar:/usr/hdp/2.6.3.0-235/hive/lib/libthrift-0.9.3.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-metastore.jar:/usr/hdp/2.6.3.0-235/hive/lib/log4j-1.2.16.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-serde.jar:/usr/hdp/2.6.3.0-235/hive/lib/HikariCP-2.5.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-service.jar:/usr/hdp/2.6.3.0-235/hive/lib/ST4-4.0.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/datanucleus-api-jdo-4.2.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/accumulo-core-1.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/geronimo-jaspic_1.0_spec-1.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/accumulo-fate-1.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-lang-2.6.jar:/usr/hdp/2.6.3.0-235/hive/lib/jpam-1.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/accumulo-start-1.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/geronimo-annotation_1.0_spec-1.1.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/accumulo-trace-1.7.0.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-common.jar:/usr/hdp/2.6.3.0-235/hive/lib/activation-1.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-scheduler.jar:/usr/hdp/2.6.3.0-235/hive/lib/ant-1.9.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-ant.jar:/usr/hdp/2.6.3.0-235/hive/lib/jta-1.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/ant-launcher-1.9.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims.jar:/usr/hdp/2.6.3.0-235/hive/lib/antlr-2.7.7.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-beeline.jar:/usr/hdp/2.6.3.0-235/hive/lib/antlr-runtime-3.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-cli-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/geronimo-jta_1.1_spec-1.1.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/apache-log4j-extras-1.2.17.jar:/usr/hdp/2.6.3.0-235/hive/lib/httpclient-4.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/asm-commons-3.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/httpcore-4.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/asm-tree-3.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/groovy-all-2.4.11.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-pool-1.5.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/ivy-2.4.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/avro-1.7.5.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-cli.jar:/usr/hdp/2.6.3.0-235/hive/lib/bonecp-0.8.0.RELEASE.jar:/usr/hdp/2.6.3.0-235/hive/lib/guava-14.0.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/xz-1.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-vfs2-2.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/json-20090211.jar:/usr/hdp/2.6.3.0-235/hive/lib/jackson-core-2.4.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-cli-1.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-common-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-codec-1.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-accumulo-handler.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-collections-3.2.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-common.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-compiler-2.7.6.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-contrib.jar:/usr/hdp/2.6.3.0-235/hive/lib/commons-compress-1.4.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/datanucleus-core-4.1.6.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-exec.jar:/usr/hdp/2.6.3.0-235/hive/lib/datanucleus-rdbms-4.1.7.jar:/usr/hdp/2.6.3.0-235/hive/lib/jackson-databind-2.4.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/eigenbase-properties-1.1.5.jar:/usr/hdp/2.6.3.0-235/hive/lib/jsr305-3.0.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar:/usr/hdp/2.6.3.0-235/hive/lib/javax.jdo-3.2.0-m3.jar:/usr/hdp/2.6.3.0-235/hive/lib/janino-2.7.6.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-accumulo-handler-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-beeline-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-contrib-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-hbase-handler-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-hwi-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-0.20S-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-0.23-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-common-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/hive-shims-scheduler-1.2.1000.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/htrace-core-3.1.0-incubating.jar:/usr/hdp/2.6.3.0-235/hive/lib/jackson-annotations-2.4.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/jetty-all-7.6.0.v20120127.jar:/usr/hdp/2.6.3.0-235/hive/lib/jetty-all-server-7.6.0.v20120127.jar:/usr/hdp/2.6.3.0-235/hive/lib/mail-1.4.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/maven-scm-api-1.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/maven-scm-provider-svn-commons-1.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/maven-scm-provider-svnexe-1.4.jar:/usr/hdp/2.6.3.0-235/hive/lib/metrics-core-3.1.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/metrics-json-3.1.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/metrics-jvm-3.1.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/netty-3.7.0.Final.jar:/usr/hdp/2.6.3.0-235/hive/lib/opencsv-2.3.jar:/usr/hdp/2.6.3.0-235/hive/lib/oro-2.0.8.jar:/usr/hdp/2.6.3.0-235/hive/lib/paranamer-2.3.jar:/usr/hdp/2.6.3.0-235/hive/lib/parquet-hadoop-bundle-1.8.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/pentaho-aggdesigner-algorithm-5.1.5-jhyde.jar:/usr/hdp/2.6.3.0-235/hive/lib/plexus-utils-1.5.6.jar:/usr/hdp/2.6.3.0-235/hive/lib/protobuf-java-2.5.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/regexp-1.3.jar:/usr/hdp/2.6.3.0-235/hive/lib/servlet-api-2.5.jar:/usr/hdp/2.6.3.0-235/hive/lib/snappy-java-1.0.5.jar:/usr/hdp/2.6.3.0-235/hive/lib/stax-api-1.0.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/stringtemplate-3.2.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/super-csv-2.2.0.jar:/usr/hdp/2.6.3.0-235/hive/lib/transaction-api-1.1.jar:/usr/hdp/2.6.3.0-235/hive/lib/velocity-1.5.jar:/usr/hdp/2.6.3.0-235/hive/lib/zookeeper-3.4.6.2.6.3.0-235.jar:/usr/hdp/2.6.3.0-235/hive/lib/mysql-connector-java.jar:/usr/hdp/2.6.3.0-235/hive-hcatalog/share/hcatalog/hive-hcatalog-core-1.2.1000.2.6.3.0-235.jar
export hive_conf_path=/usr/hdp/2.6.3.0-235/hive/conf
Output
org.apache.kylin.engine.spark.exception.SparkException: OS command error exit with return code: 1, error message: SparkEntry args:-className org.apache.kylin.engine.spark.SparkBuildDictionary -input hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/fact_distinct_columns -cubingJobId 7a33238a-1a3b-311f-fae2-5c2608942942 -counterOutput hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/counter -dictPath hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/dict -segmentId 399cc9f9-2dad-720c-79aa-10f7eacce7a7 -metaUrl kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata -cubename kylin_test_view_cube_spark
Running org.apache.kylin.engine.spark.SparkBuildDictionary -input hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/fact_distinct_columns -cubingJobId 7a33238a-1a3b-311f-fae2-5c2608942942 -counterOutput hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/counter -dictPath hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/dict -segmentId 399cc9f9-2dad-720c-79aa-10f7eacce7a7 -metaUrl kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata -cubename kylin_test_view_cube_spark
Using Spark's default log4j profile: org/apache/spark/log4j-defaults.properties
20/06/11 14:28:21 INFO SparkContext: Running Spark version 2.2.0.2.6.3.0-235
20/06/11 14:28:21 INFO SparkContext: Submitted application: Build Dimension Dictionary for: kylin_test_view_cube_spark segment 399cc9f9-2dad-720c-79aa-10f7eacce7a7
20/06/11 14:28:21 INFO SecurityManager: Changing view acls to: hadoop
20/06/11 14:28:21 INFO SecurityManager: Changing modify acls to: hadoop
20/06/11 14:28:21 INFO SecurityManager: Changing view acls groups to:
20/06/11 14:28:21 INFO SecurityManager: Changing modify acls groups to:
20/06/11 14:28:21 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); groups with view permissions: Set(); users with modify permissions: Set(hadoop); groups with modify permissions: Set()
20/06/11 14:28:22 INFO Utils: Successfully started service 'sparkDriver' on port 44123.
20/06/11 14:28:22 INFO SparkEnv: Registering MapOutputTracker
20/06/11 14:28:22 INFO SparkEnv: Registering BlockManagerMaster
20/06/11 14:28:22 INFO BlockManagerMasterEndpoint: Using org.apache.spark.storage.DefaultTopologyMapper for getting topology information
20/06/11 14:28:22 INFO BlockManagerMasterEndpoint: BlockManagerMasterEndpoint up
20/06/11 14:28:22 INFO DiskBlockManager: Created local directory at /tmp/blockmgr-c145db7c-eb82-49f8-be27-dc1b149cf19c
20/06/11 14:28:22 INFO MemoryStore: MemoryStore started with capacity 10.5 GB
20/06/11 14:28:22 INFO SparkEnv: Registering OutputCommitCoordinator
20/06/11 14:28:22 WARN Utils: Service 'SparkUI' could not bind on port 4040. Attempting port 4041.
20/06/11 14:28:22 INFO Utils: Successfully started service 'SparkUI' on port 4041.
20/06/11 14:28:22 INFO SparkUI: Bound SparkUI to 0.0.0.0, and started at http://10.150.64.72:4041
20/06/11 14:28:23 INFO SparkContext: Added JAR file:/usr/local/apache-kylin-3.0.2-bin-hbase1x/lib/kylin-job-3.0.2.jar at spark://10.150.64.72:44123/jars/kylin-job-3.0.2.jar with timestamp 1591856903004
20/06/11 14:28:23 INFO Utils: Using initial executors = 40, max of spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors and spark.executor.instances
20/06/11 14:28:25 INFO RequestHedgingRMFailoverProxyProvider: Looking for the active RM in [rm1, rm2]...
20/06/11 14:28:25 INFO RequestHedgingRMFailoverProxyProvider: Found active RM [rm2]
20/06/11 14:28:25 INFO Client: Requesting a new application from cluster with 5 NodeManagers
20/06/11 14:28:25 INFO Client: Verifying our application has not requested more than the maximum memory capability of the cluster (102400 MB per container)
20/06/11 14:28:25 INFO Client: Will allocate AM container, with 2432 MB memory including 384 MB overhead
20/06/11 14:28:25 INFO Client: Setting up container launch context for our AM
20/06/11 14:28:25 INFO Client: Setting up the launch environment for our AM container
20/06/11 14:28:25 INFO Client: Preparing resources for our AM container
20/06/11 14:28:26 INFO Client: Use hdfs cache file as spark.yarn.archive for HDP, hdfsCacheFile:hdfs://bigdata/hdp/apps/2.6.3.0-235/spark2/spark2-hdp-yarn-archive.tar.gz
20/06/11 14:28:26 INFO Client: Source and destination file systems are the same. Not copying hdfs://bigdata/hdp/apps/2.6.3.0-235/spark2/spark2-hdp-yarn-archive.tar.gz
20/06/11 14:28:26 INFO Client: Uploading resource file:/usr/local/apache-kylin-3.0.2-bin-hbase1x/lib/kylin-job-3.0.2.jar -> hdfs://bigdata/user/hadoop/.sparkStaging/application_1591190982320_4742/kylin-job-3.0.2.jar
20/06/11 14:28:26 INFO Client: Uploading resource file:/tmp/spark-af7e949c-d6ff-40ca-ade9-06a3ac8e5157/__spark_conf__2672740335056864249.zip -> hdfs://bigdata/user/hadoop/.sparkStaging/application_1591190982320_4742/__spark_conf__.zip
20/06/11 14:28:26 INFO SecurityManager: Changing view acls to: hadoop
20/06/11 14:28:26 INFO SecurityManager: Changing modify acls to: hadoop
20/06/11 14:28:26 INFO SecurityManager: Changing view acls groups to:
20/06/11 14:28:26 INFO SecurityManager: Changing modify acls groups to:
20/06/11 14:28:26 INFO SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); groups with view permissions: Set(); users with modify permissions: Set(hadoop); groups with modify permissions: Set()
20/06/11 14:28:26 INFO Client: Submitting application application_1591190982320_4742 to ResourceManager
20/06/11 14:28:26 INFO YarnClientImpl: Submitted application application_1591190982320_4742
20/06/11 14:28:26 INFO SchedulerExtensionServices: Starting Yarn extension services with app application_1591190982320_4742 and attemptId None
20/06/11 14:28:27 INFO Client: Application report for application_1591190982320_4742 (state: ACCEPTED)
20/06/11 14:28:27 INFO Client:
client token: N/A
diagnostics: AM container is launched, waiting for AM container to Register with RM
ApplicationMaster host: N/A
ApplicationMaster RPC port: -1
queue: default
start time: 1591856906890
final status: UNDEFINED
tracking URL: http://bigdata.node3:8088/proxy/application_1591190982320_4742/
user: hadoop
20/06/11 14:28:28 INFO Client: Application report for application_1591190982320_4742 (state: ACCEPTED)
20/06/11 14:28:29 INFO Client: Application report for application_1591190982320_4742 (state: ACCEPTED)
20/06/11 14:28:30 INFO Client: Application report for application_1591190982320_4742 (state: ACCEPTED)
20/06/11 14:28:31 INFO YarnClientSchedulerBackend: Add WebUI Filter. org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter, Map(PROXY_HOSTS -> bigdata.node2,bigdata.node3, PROXY_URI_BASES -> http://bigdata.node2:8088/proxy/application_1591190982320_4742,http://bigdata.node3:8088/proxy/application_1591190982320_4742), /proxy/application_1591190982320_4742
20/06/11 14:28:31 INFO JettyUtils: Adding filter: org.apache.hadoop.yarn.server.webproxy.amfilter.AmIpFilter
20/06/11 14:28:31 INFO YarnSchedulerBackend$YarnSchedulerEndpoint: ApplicationMaster registered as NettyRpcEndpointRef(spark-client://YarnAM)
20/06/11 14:28:31 INFO Client: Application report for application_1591190982320_4742 (state: RUNNING)
20/06/11 14:28:31 INFO Client:
client token: N/A
diagnostics: N/A
ApplicationMaster host: 10.150.64.72
ApplicationMaster RPC port: 0
queue: default
start time: 1591856906890
final status: UNDEFINED
tracking URL: http://bigdata.node3:8088/proxy/application_1591190982320_4742/
user: hadoop
20/06/11 14:28:31 INFO YarnClientSchedulerBackend: Application application_1591190982320_4742 has started running.
20/06/11 14:28:31 INFO Utils: Successfully started service 'org.apache.spark.network.netty.NettyBlockTransferService' on port 37065.
20/06/11 14:28:31 INFO NettyBlockTransferService: Server created on 10.150.64.72:37065
20/06/11 14:28:31 INFO BlockManager: Using org.apache.spark.storage.RandomBlockReplicationPolicy for block replication policy
20/06/11 14:28:31 INFO BlockManagerMaster: Registering BlockManager BlockManagerId(driver, 10.150.64.72, 37065, None)
20/06/11 14:28:31 INFO BlockManagerMasterEndpoint: Registering block manager 10.150.64.72:37065 with 10.5 GB RAM, BlockManagerId(driver, 10.150.64.72, 37065, None)
20/06/11 14:28:31 INFO BlockManagerMaster: Registered BlockManager BlockManagerId(driver, 10.150.64.72, 37065, None)
20/06/11 14:28:31 INFO BlockManager: external shuffle service port = 7447
20/06/11 14:28:31 INFO BlockManager: Initialized BlockManager: BlockManagerId(driver, 10.150.64.72, 37065, None)
20/06/11 14:28:32 INFO EventLoggingListener: Logging events to hdfs:///kylin/spark-history/application_1591190982320_4742
20/06/11 14:28:32 INFO Utils: Using initial executors = 40, max of spark.dynamicAllocation.initialExecutors, spark.dynamicAllocation.minExecutors and spark.executor.instances
20/06/11 14:28:35 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43718) with ID 1
20/06/11 14:28:35 INFO ExecutorAllocationManager: New executor 1 has registered (new total is 1)
20/06/11 14:28:35 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56482) with ID 4
20/06/11 14:28:35 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:39170 with 4.1 GB RAM, BlockManagerId(1, bigdata.node3, 39170, None)
20/06/11 14:28:35 INFO ExecutorAllocationManager: New executor 4 has registered (new total is 2)
20/06/11 14:28:35 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:34759 with 4.1 GB RAM, BlockManagerId(4, bigdata.node4, 34759, None)
20/06/11 14:28:35 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48438) with ID 3
20/06/11 14:28:35 INFO ExecutorAllocationManager: New executor 3 has registered (new total is 3)
20/06/11 14:28:35 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:45659 with 4.1 GB RAM, BlockManagerId(3, bigdata.node1, 45659, None)
20/06/11 14:28:35 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43734) with ID 6
20/06/11 14:28:35 INFO ExecutorAllocationManager: New executor 6 has registered (new total is 4)
20/06/11 14:28:35 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48458) with ID 8
20/06/11 14:28:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56492) with ID 9
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 8 has registered (new total is 5)
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 9 has registered (new total is 6)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:42310 with 4.1 GB RAM, BlockManagerId(6, bigdata.node3, 42310, None)
20/06/11 14:28:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37590) with ID 5
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 5 has registered (new total is 7)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:45063 with 4.1 GB RAM, BlockManagerId(8, bigdata.node1, 45063, None)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:42767 with 4.1 GB RAM, BlockManagerId(9, bigdata.node4, 42767, None)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:39225 with 4.1 GB RAM, BlockManagerId(5, bigdata.node5, 39225, None)
20/06/11 14:28:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50052) with ID 2
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 2 has registered (new total is 8)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:33477 with 4.1 GB RAM, BlockManagerId(2, bigdata.node2, 33477, None)
20/06/11 14:28:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48482) with ID 13
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 13 has registered (new total is 9)
20/06/11 14:28:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56498) with ID 14
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 14 has registered (new total is 10)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:43374 with 4.1 GB RAM, BlockManagerId(13, bigdata.node1, 43374, None)
20/06/11 14:28:36 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43740) with ID 11
20/06/11 14:28:36 INFO ExecutorAllocationManager: New executor 11 has registered (new total is 11)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:35102 with 4.1 GB RAM, BlockManagerId(14, bigdata.node4, 35102, None)
20/06/11 14:28:36 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:43242 with 4.1 GB RAM, BlockManagerId(11, bigdata.node3, 43242, None)
20/06/11 14:28:37 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37598) with ID 10
20/06/11 14:28:37 INFO ExecutorAllocationManager: New executor 10 has registered (new total is 12)
20/06/11 14:28:37 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:43881 with 4.1 GB RAM, BlockManagerId(10, bigdata.node5, 43881, None)
20/06/11 14:28:37 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37602) with ID 15
20/06/11 14:28:37 INFO ExecutorAllocationManager: New executor 15 has registered (new total is 13)
20/06/11 14:28:37 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:40621 with 4.1 GB RAM, BlockManagerId(15, bigdata.node5, 40621, None)
20/06/11 14:28:38 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50064) with ID 7
20/06/11 14:28:38 INFO ExecutorAllocationManager: New executor 7 has registered (new total is 14)
20/06/11 14:28:38 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:45001 with 4.1 GB RAM, BlockManagerId(7, bigdata.node2, 45001, None)
20/06/11 14:28:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43764) with ID 21
20/06/11 14:28:39 INFO ExecutorAllocationManager: New executor 21 has registered (new total is 15)
20/06/11 14:28:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56516) with ID 19
20/06/11 14:28:39 INFO ExecutorAllocationManager: New executor 19 has registered (new total is 16)
20/06/11 14:28:39 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:44897 with 4.1 GB RAM, BlockManagerId(21, bigdata.node3, 44897, None)
20/06/11 14:28:39 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:42875 with 4.1 GB RAM, BlockManagerId(19, bigdata.node4, 42875, None)
20/06/11 14:28:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56518) with ID 24
20/06/11 14:28:39 INFO ExecutorAllocationManager: New executor 24 has registered (new total is 17)
20/06/11 14:28:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56520) with ID 29
20/06/11 14:28:39 INFO ExecutorAllocationManager: New executor 29 has registered (new total is 18)
20/06/11 14:28:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43766) with ID 16
20/06/11 14:28:39 INFO ExecutorAllocationManager: New executor 16 has registered (new total is 19)
20/06/11 14:28:39 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43768) with ID 26
20/06/11 14:28:39 INFO ExecutorAllocationManager: New executor 26 has registered (new total is 20)
20/06/11 14:28:39 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:35808 with 4.1 GB RAM, BlockManagerId(24, bigdata.node4, 35808, None)
20/06/11 14:28:39 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:39585 with 4.1 GB RAM, BlockManagerId(29, bigdata.node4, 39585, None)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:36676 with 4.1 GB RAM, BlockManagerId(16, bigdata.node3, 36676, None)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:36727 with 4.1 GB RAM, BlockManagerId(26, bigdata.node3, 36727, None)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37626) with ID 25
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 25 has registered (new total is 21)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37628) with ID 30
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 30 has registered (new total is 22)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:39742 with 4.1 GB RAM, BlockManagerId(25, bigdata.node5, 39742, None)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37630) with ID 20
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 20 has registered (new total is 23)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:42939 with 4.1 GB RAM, BlockManagerId(30, bigdata.node5, 42939, None)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:35832 with 4.1 GB RAM, BlockManagerId(20, bigdata.node5, 35832, None)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48504) with ID 27
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 27 has registered (new total is 24)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:40888 with 4.1 GB RAM, BlockManagerId(27, bigdata.node1, 40888, None)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48506) with ID 23
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 23 has registered (new total is 25)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:44479 with 4.1 GB RAM, BlockManagerId(23, bigdata.node1, 44479, None)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48508) with ID 18
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 18 has registered (new total is 26)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:46435 with 4.1 GB RAM, BlockManagerId(18, bigdata.node1, 46435, None)
20/06/11 14:28:40 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50106) with ID 12
20/06/11 14:28:40 INFO ExecutorAllocationManager: New executor 12 has registered (new total is 27)
20/06/11 14:28:40 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:46835 with 4.1 GB RAM, BlockManagerId(12, bigdata.node2, 46835, None)
20/06/11 14:28:42 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43784) with ID 37
20/06/11 14:28:42 INFO ExecutorAllocationManager: New executor 37 has registered (new total is 28)
20/06/11 14:28:42 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56534) with ID 34
20/06/11 14:28:42 INFO ExecutorAllocationManager: New executor 34 has registered (new total is 29)
20/06/11 14:28:42 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:45783 with 4.1 GB RAM, BlockManagerId(37, bigdata.node3, 45783, None)
20/06/11 14:28:42 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:34226 with 4.1 GB RAM, BlockManagerId(34, bigdata.node4, 34226, None)
20/06/11 14:28:42 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.74:56536) with ID 40
20/06/11 14:28:42 INFO ExecutorAllocationManager: New executor 40 has registered (new total is 30)
20/06/11 14:28:42 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node4:38827 with 4.1 GB RAM, BlockManagerId(40, bigdata.node4, 38827, None)
20/06/11 14:28:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37642) with ID 35
20/06/11 14:28:43 INFO ExecutorAllocationManager: New executor 35 has registered (new total is 31)
20/06/11 14:28:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.75:37644) with ID 36
20/06/11 14:28:43 INFO ExecutorAllocationManager: New executor 36 has registered (new total is 32)
20/06/11 14:28:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.73:43788) with ID 31
20/06/11 14:28:43 INFO ExecutorAllocationManager: New executor 31 has registered (new total is 33)
20/06/11 14:28:43 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:42594 with 4.1 GB RAM, BlockManagerId(35, bigdata.node5, 42594, None)
20/06/11 14:28:43 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node5:36776 with 4.1 GB RAM, BlockManagerId(36, bigdata.node5, 36776, None)
20/06/11 14:28:43 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node3:42620 with 4.1 GB RAM, BlockManagerId(31, bigdata.node3, 42620, None)
20/06/11 14:28:43 INFO YarnClientSchedulerBackend: SchedulerBackend is ready for scheduling beginning after reached minRegisteredResourcesRatio: 0.8
20/06/11 14:28:43 INFO AbstractHadoopJob: Ready to load KylinConfig from uri: kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata
20/06/11 14:28:43 INFO KylinConfig: Creating new manager instance of class org.apache.kylin.cube.CubeManager
20/06/11 14:28:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50140) with ID 22
20/06/11 14:28:43 INFO ExecutorAllocationManager: New executor 22 has registered (new total is 34)
20/06/11 14:28:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48524) with ID 38
20/06/11 14:28:43 INFO ExecutorAllocationManager: New executor 38 has registered (new total is 35)
20/06/11 14:28:43 INFO CubeManager: Initializing CubeManager with config kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata
20/06/11 14:28:43 INFO ResourceStore: Using metadata url kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata for resource store
20/06/11 14:28:43 INFO HDFSResourceStore: hdfs meta path : hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata
20/06/11 14:28:43 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:42500 with 4.1 GB RAM, BlockManagerId(22, bigdata.node2, 42500, None)
20/06/11 14:28:43 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:46439 with 4.1 GB RAM, BlockManagerId(38, bigdata.node1, 46439, None)
20/06/11 14:28:43 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50142) with ID 17
20/06/11 14:28:44 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:39145 with 4.1 GB RAM, BlockManagerId(17, bigdata.node2, 39145, None)
20/06/11 14:28:44 INFO ExecutorAllocationManager: New executor 17 has registered (new total is 36)
20/06/11 14:28:44 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50144) with ID 28
20/06/11 14:28:44 INFO ExecutorAllocationManager: New executor 28 has registered (new total is 37)
20/06/11 14:28:44 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:45797 with 4.1 GB RAM, BlockManagerId(28, bigdata.node2, 45797, None)
20/06/11 14:28:44 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.71:48530) with ID 32
20/06/11 14:28:44 INFO ExecutorAllocationManager: New executor 32 has registered (new total is 38)
20/06/11 14:28:44 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node1:38757 with 4.1 GB RAM, BlockManagerId(32, bigdata.node1, 38757, None)
20/06/11 14:28:44 INFO KylinConfig: Creating new manager instance of class org.apache.kylin.cube.CubeDescManager
20/06/11 14:28:44 INFO CubeDescManager: Initializing CubeDescManager with config kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata
20/06/11 14:28:44 INFO KylinConfig: Creating new manager instance of class org.apache.kylin.metadata.project.ProjectManager
20/06/11 14:28:44 INFO ProjectManager: Initializing ProjectManager with metadata url kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata
20/06/11 14:28:44 INFO KylinConfig: Creating new manager instance of class org.apache.kylin.metadata.cachesync.Broadcaster
20/06/11 14:28:44 INFO KylinConfig: Creating new manager instance of class org.apache.kylin.metadata.model.DataModelManager
20/06/11 14:28:44 INFO KylinConfig: Creating new manager instance of class org.apache.kylin.metadata.TableMetadataManager
20/06/11 14:28:44 INFO MeasureTypeFactory: Checking custom measure types from kylin config
20/06/11 14:28:44 INFO MeasureTypeFactory: registering COUNT_DISTINCT(hllc), class org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
20/06/11 14:28:44 INFO MeasureTypeFactory: registering COUNT_DISTINCT(bitmap), class org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
20/06/11 14:28:44 INFO MeasureTypeFactory: registering TOP_N(topn), class org.apache.kylin.measure.topn.TopNMeasureType$Factory
20/06/11 14:28:44 INFO MeasureTypeFactory: registering RAW(raw), class org.apache.kylin.measure.raw.RawMeasureType$Factory
20/06/11 14:28:44 INFO MeasureTypeFactory: registering EXTENDED_COLUMN(extendedcolumn), class org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
20/06/11 14:28:44 INFO MeasureTypeFactory: registering PERCENTILE_APPROX(percentile), class org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
20/06/11 14:28:44 INFO MeasureTypeFactory: registering COUNT_DISTINCT(dim_dc), class org.apache.kylin.measure.dim.DimCountDistinctMeasureType$Factory
20/06/11 14:28:45 INFO SparkBuildDictionary: Dimensions all is :[DimensionDesc\{name=TCKT_OFFC_ID, table=VIEW_A1, column=TCKT_OFFC_ID, derived=null, join=null}, DimensionDesc\{name=DSTC_ID, table=VIEW_A1, column=DSTC_ID, derived=null, join=null}, DimensionDesc\{name=AGE, table=VIEW_A1, column=AGE, derived=null, join=null}, DimensionDesc\{name=GND, table=VIEW_A1, column=GND, derived=null, join=null}, DimensionDesc\{name=FF_AIRLINE_CD, table=VIEW_A1, column=FF_AIRLINE_CD, derived=null, join=null}, DimensionDesc\{name=SUM_FLAG, table=VIEW_A1, column=SUM_FLAG, derived=null, join=null}, DimensionDesc\{name=GP_FLAG, table=VIEW_A1, column=GP_FLAG, derived=null, join=null}, DimensionDesc\{name=AGRM_FLAG, table=VIEW_A1, column=AGRM_FLAG, derived=null, join=null}, DimensionDesc\{name=GRP_FLAG, table=VIEW_A1, column=GRP_FLAG, derived=null, join=null}, DimensionDesc\{name=DEPT_AIRPORT_CD, table=VIEW_A1, column=DEPT_AIRPORT_CD, derived=null, join=null}, DimensionDesc\{name=DEPT_DT, table=VIEW_A1, column=DEPT_DT, derived=null, join=null}, DimensionDesc\{name=ARRV_AIRPORT_CD, table=VIEW_A1, column=ARRV_AIRPORT_CD, derived=null, join=null}, DimensionDesc\{name=CRR_AIRLINE_CD, table=VIEW_A1, column=CRR_AIRLINE_CD, derived=null, join=null}, DimensionDesc\{name=ADVNC_DAY, table=VIEW_A1, column=ADVNC_DAY, derived=null, join=null}, DimensionDesc\{name=a1, table=VIEW_A1, column=a1, derived=null, join=null}, DimensionDesc\{name=GP_CN, table=DIM_A1, column=null, derived=[GP_CN], join=JoinDesc [type=left, primary_key=[DIM_A1.GP_ID], foreign_key=[VIEW_A1.GP_FLAG]]}, DimensionDesc\{name=GP_EN, table=DIM_A1, column=null, derived=[GP_EN], join=JoinDesc [type=left, primary_key=[DIM_A1.GP_ID], foreign_key=[VIEW_A1.GP_FLAG]]}, DimensionDesc\{name=CAL_YR, table=DIM_A2, column=CAL_YR, derived=null, join=JoinDesc [type=left, primary_key=[DIM_A2.CAL_DT], foreign_key=[VIEW_A1.DEPT_DT]]}, DimensionDesc\{name=CAL_QTR, table=DIM_A2, column=null, derived=[CAL_QTR], join=JoinDesc [type=left, primary_key=[DIM_A2.CAL_DT], foreign_key=[VIEW_A1.DEPT_DT]]}, DimensionDesc\{name=CAL_MO, table=DIM_A2, column=null, derived=[CAL_MO], join=JoinDesc [type=left, primary_key=[DIM_A2.CAL_DT], foreign_key=[VIEW_A1.DEPT_DT]]}, DimensionDesc\{name=AGRM_CN, table=DIM_AGREEMENT, column=null, derived=[AGRM_CN], join=JoinDesc [type=left, primary_key=[DIM_AGREEMENT.AGRM_ID], foreign_key=[VIEW_A1.AGRM_FLAG]]}, DimensionDesc\{name=AGRM_EN, table=DIM_AGREEMENT, column=null, derived=[AGRM_EN], join=JoinDesc [type=left, primary_key=[DIM_AGREEMENT.AGRM_ID], foreign_key=[VIEW_A1.AGRM_FLAG]]}, DimensionDesc\{name=CGY_ADVNC_DAY, table=DIM_ADVNC_DAY, column=null, derived=[CGY_ADVNC_DAY], join=JoinDesc [type=left, primary_key=[DIM_ADVNC_DAY.ADVNC_DAY_ID], foreign_key=[VIEW_A1.ADVNC_DAY]]}, DimensionDesc\{name=OFFC_NM, table=DIM_OFFICE, column=null, derived=[OFFC_NM], join=JoinDesc [type=left, primary_key=[DIM_OFFICE.OFFC_ID], foreign_key=[VIEW_A1.TCKT_OFFC_ID]]}, DimensionDesc\{name=GRP_CN, table=DIM_GROUP, column=null, derived=[GRP_CN], join=JoinDesc [type=left, primary_key=[DIM_GROUP.GRP_ID], foreign_key=[VIEW_A1.GRP_FLAG]]}, DimensionDesc\{name=GRP_EN, table=DIM_GROUP, column=null, derived=[GRP_EN], join=JoinDesc [type=left, primary_key=[DIM_GROUP.GRP_ID], foreign_key=[VIEW_A1.GRP_FLAG]]}, DimensionDesc\{name=AIRLINE_CN, table=DIM_FF_AIRLINE, column=null, derived=[AIRLINE_CN], join=JoinDesc [type=left, primary_key=[DIM_FF_AIRLINE.AIRLINE_CD], foreign_key=[VIEW_A1.FF_AIRLINE_CD]]}, DimensionDesc\{name=AIRLINE_EN, table=DIM_FF_AIRLINE, column=null, derived=[AIRLINE_EN], join=JoinDesc [type=left, primary_key=[DIM_FF_AIRLINE.AIRLINE_CD], foreign_key=[VIEW_A1.FF_AIRLINE_CD]]}, DimensionDesc\{name=AIRLINE_CN, table=DIM_CRR_AIRLINE, column=null, derived=[AIRLINE_CN], join=JoinDesc [type=left, primary_key=[DIM_CRR_AIRLINE.AIRLINE_CD], foreign_key=[VIEW_A1.CRR_AIRLINE_CD]]}, DimensionDesc\{name=AIRLINE_EN, table=DIM_CRR_AIRLINE, column=null, derived=[AIRLINE_EN], join=JoinDesc [type=left, primary_key=[DIM_CRR_AIRLINE.AIRLINE_CD], foreign_key=[VIEW_A1.CRR_AIRLINE_CD]]}, DimensionDesc\{name=CGY_AGE_GRP_1, table=DIM_AGE, column=null, derived=[CGY_AGE_GRP_1], join=JoinDesc [type=left, primary_key=[DIM_AGE.AGE_ID], foreign_key=[VIEW_A1.AGE]]}, DimensionDesc\{name=AIRPORT_CN, table=DIM_DEPT_AIRPORT, column=null, derived=[AIRPORT_CN], join=JoinDesc [type=left, primary_key=[DIM_DEPT_AIRPORT.AIRPORT_CD], foreign_key=[VIEW_A1.DEPT_AIRPORT_CD]]}, DimensionDesc\{name=AIRPORT_EN, table=DIM_DEPT_AIRPORT, column=null, derived=[AIRPORT_EN], join=JoinDesc [type=left, primary_key=[DIM_DEPT_AIRPORT.AIRPORT_CD], foreign_key=[VIEW_A1.DEPT_AIRPORT_CD]]}, DimensionDesc\{name=AIRPORT_CN, table=DIM_ARRV_AIRPORT, column=null, derived=[AIRPORT_CN], join=JoinDesc [type=left, primary_key=[DIM_ARRV_AIRPORT.AIRPORT_CD], foreign_key=[VIEW_A1.ARRV_AIRPORT_CD]]}, DimensionDesc\{name=AIRPORT_EN, table=DIM_ARRV_AIRPORT, column=null, derived=[AIRPORT_EN], join=JoinDesc [type=left, primary_key=[DIM_ARRV_AIRPORT.AIRPORT_CD], foreign_key=[VIEW_A1.ARRV_AIRPORT_CD]]}, DimensionDesc\{name=AIR_RTE_NAME, table=DIM_AIR_ROUTE, column=null, derived=[AIR_RTE_NAME], join=JoinDesc [type=left, primary_key=[DIM_AIR_ROUTE.a1], foreign_key=[VIEW_A1.a1]]}, DimensionDesc\{name=GND_CN, table=DIM_GENDER, column=null, derived=[GND_CN], join=JoinDesc [type=left, primary_key=[DIM_GENDER.GND_ID], foreign_key=[VIEW_A1.GND]]}, DimensionDesc\{name=GND_EN, table=DIM_GENDER, column=null, derived=[GND_EN], join=JoinDesc [type=left, primary_key=[DIM_GENDER.GND_ID], foreign_key=[VIEW_A1.GND]]}, DimensionDesc\{name=PROV_CN, table=DIM_REGION, column=null, derived=[PROV_CN], join=JoinDesc [type=left, primary_key=[DIM_REGION.DSTC_ID], foreign_key=[VIEW_A1.DSTC_ID]]}, DimensionDesc\{name=CTY_CN, table=DIM_REGION, column=null, derived=[CTY_CN], join=JoinDesc [type=left, primary_key=[DIM_REGION.DSTC_ID], foreign_key=[VIEW_A1.DSTC_ID]]}, DimensionDesc\{name=DSTC_CN, table=DIM_REGION, column=null, derived=[DSTC_CN], join=JoinDesc [type=left, primary_key=[DIM_REGION.DSTC_ID], foreign_key=[VIEW_A1.DSTC_ID]]}]
20/06/11 14:28:45 INFO SparkBuildDictionary: Spark build dict uhc columns is 0
20/06/11 14:28:45 INFO SparkBuildDictionary: Cube name is kylin_test_view_cube_spark, segment id is 399cc9f9-2dad-720c-79aa-10f7eacce7a7
20/06/11 14:28:45 INFO SparkBuildDictionary: Fact columns input path is hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/fact_distinct_columns
20/06/11 14:28:45 INFO SparkBuildDictionary: Fact columns input path is hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/dict
20/06/11 14:28:45 INFO SparkContext: Starting job: collect at SparkBuildDictionary.java:168
20/06/11 14:28:45 INFO DAGScheduler: Got job 0 (collect at SparkBuildDictionary.java:168) with 152 output partitions
20/06/11 14:28:45 INFO DAGScheduler: Final stage: ResultStage 0 (collect at SparkBuildDictionary.java:168)
20/06/11 14:28:45 INFO DAGScheduler: Parents of final stage: List()
20/06/11 14:28:45 INFO DAGScheduler: Missing parents: List()
20/06/11 14:28:45 INFO DAGScheduler: Submitting ResultStage 0 (MapPartitionsRDD[1] at mapToPair at SparkBuildDictionary.java:167), which has no missing parents
20/06/11 14:28:45 INFO MemoryStore: Block broadcast_0 stored as values in memory (estimated size 9.6 KB, free 10.5 GB)
20/06/11 14:28:46 INFO MemoryStore: Block broadcast_0_piece0 stored as bytes in memory (estimated size 5.4 KB, free 10.5 GB)
20/06/11 14:28:46 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on 10.150.64.72:37065 (size: 5.4 KB, free: 10.5 GB)
20/06/11 14:28:46 INFO SparkContext: Created broadcast 0 from broadcast at DAGScheduler.scala:1006
20/06/11 14:28:46 INFO DAGScheduler: Submitting 152 missing tasks from ResultStage 0 (MapPartitionsRDD[1] at mapToPair at SparkBuildDictionary.java:167) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
20/06/11 14:28:46 INFO YarnScheduler: Adding task set 0.0 with 152 tasks
20/06/11 14:28:46 INFO TaskSetManager: Starting task 0.0 in stage 0.0 (TID 0, bigdata.node4, executor 9, partition 0, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 1.0 in stage 0.0 (TID 1, bigdata.node5, executor 15, partition 1, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 2.0 in stage 0.0 (TID 2, bigdata.node3, executor 31, partition 2, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 3.0 in stage 0.0 (TID 3, bigdata.node1, executor 8, partition 3, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 4.0 in stage 0.0 (TID 4, bigdata.node5, executor 25, partition 4, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 5.0 in stage 0.0 (TID 5, bigdata.node2, executor 2, partition 5, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 6.0 in stage 0.0 (TID 6, bigdata.node5, executor 35, partition 6, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 7.0 in stage 0.0 (TID 7, bigdata.node1, executor 32, partition 7, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 8.0 in stage 0.0 (TID 8, bigdata.node5, executor 20, partition 8, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 9.0 in stage 0.0 (TID 9, bigdata.node4, executor 19, partition 9, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 10.0 in stage 0.0 (TID 10, bigdata.node3, executor 26, partition 10, PROCESS_LOCAL, 15511 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 11.0 in stage 0.0 (TID 11, bigdata.node1, executor 18, partition 11, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 12.0 in stage 0.0 (TID 12, bigdata.node5, executor 10, partition 12, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 13.0 in stage 0.0 (TID 13, bigdata.node4, executor 4, partition 13, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 14.0 in stage 0.0 (TID 14, bigdata.node5, executor 36, partition 14, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 15.0 in stage 0.0 (TID 15, bigdata.node1, executor 38, partition 15, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 16.0 in stage 0.0 (TID 16, bigdata.node1, executor 3, partition 16, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 17.0 in stage 0.0 (TID 17, bigdata.node1, executor 23, partition 17, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 18.0 in stage 0.0 (TID 18, bigdata.node2, executor 17, partition 18, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 19.0 in stage 0.0 (TID 19, bigdata.node1, executor 27, partition 19, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 20.0 in stage 0.0 (TID 20, bigdata.node3, executor 21, partition 20, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 21.0 in stage 0.0 (TID 21, bigdata.node2, executor 12, partition 21, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 22.0 in stage 0.0 (TID 22, bigdata.node3, executor 1, partition 22, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 23.0 in stage 0.0 (TID 23, bigdata.node4, executor 40, partition 23, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 24.0 in stage 0.0 (TID 24, bigdata.node4, executor 34, partition 24, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 25.0 in stage 0.0 (TID 25, bigdata.node2, executor 7, partition 25, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 26.0 in stage 0.0 (TID 26, bigdata.node3, executor 37, partition 26, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 27.0 in stage 0.0 (TID 27, bigdata.node4, executor 29, partition 27, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 28.0 in stage 0.0 (TID 28, bigdata.node5, executor 5, partition 28, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 29.0 in stage 0.0 (TID 29, bigdata.node5, executor 30, partition 29, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 30.0 in stage 0.0 (TID 30, bigdata.node3, executor 11, partition 30, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 31.0 in stage 0.0 (TID 31, bigdata.node4, executor 14, partition 31, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:46 INFO TaskSetManager: Starting task 32.0 in stage 0.0 (TID 32, bigdata.node2, executor 28, partition 32, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 33.0 in stage 0.0 (TID 33, bigdata.node4, executor 24, partition 33, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 34.0 in stage 0.0 (TID 34, bigdata.node1, executor 13, partition 34, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 35.0 in stage 0.0 (TID 35, bigdata.node3, executor 16, partition 35, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 36.0 in stage 0.0 (TID 36, bigdata.node3, executor 6, partition 36, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 37.0 in stage 0.0 (TID 37, bigdata.node2, executor 22, partition 37, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 38.0 in stage 0.0 (TID 38, bigdata.node4, executor 9, partition 38, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 39.0 in stage 0.0 (TID 39, bigdata.node5, executor 15, partition 39, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 40.0 in stage 0.0 (TID 40, bigdata.node3, executor 31, partition 40, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 41.0 in stage 0.0 (TID 41, bigdata.node1, executor 8, partition 41, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 42.0 in stage 0.0 (TID 42, bigdata.node5, executor 25, partition 42, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 43.0 in stage 0.0 (TID 43, bigdata.node2, executor 2, partition 43, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 44.0 in stage 0.0 (TID 44, bigdata.node5, executor 35, partition 44, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 45.0 in stage 0.0 (TID 45, bigdata.node1, executor 32, partition 45, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 46.0 in stage 0.0 (TID 46, bigdata.node5, executor 20, partition 46, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 47.0 in stage 0.0 (TID 47, bigdata.node4, executor 19, partition 47, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 48.0 in stage 0.0 (TID 48, bigdata.node3, executor 26, partition 48, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 49.0 in stage 0.0 (TID 49, bigdata.node1, executor 18, partition 49, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 50.0 in stage 0.0 (TID 50, bigdata.node5, executor 10, partition 50, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 51.0 in stage 0.0 (TID 51, bigdata.node4, executor 4, partition 51, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 52.0 in stage 0.0 (TID 52, bigdata.node5, executor 36, partition 52, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 53.0 in stage 0.0 (TID 53, bigdata.node1, executor 38, partition 53, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 54.0 in stage 0.0 (TID 54, bigdata.node1, executor 3, partition 54, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 55.0 in stage 0.0 (TID 55, bigdata.node1, executor 23, partition 55, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 56.0 in stage 0.0 (TID 56, bigdata.node2, executor 17, partition 56, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 57.0 in stage 0.0 (TID 57, bigdata.node1, executor 27, partition 57, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 58.0 in stage 0.0 (TID 58, bigdata.node3, executor 21, partition 58, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 59.0 in stage 0.0 (TID 59, bigdata.node2, executor 12, partition 59, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 60.0 in stage 0.0 (TID 60, bigdata.node3, executor 1, partition 60, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 61.0 in stage 0.0 (TID 61, bigdata.node4, executor 40, partition 61, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 62.0 in stage 0.0 (TID 62, bigdata.node4, executor 34, partition 62, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 63.0 in stage 0.0 (TID 63, bigdata.node2, executor 7, partition 63, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 64.0 in stage 0.0 (TID 64, bigdata.node3, executor 37, partition 64, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 65.0 in stage 0.0 (TID 65, bigdata.node4, executor 29, partition 65, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 66.0 in stage 0.0 (TID 66, bigdata.node5, executor 5, partition 66, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 67.0 in stage 0.0 (TID 67, bigdata.node5, executor 30, partition 67, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 68.0 in stage 0.0 (TID 68, bigdata.node3, executor 11, partition 68, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 69.0 in stage 0.0 (TID 69, bigdata.node4, executor 14, partition 69, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 70.0 in stage 0.0 (TID 70, bigdata.node2, executor 28, partition 70, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 71.0 in stage 0.0 (TID 71, bigdata.node4, executor 24, partition 71, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 72.0 in stage 0.0 (TID 72, bigdata.node1, executor 13, partition 72, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 73.0 in stage 0.0 (TID 73, bigdata.node3, executor 16, partition 73, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 74.0 in stage 0.0 (TID 74, bigdata.node3, executor 6, partition 74, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 75.0 in stage 0.0 (TID 75, bigdata.node2, executor 22, partition 75, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 76.0 in stage 0.0 (TID 76, bigdata.node4, executor 9, partition 76, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 77.0 in stage 0.0 (TID 77, bigdata.node5, executor 15, partition 77, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 78.0 in stage 0.0 (TID 78, bigdata.node3, executor 31, partition 78, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 79.0 in stage 0.0 (TID 79, bigdata.node1, executor 8, partition 79, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 80.0 in stage 0.0 (TID 80, bigdata.node5, executor 25, partition 80, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 81.0 in stage 0.0 (TID 81, bigdata.node2, executor 2, partition 81, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 82.0 in stage 0.0 (TID 82, bigdata.node5, executor 35, partition 82, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 83.0 in stage 0.0 (TID 83, bigdata.node1, executor 32, partition 83, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 84.0 in stage 0.0 (TID 84, bigdata.node5, executor 20, partition 84, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 85.0 in stage 0.0 (TID 85, bigdata.node4, executor 19, partition 85, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 86.0 in stage 0.0 (TID 86, bigdata.node3, executor 26, partition 86, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 87.0 in stage 0.0 (TID 87, bigdata.node1, executor 18, partition 87, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 88.0 in stage 0.0 (TID 88, bigdata.node5, executor 10, partition 88, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 89.0 in stage 0.0 (TID 89, bigdata.node4, executor 4, partition 89, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 90.0 in stage 0.0 (TID 90, bigdata.node5, executor 36, partition 90, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 91.0 in stage 0.0 (TID 91, bigdata.node1, executor 38, partition 91, PROCESS_LOCAL, 11516 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 92.0 in stage 0.0 (TID 92, bigdata.node1, executor 3, partition 92, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 93.0 in stage 0.0 (TID 93, bigdata.node1, executor 23, partition 93, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 94.0 in stage 0.0 (TID 94, bigdata.node2, executor 17, partition 94, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 95.0 in stage 0.0 (TID 95, bigdata.node1, executor 27, partition 95, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 96.0 in stage 0.0 (TID 96, bigdata.node3, executor 21, partition 96, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 97.0 in stage 0.0 (TID 97, bigdata.node2, executor 12, partition 97, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 98.0 in stage 0.0 (TID 98, bigdata.node3, executor 1, partition 98, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 99.0 in stage 0.0 (TID 99, bigdata.node4, executor 40, partition 99, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 100.0 in stage 0.0 (TID 100, bigdata.node4, executor 34, partition 100, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 101.0 in stage 0.0 (TID 101, bigdata.node2, executor 7, partition 101, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 102.0 in stage 0.0 (TID 102, bigdata.node3, executor 37, partition 102, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 103.0 in stage 0.0 (TID 103, bigdata.node4, executor 29, partition 103, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 104.0 in stage 0.0 (TID 104, bigdata.node5, executor 5, partition 104, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 105.0 in stage 0.0 (TID 105, bigdata.node5, executor 30, partition 105, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 106.0 in stage 0.0 (TID 106, bigdata.node3, executor 11, partition 106, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 107.0 in stage 0.0 (TID 107, bigdata.node4, executor 14, partition 107, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 108.0 in stage 0.0 (TID 108, bigdata.node2, executor 28, partition 108, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 109.0 in stage 0.0 (TID 109, bigdata.node4, executor 24, partition 109, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 110.0 in stage 0.0 (TID 110, bigdata.node1, executor 13, partition 110, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 111.0 in stage 0.0 (TID 111, bigdata.node3, executor 16, partition 111, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 112.0 in stage 0.0 (TID 112, bigdata.node3, executor 6, partition 112, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 113.0 in stage 0.0 (TID 113, bigdata.node2, executor 22, partition 113, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 114.0 in stage 0.0 (TID 114, bigdata.node4, executor 9, partition 114, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 115.0 in stage 0.0 (TID 115, bigdata.node5, executor 15, partition 115, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:47 INFO TaskSetManager: Starting task 116.0 in stage 0.0 (TID 116, bigdata.node3, executor 31, partition 116, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 117.0 in stage 0.0 (TID 117, bigdata.node1, executor 8, partition 117, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 118.0 in stage 0.0 (TID 118, bigdata.node5, executor 25, partition 118, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 119.0 in stage 0.0 (TID 119, bigdata.node2, executor 2, partition 119, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 120.0 in stage 0.0 (TID 120, bigdata.node5, executor 35, partition 120, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 121.0 in stage 0.0 (TID 121, bigdata.node1, executor 32, partition 121, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 122.0 in stage 0.0 (TID 122, bigdata.node5, executor 20, partition 122, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 123.0 in stage 0.0 (TID 123, bigdata.node4, executor 19, partition 123, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 124.0 in stage 0.0 (TID 124, bigdata.node3, executor 26, partition 124, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 125.0 in stage 0.0 (TID 125, bigdata.node1, executor 18, partition 125, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 126.0 in stage 0.0 (TID 126, bigdata.node5, executor 10, partition 126, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 127.0 in stage 0.0 (TID 127, bigdata.node4, executor 4, partition 127, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 128.0 in stage 0.0 (TID 128, bigdata.node5, executor 36, partition 128, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 129.0 in stage 0.0 (TID 129, bigdata.node1, executor 38, partition 129, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 130.0 in stage 0.0 (TID 130, bigdata.node1, executor 3, partition 130, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 131.0 in stage 0.0 (TID 131, bigdata.node1, executor 23, partition 131, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 132.0 in stage 0.0 (TID 132, bigdata.node2, executor 17, partition 132, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 133.0 in stage 0.0 (TID 133, bigdata.node1, executor 27, partition 133, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 134.0 in stage 0.0 (TID 134, bigdata.node3, executor 21, partition 134, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 135.0 in stage 0.0 (TID 135, bigdata.node2, executor 12, partition 135, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 136.0 in stage 0.0 (TID 136, bigdata.node3, executor 1, partition 136, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 137.0 in stage 0.0 (TID 137, bigdata.node4, executor 40, partition 137, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 138.0 in stage 0.0 (TID 138, bigdata.node4, executor 34, partition 138, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 139.0 in stage 0.0 (TID 139, bigdata.node2, executor 7, partition 139, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 140.0 in stage 0.0 (TID 140, bigdata.node3, executor 37, partition 140, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 141.0 in stage 0.0 (TID 141, bigdata.node4, executor 29, partition 141, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 142.0 in stage 0.0 (TID 142, bigdata.node5, executor 5, partition 142, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 143.0 in stage 0.0 (TID 143, bigdata.node5, executor 30, partition 143, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 144.0 in stage 0.0 (TID 144, bigdata.node3, executor 11, partition 144, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 145.0 in stage 0.0 (TID 145, bigdata.node4, executor 14, partition 145, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 146.0 in stage 0.0 (TID 146, bigdata.node2, executor 28, partition 146, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 147.0 in stage 0.0 (TID 147, bigdata.node4, executor 24, partition 147, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 148.0 in stage 0.0 (TID 148, bigdata.node1, executor 13, partition 148, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 149.0 in stage 0.0 (TID 149, bigdata.node3, executor 16, partition 149, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 150.0 in stage 0.0 (TID 150, bigdata.node3, executor 6, partition 150, PROCESS_LOCAL, 4689 bytes)
20/06/11 14:28:48 INFO TaskSetManager: Starting task 151.0 in stage 0.0 (TID 151, bigdata.node2, executor 22, partition 151, PROCESS_LOCAL, 15510 bytes)
20/06/11 14:28:48 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50158) with ID 33
20/06/11 14:28:48 INFO ExecutorAllocationManager: New executor 33 has registered (new total is 39)
20/06/11 14:28:48 INFO YarnSchedulerBackend$YarnDriverEndpoint: Registered executor NettyRpcEndpointRef(spark-client://Executor) (10.150.64.72:50162) with ID 39
20/06/11 14:28:48 INFO ExecutorAllocationManager: New executor 39 has registered (new total is 40)
20/06/11 14:28:48 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:37434 with 4.1 GB RAM, BlockManagerId(33, bigdata.node2, 37434, None)
20/06/11 14:28:48 INFO BlockManagerMasterEndpoint: Registering block manager bigdata.node2:42353 with 4.1 GB RAM, BlockManagerId(39, bigdata.node2, 42353, None)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:34759 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:42767 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node2:45797 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:35102 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:39585 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:38827 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:45063 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:49 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:40888 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:35808 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:42310 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:43881 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:35832 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:39742 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:42875 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:39225 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:43374 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:36727 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:42939 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:36676 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:44897 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:39170 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:42620 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:42594 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:43242 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 38.0 in stage 0.0 (TID 38) in 3116 ms on bigdata.node4 (executor 9) (1/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 76.0 in stage 0.0 (TID 76) in 2584 ms on bigdata.node4 (executor 9) (2/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 0.0 in stage 0.0 (TID 0) in 3450 ms on bigdata.node4 (executor 9) (3/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 114.0 in stage 0.0 (TID 114) in 2405 ms on bigdata.node4 (executor 9) (4/152)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:38757 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:45659 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 79.0 in stage 0.0 (TID 79) in 2757 ms on bigdata.node1 (executor 8) (5/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 108.0 in stage 0.0 (TID 108) in 2621 ms on bigdata.node2 (executor 28) (6/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 146.0 in stage 0.0 (TID 146) in 2118 ms on bigdata.node2 (executor 28) (7/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 32.0 in stage 0.0 (TID 32) in 3345 ms on bigdata.node2 (executor 28) (8/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 41.0 in stage 0.0 (TID 41) in 3297 ms on bigdata.node1 (executor 8) (9/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 3.0 in stage 0.0 (TID 3) in 3578 ms on bigdata.node1 (executor 8) (10/152)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:44479 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 117.0 in stage 0.0 (TID 117) in 2600 ms on bigdata.node1 (executor 8) (11/152)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node4:34226 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 23.0 in stage 0.0 (TID 23) in 3446 ms on bigdata.node4 (executor 40) (12/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 72.0 in stage 0.0 (TID 72) in 2851 ms on bigdata.node1 (executor 13) (13/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 110.0 in stage 0.0 (TID 110) in 2669 ms on bigdata.node1 (executor 13) (14/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 148.0 in stage 0.0 (TID 148) in 2167 ms on bigdata.node1 (executor 13) (15/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 31.0 in stage 0.0 (TID 31) in 3408 ms on bigdata.node4 (executor 14) (16/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 34.0 in stage 0.0 (TID 34) in 3391 ms on bigdata.node1 (executor 13) (17/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 107.0 in stage 0.0 (TID 107) in 2684 ms on bigdata.node4 (executor 14) (18/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 145.0 in stage 0.0 (TID 145) in 2180 ms on bigdata.node4 (executor 14) (19/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 69.0 in stage 0.0 (TID 69) in 2874 ms on bigdata.node4 (executor 14) (20/152)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node2:45001 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 99.0 in stage 0.0 (TID 99) in 2735 ms on bigdata.node4 (executor 40) (21/152)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:36776 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node2:39145 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node2:46835 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node2:42500 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node2:33477 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node3:45783 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node5:40621 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 8.0 in stage 0.0 (TID 8) in 3686 ms on bigdata.node5 (executor 20) (22/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 127.0 in stage 0.0 (TID 127) in 2382 ms on bigdata.node4 (executor 4) (23/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 51.0 in stage 0.0 (TID 51) in 3093 ms on bigdata.node4 (executor 4) (24/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 13.0 in stage 0.0 (TID 13) in 3647 ms on bigdata.node4 (executor 4) (25/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 89.0 in stage 0.0 (TID 89) in 2882 ms on bigdata.node4 (executor 4) (26/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 84.0 in stage 0.0 (TID 84) in 2912 ms on bigdata.node5 (executor 20) (27/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 122.0 in stage 0.0 (TID 122) in 2416 ms on bigdata.node5 (executor 20) (28/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 46.0 in stage 0.0 (TID 46) in 3450 ms on bigdata.node5 (executor 20) (29/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 42.0 in stage 0.0 (TID 42) in 3480 ms on bigdata.node5 (executor 25) (30/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 4.0 in stage 0.0 (TID 4) in 3754 ms on bigdata.node5 (executor 25) (31/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 118.0 in stage 0.0 (TID 118) in 2459 ms on bigdata.node5 (executor 25) (32/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 80.0 in stage 0.0 (TID 80) in 2959 ms on bigdata.node5 (executor 25) (33/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 143.0 in stage 0.0 (TID 143) in 2349 ms on bigdata.node5 (executor 30) (34/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 105.0 in stage 0.0 (TID 105) in 2856 ms on bigdata.node5 (executor 30) (35/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 29.0 in stage 0.0 (TID 29) in 3585 ms on bigdata.node5 (executor 30) (36/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 67.0 in stage 0.0 (TID 67) in 3051 ms on bigdata.node5 (executor 30) (37/152)
20/06/11 14:28:50 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:46439 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 142.0 in stage 0.0 (TID 142) in 2379 ms on bigdata.node5 (executor 5) (38/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 104.0 in stage 0.0 (TID 104) in 2887 ms on bigdata.node5 (executor 5) (39/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 28.0 in stage 0.0 (TID 28) in 3621 ms on bigdata.node5 (executor 5) (40/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 66.0 in stage 0.0 (TID 66) in 3085 ms on bigdata.node5 (executor 5) (41/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 137.0 in stage 0.0 (TID 137) in 2417 ms on bigdata.node4 (executor 40) (42/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 61.0 in stage 0.0 (TID 61) in 3127 ms on bigdata.node4 (executor 40) (43/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 120.0 in stage 0.0 (TID 120) in 2527 ms on bigdata.node5 (executor 35) (44/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 82.0 in stage 0.0 (TID 82) in 3023 ms on bigdata.node5 (executor 35) (45/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 44.0 in stage 0.0 (TID 44) in 3561 ms on bigdata.node5 (executor 35) (46/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 6.0 in stage 0.0 (TID 6) in 3821 ms on bigdata.node5 (executor 35) (47/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 16.0 in stage 0.0 (TID 16) in 3805 ms on bigdata.node1 (executor 3) (48/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 54.0 in stage 0.0 (TID 54) in 3254 ms on bigdata.node1 (executor 3) (49/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 92.0 in stage 0.0 (TID 92) in 3047 ms on bigdata.node1 (executor 3) (50/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 130.0 in stage 0.0 (TID 130) in 2549 ms on bigdata.node1 (executor 3) (51/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 95.0 in stage 0.0 (TID 95) in 3090 ms on bigdata.node1 (executor 27) (52/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 19.0 in stage 0.0 (TID 19) in 3844 ms on bigdata.node1 (executor 27) (53/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 133.0 in stage 0.0 (TID 133) in 2574 ms on bigdata.node1 (executor 27) (54/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 57.0 in stage 0.0 (TID 57) in 3295 ms on bigdata.node1 (executor 27) (55/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 88.0 in stage 0.0 (TID 88) in 3355 ms on bigdata.node5 (executor 10) (56/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 126.0 in stage 0.0 (TID 126) in 2860 ms on bigdata.node5 (executor 10) (57/152)
20/06/11 14:28:50 INFO TaskSetManager: Finished task 12.0 in stage 0.0 (TID 12) in 4124 ms on bigdata.node5 (executor 10) (58/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 39.0 in stage 0.0 (TID 39) in 3996 ms on bigdata.node5 (executor 15) (59/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 1.0 in stage 0.0 (TID 1) in 4290 ms on bigdata.node5 (executor 15) (60/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 77.0 in stage 0.0 (TID 77) in 3461 ms on bigdata.node5 (executor 15) (61/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 115.0 in stage 0.0 (TID 115) in 3286 ms on bigdata.node5 (executor 15) (62/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 128.0 in stage 0.0 (TID 128) in 2917 ms on bigdata.node5 (executor 36) (63/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 14.0 in stage 0.0 (TID 14) in 4180 ms on bigdata.node5 (executor 36) (64/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 52.0 in stage 0.0 (TID 52) in 3626 ms on bigdata.node5 (executor 36) (65/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 90.0 in stage 0.0 (TID 90) in 3415 ms on bigdata.node5 (executor 36) (66/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 119.0 in stage 0.0 (TID 119) in 3014 ms on bigdata.node2 (executor 2) (67/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 43.0 in stage 0.0 (TID 43) in 4041 ms on bigdata.node2 (executor 2) (68/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 5.0 in stage 0.0 (TID 5) in 4305 ms on bigdata.node2 (executor 2) (69/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 55.0 in stage 0.0 (TID 55) in 3694 ms on bigdata.node1 (executor 23) (70/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 17.0 in stage 0.0 (TID 17) in 4247 ms on bigdata.node1 (executor 23) (71/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 93.0 in stage 0.0 (TID 93) in 3497 ms on bigdata.node1 (executor 23) (72/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 97.0 in stage 0.0 (TID 97) in 3495 ms on bigdata.node2 (executor 12) (73/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 21.0 in stage 0.0 (TID 21) in 4244 ms on bigdata.node2 (executor 12) (74/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 59.0 in stage 0.0 (TID 59) in 3698 ms on bigdata.node2 (executor 12) (75/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 135.0 in stage 0.0 (TID 135) in 2983 ms on bigdata.node2 (executor 12) (76/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 15.0 in stage 0.0 (TID 15) in 4296 ms on bigdata.node1 (executor 38) (77/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 138.0 in stage 0.0 (TID 138) in 3021 ms on bigdata.node4 (executor 34) (78/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 62.0 in stage 0.0 (TID 62) in 3729 ms on bigdata.node4 (executor 34) (79/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 100.0 in stage 0.0 (TID 100) in 3531 ms on bigdata.node4 (executor 34) (80/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 24.0 in stage 0.0 (TID 24) in 4272 ms on bigdata.node4 (executor 34) (81/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 56.0 in stage 0.0 (TID 56) in 3808 ms on bigdata.node2 (executor 17) (82/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 132.0 in stage 0.0 (TID 132) in 3086 ms on bigdata.node2 (executor 17) (83/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 18.0 in stage 0.0 (TID 18) in 4361 ms on bigdata.node2 (executor 17) (84/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 94.0 in stage 0.0 (TID 94) in 3605 ms on bigdata.node2 (executor 17) (85/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 33.0 in stage 0.0 (TID 33) in 4313 ms on bigdata.node4 (executor 24) (86/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 147.0 in stage 0.0 (TID 147) in 3089 ms on bigdata.node4 (executor 24) (87/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 109.0 in stage 0.0 (TID 109) in 3594 ms on bigdata.node4 (executor 24) (88/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 71.0 in stage 0.0 (TID 71) in 3786 ms on bigdata.node4 (executor 24) (89/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 85.0 in stage 0.0 (TID 85) in 3726 ms on bigdata.node4 (executor 19) (90/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 123.0 in stage 0.0 (TID 123) in 3232 ms on bigdata.node4 (executor 19) (91/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 9.0 in stage 0.0 (TID 9) in 4507 ms on bigdata.node4 (executor 19) (92/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 47.0 in stage 0.0 (TID 47) in 3947 ms on bigdata.node4 (executor 19) (93/152)
20/06/11 14:28:51 INFO BlockManagerInfo: Added broadcast_0_piece0 in memory on bigdata.node1:46435 (size: 5.4 KB, free: 4.1 GB)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 27.0 in stage 0.0 (TID 27) in 4493 ms on bigdata.node4 (executor 29) (94/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 103.0 in stage 0.0 (TID 103) in 3760 ms on bigdata.node4 (executor 29) (95/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 65.0 in stage 0.0 (TID 65) in 3955 ms on bigdata.node4 (executor 29) (96/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 45.0 in stage 0.0 (TID 45) in 4488 ms on bigdata.node1 (executor 32) (97/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 7.0 in stage 0.0 (TID 7) in 4743 ms on bigdata.node1 (executor 32) (98/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 83.0 in stage 0.0 (TID 83) in 3957 ms on bigdata.node1 (executor 32) (99/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 53.0 in stage 0.0 (TID 53) in 4185 ms on bigdata.node1 (executor 38) (100/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 129.0 in stage 0.0 (TID 129) in 3479 ms on bigdata.node1 (executor 38) (101/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 36.0 in stage 0.0 (TID 36) in 4716 ms on bigdata.node3 (executor 6) (102/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 74.0 in stage 0.0 (TID 74) in 4179 ms on bigdata.node3 (executor 6) (103/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 150.0 in stage 0.0 (TID 150) in 3501 ms on bigdata.node3 (executor 6) (104/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 49.0 in stage 0.0 (TID 49) in 4363 ms on bigdata.node1 (executor 18) (105/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 125.0 in stage 0.0 (TID 125) in 3651 ms on bigdata.node1 (executor 18) (106/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 11.0 in stage 0.0 (TID 11) in 4918 ms on bigdata.node1 (executor 18) (107/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 87.0 in stage 0.0 (TID 87) in 4148 ms on bigdata.node1 (executor 18) (108/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 112.0 in stage 0.0 (TID 112) in 4034 ms on bigdata.node3 (executor 6) (109/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 106.0 in stage 0.0 (TID 106) in 4077 ms on bigdata.node3 (executor 11) (110/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 68.0 in stage 0.0 (TID 68) in 4266 ms on bigdata.node3 (executor 11) (111/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 144.0 in stage 0.0 (TID 144) in 3583 ms on bigdata.node3 (executor 11) (112/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 139.0 in stage 0.0 (TID 139) in 3731 ms on bigdata.node2 (executor 7) (113/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 25.0 in stage 0.0 (TID 25) in 4977 ms on bigdata.node2 (executor 7) (114/152)
20/06/11 14:28:51 INFO TaskSetManager: Finished task 63.0 in stage 0.0 (TID 63) in 4439 ms on bigdata.node2 (executor 7) (115/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 113.0 in stage 0.0 (TID 113) in 4468 ms on bigdata.node2 (executor 22) (116/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 75.0 in stage 0.0 (TID 75) in 4647 ms on bigdata.node2 (executor 22) (117/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 37.0 in stage 0.0 (TID 37) in 5186 ms on bigdata.node2 (executor 22) (118/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 22.0 in stage 0.0 (TID 22) in 5385 ms on bigdata.node3 (executor 1) (119/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 149.0 in stage 0.0 (TID 149) in 4341 ms on bigdata.node3 (executor 16) (120/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 73.0 in stage 0.0 (TID 73) in 5023 ms on bigdata.node3 (executor 16) (121/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 35.0 in stage 0.0 (TID 35) in 5573 ms on bigdata.node3 (executor 16) (122/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 26.0 in stage 0.0 (TID 26) in 5638 ms on bigdata.node3 (executor 37) (123/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 140.0 in stage 0.0 (TID 140) in 4397 ms on bigdata.node3 (executor 37) (124/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 64.0 in stage 0.0 (TID 64) in 5100 ms on bigdata.node3 (executor 37) (125/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 102.0 in stage 0.0 (TID 102) in 4904 ms on bigdata.node3 (executor 37) (126/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 50.0 in stage 0.0 (TID 50) in 5212 ms on bigdata.node5 (executor 10) (127/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 124.0 in stage 0.0 (TID 124) in 4564 ms on bigdata.node3 (executor 26) (128/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 48.0 in stage 0.0 (TID 48) in 5276 ms on bigdata.node3 (executor 26) (129/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 86.0 in stage 0.0 (TID 86) in 5068 ms on bigdata.node3 (executor 26) (130/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 116.0 in stage 0.0 (TID 116) in 4957 ms on bigdata.node3 (executor 31) (131/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 136.0 in stage 0.0 (TID 136) in 4526 ms on bigdata.node3 (executor 1) (132/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 78.0 in stage 0.0 (TID 78) in 5136 ms on bigdata.node3 (executor 31) (133/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 98.0 in stage 0.0 (TID 98) in 5040 ms on bigdata.node3 (executor 1) (134/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 2.0 in stage 0.0 (TID 2) in 5966 ms on bigdata.node3 (executor 31) (135/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 96.0 in stage 0.0 (TID 96) in 5091 ms on bigdata.node3 (executor 21) (136/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 134.0 in stage 0.0 (TID 134) in 4576 ms on bigdata.node3 (executor 21) (137/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 58.0 in stage 0.0 (TID 58) in 5295 ms on bigdata.node3 (executor 21) (138/152)
20/06/11 14:28:52 INFO TaskSetManager: Finished task 70.0 in stage 0.0 (TID 70) in 5244 ms on bigdata.node2 (executor 28) (139/152)
20/06/11 14:28:53 INFO TaskSetManager: Finished task 81.0 in stage 0.0 (TID 81) in 5596 ms on bigdata.node2 (executor 2) (140/152)
20/06/11 14:28:53 INFO TaskSetManager: Finished task 141.0 in stage 0.0 (TID 141) in 5041 ms on bigdata.node4 (executor 29) (141/152)
20/06/11 14:28:53 INFO TaskSetManager: Finished task 131.0 in stage 0.0 (TID 131) in 5416 ms on bigdata.node1 (executor 23) (142/152)
20/06/11 14:28:53 INFO TaskSetManager: Finished task 101.0 in stage 0.0 (TID 101) in 6126 ms on bigdata.node2 (executor 7) (143/152)
20/06/11 14:28:53 INFO TaskSetManager: Finished task 91.0 in stage 0.0 (TID 91) in 6319 ms on bigdata.node1 (executor 38) (144/152)
20/06/11 14:28:54 INFO TaskSetManager: Finished task 151.0 in stage 0.0 (TID 151) in 5789 ms on bigdata.node2 (executor 22) (145/152)
20/06/11 14:28:54 INFO TaskSetManager: Finished task 121.0 in stage 0.0 (TID 121) in 5976 ms on bigdata.node1 (executor 32) (146/152)
20/06/11 14:28:55 INFO TaskSetManager: Finished task 30.0 in stage 0.0 (TID 30) in 8307 ms on bigdata.node3 (executor 11) (147/152)
20/06/11 14:28:55 INFO TaskSetManager: Finished task 40.0 in stage 0.0 (TID 40) in 8381 ms on bigdata.node3 (executor 31) (148/152)
20/06/11 14:28:55 INFO TaskSetManager: Finished task 60.0 in stage 0.0 (TID 60) in 8516 ms on bigdata.node3 (executor 1) (149/152)
20/06/11 14:28:56 INFO TaskSetManager: Finished task 10.0 in stage 0.0 (TID 10) in 9169 ms on bigdata.node3 (executor 26) (150/152)
20/06/11 14:28:56 INFO TaskSetManager: Finished task 20.0 in stage 0.0 (TID 20) in 9169 ms on bigdata.node3 (executor 21) (151/152)
20/06/11 14:28:56 INFO TaskSetManager: Finished task 111.0 in stage 0.0 (TID 111) in 8396 ms on bigdata.node3 (executor 16) (152/152)
20/06/11 14:28:56 INFO YarnScheduler: Removed TaskSet 0.0, whose tasks have all completed, from pool
20/06/11 14:28:56 INFO DAGScheduler: ResultStage 0 (collect at SparkBuildDictionary.java:168) finished in 9.436 s
20/06/11 14:28:56 INFO DAGScheduler: Job 0 finished: collect at SparkBuildDictionary.java:168, took 10.968914 s
20/06/11 14:28:56 INFO SparkContext: Starting job: collect at SparkBuildDictionary.java:177
20/06/11 14:28:56 INFO DAGScheduler: Registering RDD 4 (mapToPair at SparkBuildDictionary.java:173)
20/06/11 14:28:56 INFO DAGScheduler: Got job 1 (collect at SparkBuildDictionary.java:177) with 160 output partitions
20/06/11 14:28:56 INFO DAGScheduler: Final stage: ResultStage 2 (collect at SparkBuildDictionary.java:177)
20/06/11 14:28:56 INFO DAGScheduler: Parents of final stage: List(ShuffleMapStage 1)
20/06/11 14:28:56 INFO DAGScheduler: Missing parents: List(ShuffleMapStage 1)
20/06/11 14:28:56 INFO DAGScheduler: Submitting ShuffleMapStage 1 (MapPartitionsRDD[4] at mapToPair at SparkBuildDictionary.java:173), which has no missing parents
20/06/11 14:28:56 INFO MemoryStore: Block broadcast_1 stored as values in memory (estimated size 12.3 KB, free 10.5 GB)
20/06/11 14:28:56 INFO MemoryStore: Block broadcast_1_piece0 stored as bytes in memory (estimated size 6.7 KB, free 10.5 GB)
20/06/11 14:28:56 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on 10.150.64.72:37065 (size: 6.7 KB, free: 10.5 GB)
20/06/11 14:28:56 INFO SparkContext: Created broadcast 1 from broadcast at DAGScheduler.scala:1006
20/06/11 14:28:56 INFO DAGScheduler: Submitting 160 missing tasks from ShuffleMapStage 1 (MapPartitionsRDD[4] at mapToPair at SparkBuildDictionary.java:173) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
20/06/11 14:28:56 INFO YarnScheduler: Adding task set 1.0 with 160 tasks
20/06/11 14:28:56 INFO TaskSetManager: Starting task 0.0 in stage 1.0 (TID 152, bigdata.node3, executor 21, partition 0, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 1.0 in stage 1.0 (TID 153, bigdata.node4, executor 29, partition 1, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 2.0 in stage 1.0 (TID 154, bigdata.node1, executor 32, partition 2, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 3.0 in stage 1.0 (TID 155, bigdata.node4, executor 34, partition 3, PROCESS_LOCAL, 15528 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 4.0 in stage 1.0 (TID 156, bigdata.node2, executor 22, partition 4, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 5.0 in stage 1.0 (TID 157, bigdata.node5, executor 30, partition 5, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 6.0 in stage 1.0 (TID 158, bigdata.node2, executor 33, partition 6, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 7.0 in stage 1.0 (TID 159, bigdata.node4, executor 24, partition 7, PROCESS_LOCAL, 15521 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 8.0 in stage 1.0 (TID 160, bigdata.node1, executor 13, partition 8, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 9.0 in stage 1.0 (TID 161, bigdata.node2, executor 17, partition 9, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 10.0 in stage 1.0 (TID 162, bigdata.node2, executor 7, partition 10, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 11.0 in stage 1.0 (TID 163, bigdata.node3, executor 37, partition 11, PROCESS_LOCAL, 15519 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 12.0 in stage 1.0 (TID 164, bigdata.node5, executor 25, partition 12, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 13.0 in stage 1.0 (TID 165, bigdata.node4, executor 4, partition 13, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 14.0 in stage 1.0 (TID 166, bigdata.node5, executor 10, partition 14, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 15.0 in stage 1.0 (TID 167, bigdata.node3, executor 26, partition 15, PROCESS_LOCAL, 15519 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 16.0 in stage 1.0 (TID 168, bigdata.node5, executor 20, partition 16, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 17.0 in stage 1.0 (TID 169, bigdata.node1, executor 3, partition 17, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 18.0 in stage 1.0 (TID 170, bigdata.node5, executor 15, partition 18, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 19.0 in stage 1.0 (TID 171, bigdata.node3, executor 6, partition 19, PROCESS_LOCAL, 15529 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 20.0 in stage 1.0 (TID 172, bigdata.node3, executor 31, partition 20, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 21.0 in stage 1.0 (TID 173, bigdata.node1, executor 38, partition 21, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 22.0 in stage 1.0 (TID 174, bigdata.node5, executor 5, partition 22, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 23.0 in stage 1.0 (TID 175, bigdata.node4, executor 9, partition 23, PROCESS_LOCAL, 15524 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 24.0 in stage 1.0 (TID 176, bigdata.node1, executor 23, partition 24, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 25.0 in stage 1.0 (TID 177, bigdata.node4, executor 14, partition 25, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 26.0 in stage 1.0 (TID 178, bigdata.node1, executor 8, partition 26, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 27.0 in stage 1.0 (TID 179, bigdata.node2, executor 39, partition 27, PROCESS_LOCAL, 15523 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 28.0 in stage 1.0 (TID 180, bigdata.node5, executor 36, partition 28, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 29.0 in stage 1.0 (TID 181, bigdata.node3, executor 11, partition 29, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 30.0 in stage 1.0 (TID 182, bigdata.node3, executor 1, partition 30, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 31.0 in stage 1.0 (TID 183, bigdata.node4, executor 19, partition 31, PROCESS_LOCAL, 15525 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 32.0 in stage 1.0 (TID 184, bigdata.node3, executor 16, partition 32, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 33.0 in stage 1.0 (TID 185, bigdata.node2, executor 12, partition 33, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 34.0 in stage 1.0 (TID 186, bigdata.node1, executor 18, partition 34, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 35.0 in stage 1.0 (TID 187, bigdata.node4, executor 40, partition 35, PROCESS_LOCAL, 15524 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 36.0 in stage 1.0 (TID 188, bigdata.node1, executor 27, partition 36, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 37.0 in stage 1.0 (TID 189, bigdata.node2, executor 28, partition 37, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 38.0 in stage 1.0 (TID 190, bigdata.node5, executor 35, partition 38, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 39.0 in stage 1.0 (TID 191, bigdata.node2, executor 2, partition 39, PROCESS_LOCAL, 15531 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 40.0 in stage 1.0 (TID 192, bigdata.node3, executor 21, partition 40, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 41.0 in stage 1.0 (TID 193, bigdata.node4, executor 29, partition 41, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 42.0 in stage 1.0 (TID 194, bigdata.node1, executor 32, partition 42, PROCESS_LOCAL, 15522 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 43.0 in stage 1.0 (TID 195, bigdata.node4, executor 34, partition 43, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 44.0 in stage 1.0 (TID 196, bigdata.node2, executor 22, partition 44, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 45.0 in stage 1.0 (TID 197, bigdata.node5, executor 30, partition 45, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 46.0 in stage 1.0 (TID 198, bigdata.node2, executor 33, partition 46, PROCESS_LOCAL, 15531 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 47.0 in stage 1.0 (TID 199, bigdata.node4, executor 24, partition 47, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 48.0 in stage 1.0 (TID 200, bigdata.node1, executor 13, partition 48, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 49.0 in stage 1.0 (TID 201, bigdata.node2, executor 17, partition 49, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 50.0 in stage 1.0 (TID 202, bigdata.node2, executor 7, partition 50, PROCESS_LOCAL, 15530 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 51.0 in stage 1.0 (TID 203, bigdata.node3, executor 37, partition 51, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 52.0 in stage 1.0 (TID 204, bigdata.node5, executor 25, partition 52, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 53.0 in stage 1.0 (TID 205, bigdata.node4, executor 4, partition 53, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 54.0 in stage 1.0 (TID 206, bigdata.node5, executor 10, partition 54, PROCESS_LOCAL, 15524 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 55.0 in stage 1.0 (TID 207, bigdata.node3, executor 26, partition 55, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 56.0 in stage 1.0 (TID 208, bigdata.node5, executor 20, partition 56, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 57.0 in stage 1.0 (TID 209, bigdata.node1, executor 3, partition 57, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 58.0 in stage 1.0 (TID 210, bigdata.node5, executor 15, partition 58, PROCESS_LOCAL, 15526 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 59.0 in stage 1.0 (TID 211, bigdata.node3, executor 6, partition 59, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 60.0 in stage 1.0 (TID 212, bigdata.node3, executor 31, partition 60, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 61.0 in stage 1.0 (TID 213, bigdata.node1, executor 38, partition 61, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 62.0 in stage 1.0 (TID 214, bigdata.node5, executor 5, partition 62, PROCESS_LOCAL, 15894 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 63.0 in stage 1.0 (TID 215, bigdata.node4, executor 9, partition 63, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 64.0 in stage 1.0 (TID 216, bigdata.node1, executor 23, partition 64, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 65.0 in stage 1.0 (TID 217, bigdata.node4, executor 14, partition 65, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 66.0 in stage 1.0 (TID 218, bigdata.node1, executor 8, partition 66, PROCESS_LOCAL, 15894 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 67.0 in stage 1.0 (TID 219, bigdata.node2, executor 39, partition 67, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 68.0 in stage 1.0 (TID 220, bigdata.node5, executor 36, partition 68, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 69.0 in stage 1.0 (TID 221, bigdata.node3, executor 11, partition 69, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 70.0 in stage 1.0 (TID 222, bigdata.node3, executor 1, partition 70, PROCESS_LOCAL, 16097 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 71.0 in stage 1.0 (TID 223, bigdata.node4, executor 19, partition 71, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 72.0 in stage 1.0 (TID 224, bigdata.node3, executor 16, partition 72, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 73.0 in stage 1.0 (TID 225, bigdata.node2, executor 12, partition 73, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 74.0 in stage 1.0 (TID 226, bigdata.node1, executor 18, partition 74, PROCESS_LOCAL, 15971 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 75.0 in stage 1.0 (TID 227, bigdata.node4, executor 40, partition 75, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 76.0 in stage 1.0 (TID 228, bigdata.node1, executor 27, partition 76, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 77.0 in stage 1.0 (TID 229, bigdata.node2, executor 28, partition 77, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 78.0 in stage 1.0 (TID 230, bigdata.node5, executor 35, partition 78, PROCESS_LOCAL, 15970 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 79.0 in stage 1.0 (TID 231, bigdata.node2, executor 2, partition 79, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 80.0 in stage 1.0 (TID 232, bigdata.node3, executor 21, partition 80, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 81.0 in stage 1.0 (TID 233, bigdata.node4, executor 29, partition 81, PROCESS_LOCAL, 15941 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 82.0 in stage 1.0 (TID 234, bigdata.node1, executor 32, partition 82, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 83.0 in stage 1.0 (TID 235, bigdata.node4, executor 34, partition 83, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 84.0 in stage 1.0 (TID 236, bigdata.node2, executor 22, partition 84, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 85.0 in stage 1.0 (TID 237, bigdata.node5, executor 30, partition 85, PROCESS_LOCAL, 15941 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 86.0 in stage 1.0 (TID 238, bigdata.node2, executor 33, partition 86, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 87.0 in stage 1.0 (TID 239, bigdata.node4, executor 24, partition 87, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 88.0 in stage 1.0 (TID 240, bigdata.node1, executor 13, partition 88, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 89.0 in stage 1.0 (TID 241, bigdata.node2, executor 17, partition 89, PROCESS_LOCAL, 15879 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 90.0 in stage 1.0 (TID 242, bigdata.node2, executor 7, partition 90, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 91.0 in stage 1.0 (TID 243, bigdata.node3, executor 37, partition 91, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 92.0 in stage 1.0 (TID 244, bigdata.node5, executor 25, partition 92, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 93.0 in stage 1.0 (TID 245, bigdata.node4, executor 4, partition 93, PROCESS_LOCAL, 15847 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 94.0 in stage 1.0 (TID 246, bigdata.node5, executor 10, partition 94, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 95.0 in stage 1.0 (TID 247, bigdata.node3, executor 26, partition 95, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 96.0 in stage 1.0 (TID 248, bigdata.node5, executor 20, partition 96, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 97.0 in stage 1.0 (TID 249, bigdata.node1, executor 3, partition 97, PROCESS_LOCAL, 15910 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 98.0 in stage 1.0 (TID 250, bigdata.node5, executor 15, partition 98, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 99.0 in stage 1.0 (TID 251, bigdata.node3, executor 6, partition 99, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 100.0 in stage 1.0 (TID 252, bigdata.node3, executor 31, partition 100, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 101.0 in stage 1.0 (TID 253, bigdata.node1, executor 38, partition 101, PROCESS_LOCAL, 15910 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 102.0 in stage 1.0 (TID 254, bigdata.node5, executor 5, partition 102, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 103.0 in stage 1.0 (TID 255, bigdata.node4, executor 9, partition 103, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 104.0 in stage 1.0 (TID 256, bigdata.node1, executor 23, partition 104, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 105.0 in stage 1.0 (TID 257, bigdata.node4, executor 14, partition 105, PROCESS_LOCAL, 16107 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 106.0 in stage 1.0 (TID 258, bigdata.node1, executor 8, partition 106, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 107.0 in stage 1.0 (TID 259, bigdata.node2, executor 39, partition 107, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 108.0 in stage 1.0 (TID 260, bigdata.node5, executor 36, partition 108, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 109.0 in stage 1.0 (TID 261, bigdata.node3, executor 11, partition 109, PROCESS_LOCAL, 16107 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 110.0 in stage 1.0 (TID 262, bigdata.node3, executor 1, partition 110, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 111.0 in stage 1.0 (TID 263, bigdata.node4, executor 19, partition 111, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 112.0 in stage 1.0 (TID 264, bigdata.node3, executor 16, partition 112, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 113.0 in stage 1.0 (TID 265, bigdata.node2, executor 12, partition 113, PROCESS_LOCAL, 16112 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 114.0 in stage 1.0 (TID 266, bigdata.node1, executor 18, partition 114, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 115.0 in stage 1.0 (TID 267, bigdata.node4, executor 40, partition 115, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 116.0 in stage 1.0 (TID 268, bigdata.node1, executor 27, partition 116, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 117.0 in stage 1.0 (TID 269, bigdata.node2, executor 28, partition 117, PROCESS_LOCAL, 16112 bytes)
20/06/11 14:28:56 INFO TaskSetManager: Starting task 118.0 in stage 1.0 (TID 270, bigdata.node5, executor 35, partition 118, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 119.0 in stage 1.0 (TID 271, bigdata.node2, executor 2, partition 119, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 120.0 in stage 1.0 (TID 272, bigdata.node3, executor 21, partition 120, PROCESS_LOCAL, 15996 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 121.0 in stage 1.0 (TID 273, bigdata.node4, executor 29, partition 121, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 122.0 in stage 1.0 (TID 274, bigdata.node1, executor 32, partition 122, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 123.0 in stage 1.0 (TID 275, bigdata.node4, executor 34, partition 123, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 124.0 in stage 1.0 (TID 276, bigdata.node2, executor 22, partition 124, PROCESS_LOCAL, 17247 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 125.0 in stage 1.0 (TID 277, bigdata.node5, executor 30, partition 125, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 126.0 in stage 1.0 (TID 278, bigdata.node2, executor 33, partition 126, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 127.0 in stage 1.0 (TID 279, bigdata.node4, executor 24, partition 127, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 128.0 in stage 1.0 (TID 280, bigdata.node1, executor 13, partition 128, PROCESS_LOCAL, 17247 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 129.0 in stage 1.0 (TID 281, bigdata.node2, executor 17, partition 129, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 130.0 in stage 1.0 (TID 282, bigdata.node2, executor 7, partition 130, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 131.0 in stage 1.0 (TID 283, bigdata.node3, executor 37, partition 131, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 132.0 in stage 1.0 (TID 284, bigdata.node5, executor 25, partition 132, PROCESS_LOCAL, 17247 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 133.0 in stage 1.0 (TID 285, bigdata.node4, executor 4, partition 133, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 134.0 in stage 1.0 (TID 286, bigdata.node5, executor 10, partition 134, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 135.0 in stage 1.0 (TID 287, bigdata.node3, executor 26, partition 135, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 136.0 in stage 1.0 (TID 288, bigdata.node5, executor 20, partition 136, PROCESS_LOCAL, 17247 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 137.0 in stage 1.0 (TID 289, bigdata.node1, executor 3, partition 137, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 138.0 in stage 1.0 (TID 290, bigdata.node5, executor 15, partition 138, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 139.0 in stage 1.0 (TID 291, bigdata.node3, executor 6, partition 139, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 140.0 in stage 1.0 (TID 292, bigdata.node3, executor 31, partition 140, PROCESS_LOCAL, 15883 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 141.0 in stage 1.0 (TID 293, bigdata.node1, executor 38, partition 141, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 142.0 in stage 1.0 (TID 294, bigdata.node5, executor 5, partition 142, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 143.0 in stage 1.0 (TID 295, bigdata.node4, executor 9, partition 143, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 144.0 in stage 1.0 (TID 296, bigdata.node1, executor 23, partition 144, PROCESS_LOCAL, 15914 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 145.0 in stage 1.0 (TID 297, bigdata.node4, executor 14, partition 145, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 146.0 in stage 1.0 (TID 298, bigdata.node1, executor 8, partition 146, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 147.0 in stage 1.0 (TID 299, bigdata.node2, executor 39, partition 147, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 148.0 in stage 1.0 (TID 300, bigdata.node5, executor 36, partition 148, PROCESS_LOCAL, 15914 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 149.0 in stage 1.0 (TID 301, bigdata.node3, executor 11, partition 149, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 150.0 in stage 1.0 (TID 302, bigdata.node3, executor 1, partition 150, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 151.0 in stage 1.0 (TID 303, bigdata.node4, executor 19, partition 151, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 152.0 in stage 1.0 (TID 304, bigdata.node3, executor 16, partition 152, PROCESS_LOCAL, 16129 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 153.0 in stage 1.0 (TID 305, bigdata.node2, executor 12, partition 153, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 154.0 in stage 1.0 (TID 306, bigdata.node1, executor 18, partition 154, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 155.0 in stage 1.0 (TID 307, bigdata.node4, executor 40, partition 155, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 156.0 in stage 1.0 (TID 308, bigdata.node1, executor 27, partition 156, PROCESS_LOCAL, 16128 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 157.0 in stage 1.0 (TID 309, bigdata.node2, executor 28, partition 157, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 158.0 in stage 1.0 (TID 310, bigdata.node5, executor 35, partition 158, PROCESS_LOCAL, 4678 bytes)
20/06/11 14:28:57 INFO TaskSetManager: Starting task 159.0 in stage 1.0 (TID 311, bigdata.node2, executor 2, partition 159, PROCESS_LOCAL, 16129 bytes)
20/06/11 14:28:57 INFO ExecutorAllocationManager: Requesting 40 new executors because tasks are backlogged (new desired total will be 40)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:39225 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:42939 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:39742 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:40888 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:35102 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:46435 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:33477 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:40621 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:35832 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:43374 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:57 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:45659 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:42594 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 79.0 in stage 1.0 (TID 231) in 1734 ms on bigdata.node2 (executor 2) (1/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 119.0 in stage 1.0 (TID 271) in 1454 ms on bigdata.node2 (executor 2) (2/160)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:42310 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:45797 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:44897 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:46439 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 36.0 in stage 1.0 (TID 188) in 2142 ms on bigdata.node1 (executor 27) (3/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 99.0 in stage 1.0 (TID 251) in 1786 ms on bigdata.node3 (executor 6) (4/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 59.0 in stage 1.0 (TID 211) in 2039 ms on bigdata.node3 (executor 6) (5/160)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:38757 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 139.0 in stage 1.0 (TID 291) in 1510 ms on bigdata.node3 (executor 6) (6/160)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:42620 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:45063 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 80.0 in stage 1.0 (TID 232) in 2020 ms on bigdata.node3 (executor 21) (7/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 76.0 in stage 1.0 (TID 228) in 2043 ms on bigdata.node1 (executor 27) (8/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 116.0 in stage 1.0 (TID 268) in 1783 ms on bigdata.node1 (executor 27) (9/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 8.0 in stage 1.0 (TID 160) in 2446 ms on bigdata.node1 (executor 13) (10/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 48.0 in stage 1.0 (TID 200) in 2228 ms on bigdata.node1 (executor 13) (11/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 88.0 in stage 1.0 (TID 240) in 1996 ms on bigdata.node1 (executor 13) (12/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 26.0 in stage 1.0 (TID 178) in 2413 ms on bigdata.node1 (executor 8) (13/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 146.0 in stage 1.0 (TID 298) in 1639 ms on bigdata.node1 (executor 8) (14/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 106.0 in stage 1.0 (TID 258) in 1939 ms on bigdata.node1 (executor 8) (15/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 0.0 in stage 1.0 (TID 152) in 2700 ms on bigdata.node3 (executor 21) (16/160)
20/06/11 14:28:58 INFO TaskSetManager: Finished task 40.0 in stage 1.0 (TID 192) in 2481 ms on bigdata.node3 (executor 21) (17/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:46835 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node1:44479 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 73.0 in stage 1.0 (TID 225) in 2467 ms on bigdata.node2 (executor 12) (18/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 153.0 in stage 1.0 (TID 305) in 1909 ms on bigdata.node2 (executor 12) (19/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 33.0 in stage 1.0 (TID 185) in 2710 ms on bigdata.node2 (executor 12) (20/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 154.0 in stage 1.0 (TID 306) in 1925 ms on bigdata.node1 (executor 18) (21/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 34.0 in stage 1.0 (TID 186) in 2721 ms on bigdata.node1 (executor 18) (22/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 141.0 in stage 1.0 (TID 293) in 2031 ms on bigdata.node1 (executor 38) (23/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 114.0 in stage 1.0 (TID 266) in 2237 ms on bigdata.node1 (executor 18) (24/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 61.0 in stage 1.0 (TID 213) in 2581 ms on bigdata.node1 (executor 38) (25/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 21.0 in stage 1.0 (TID 173) in 2817 ms on bigdata.node1 (executor 38) (26/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 64.0 in stage 1.0 (TID 216) in 2572 ms on bigdata.node1 (executor 23) (27/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 24.0 in stage 1.0 (TID 176) in 2815 ms on bigdata.node1 (executor 23) (28/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 104.0 in stage 1.0 (TID 256) in 2314 ms on bigdata.node1 (executor 23) (29/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 100.0 in stage 1.0 (TID 252) in 2351 ms on bigdata.node3 (executor 31) (30/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:42875 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:39170 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 120.0 in stage 1.0 (TID 272) in 2289 ms on bigdata.node3 (executor 21) (31/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:42500 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:39585 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 82.0 in stage 1.0 (TID 234) in 2559 ms on bigdata.node1 (executor 32) (32/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:38827 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 17.0 in stage 1.0 (TID 169) in 2930 ms on bigdata.node1 (executor 3) (33/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:34226 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 22.0 in stage 1.0 (TID 174) in 2905 ms on bigdata.node5 (executor 5) (34/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:43242 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:43881 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 57.0 in stage 1.0 (TID 209) in 2703 ms on bigdata.node1 (executor 3) (35/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 2.0 in stage 1.0 (TID 154) in 3012 ms on bigdata.node1 (executor 32) (36/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:39145 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 137.0 in stage 1.0 (TID 289) in 2168 ms on bigdata.node1 (executor 3) (37/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 122.0 in stage 1.0 (TID 274) in 2274 ms on bigdata.node1 (executor 32) (38/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:45001 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 145.0 in stage 1.0 (TID 297) in 2105 ms on bigdata.node4 (executor 14) (39/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 25.0 in stage 1.0 (TID 177) in 2891 ms on bigdata.node4 (executor 14) (40/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 65.0 in stage 1.0 (TID 217) in 2657 ms on bigdata.node4 (executor 14) (41/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 38.0 in stage 1.0 (TID 190) in 2821 ms on bigdata.node5 (executor 35) (42/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 102.0 in stage 1.0 (TID 254) in 2420 ms on bigdata.node5 (executor 5) (43/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 125.0 in stage 1.0 (TID 277) in 2264 ms on bigdata.node5 (executor 30) (44/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 142.0 in stage 1.0 (TID 294) in 2150 ms on bigdata.node5 (executor 5) (45/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 45.0 in stage 1.0 (TID 197) in 2796 ms on bigdata.node5 (executor 30) (46/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 5.0 in stage 1.0 (TID 157) in 3022 ms on bigdata.node5 (executor 30) (47/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 118.0 in stage 1.0 (TID 270) in 2334 ms on bigdata.node5 (executor 35) (48/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 158.0 in stage 1.0 (TID 310) in 2051 ms on bigdata.node5 (executor 35) (49/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:45783 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:36676 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 92.0 in stage 1.0 (TID 244) in 2538 ms on bigdata.node5 (executor 25) (50/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 52.0 in stage 1.0 (TID 204) in 2784 ms on bigdata.node5 (executor 25) (51/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node3:36727 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 12.0 in stage 1.0 (TID 164) in 3010 ms on bigdata.node5 (executor 25) (52/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 96.0 in stage 1.0 (TID 248) in 2562 ms on bigdata.node5 (executor 20) (53/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 56.0 in stage 1.0 (TID 208) in 2823 ms on bigdata.node5 (executor 20) (54/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 16.0 in stage 1.0 (TID 168) in 3055 ms on bigdata.node5 (executor 20) (55/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 39.0 in stage 1.0 (TID 191) in 2937 ms on bigdata.node2 (executor 2) (56/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 144.0 in stage 1.0 (TID 296) in 2242 ms on bigdata.node1 (executor 23) (57/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 49.0 in stage 1.0 (TID 201) in 2925 ms on bigdata.node2 (executor 17) (58/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 129.0 in stage 1.0 (TID 281) in 2408 ms on bigdata.node2 (executor 17) (59/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 9.0 in stage 1.0 (TID 161) in 3151 ms on bigdata.node2 (executor 17) (60/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 101.0 in stage 1.0 (TID 253) in 2607 ms on bigdata.node1 (executor 38) (61/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 37.0 in stage 1.0 (TID 189) in 3007 ms on bigdata.node2 (executor 28) (62/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 157.0 in stage 1.0 (TID 309) in 2215 ms on bigdata.node2 (executor 28) (63/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 159.0 in stage 1.0 (TID 311) in 2204 ms on bigdata.node2 (executor 2) (64/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 77.0 in stage 1.0 (TID 229) in 2776 ms on bigdata.node2 (executor 28) (65/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:37434 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 84.0 in stage 1.0 (TID 236) in 2764 ms on bigdata.node2 (executor 22) (66/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 4.0 in stage 1.0 (TID 156) in 3220 ms on bigdata.node2 (executor 22) (67/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 44.0 in stage 1.0 (TID 196) in 3001 ms on bigdata.node2 (executor 22) (68/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 10.0 in stage 1.0 (TID 162) in 3220 ms on bigdata.node2 (executor 7) (69/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 90.0 in stage 1.0 (TID 242) in 2763 ms on bigdata.node2 (executor 7) (70/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 130.0 in stage 1.0 (TID 282) in 2484 ms on bigdata.node2 (executor 7) (71/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node2:42353 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 117.0 in stage 1.0 (TID 269) in 2659 ms on bigdata.node2 (executor 28) (72/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 124.0 in stage 1.0 (TID 276) in 2628 ms on bigdata.node2 (executor 22) (73/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node5:36776 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 42.0 in stage 1.0 (TID 194) in 3166 ms on bigdata.node1 (executor 32) (74/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 50.0 in stage 1.0 (TID 202) in 3146 ms on bigdata.node2 (executor 7) (75/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 14.0 in stage 1.0 (TID 166) in 3380 ms on bigdata.node5 (executor 10) (76/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 134.0 in stage 1.0 (TID 286) in 2633 ms on bigdata.node5 (executor 10) (77/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 94.0 in stage 1.0 (TID 246) in 2913 ms on bigdata.node5 (executor 10) (78/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 98.0 in stage 1.0 (TID 250) in 2899 ms on bigdata.node5 (executor 15) (79/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 18.0 in stage 1.0 (TID 170) in 3382 ms on bigdata.node5 (executor 15) (80/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 69.0 in stage 1.0 (TID 221) in 3090 ms on bigdata.node3 (executor 11) (81/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 29.0 in stage 1.0 (TID 181) in 3325 ms on bigdata.node3 (executor 11) (82/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 149.0 in stage 1.0 (TID 301) in 2533 ms on bigdata.node3 (executor 11) (83/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 138.0 in stage 1.0 (TID 290) in 2617 ms on bigdata.node5 (executor 15) (84/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 115.0 in stage 1.0 (TID 267) in 2790 ms on bigdata.node4 (executor 40) (85/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 28.0 in stage 1.0 (TID 180) in 3360 ms on bigdata.node5 (executor 36) (86/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 68.0 in stage 1.0 (TID 220) in 3124 ms on bigdata.node5 (executor 36) (87/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 108.0 in stage 1.0 (TID 260) in 2861 ms on bigdata.node5 (executor 36) (88/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 112.0 in stage 1.0 (TID 264) in 2840 ms on bigdata.node3 (executor 16) (89/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 32.0 in stage 1.0 (TID 184) in 3343 ms on bigdata.node3 (executor 16) (90/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 135.0 in stage 1.0 (TID 287) in 2685 ms on bigdata.node3 (executor 26) (91/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 95.0 in stage 1.0 (TID 247) in 2966 ms on bigdata.node3 (executor 26) (92/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 75.0 in stage 1.0 (TID 227) in 3098 ms on bigdata.node4 (executor 40) (93/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 72.0 in stage 1.0 (TID 224) in 3116 ms on bigdata.node3 (executor 16) (94/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 55.0 in stage 1.0 (TID 207) in 3219 ms on bigdata.node3 (executor 26) (95/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 121.0 in stage 1.0 (TID 273) in 2788 ms on bigdata.node4 (executor 29) (96/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 155.0 in stage 1.0 (TID 307) in 2547 ms on bigdata.node4 (executor 40) (97/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 1.0 in stage 1.0 (TID 153) in 3530 ms on bigdata.node4 (executor 29) (98/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 41.0 in stage 1.0 (TID 193) in 3311 ms on bigdata.node4 (executor 29) (99/160)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:35808 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:42767 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 60.0 in stage 1.0 (TID 212) in 3235 ms on bigdata.node3 (executor 31) (100/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 20.0 in stage 1.0 (TID 172) in 3466 ms on bigdata.node3 (executor 31) (101/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 127.0 in stage 1.0 (TID 279) in 2915 ms on bigdata.node4 (executor 24) (102/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 54.0 in stage 1.0 (TID 206) in 3393 ms on bigdata.node5 (executor 10) (103/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 87.0 in stage 1.0 (TID 239) in 3202 ms on bigdata.node4 (executor 24) (104/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 47.0 in stage 1.0 (TID 199) in 3434 ms on bigdata.node4 (executor 24) (105/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 109.0 in stage 1.0 (TID 261) in 3041 ms on bigdata.node3 (executor 11) (106/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 91.0 in stage 1.0 (TID 243) in 3206 ms on bigdata.node3 (executor 37) (107/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 131.0 in stage 1.0 (TID 283) in 2923 ms on bigdata.node3 (executor 37) (108/160)
20/06/11 14:28:59 INFO TaskSetManager: Finished task 51.0 in stage 1.0 (TID 203) in 3443 ms on bigdata.node3 (executor 37) (109/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 152.0 in stage 1.0 (TID 304) in 2899 ms on bigdata.node3 (executor 16) (110/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 81.0 in stage 1.0 (TID 233) in 3458 ms on bigdata.node4 (executor 29) (111/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 63.0 in stage 1.0 (TID 215) in 3568 ms on bigdata.node4 (executor 9) (112/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 103.0 in stage 1.0 (TID 255) in 3305 ms on bigdata.node4 (executor 9) (113/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 143.0 in stage 1.0 (TID 295) in 3023 ms on bigdata.node4 (executor 9) (114/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 140.0 in stage 1.0 (TID 292) in 3059 ms on bigdata.node3 (executor 31) (115/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 15.0 in stage 1.0 (TID 167) in 3871 ms on bigdata.node3 (executor 26) (116/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 30.0 in stage 1.0 (TID 182) in 3795 ms on bigdata.node3 (executor 1) (117/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 147.0 in stage 1.0 (TID 299) in 3159 ms on bigdata.node2 (executor 39) (118/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 107.0 in stage 1.0 (TID 259) in 3447 ms on bigdata.node2 (executor 39) (119/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 67.0 in stage 1.0 (TID 219) in 3717 ms on bigdata.node2 (executor 39) (120/160)
20/06/11 14:29:00 INFO BlockManagerInfo: Added broadcast_1_piece0 in memory on bigdata.node4:34759 (size: 6.7 KB, free: 4.1 GB)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 123.0 in stage 1.0 (TID 275) in 3368 ms on bigdata.node4 (executor 34) (121/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 83.0 in stage 1.0 (TID 235) in 3656 ms on bigdata.node4 (executor 34) (122/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 150.0 in stage 1.0 (TID 302) in 3177 ms on bigdata.node3 (executor 1) (123/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 110.0 in stage 1.0 (TID 262) in 3470 ms on bigdata.node3 (executor 1) (124/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 43.0 in stage 1.0 (TID 195) in 3893 ms on bigdata.node4 (executor 34) (125/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 151.0 in stage 1.0 (TID 303) in 3174 ms on bigdata.node4 (executor 19) (126/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 71.0 in stage 1.0 (TID 223) in 3734 ms on bigdata.node4 (executor 19) (127/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 111.0 in stage 1.0 (TID 263) in 3467 ms on bigdata.node4 (executor 19) (128/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 133.0 in stage 1.0 (TID 285) in 3356 ms on bigdata.node4 (executor 4) (129/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 53.0 in stage 1.0 (TID 205) in 3891 ms on bigdata.node4 (executor 4) (130/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 13.0 in stage 1.0 (TID 165) in 4116 ms on bigdata.node4 (executor 4) (131/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 6.0 in stage 1.0 (TID 158) in 4166 ms on bigdata.node2 (executor 33) (132/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 126.0 in stage 1.0 (TID 278) in 3423 ms on bigdata.node2 (executor 33) (133/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 86.0 in stage 1.0 (TID 238) in 3708 ms on bigdata.node2 (executor 33) (134/160)
20/06/11 14:29:00 INFO TaskSetManager: Finished task 70.0 in stage 1.0 (TID 222) in 3874 ms on bigdata.node3 (executor 1) (135/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 19.0 in stage 1.0 (TID 171) in 4712 ms on bigdata.node3 (executor 6) (136/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 66.0 in stage 1.0 (TID 218) in 4724 ms on bigdata.node1 (executor 8) (137/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 156.0 in stage 1.0 (TID 308) in 4254 ms on bigdata.node1 (executor 27) (138/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 97.0 in stage 1.0 (TID 249) in 4707 ms on bigdata.node1 (executor 3) (139/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 128.0 in stage 1.0 (TID 280) in 4520 ms on bigdata.node1 (executor 13) (140/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 113.0 in stage 1.0 (TID 265) in 4628 ms on bigdata.node2 (executor 12) (141/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 74.0 in stage 1.0 (TID 226) in 4943 ms on bigdata.node1 (executor 18) (142/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 11.0 in stage 1.0 (TID 163) in 5430 ms on bigdata.node3 (executor 37) (143/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 78.0 in stage 1.0 (TID 230) in 5133 ms on bigdata.node5 (executor 35) (144/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 132.0 in stage 1.0 (TID 284) in 4768 ms on bigdata.node5 (executor 25) (145/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 89.0 in stage 1.0 (TID 241) in 5091 ms on bigdata.node2 (executor 17) (146/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 148.0 in stage 1.0 (TID 300) in 4657 ms on bigdata.node5 (executor 36) (147/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 58.0 in stage 1.0 (TID 210) in 5338 ms on bigdata.node5 (executor 15) (148/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 62.0 in stage 1.0 (TID 214) in 5358 ms on bigdata.node5 (executor 5) (149/160)
20/06/11 14:29:01 INFO TaskSetManager: Finished task 136.0 in stage 1.0 (TID 288) in 4886 ms on bigdata.node5 (executor 20) (150/160)
20/06/11 14:29:02 INFO TaskSetManager: Finished task 85.0 in stage 1.0 (TID 237) in 5641 ms on bigdata.node5 (executor 30) (151/160)
20/06/11 14:29:02 INFO TaskSetManager: Finished task 27.0 in stage 1.0 (TID 179) in 6085 ms on bigdata.node2 (executor 39) (152/160)
20/06/11 14:29:02 INFO TaskSetManager: Finished task 46.0 in stage 1.0 (TID 198) in 6009 ms on bigdata.node2 (executor 33) (153/160)
20/06/11 14:29:02 INFO TaskSetManager: Finished task 35.0 in stage 1.0 (TID 187) in 6423 ms on bigdata.node4 (executor 40) (154/160)
20/06/11 14:29:02 INFO TaskSetManager: Finished task 23.0 in stage 1.0 (TID 175) in 6554 ms on bigdata.node4 (executor 9) (155/160)
20/06/11 14:29:02 INFO TaskSetManager: Finished task 31.0 in stage 1.0 (TID 183) in 6566 ms on bigdata.node4 (executor 19) (156/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 7.0 in stage 1.0 (TID 159) in 6720 ms on bigdata.node4 (executor 24) (157/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 3.0 in stage 1.0 (TID 155) in 6766 ms on bigdata.node4 (executor 34) (158/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 105.0 in stage 1.0 (TID 257) in 6238 ms on bigdata.node4 (executor 14) (159/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 93.0 in stage 1.0 (TID 245) in 6363 ms on bigdata.node4 (executor 4) (160/160)
20/06/11 14:29:03 INFO YarnScheduler: Removed TaskSet 1.0, whose tasks have all completed, from pool
20/06/11 14:29:03 INFO DAGScheduler: ShuffleMapStage 1 (mapToPair at SparkBuildDictionary.java:173) finished in 6.898 s
20/06/11 14:29:03 INFO DAGScheduler: looking for newly runnable stages
20/06/11 14:29:03 INFO DAGScheduler: running: Set()
20/06/11 14:29:03 INFO DAGScheduler: waiting: Set(ResultStage 2)
20/06/11 14:29:03 INFO DAGScheduler: failed: Set()
20/06/11 14:29:03 INFO DAGScheduler: Submitting ResultStage 2 (MapPartitionsRDD[8] at filter at SparkBuildDictionary.java:176), which has no missing parents
20/06/11 14:29:03 INFO MemoryStore: Block broadcast_2 stored as values in memory (estimated size 14.1 KB, free 10.5 GB)
20/06/11 14:29:03 INFO MemoryStore: Block broadcast_2_piece0 stored as bytes in memory (estimated size 7.5 KB, free 10.5 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on 10.150.64.72:37065 (size: 7.5 KB, free: 10.5 GB)
20/06/11 14:29:03 INFO SparkContext: Created broadcast 2 from broadcast at DAGScheduler.scala:1006
20/06/11 14:29:03 INFO DAGScheduler: Submitting 160 missing tasks from ResultStage 2 (MapPartitionsRDD[8] at filter at SparkBuildDictionary.java:176) (first 15 tasks are for partitions Vector(0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14))
20/06/11 14:29:03 INFO YarnScheduler: Adding task set 2.0 with 160 tasks
20/06/11 14:29:03 INFO TaskSetManager: Starting task 21.0 in stage 2.0 (TID 312, bigdata.node5, executor 25, partition 21, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 40.0 in stage 2.0 (TID 313, bigdata.node4, executor 34, partition 40, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 82.0 in stage 2.0 (TID 314, bigdata.node4, executor 40, partition 82, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 51.0 in stage 2.0 (TID 315, bigdata.node3, executor 21, partition 51, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 158.0 in stage 2.0 (TID 316, bigdata.node4, executor 4, partition 158, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 31.0 in stage 2.0 (TID 317, bigdata.node5, executor 36, partition 31, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 64.0 in stage 2.0 (TID 318, bigdata.node2, executor 17, partition 64, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 77.0 in stage 2.0 (TID 319, bigdata.node5, executor 15, partition 77, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 109.0 in stage 2.0 (TID 320, bigdata.node5, executor 30, partition 109, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 115.0 in stage 2.0 (TID 321, bigdata.node1, executor 18, partition 115, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 153.0 in stage 2.0 (TID 322, bigdata.node2, executor 2, partition 153, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 0.0 in stage 2.0 (TID 323, bigdata.node5, executor 25, partition 0, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 1.0 in stage 2.0 (TID 324, bigdata.node4, executor 34, partition 1, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 2.0 in stage 2.0 (TID 325, bigdata.node4, executor 40, partition 2, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 3.0 in stage 2.0 (TID 326, bigdata.node3, executor 21, partition 3, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 4.0 in stage 2.0 (TID 327, bigdata.node4, executor 4, partition 4, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 5.0 in stage 2.0 (TID 328, bigdata.node5, executor 36, partition 5, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 6.0 in stage 2.0 (TID 329, bigdata.node2, executor 17, partition 6, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 7.0 in stage 2.0 (TID 330, bigdata.node5, executor 15, partition 7, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 8.0 in stage 2.0 (TID 331, bigdata.node5, executor 30, partition 8, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 9.0 in stage 2.0 (TID 332, bigdata.node3, executor 1, partition 9, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 10.0 in stage 2.0 (TID 333, bigdata.node3, executor 37, partition 10, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 11.0 in stage 2.0 (TID 334, bigdata.node5, executor 20, partition 11, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 12.0 in stage 2.0 (TID 335, bigdata.node1, executor 18, partition 12, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 13.0 in stage 2.0 (TID 336, bigdata.node5, executor 35, partition 13, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 14.0 in stage 2.0 (TID 337, bigdata.node1, executor 32, partition 14, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 15.0 in stage 2.0 (TID 338, bigdata.node2, executor 2, partition 15, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 16.0 in stage 2.0 (TID 339, bigdata.node4, executor 24, partition 16, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 17.0 in stage 2.0 (TID 340, bigdata.node3, executor 26, partition 17, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 18.0 in stage 2.0 (TID 341, bigdata.node5, executor 10, partition 18, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 19.0 in stage 2.0 (TID 342, bigdata.node3, executor 11, partition 19, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 20.0 in stage 2.0 (TID 343, bigdata.node1, executor 8, partition 20, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 22.0 in stage 2.0 (TID 344, bigdata.node2, executor 12, partition 22, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 23.0 in stage 2.0 (TID 345, bigdata.node2, executor 39, partition 23, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 24.0 in stage 2.0 (TID 346, bigdata.node2, executor 28, partition 24, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 25.0 in stage 2.0 (TID 347, bigdata.node2, executor 33, partition 25, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 26.0 in stage 2.0 (TID 348, bigdata.node2, executor 22, partition 26, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 27.0 in stage 2.0 (TID 349, bigdata.node3, executor 6, partition 27, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 28.0 in stage 2.0 (TID 350, bigdata.node1, executor 23, partition 28, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 29.0 in stage 2.0 (TID 351, bigdata.node4, executor 14, partition 29, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 30.0 in stage 2.0 (TID 352, bigdata.node1, executor 27, partition 30, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 32.0 in stage 2.0 (TID 353, bigdata.node4, executor 19, partition 32, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 33.0 in stage 2.0 (TID 354, bigdata.node4, executor 29, partition 33, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 34.0 in stage 2.0 (TID 355, bigdata.node3, executor 31, partition 34, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 35.0 in stage 2.0 (TID 356, bigdata.node3, executor 16, partition 35, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 36.0 in stage 2.0 (TID 357, bigdata.node1, executor 3, partition 36, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 37.0 in stage 2.0 (TID 358, bigdata.node4, executor 9, partition 37, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 38.0 in stage 2.0 (TID 359, bigdata.node5, executor 5, partition 38, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 39.0 in stage 2.0 (TID 360, bigdata.node2, executor 7, partition 39, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 41.0 in stage 2.0 (TID 361, bigdata.node1, executor 38, partition 41, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 42.0 in stage 2.0 (TID 362, bigdata.node1, executor 13, partition 42, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 43.0 in stage 2.0 (TID 363, bigdata.node5, executor 25, partition 43, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 44.0 in stage 2.0 (TID 364, bigdata.node4, executor 34, partition 44, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 45.0 in stage 2.0 (TID 365, bigdata.node4, executor 40, partition 45, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 46.0 in stage 2.0 (TID 366, bigdata.node3, executor 21, partition 46, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 47.0 in stage 2.0 (TID 367, bigdata.node4, executor 4, partition 47, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 48.0 in stage 2.0 (TID 368, bigdata.node5, executor 36, partition 48, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 49.0 in stage 2.0 (TID 369, bigdata.node2, executor 17, partition 49, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 50.0 in stage 2.0 (TID 370, bigdata.node5, executor 15, partition 50, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 52.0 in stage 2.0 (TID 371, bigdata.node5, executor 30, partition 52, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 53.0 in stage 2.0 (TID 372, bigdata.node3, executor 1, partition 53, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 54.0 in stage 2.0 (TID 373, bigdata.node3, executor 37, partition 54, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 55.0 in stage 2.0 (TID 374, bigdata.node5, executor 20, partition 55, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 56.0 in stage 2.0 (TID 375, bigdata.node1, executor 18, partition 56, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 57.0 in stage 2.0 (TID 376, bigdata.node5, executor 35, partition 57, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 58.0 in stage 2.0 (TID 377, bigdata.node1, executor 32, partition 58, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 59.0 in stage 2.0 (TID 378, bigdata.node2, executor 2, partition 59, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 60.0 in stage 2.0 (TID 379, bigdata.node4, executor 24, partition 60, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 61.0 in stage 2.0 (TID 380, bigdata.node3, executor 26, partition 61, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 62.0 in stage 2.0 (TID 381, bigdata.node5, executor 10, partition 62, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 63.0 in stage 2.0 (TID 382, bigdata.node3, executor 11, partition 63, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 65.0 in stage 2.0 (TID 383, bigdata.node1, executor 8, partition 65, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 66.0 in stage 2.0 (TID 384, bigdata.node2, executor 12, partition 66, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 67.0 in stage 2.0 (TID 385, bigdata.node2, executor 39, partition 67, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 68.0 in stage 2.0 (TID 386, bigdata.node2, executor 28, partition 68, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 69.0 in stage 2.0 (TID 387, bigdata.node2, executor 33, partition 69, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 70.0 in stage 2.0 (TID 388, bigdata.node2, executor 22, partition 70, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 71.0 in stage 2.0 (TID 389, bigdata.node3, executor 6, partition 71, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 72.0 in stage 2.0 (TID 390, bigdata.node1, executor 23, partition 72, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 73.0 in stage 2.0 (TID 391, bigdata.node4, executor 14, partition 73, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 74.0 in stage 2.0 (TID 392, bigdata.node1, executor 27, partition 74, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 75.0 in stage 2.0 (TID 393, bigdata.node4, executor 19, partition 75, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 76.0 in stage 2.0 (TID 394, bigdata.node4, executor 29, partition 76, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 78.0 in stage 2.0 (TID 395, bigdata.node3, executor 31, partition 78, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 79.0 in stage 2.0 (TID 396, bigdata.node3, executor 16, partition 79, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 80.0 in stage 2.0 (TID 397, bigdata.node1, executor 3, partition 80, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 81.0 in stage 2.0 (TID 398, bigdata.node4, executor 9, partition 81, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 83.0 in stage 2.0 (TID 399, bigdata.node5, executor 5, partition 83, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 84.0 in stage 2.0 (TID 400, bigdata.node2, executor 7, partition 84, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 85.0 in stage 2.0 (TID 401, bigdata.node1, executor 38, partition 85, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 86.0 in stage 2.0 (TID 402, bigdata.node1, executor 13, partition 86, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 87.0 in stage 2.0 (TID 403, bigdata.node5, executor 25, partition 87, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 88.0 in stage 2.0 (TID 404, bigdata.node4, executor 34, partition 88, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 89.0 in stage 2.0 (TID 405, bigdata.node4, executor 40, partition 89, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 90.0 in stage 2.0 (TID 406, bigdata.node3, executor 21, partition 90, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 91.0 in stage 2.0 (TID 407, bigdata.node4, executor 4, partition 91, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 92.0 in stage 2.0 (TID 408, bigdata.node5, executor 36, partition 92, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 93.0 in stage 2.0 (TID 409, bigdata.node2, executor 17, partition 93, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 94.0 in stage 2.0 (TID 410, bigdata.node5, executor 15, partition 94, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 95.0 in stage 2.0 (TID 411, bigdata.node5, executor 30, partition 95, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 96.0 in stage 2.0 (TID 412, bigdata.node3, executor 1, partition 96, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 97.0 in stage 2.0 (TID 413, bigdata.node3, executor 37, partition 97, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 98.0 in stage 2.0 (TID 414, bigdata.node5, executor 20, partition 98, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 99.0 in stage 2.0 (TID 415, bigdata.node1, executor 18, partition 99, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 100.0 in stage 2.0 (TID 416, bigdata.node5, executor 35, partition 100, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 101.0 in stage 2.0 (TID 417, bigdata.node1, executor 32, partition 101, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 102.0 in stage 2.0 (TID 418, bigdata.node2, executor 2, partition 102, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 103.0 in stage 2.0 (TID 419, bigdata.node4, executor 24, partition 103, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 104.0 in stage 2.0 (TID 420, bigdata.node3, executor 26, partition 104, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 105.0 in stage 2.0 (TID 421, bigdata.node5, executor 10, partition 105, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 106.0 in stage 2.0 (TID 422, bigdata.node3, executor 11, partition 106, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 107.0 in stage 2.0 (TID 423, bigdata.node1, executor 8, partition 107, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 108.0 in stage 2.0 (TID 424, bigdata.node2, executor 12, partition 108, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 110.0 in stage 2.0 (TID 425, bigdata.node2, executor 39, partition 110, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 111.0 in stage 2.0 (TID 426, bigdata.node2, executor 28, partition 111, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 112.0 in stage 2.0 (TID 427, bigdata.node2, executor 33, partition 112, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 113.0 in stage 2.0 (TID 428, bigdata.node2, executor 22, partition 113, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 114.0 in stage 2.0 (TID 429, bigdata.node3, executor 6, partition 114, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 116.0 in stage 2.0 (TID 430, bigdata.node1, executor 23, partition 116, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 117.0 in stage 2.0 (TID 431, bigdata.node4, executor 14, partition 117, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 118.0 in stage 2.0 (TID 432, bigdata.node1, executor 27, partition 118, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 119.0 in stage 2.0 (TID 433, bigdata.node4, executor 19, partition 119, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 120.0 in stage 2.0 (TID 434, bigdata.node4, executor 29, partition 120, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 121.0 in stage 2.0 (TID 435, bigdata.node3, executor 31, partition 121, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 122.0 in stage 2.0 (TID 436, bigdata.node3, executor 16, partition 122, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 123.0 in stage 2.0 (TID 437, bigdata.node1, executor 3, partition 123, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 124.0 in stage 2.0 (TID 438, bigdata.node4, executor 9, partition 124, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 125.0 in stage 2.0 (TID 439, bigdata.node5, executor 5, partition 125, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 126.0 in stage 2.0 (TID 440, bigdata.node2, executor 7, partition 126, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 127.0 in stage 2.0 (TID 441, bigdata.node1, executor 38, partition 127, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 128.0 in stage 2.0 (TID 442, bigdata.node1, executor 13, partition 128, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 129.0 in stage 2.0 (TID 443, bigdata.node3, executor 1, partition 129, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 130.0 in stage 2.0 (TID 444, bigdata.node3, executor 37, partition 130, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 131.0 in stage 2.0 (TID 445, bigdata.node5, executor 20, partition 131, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 132.0 in stage 2.0 (TID 446, bigdata.node5, executor 35, partition 132, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 133.0 in stage 2.0 (TID 447, bigdata.node1, executor 32, partition 133, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 134.0 in stage 2.0 (TID 448, bigdata.node4, executor 24, partition 134, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 135.0 in stage 2.0 (TID 449, bigdata.node3, executor 26, partition 135, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 136.0 in stage 2.0 (TID 450, bigdata.node5, executor 10, partition 136, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 137.0 in stage 2.0 (TID 451, bigdata.node3, executor 11, partition 137, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 138.0 in stage 2.0 (TID 452, bigdata.node1, executor 8, partition 138, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 139.0 in stage 2.0 (TID 453, bigdata.node2, executor 12, partition 139, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 140.0 in stage 2.0 (TID 454, bigdata.node2, executor 39, partition 140, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 141.0 in stage 2.0 (TID 455, bigdata.node2, executor 28, partition 141, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 142.0 in stage 2.0 (TID 456, bigdata.node2, executor 33, partition 142, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 143.0 in stage 2.0 (TID 457, bigdata.node2, executor 22, partition 143, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 144.0 in stage 2.0 (TID 458, bigdata.node3, executor 6, partition 144, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 145.0 in stage 2.0 (TID 459, bigdata.node1, executor 23, partition 145, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 146.0 in stage 2.0 (TID 460, bigdata.node4, executor 14, partition 146, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 147.0 in stage 2.0 (TID 461, bigdata.node1, executor 27, partition 147, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 148.0 in stage 2.0 (TID 462, bigdata.node4, executor 19, partition 148, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 149.0 in stage 2.0 (TID 463, bigdata.node4, executor 29, partition 149, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 150.0 in stage 2.0 (TID 464, bigdata.node3, executor 31, partition 150, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 151.0 in stage 2.0 (TID 465, bigdata.node3, executor 16, partition 151, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 152.0 in stage 2.0 (TID 466, bigdata.node1, executor 3, partition 152, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 154.0 in stage 2.0 (TID 467, bigdata.node4, executor 9, partition 154, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 155.0 in stage 2.0 (TID 468, bigdata.node5, executor 5, partition 155, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 156.0 in stage 2.0 (TID 469, bigdata.node2, executor 7, partition 156, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 157.0 in stage 2.0 (TID 470, bigdata.node1, executor 38, partition 157, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO TaskSetManager: Starting task 159.0 in stage 2.0 (TID 471, bigdata.node1, executor 13, partition 159, PROCESS_LOCAL, 4632 bytes)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:38757 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:39585 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:45797 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:44479 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:39170 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:42620 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:44897 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:36727 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:43242 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:40621 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:46835 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:39145 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48530
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50144
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56520
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43718
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48506
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:38827 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:36676 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43788
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43764
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43740
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43768
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37602
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43766
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50142
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50106
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:45063 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:46435 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56536
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:46439 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:45783 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node3:42310 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:42767 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:40888 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:42594 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:35808 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMaster: Size of output statuses for shuffle 0 is 750 bytes
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:45001 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:42500 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:42875 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:34759 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37642
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50064
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:35102 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56518
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node4:34226 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50140
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56492
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:39225 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43734
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48524
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56516
20/06/11 14:29:03 INFO TaskSetManager: Finished task 24.0 in stage 2.0 (TID 346) in 684 ms on bigdata.node2 (executor 28) (1/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 111.0 in stage 2.0 (TID 426) in 679 ms on bigdata.node2 (executor 28) (2/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 141.0 in stage 2.0 (TID 455) in 679 ms on bigdata.node2 (executor 28) (3/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 68.0 in stage 2.0 (TID 386) in 683 ms on bigdata.node2 (executor 28) (4/160)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:37434 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48458
20/06/11 14:29:03 INFO TaskSetManager: Finished task 33.0 in stage 2.0 (TID 354) in 699 ms on bigdata.node4 (executor 29) (5/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 149.0 in stage 2.0 (TID 463) in 694 ms on bigdata.node4 (executor 29) (6/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 76.0 in stage 2.0 (TID 394) in 699 ms on bigdata.node4 (executor 29) (7/160)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56482
20/06/11 14:29:03 INFO TaskSetManager: Finished task 22.0 in stage 2.0 (TID 344) in 703 ms on bigdata.node2 (executor 12) (8/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 108.0 in stage 2.0 (TID 424) in 698 ms on bigdata.node2 (executor 12) (9/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 66.0 in stage 2.0 (TID 384) in 702 ms on bigdata.node2 (executor 12) (10/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 139.0 in stage 2.0 (TID 453) in 699 ms on bigdata.node2 (executor 12) (11/160)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56534
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.74:56498
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:33477 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node2:42353 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 120.0 in stage 2.0 (TID 434) in 712 ms on bigdata.node4 (executor 29) (12/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 106.0 in stage 2.0 (TID 422) in 717 ms on bigdata.node3 (executor 11) (13/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 63.0 in stage 2.0 (TID 382) in 721 ms on bigdata.node3 (executor 11) (14/160)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50158
20/06/11 14:29:03 INFO TaskSetManager: Finished task 137.0 in stage 2.0 (TID 451) in 723 ms on bigdata.node3 (executor 11) (15/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 122.0 in stage 2.0 (TID 436) in 726 ms on bigdata.node3 (executor 16) (16/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 151.0 in stage 2.0 (TID 465) in 724 ms on bigdata.node3 (executor 16) (17/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 35.0 in stage 2.0 (TID 356) in 732 ms on bigdata.node3 (executor 16) (18/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 19.0 in stage 2.0 (TID 342) in 740 ms on bigdata.node3 (executor 11) (19/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 79.0 in stage 2.0 (TID 396) in 739 ms on bigdata.node3 (executor 16) (20/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 113.0 in stage 2.0 (TID 428) in 737 ms on bigdata.node2 (executor 22) (21/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 143.0 in stage 2.0 (TID 457) in 736 ms on bigdata.node2 (executor 22) (22/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 26.0 in stage 2.0 (TID 348) in 742 ms on bigdata.node2 (executor 22) (23/160)
20/06/11 14:29:03 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50052
20/06/11 14:29:03 INFO TaskSetManager: Finished task 93.0 in stage 2.0 (TID 409) in 749 ms on bigdata.node2 (executor 17) (24/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 6.0 in stage 2.0 (TID 329) in 756 ms on bigdata.node2 (executor 17) (25/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 49.0 in stage 2.0 (TID 369) in 753 ms on bigdata.node2 (executor 17) (26/160)
20/06/11 14:29:03 INFO TaskSetManager: Finished task 70.0 in stage 2.0 (TID 388) in 753 ms on bigdata.node2 (executor 22) (27/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 144.0 in stage 2.0 (TID 458) in 874 ms on bigdata.node3 (executor 6) (28/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 27.0 in stage 2.0 (TID 349) in 882 ms on bigdata.node3 (executor 6) (29/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 15.0 in stage 2.0 (TID 338) in 883 ms on bigdata.node2 (executor 2) (30/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 59.0 in stage 2.0 (TID 378) in 880 ms on bigdata.node2 (executor 2) (31/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 102.0 in stage 2.0 (TID 418) in 878 ms on bigdata.node2 (executor 2) (32/160)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.73:43784
20/06/11 14:29:04 INFO TaskSetManager: Finished task 90.0 in stage 2.0 (TID 406) in 925 ms on bigdata.node3 (executor 21) (33/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 129.0 in stage 2.0 (TID 443) in 923 ms on bigdata.node3 (executor 1) (34/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 96.0 in stage 2.0 (TID 412) in 926 ms on bigdata.node3 (executor 1) (35/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 3.0 in stage 2.0 (TID 326) in 932 ms on bigdata.node3 (executor 21) (36/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 46.0 in stage 2.0 (TID 366) in 929 ms on bigdata.node3 (executor 21) (37/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 53.0 in stage 2.0 (TID 372) in 935 ms on bigdata.node3 (executor 1) (38/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 9.0 in stage 2.0 (TID 332) in 939 ms on bigdata.node3 (executor 1) (39/160)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37590
20/06/11 14:29:04 INFO TaskSetManager: Finished task 135.0 in stage 2.0 (TID 449) in 948 ms on bigdata.node3 (executor 26) (40/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 61.0 in stage 2.0 (TID 380) in 955 ms on bigdata.node3 (executor 26) (41/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 10.0 in stage 2.0 (TID 333) in 959 ms on bigdata.node3 (executor 37) (42/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 97.0 in stage 2.0 (TID 413) in 955 ms on bigdata.node3 (executor 37) (43/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 130.0 in stage 2.0 (TID 444) in 953 ms on bigdata.node3 (executor 37) (44/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 104.0 in stage 2.0 (TID 420) in 959 ms on bigdata.node3 (executor 26) (45/160)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:36776 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48508
20/06/11 14:29:04 INFO TaskSetManager: Finished task 54.0 in stage 2.0 (TID 373) in 1141 ms on bigdata.node3 (executor 37) (46/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 17.0 in stage 2.0 (TID 340) in 1143 ms on bigdata.node3 (executor 26) (47/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 154.0 in stage 2.0 (TID 467) in 1136 ms on bigdata.node4 (executor 9) (48/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 124.0 in stage 2.0 (TID 438) in 1138 ms on bigdata.node4 (executor 9) (49/160)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.72:50162
20/06/11 14:29:04 INFO TaskSetManager: Finished task 73.0 in stage 2.0 (TID 391) in 1142 ms on bigdata.node4 (executor 14) (50/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 117.0 in stage 2.0 (TID 431) in 1139 ms on bigdata.node4 (executor 14) (51/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 114.0 in stage 2.0 (TID 429) in 1139 ms on bigdata.node3 (executor 6) (52/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 71.0 in stage 2.0 (TID 389) in 1142 ms on bigdata.node3 (executor 6) (53/160)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:43881 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:42939 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 107.0 in stage 2.0 (TID 423) in 1320 ms on bigdata.node1 (executor 8) (54/160)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37644
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48504
20/06/11 14:29:04 INFO TaskSetManager: Finished task 37.0 in stage 2.0 (TID 358) in 1324 ms on bigdata.node4 (executor 9) (55/160)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:39742 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 29.0 in stage 2.0 (TID 351) in 1325 ms on bigdata.node4 (executor 14) (56/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 20.0 in stage 2.0 (TID 343) in 1326 ms on bigdata.node1 (executor 8) (57/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 81.0 in stage 2.0 (TID 398) in 1322 ms on bigdata.node4 (executor 9) (58/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 119.0 in stage 2.0 (TID 433) in 1320 ms on bigdata.node4 (executor 19) (59/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 146.0 in stage 2.0 (TID 460) in 1318 ms on bigdata.node4 (executor 14) (60/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 75.0 in stage 2.0 (TID 393) in 1323 ms on bigdata.node4 (executor 19) (61/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 138.0 in stage 2.0 (TID 452) in 1320 ms on bigdata.node1 (executor 8) (62/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 2.0 in stage 2.0 (TID 325) in 1328 ms on bigdata.node4 (executor 40) (63/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 83.0 in stage 2.0 (TID 399) in 1323 ms on bigdata.node5 (executor 5) (64/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 32.0 in stage 2.0 (TID 353) in 1327 ms on bigdata.node4 (executor 19) (65/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 44.0 in stage 2.0 (TID 364) in 1326 ms on bigdata.node4 (executor 34) (66/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 38.0 in stage 2.0 (TID 359) in 1327 ms on bigdata.node5 (executor 5) (67/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 65.0 in stage 2.0 (TID 383) in 1325 ms on bigdata.node1 (executor 8) (68/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 45.0 in stage 2.0 (TID 365) in 1326 ms on bigdata.node4 (executor 40) (69/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 125.0 in stage 2.0 (TID 439) in 1322 ms on bigdata.node5 (executor 5) (70/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 88.0 in stage 2.0 (TID 404) in 1325 ms on bigdata.node4 (executor 34) (71/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 34.0 in stage 2.0 (TID 355) in 1328 ms on bigdata.node3 (executor 31) (72/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 89.0 in stage 2.0 (TID 405) in 1330 ms on bigdata.node4 (executor 40) (73/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 1.0 in stage 2.0 (TID 324) in 1335 ms on bigdata.node4 (executor 34) (74/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 148.0 in stage 2.0 (TID 462) in 1326 ms on bigdata.node4 (executor 19) (75/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 121.0 in stage 2.0 (TID 435) in 1328 ms on bigdata.node3 (executor 31) (76/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 155.0 in stage 2.0 (TID 468) in 1331 ms on bigdata.node5 (executor 5) (77/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 50.0 in stage 2.0 (TID 370) in 1337 ms on bigdata.node5 (executor 15) (78/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 150.0 in stage 2.0 (TID 464) in 1331 ms on bigdata.node3 (executor 31) (79/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 78.0 in stage 2.0 (TID 395) in 1335 ms on bigdata.node3 (executor 31) (80/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 39.0 in stage 2.0 (TID 360) in 1339 ms on bigdata.node2 (executor 7) (81/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 7.0 in stage 2.0 (TID 330) in 1340 ms on bigdata.node5 (executor 15) (82/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 94.0 in stage 2.0 (TID 410) in 1335 ms on bigdata.node5 (executor 15) (83/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 156.0 in stage 2.0 (TID 469) in 1332 ms on bigdata.node2 (executor 7) (84/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 84.0 in stage 2.0 (TID 400) in 1336 ms on bigdata.node2 (executor 7) (85/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 132.0 in stage 2.0 (TID 446) in 1333 ms on bigdata.node5 (executor 35) (86/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 126.0 in stage 2.0 (TID 440) in 1335 ms on bigdata.node2 (executor 7) (87/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 60.0 in stage 2.0 (TID 379) in 1338 ms on bigdata.node4 (executor 24) (88/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 57.0 in stage 2.0 (TID 376) in 1339 ms on bigdata.node5 (executor 35) (89/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 134.0 in stage 2.0 (TID 448) in 1334 ms on bigdata.node4 (executor 24) (90/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 13.0 in stage 2.0 (TID 336) in 1342 ms on bigdata.node5 (executor 35) (91/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 100.0 in stage 2.0 (TID 416) in 1337 ms on bigdata.node5 (executor 35) (92/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 103.0 in stage 2.0 (TID 419) in 1337 ms on bigdata.node4 (executor 24) (93/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 16.0 in stage 2.0 (TID 339) in 1342 ms on bigdata.node4 (executor 24) (94/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 47.0 in stage 2.0 (TID 367) in 1340 ms on bigdata.node4 (executor 4) (95/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 91.0 in stage 2.0 (TID 407) in 1339 ms on bigdata.node4 (executor 4) (96/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 14.0 in stage 2.0 (TID 337) in 1343 ms on bigdata.node1 (executor 32) (97/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 4.0 in stage 2.0 (TID 327) in 1345 ms on bigdata.node4 (executor 4) (98/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 101.0 in stage 2.0 (TID 417) in 1340 ms on bigdata.node1 (executor 32) (99/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 58.0 in stage 2.0 (TID 377) in 1343 ms on bigdata.node1 (executor 32) (100/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 110.0 in stage 2.0 (TID 425) in 1339 ms on bigdata.node2 (executor 39) (101/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 67.0 in stage 2.0 (TID 385) in 1342 ms on bigdata.node2 (executor 39) (102/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 133.0 in stage 2.0 (TID 447) in 1338 ms on bigdata.node1 (executor 32) (103/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 140.0 in stage 2.0 (TID 454) in 1339 ms on bigdata.node2 (executor 39) (104/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 41.0 in stage 2.0 (TID 361) in 1344 ms on bigdata.node1 (executor 38) (105/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 157.0 in stage 2.0 (TID 470) in 1338 ms on bigdata.node1 (executor 38) (106/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 99.0 in stage 2.0 (TID 415) in 1341 ms on bigdata.node1 (executor 18) (107/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 56.0 in stage 2.0 (TID 375) in 1344 ms on bigdata.node1 (executor 18) (108/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 12.0 in stage 2.0 (TID 335) in 1347 ms on bigdata.node1 (executor 18) (109/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 23.0 in stage 2.0 (TID 345) in 1346 ms on bigdata.node2 (executor 39) (110/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 127.0 in stage 2.0 (TID 441) in 1340 ms on bigdata.node1 (executor 38) (111/160)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node5:35832 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:43374 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO BlockManagerInfo: Added broadcast_2_piece0 in memory on bigdata.node1:45659 (size: 7.5 KB, free: 4.1 GB)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37598
20/06/11 14:29:04 INFO TaskSetManager: Finished task 112.0 in stage 2.0 (TID 427) in 1366 ms on bigdata.node2 (executor 33) (112/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 142.0 in stage 2.0 (TID 456) in 1365 ms on bigdata.node2 (executor 33) (113/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 25.0 in stage 2.0 (TID 347) in 1371 ms on bigdata.node2 (executor 33) (114/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 69.0 in stage 2.0 (TID 387) in 1369 ms on bigdata.node2 (executor 33) (115/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 147.0 in stage 2.0 (TID 461) in 1375 ms on bigdata.node1 (executor 27) (116/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 118.0 in stage 2.0 (TID 432) in 1377 ms on bigdata.node1 (executor 27) (117/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 74.0 in stage 2.0 (TID 392) in 1381 ms on bigdata.node1 (executor 27) (118/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 30.0 in stage 2.0 (TID 352) in 1385 ms on bigdata.node1 (executor 27) (119/160)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48482
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.71:48438
20/06/11 14:29:04 INFO TaskSetManager: Finished task 116.0 in stage 2.0 (TID 430) in 1428 ms on bigdata.node1 (executor 23) (120/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 145.0 in stage 2.0 (TID 459) in 1426 ms on bigdata.node1 (executor 23) (121/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 28.0 in stage 2.0 (TID 350) in 1433 ms on bigdata.node1 (executor 23) (122/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 72.0 in stage 2.0 (TID 390) in 1432 ms on bigdata.node1 (executor 23) (123/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 136.0 in stage 2.0 (TID 450) in 1432 ms on bigdata.node5 (executor 10) (124/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 105.0 in stage 2.0 (TID 421) in 1434 ms on bigdata.node5 (executor 10) (125/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 62.0 in stage 2.0 (TID 381) in 1436 ms on bigdata.node5 (executor 10) (126/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 18.0 in stage 2.0 (TID 341) in 1440 ms on bigdata.node5 (executor 10) (127/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 42.0 in stage 2.0 (TID 362) in 1470 ms on bigdata.node1 (executor 13) (128/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 123.0 in stage 2.0 (TID 437) in 1466 ms on bigdata.node1 (executor 3) (129/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 36.0 in stage 2.0 (TID 357) in 1471 ms on bigdata.node1 (executor 3) (130/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 86.0 in stage 2.0 (TID 402) in 1469 ms on bigdata.node1 (executor 13) (131/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 80.0 in stage 2.0 (TID 397) in 1469 ms on bigdata.node1 (executor 3) (132/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 128.0 in stage 2.0 (TID 442) in 1466 ms on bigdata.node1 (executor 13) (133/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 159.0 in stage 2.0 (TID 471) in 1465 ms on bigdata.node1 (executor 13) (134/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 152.0 in stage 2.0 (TID 466) in 1465 ms on bigdata.node1 (executor 3) (135/160)
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37628
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37626
20/06/11 14:29:04 INFO MapOutputTrackerMasterEndpoint: Asked to send map output locations for shuffle 0 to 10.150.64.75:37630
20/06/11 14:29:04 INFO TaskSetManager: Finished task 95.0 in stage 2.0 (TID 411) in 1636 ms on bigdata.node5 (executor 30) (136/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 8.0 in stage 2.0 (TID 331) in 1645 ms on bigdata.node5 (executor 30) (137/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 87.0 in stage 2.0 (TID 403) in 1657 ms on bigdata.node5 (executor 25) (138/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 0.0 in stage 2.0 (TID 323) in 1662 ms on bigdata.node5 (executor 25) (139/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 131.0 in stage 2.0 (TID 445) in 1657 ms on bigdata.node5 (executor 20) (140/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 55.0 in stage 2.0 (TID 374) in 1662 ms on bigdata.node5 (executor 20) (141/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 11.0 in stage 2.0 (TID 334) in 1665 ms on bigdata.node5 (executor 20) (142/160)
20/06/11 14:29:04 INFO TaskSetManager: Finished task 98.0 in stage 2.0 (TID 414) in 1660 ms on bigdata.node5 (executor 20) (143/160)
20/06/11 14:29:05 INFO TaskSetManager: Finished task 85.0 in stage 2.0 (TID 401) in 1861 ms on bigdata.node1 (executor 38) (144/160)
20/06/11 14:29:05 INFO TaskSetManager: Finished task 52.0 in stage 2.0 (TID 371) in 2048 ms on bigdata.node5 (executor 30) (145/160)
20/06/11 14:29:05 INFO TaskSetManager: Finished task 43.0 in stage 2.0 (TID 363) in 2053 ms on bigdata.node5 (executor 25) (146/160)
20/06/11 14:29:05 INFO TaskSetManager: Finished task 92.0 in stage 2.0 (TID 408) in 2076 ms on bigdata.node5 (executor 36) (147/160)
20/06/11 14:29:05 INFO TaskSetManager: Finished task 5.0 in stage 2.0 (TID 328) in 2083 ms on bigdata.node5 (executor 36) (148/160)
20/06/11 14:29:05 INFO TaskSetManager: Finished task 48.0 in stage 2.0 (TID 368) in 2080 ms on bigdata.node5 (executor 36) (149/160)
20/06/11 14:29:08 WARN TaskSetManager: Lost task 51.0 in stage 2.0 (TID 315, bigdata.node3, executor 21): java.lang.RuntimeException: cannot get HiveTableMeta
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:50)
at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
at scala.collection.Iterator$class.foreach(Iterator.scala:893)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
at scala.collection.AbstractIterator.to(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: NoSuchObjectException(message:test_DW.DIM_A2 table not found)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy38.get_table(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)
at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:48)
... 30 more
20/06/11 14:29:08 INFO TaskSetManager: Starting task 51.1 in stage 2.0 (TID 472, bigdata.node3, executor 6, partition 51, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:09 INFO TaskSetManager: Lost task 153.0 in stage 2.0 (TID 322) on bigdata.node2, executor 2: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 1]
20/06/11 14:29:09 INFO TaskSetManager: Starting task 153.1 in stage 2.0 (TID 473, bigdata.node2, executor 22, partition 153, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:09 INFO TaskSetManager: Lost task 115.0 in stage 2.0 (TID 321) on bigdata.node1, executor 18: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 2]
20/06/11 14:29:09 INFO TaskSetManager: Starting task 115.1 in stage 2.0 (TID 474, bigdata.node1, executor 32, partition 115, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:10 INFO TaskSetManager: Lost task 64.0 in stage 2.0 (TID 318) on bigdata.node2, executor 17: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 3]
20/06/11 14:29:10 INFO TaskSetManager: Starting task 64.1 in stage 2.0 (TID 475, bigdata.node2, executor 33, partition 64, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:10 INFO TaskSetManager: Lost task 40.0 in stage 2.0 (TID 313) on bigdata.node4, executor 34: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 4]
20/06/11 14:29:10 INFO TaskSetManager: Starting task 40.1 in stage 2.0 (TID 476, bigdata.node3, executor 37, partition 40, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:10 INFO TaskSetManager: Lost task 77.0 in stage 2.0 (TID 319) on bigdata.node5, executor 15: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 5]
20/06/11 14:29:10 INFO TaskSetManager: Starting task 77.1 in stage 2.0 (TID 477, bigdata.node5, executor 36, partition 77, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:11 INFO TaskSetManager: Lost task 77.1 in stage 2.0 (TID 477) on bigdata.node5, executor 36: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 6]
20/06/11 14:29:11 INFO TaskSetManager: Starting task 77.2 in stage 2.0 (TID 478, bigdata.node1, executor 38, partition 77, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:11 INFO TaskSetManager: Lost task 31.0 in stage 2.0 (TID 317) on bigdata.node5, executor 36: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 7]
20/06/11 14:29:11 INFO TaskSetManager: Starting task 31.1 in stage 2.0 (TID 479, bigdata.node2, executor 12, partition 31, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:11 INFO TaskSetManager: Lost task 82.0 in stage 2.0 (TID 314) on bigdata.node4, executor 40: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 8]
20/06/11 14:29:11 INFO TaskSetManager: Lost task 109.0 in stage 2.0 (TID 320) on bigdata.node5, executor 30: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 9]
20/06/11 14:29:11 INFO TaskSetManager: Starting task 109.1 in stage 2.0 (TID 480, bigdata.node5, executor 30, partition 109, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:11 INFO TaskSetManager: Starting task 82.1 in stage 2.0 (TID 481, bigdata.node4, executor 40, partition 82, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:11 INFO TaskSetManager: Lost task 21.0 in stage 2.0 (TID 312) on bigdata.node5, executor 25: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 10]
20/06/11 14:29:11 INFO TaskSetManager: Starting task 21.1 in stage 2.0 (TID 482, bigdata.node1, executor 32, partition 21, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:12 INFO TaskSetManager: Lost task 109.1 in stage 2.0 (TID 480) on bigdata.node5, executor 30: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 11]
20/06/11 14:29:12 INFO TaskSetManager: Starting task 109.2 in stage 2.0 (TID 483, bigdata.node1, executor 3, partition 109, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:12 INFO TaskSetManager: Lost task 82.1 in stage 2.0 (TID 481) on bigdata.node4, executor 40: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 12]
20/06/11 14:29:12 INFO TaskSetManager: Starting task 82.2 in stage 2.0 (TID 484, bigdata.node2, executor 2, partition 82, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:12 INFO TaskSetManager: Lost task 158.0 in stage 2.0 (TID 316) on bigdata.node4, executor 4: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 13]
20/06/11 14:29:12 INFO TaskSetManager: Starting task 158.1 in stage 2.0 (TID 485, bigdata.node5, executor 36, partition 158, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:12 INFO TaskSetManager: Lost task 158.1 in stage 2.0 (TID 485) on bigdata.node5, executor 36: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 14]
20/06/11 14:29:12 INFO TaskSetManager: Starting task 158.2 in stage 2.0 (TID 486, bigdata.node4, executor 4, partition 158, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:13 INFO TaskSetManager: Lost task 158.2 in stage 2.0 (TID 486) on bigdata.node4, executor 4: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 15]
20/06/11 14:29:13 INFO TaskSetManager: Lost task 82.2 in stage 2.0 (TID 484) on bigdata.node2, executor 2: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 16]
20/06/11 14:29:13 INFO TaskSetManager: Starting task 82.3 in stage 2.0 (TID 487, bigdata.node3, executor 21, partition 82, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:13 INFO TaskSetManager: Starting task 158.3 in stage 2.0 (TID 488, bigdata.node4, executor 14, partition 158, NODE_LOCAL, 4632 bytes)
20/06/11 14:29:13 INFO TaskSetManager: Lost task 82.3 in stage 2.0 (TID 487) on bigdata.node3, executor 21: java.lang.RuntimeException (cannot get HiveTableMeta) [duplicate 17]
20/06/11 14:29:13 ERROR TaskSetManager: Task 82 in stage 2.0 failed 4 times; aborting job
20/06/11 14:29:13 INFO YarnScheduler: Cancelling stage 2
20/06/11 14:29:13 INFO YarnScheduler: Stage 2 was cancelled
20/06/11 14:29:13 INFO DAGScheduler: ResultStage 2 (collect at SparkBuildDictionary.java:177) failed in 10.390 s due to Job aborted due to stage failure: Task 82 in stage 2.0 failed 4 times, most recent failure: Lost task 82.3 in stage 2.0 (TID 487, bigdata.node3, executor 21): java.lang.RuntimeException: cannot get HiveTableMeta
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:50)
at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
at scala.collection.Iterator$class.foreach(Iterator.scala:893)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
at scala.collection.AbstractIterator.to(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: NoSuchObjectException(message:test_DW.DIM_A1 table not found)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy38.get_table(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)
at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:48)
... 30 more
Driver stacktrace:
20/06/11 14:29:13 INFO DAGScheduler: Job 1 failed: collect at SparkBuildDictionary.java:177, took 17.385376 s
20/06/11 14:29:13 WARN ExecutorAllocationManager: No stages are running, but numRunningTasks != 0
20/06/11 14:29:13 INFO SparkUI: Stopped Spark web UI at http://10.150.64.72:4041
20/06/11 14:29:13 WARN TaskSetManager: Lost task 31.1 in stage 2.0 (TID 479, bigdata.node2, executor 12): TaskKilled (stage cancelled)
20/06/11 14:29:13 INFO YarnClientSchedulerBackend: Interrupting monitor thread
20/06/11 14:29:13 INFO YarnClientSchedulerBackend: Shutting down all executors
20/06/11 14:29:13 INFO YarnSchedulerBackend$YarnDriverEndpoint: Asking each executor to shut down
20/06/11 14:29:13 INFO SchedulerExtensionServices: Stopping SchedulerExtensionServices
(serviceOption=None,
services=List(),
started=false)
20/06/11 14:29:13 INFO YarnClientSchedulerBackend: Stopped
20/06/11 14:29:13 INFO MapOutputTrackerMasterEndpoint: MapOutputTrackerMasterEndpoint stopped!
20/06/11 14:29:13 INFO MemoryStore: MemoryStore cleared
20/06/11 14:29:13 INFO BlockManager: BlockManager stopped
20/06/11 14:29:13 INFO BlockManagerMaster: BlockManagerMaster stopped
20/06/11 14:29:13 INFO OutputCommitCoordinator$OutputCommitCoordinatorEndpoint: OutputCommitCoordinator stopped!
20/06/11 14:29:13 INFO SparkContext: Successfully stopped SparkContext
Exception in thread "main" java.lang.RuntimeException: error execute org.apache.kylin.engine.spark.SparkBuildDictionary. Root cause: Job aborted due to stage failure: Task 82 in stage 2.0 failed 4 times, most recent failure: Lost task 82.3 in stage 2.0 (TID 487, bigdata.node3, executor 21): java.lang.RuntimeException: cannot get HiveTableMeta
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:50)
at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
at scala.collection.Iterator$class.foreach(Iterator.scala:893)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
at scala.collection.AbstractIterator.to(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: NoSuchObjectException(message:test_DW.DIM_A1 table not found)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy38.get_table(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)
at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:48)
... 30 more
Driver stacktrace:
at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:42)
at org.apache.kylin.common.util.SparkEntry.main(SparkEntry.java:44)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:782)
at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 82 in stage 2.0 failed 4 times, most recent failure: Lost task 82.3 in stage 2.0 (TID 487, bigdata.node3, executor 21): java.lang.RuntimeException: cannot get HiveTableMeta
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:50)
at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
at scala.collection.Iterator$class.foreach(Iterator.scala:893)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
at scala.collection.AbstractIterator.to(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: NoSuchObjectException(message:test_DW.DIM_A1 table not found)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy38.get_table(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)
at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:48)
... 30 more
Driver stacktrace:
at org.apache.spark.scheduler.DAGScheduler.org$apache$spark$scheduler$DAGScheduler$$failJobAndIndependentStages(DAGScheduler.scala:1517)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1505)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$abortStage$1.apply(DAGScheduler.scala:1504)
at scala.collection.mutable.ResizableArray$class.foreach(ResizableArray.scala:59)
at scala.collection.mutable.ArrayBuffer.foreach(ArrayBuffer.scala:48)
at org.apache.spark.scheduler.DAGScheduler.abortStage(DAGScheduler.scala:1504)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:814)
at org.apache.spark.scheduler.DAGScheduler$$anonfun$handleTaskSetFailed$1.apply(DAGScheduler.scala:814)
at scala.Option.foreach(Option.scala:257)
at org.apache.spark.scheduler.DAGScheduler.handleTaskSetFailed(DAGScheduler.scala:814)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.doOnReceive(DAGScheduler.scala:1732)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1687)
at org.apache.spark.scheduler.DAGSchedulerEventProcessLoop.onReceive(DAGScheduler.scala:1676)
at org.apache.spark.util.EventLoop$$anon$1.run(EventLoop.scala:48)
at org.apache.spark.scheduler.DAGScheduler.runJob(DAGScheduler.scala:630)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2029)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2050)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2069)
at org.apache.spark.SparkContext.runJob(SparkContext.scala:2094)
at org.apache.spark.rdd.RDD$$anonfun$collect$1.apply(RDD.scala:936)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:151)
at org.apache.spark.rdd.RDDOperationScope$.withScope(RDDOperationScope.scala:112)
at org.apache.spark.rdd.RDD.withScope(RDD.scala:362)
at org.apache.spark.rdd.RDD.collect(RDD.scala:935)
at org.apache.spark.api.java.JavaRDDLike$class.collect(JavaRDDLike.scala:361)
at org.apache.spark.api.java.AbstractJavaRDDLike.collect(JavaRDDLike.scala:45)
at org.apache.kylin.engine.spark.SparkBuildDictionary.execute(SparkBuildDictionary.java:177)
at org.apache.kylin.common.util.AbstractApplication.execute(AbstractApplication.java:37)
... 10 more
Caused by: java.lang.RuntimeException: cannot get HiveTableMeta
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:50)
at org.apache.kylin.source.hive.HiveSource.createReadableTable(HiveSource.java:68)
at org.apache.kylin.source.SourceManager.createReadableTable(SourceManager.java:145)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.buildSnapshotTable(SparkBuildDictionary.java:386)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:367)
at org.apache.kylin.engine.spark.SparkBuildDictionary$SnapshotBuildFunction.call(SparkBuildDictionary.java:325)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at org.apache.spark.api.java.JavaPairRDD$$anonfun$pairFunToScalaFun$1.apply(JavaPairRDD.scala:1043)
at scala.collection.Iterator$$anon$11.next(Iterator.scala:409)
at scala.collection.Iterator$$anon$13.hasNext(Iterator.scala:462)
at scala.collection.Iterator$class.foreach(Iterator.scala:893)
at scala.collection.AbstractIterator.foreach(Iterator.scala:1336)
at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:59)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:104)
at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:48)
at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:310)
at scala.collection.AbstractIterator.to(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:302)
at scala.collection.AbstractIterator.toBuffer(Iterator.scala:1336)
at scala.collection.TraversableOnce$class.toArray(TraversableOnce.scala:289)
at scala.collection.AbstractIterator.toArray(Iterator.scala:1336)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.rdd.RDD$$anonfun$collect$1$$anonfun$13.apply(RDD.scala:936)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.SparkContext$$anonfun$runJob$5.apply(SparkContext.scala:2069)
at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:87)
at org.apache.spark.scheduler.Task.run(Task.scala:108)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:338)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
Caused by: NoSuchObjectException(message:test_DW.DIM_A1 table not found)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1808)
at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1778)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:107)
at com.sun.proxy.$Proxy38.get_table(Unknown Source)
at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1208)
at org.apache.kylin.source.hive.CLIHiveClient.getHiveTableMeta(CLIHiveClient.java:78)
at org.apache.kylin.source.hive.HiveTable.<init>(HiveTable.java:48)
... 30 more
20/06/11 14:29:13 INFO ShutdownHookManager: Shutdown hook called
20/06/11 14:29:13 INFO ShutdownHookManager: Deleting directory /tmp/spark-af7e949c-d6ff-40ca-ade9-06a3ac8e5157
The command is:
export HADOOP_CONF_DIR=/usr/hdp/2.6.3.0-235/hadoop/conf && /usr/local/apache-kylin-3.0.2-bin-hbase1x/spark/bin/spark-submit --class org.apache.kylin.common.util.SparkEntry --name "Build Dimension Dictionary with Spark" --conf spark.executor.instances=40 --conf spark.yarn.queue=default --conf spark.history.fs.logDirectory=hdfs:///kylin/spark-history --conf spark.master=yarn --conf spark.hadoop.yarn.timeline-service.enabled=false --conf spark.executor.memory=8g --conf spark.eventLog.enabled=true --conf spark.eventLog.dir=hdfs:///kylin/spark-history --conf spark.yarn.executor.memoryOverhead=1024 --conf spark.driver.memory=20g --conf spark.shuffle.service.enabled=true --jars /usr/local/apache-kylin-3.0.2-bin-hbase1x/lib/kylin-job-3.0.2.jar /usr/local/apache-kylin-3.0.2-bin-hbase1x/lib/kylin-job-3.0.2.jar -className org.apache.kylin.engine.spark.SparkBuildDictionary -input hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/fact_distinct_columns -cubingJobId 7a33238a-1a3b-311f-fae2-5c2608942942 -counterOutput hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/counter -dictPath hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/dict -segmentId 399cc9f9-2dad-720c-79aa-10f7eacce7a7 -metaUrl kylin_metadata@hdfs,path=hdfs://bigdata/kylin/kylin_metadata/kylin-7a33238a-1a3b-311f-fae2-5c2608942942/kylin_test_view_cube_spark/metadata -cubename kylin_test_view_cube_spark
at org.apache.kylin.engine.spark.SparkExecutable.doWork(SparkExecutable.java:392)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:748)
--
This message was sent by Atlassian Jira
(v8.3.4#803005)