user@spark.apache.org, 2015-01

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: Big performance difference between "client" and "cluster" deployment mode; is this expected? - posted by Tathagata Das <ta...@gmail.com> on 2015/01/01 01:21:39 UTC, 1 replies.
- limit vs sample for indexing a small amount of data quickly? - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/01 04:00:44 UTC, 1 replies.
- NullPointerException - posted by rapelly kartheek <ka...@gmail.com> on 2015/01/01 07:24:40 UTC, 5 replies.
- spark ignoring all memory settings and defaulting to 512MB? - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/01 07:35:49 UTC, 4 replies.
- Re: Some Serious Issue with Spark Streaming ? Blocks Getting Removed and Jobs have Failed.. - posted by zgm <za...@gmail.com> on 2015/01/01 09:16:51 UTC, 1 replies.
- Re: Trying to make spark-jobserver work with yarn - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/01 09:22:11 UTC, 1 replies.
- Re: NoSuchMethodError: com.typesafe.config.Config.getDuration with akka-http/akka-stream - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/01 09:28:36 UTC, 6 replies.
- Re: spark stream + cassandra (execution on event) - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/01 09:32:56 UTC, 0 replies.
- Re: Spark app performance - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/01 09:35:09 UTC, 1 replies.
- Re: Reading nested JSON data with Spark SQL - posted by Pankaj Narang <pa...@gmail.com> on 2015/01/01 09:36:13 UTC, 2 replies.
- Only One Kafka receiver is running in spark irrespective of multiple DStreams - posted by Tapas Swain <ta...@gmail.com> on 2015/01/01 10:59:53 UTC, 0 replies.
- Re: FlatMapValues - posted by Hitesh Khamesra <hi...@gmail.com> on 2015/01/01 18:46:39 UTC, 4 replies.
- Re: JdbcRDD and ClassTag issue - posted by Sujee <su...@gmail.com> on 2015/01/01 19:10:27 UTC, 0 replies.
- Re: JdbcRDD - posted by Sujee <su...@gmail.com> on 2015/01/01 19:18:49 UTC, 0 replies.
- How to propagate the value set in SparkContext.setCallSite() to all executors? - posted by RK <pr...@yahoo.com.INVALID> on 2015/01/01 19:27:59 UTC, 1 replies.
- sparkContext.textFile does not honour the minPartitions argument - posted by Aniket Bhatnagar <an...@gmail.com> on 2015/01/01 19:43:56 UTC, 2 replies.
- Incorrect information in the UI about data received by KafkaReceiver??? - posted by RK <pr...@yahoo.com.INVALID> on 2015/01/01 20:26:04 UTC, 0 replies.
- Re: Gradual slow down of the Streaming job (getCallSite at DStream.scala:294) - posted by RK <pr...@yahoo.com.INVALID> on 2015/01/01 20:36:48 UTC, 2 replies.
- DAG info - posted by shahid ashraf <sh...@trialx.com> on 2015/01/02 07:33:58 UTC, 4 replies.
- Re: Compile error from Spark 1.2.0 - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/02 07:45:53 UTC, 1 replies.
- Re: DecisionTree Algorithm used in Spark MLLib - posted by Manish Amde <ma...@gmail.com> on 2015/01/02 08:41:08 UTC, 0 replies.
- Is it possible to do incremental training using ALSModel (MLlib)? - posted by Wouter Samaey <wo...@storefront.be> on 2015/01/02 10:40:28 UTC, 8 replies.
- MLLIB and Openblas library in non-default dir - posted by Tomas Hudik <xh...@gmail.com> on 2015/01/02 12:41:17 UTC, 4 replies.
- pyspark executor PYTHONPATH - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/02 13:49:21 UTC, 1 replies.
- JdbcRdd for Python - posted by elliott cordo <el...@gmail.com> on 2015/01/02 14:17:46 UTC, 4 replies.
- Re: NoClassDefFoundError when trying to run spark application - posted by Pankaj Narang <pa...@gmail.com> on 2015/01/02 16:34:11 UTC, 0 replies.
- (send this email to subscribe) - posted by Pankaj <pa...@gmail.com> on 2015/01/02 16:36:50 UTC, 1 replies.
- KafkaReceiver executor in spark streaming job on YARN suddenly killed by ResourceManager - posted by Jun Ki Kim <wi...@gmail.com> on 2015/01/02 17:13:43 UTC, 0 replies.
- KafkaReceiver executor in spark streaming job on YARN suddenly killed by ResourceManager - posted by Junki Kim <wi...@gmail.com> on 2015/01/02 17:17:11 UTC, 0 replies.
- different akka versions and spark - posted by Koert Kuipers <ko...@tresata.com> on 2015/01/02 18:11:48 UTC, 7 replies.
- Re: Apache Spark, Hadoop 2.2.0 without Yarn Integration - posted by Moep <ni...@googlemail.com> on 2015/01/02 21:06:15 UTC, 1 replies.
- Spark or Tachyon: capture data lineage - posted by Jerry Lam <ch...@gmail.com> on 2015/01/02 21:24:09 UTC, 2 replies.
- Submitting spark jobs through yarn-client - posted by Corey Nolet <cj...@gmail.com> on 2015/01/02 22:20:50 UTC, 5 replies.
- Publishing streaming results to web interface - posted by tfrisk <tf...@gmail.com> on 2015/01/02 23:45:47 UTC, 3 replies.
- How to convert String data to RDD. - posted by RP <ha...@outlook.com> on 2015/01/03 01:31:57 UTC, 0 replies.
- Re: How to convert String data to RDD. - posted by Ted Yu <yu...@gmail.com> on 2015/01/03 04:57:45 UTC, 0 replies.
- SparkSQL 1.2.0 sources API error - posted by Niranda Perera <ni...@gmail.com> on 2015/01/03 06:36:53 UTC, 4 replies.
- Spark-1.2.0 build error - posted by rapelly kartheek <ka...@gmail.com> on 2015/01/03 07:03:43 UTC, 0 replies.
- getting number of partition per topic in kafka - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/03 09:24:24 UTC, 1 replies.
- Unable to build spark from source - posted by Manoj Kumar <ma...@gmail.com> on 2015/01/03 11:16:34 UTC, 9 replies.
- sqlContext is undefined in the Spark Shell - posted by "bit1129@163.com" <bi...@163.com> on 2015/01/03 12:03:38 UTC, 1 replies.
- Re: saveAsTextFile - posted by Pankaj Narang <pa...@gmail.com> on 2015/01/03 13:07:46 UTC, 3 replies.
- Spark MLIB for Kaggle's CTR challenge - posted by Maisnam Ns <ma...@gmail.com> on 2015/01/03 18:07:28 UTC, 0 replies.
- (Unknown) - posted by Sujeevan <su...@gmail.com> on 2015/01/03 18:20:59 UTC, 3 replies.
- Joining by values - posted by dcmovva <di...@gmail.com> on 2015/01/03 19:10:24 UTC, 5 replies.
- spark.akka.frameSize limit error - posted by Saeed Shahrivari <sa...@gmail.com> on 2015/01/03 19:40:21 UTC, 4 replies.
- save rdd to ORC file - posted by SamyaMaiti <sa...@gmail.com> on 2015/01/03 20:27:19 UTC, 1 replies.
- spark.sql.shuffle.partitions parameter - posted by Yuri Makhno <ym...@gmail.com> on 2015/01/03 21:36:24 UTC, 0 replies.
- Better way of measuring custom application metrics - posted by Enno Shioji <es...@gmail.com> on 2015/01/04 00:47:01 UTC, 3 replies.
- Spark for core business-logic? - Replacing: MongoDB? - posted by Alec Taylor <al...@gmail.com> on 2015/01/04 01:43:02 UTC, 6 replies.
- Re: Elastic allocation(spark.dynamicAllocation.enabled) results in task never being executed. - posted by firemonk9 <dh...@gmail.com> on 2015/01/04 03:54:09 UTC, 3 replies.
- Re: building spark1.2 meet error - posted by j_soft <zs...@gmail.com> on 2015/01/04 04:11:22 UTC, 2 replies.
- Re: simple job + futures timeout - posted by brichards <bo...@gmail.com> on 2015/01/04 06:35:28 UTC, 0 replies.
- does calling cache()/persist() on a RDD trigger its immediate evaluation? - posted by Pengcheng YIN <pc...@gmail.com> on 2015/01/04 08:23:16 UTC, 1 replies.
- Performance degrade - posted by Abhideep Chakravarty <Ab...@mindtree.com> on 2015/01/04 17:12:44 UTC, 0 replies.
- Problem with building spark-1.2.0 - posted by "Kartheek.R" <ka...@gmail.com> on 2015/01/04 17:15:25 UTC, 8 replies.
- A spark newbie question - posted by Dinesh Vallabhdas <di...@yahoo.com.INVALID> on 2015/01/04 17:28:08 UTC, 2 replies.
- A spark newbie question on summary statistics - posted by anondin <di...@yahoo.com> on 2015/01/04 17:36:24 UTC, 0 replies.
- Repartition Memory Leak - posted by Brad Willard <br...@gmail.com> on 2015/01/04 19:23:52 UTC, 2 replies.
- Re: Shuffle Problems in 1.2.0 - posted by Josh Rosen <ro...@gmail.com> on 2015/01/04 22:11:30 UTC, 8 replies.
- Re: Shuffle write increases in spark 1.2 - posted by Josh Rosen <ro...@gmail.com> on 2015/01/04 22:14:49 UTC, 0 replies.
- Re: Number of cores is 0 in WebUI when use bin/spark-submit - posted by Josh Rosen <ro...@gmail.com> on 2015/01/04 22:18:52 UTC, 0 replies.
- Re: Using Python IDE for Spark Application Development - posted by Attila Csordas <at...@gmail.com> on 2015/01/04 23:05:30 UTC, 0 replies.
- Reading one partition at a time - posted by Michael Albert <m_...@yahoo.com.INVALID> on 2015/01/05 01:30:53 UTC, 1 replies.
- a vague question, but perhaps it might ring a bell - posted by Michael Albert <m_...@yahoo.com.INVALID> on 2015/01/05 02:13:05 UTC, 3 replies.
- Using graphx to calculate average distance of a big graph - posted by James <al...@gmail.com> on 2015/01/05 03:28:04 UTC, 2 replies.
- python API for gradient boosting? - posted by Christopher Thom <Ch...@quantium.com.au> on 2015/01/05 03:58:11 UTC, 3 replies.
- Does SparkSQL not support nested IF(1=1, 1, IF(2=2, 2, 3)) statements? - posted by RK <pr...@yahoo.com.INVALID> on 2015/01/05 04:28:38 UTC, 3 replies.
- Launching Spark app in client mode for standalone cluster - posted by Boromir Widas <vc...@gmail.com> on 2015/01/05 04:42:27 UTC, 3 replies.
- Controlling number of executors on Mesos vs YARN - posted by mvle <mv...@us.ibm.com> on 2015/01/05 06:37:35 UTC, 1 replies.
- Re: Parquet schema changes - posted by Adam Gilmore <dr...@gmail.com> on 2015/01/05 06:44:22 UTC, 3 replies.
- Re: Issue with Parquet on Spark 1.2 and Amazon EMR - posted by Adam Gilmore <dr...@gmail.com> on 2015/01/05 06:45:06 UTC, 4 replies.
- spark worker nodes getting disassociated while running hive on spark - posted by Somnath Pandeya <So...@infosys.com> on 2015/01/05 08:07:28 UTC, 0 replies.
- Driver hangs on running mllib word2vec - posted by Eric Zhen <zh...@gmail.com> on 2015/01/05 08:18:02 UTC, 6 replies.
- Override hostname of Spark executors - posted by christian_t <da...@gmail.com> on 2015/01/05 10:05:44 UTC, 0 replies.
- Re: Mesos resource allocation - posted by Josh Devins <jo...@soundcloud.com> on 2015/01/05 10:22:13 UTC, 1 replies.
- stopping streaming context - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/05 10:45:58 UTC, 1 replies.
- Implement customized Join for SparkSQL - posted by "Dai, Kevin" <yu...@ebay.com> on 2015/01/05 11:28:52 UTC, 3 replies.
- Finding most occurrences in a JSON Nested Array - posted by adstan <ni...@gmail.com> on 2015/01/05 11:56:09 UTC, 9 replies.
- spark 1.2: value toJSON is not a member of org.apache.spark.sql.SchemaRDD - posted by bchazalet <bc...@companywatch.net> on 2015/01/05 12:11:52 UTC, 1 replies.
- Spark Driver "behind" NAT - posted by Aaron <aa...@gmail.com> on 2015/01/05 13:41:00 UTC, 4 replies.
- Add PredictionIO to Powered by Spark - posted by Thomas Stone <th...@prediction.io> on 2015/01/05 17:24:25 UTC, 0 replies.
- Saving partial (top 10) DStream windows to hdfs - posted by Laeeq Ahmed <la...@yahoo.com.INVALID> on 2015/01/05 18:38:09 UTC, 7 replies.
- Custom receiver runtime Kryo exception - posted by Padmanabhan, "Mahesh (contractor)" <ma...@twc-contractor.com> on 2015/01/05 18:57:44 UTC, 0 replies.
- Question on Spark UI/accumulators - posted by Virgil Palanciuc <vi...@gmail.com> on 2015/01/05 19:11:47 UTC, 0 replies.
- Developing with Pycharm - posted by Steve Lewis <lo...@gmail.com> on 2015/01/05 19:18:06 UTC, 0 replies.
- problem while running code - posted by shahid <sh...@trialx.com> on 2015/01/05 19:37:50 UTC, 0 replies.
- Timeout Exception in standalone cluster - posted by rajnish <ra...@gmail.com> on 2015/01/05 19:43:17 UTC, 1 replies.
- Re: Api to get the status of spark workers - posted by rajnish <ra...@gmail.com> on 2015/01/05 19:46:17 UTC, 0 replies.
- Fwd: ApacheCon North America 2015 Call For Papers - posted by Matei Zaharia <ma...@gmail.com> on 2015/01/05 20:36:31 UTC, 0 replies.
- org.apache.spark.sql.catalyst.errors.package$TreeNodeException: Unresolved attributes: pyspark on yarn - posted by Sam Flint <sa...@magnetic.com> on 2015/01/05 22:01:17 UTC, 0 replies.
- SparkSQL support for reading Avro files - posted by yanenli2 <ya...@gmail.com> on 2015/01/05 22:12:59 UTC, 3 replies.
- Spark response times for queries seem slow - posted by Sam Flint <sa...@magnetic.com> on 2015/01/06 00:20:14 UTC, 1 replies.
- Parquet predicate pushdown - posted by Adam Gilmore <dr...@gmail.com> on 2015/01/06 00:38:20 UTC, 2 replies.
- Reading from a centralized stored - posted by Franc Carter <fr...@rozettatech.com> on 2015/01/06 01:25:43 UTC, 5 replies.
- Spark avro: Sample app fails to run in a spark standalone cluster - posted by Niranda Perera <ni...@gmail.com> on 2015/01/06 05:36:01 UTC, 0 replies.
- Add StructType column to SchemaRDD - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/06 06:52:57 UTC, 3 replies.
- TF-IDF from spark-1.1.0 not working on cluster mode - posted by Priya Ch <le...@gmail.com> on 2015/01/06 08:12:17 UTC, 3 replies.
- Guava 11 dependency issue in Spark 1.2.0 - posted by Niranda Perera <ni...@gmail.com> on 2015/01/06 09:38:12 UTC, 7 replies.
- Add to the spark users list - posted by Bilna Govind <bi...@gmail.com> on 2015/01/06 10:26:03 UTC, 0 replies.
- Set EXTRA_JAR environment variable for spark-jobserver - posted by Sasi <sa...@gmail.com> on 2015/01/06 12:53:53 UTC, 9 replies.
- Re: Spark error in execution - posted by Daniel Darabos <da...@lynxanalytics.com> on 2015/01/06 13:31:52 UTC, 0 replies.
- streamSQL - is it available or is it in POC ? - posted by tfrisk <tf...@gmail.com> on 2015/01/06 14:09:40 UTC, 0 replies.
- Pyspark Interactive shell - posted by Naveen Kumar Pokala <np...@spcapitaliq.com> on 2015/01/06 14:52:35 UTC, 3 replies.
- Trouble with large Yarn job - posted by Anders Arpteg <ar...@spotify.com> on 2015/01/06 15:20:16 UTC, 5 replies.
- I think I am almost lost in the internals of Spark - posted by Todd <bi...@163.com> on 2015/01/06 15:24:17 UTC, 6 replies.
- How to limit the number of concurrent tasks per node? - posted by Pengcheng YIN <pc...@gmail.com> on 2015/01/06 15:29:57 UTC, 0 replies.
- Problem getting Spark running on a Yarn cluster - posted by Sharon Rapoport <sh...@plaid.com> on 2015/01/06 15:40:31 UTC, 1 replies.
- Saving data to Hbase hung in Spark streaming application with Spark 1.2.0 - posted by Max Xu <Ma...@twosigma.com> on 2015/01/06 15:42:05 UTC, 6 replies.
- Location of logs in local mode - posted by Brett Meyer <Br...@crowdstrike.com> on 2015/01/06 16:25:49 UTC, 0 replies.
- Data Locality - posted by gtinside <gt...@gmail.com> on 2015/01/06 17:17:40 UTC, 4 replies.
- RDD Moving Average - posted by Asim Jalis <as...@gmail.com> on 2015/01/06 18:25:24 UTC, 13 replies.
- 1.2.0 - java.lang.ClassCastException: scala.Tuple2 cannot be cast to scala.collection.Iterator - posted by bchazalet <bc...@companywatch.net> on 2015/01/06 18:33:14 UTC, 0 replies.
- Multiple Spark Streaming receiver model - posted by manjuldixit <ma...@kronos.com> on 2015/01/06 20:11:44 UTC, 2 replies.
- Is there a way to read a parquet database without generating an RDD - posted by Steve Lewis <lo...@gmail.com> on 2015/01/06 20:36:26 UTC, 0 replies.
- HDFS_DELEGATION_TOKEN errors after switching Spark Contexts - posted by "Ganelin, Ilya" <Il...@capitalone.com> on 2015/01/06 20:36:51 UTC, 0 replies.
- confidence/probability for prediction in MLlib - posted by Jianguo Li <fl...@gmail.com> on 2015/01/06 20:43:09 UTC, 1 replies.
- Re: disable log4j for spark-shell - posted by brichards <bo...@gmail.com> on 2015/01/06 21:05:03 UTC, 2 replies.
- [MLLib] storageLevel in ALS - posted by "Fernando O." <fo...@gmail.com> on 2015/01/06 21:57:01 UTC, 4 replies.
- Current Build Gives HTTP ERROR - posted by Ganon Pierce <ga...@me.com> on 2015/01/06 22:09:28 UTC, 11 replies.
- Snappy error when driver is running in JBoss - posted by Charles <ch...@cenx.com> on 2015/01/06 23:26:15 UTC, 2 replies.
- Re: Spark 1.1.0 and HBase: Snappy UnsatisfiedLinkError - posted by Charles <ch...@cenx.com> on 2015/01/06 23:35:51 UTC, 0 replies.
- Using ec2 launch script with locally built version of spark? - posted by Ganon Pierce <ga...@me.com> on 2015/01/06 23:51:34 UTC, 1 replies.
- How to replace user.id to user.names in a file - posted by riginos <sa...@gmail.com> on 2015/01/07 01:53:34 UTC, 3 replies.
- Cannot see RDDs in Spark UI - posted by Manoj Samel <ma...@gmail.com> on 2015/01/07 03:48:31 UTC, 1 replies.
- SparkSQL schemaRDD & MapPartitions calls - performance issues - columnar formats? - posted by Nathan McCarthy <Na...@quantium.com.au> on 2015/01/07 04:53:05 UTC, 8 replies.
- Re: How to merge a RDD of RDDs into one uber RDD - posted by "k.tham" <ke...@gmail.com> on 2015/01/07 06:17:24 UTC, 4 replies.
- Re: Spark SQL implementation error - posted by Pankaj Narang <pa...@gmail.com> on 2015/01/07 07:02:47 UTC, 0 replies.
- Why Parquet Predicate Pushdown doesn't work? - posted by Xuelin Cao <xu...@yahoo.com.INVALID> on 2015/01/07 07:18:58 UTC, 5 replies.
- spark-network-yarn 2.11 depends on spark-network-shuffle 2.10 - posted by Aniket Bhatnagar <an...@gmail.com> on 2015/01/07 09:25:46 UTC, 2 replies.
- example insert statement in Spark SQL - posted by Niranda Perera <ni...@gmail.com> on 2015/01/07 10:13:01 UTC, 1 replies.
- Spark SQL: The cached columnar table is not columnar? - posted by Xuelin Cao <xu...@yahoo.com.INVALID> on 2015/01/07 10:37:40 UTC, 7 replies.
- spark 1.2 defaults to MR1 class when calling newAPIHadoopRDD - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/07 10:38:04 UTC, 6 replies.
- Re: Reading Data Using TextFileStream - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/07 11:46:41 UTC, 2 replies.
- [GraphX] Integration with TinkerPop3/Gremlin - posted by Nicolas Colson <ni...@gmail.com> on 2015/01/07 12:03:54 UTC, 1 replies.
- max receiving rate in spark streaming - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/07 12:11:08 UTC, 1 replies.
- TestSuiteBase based unit test using a sliding window join timesout - posted by Enno Shioji <es...@gmail.com> on 2015/01/07 12:16:24 UTC, 0 replies.
- FW: No APPLICATION_COMPLETE file created in history server log location upon pyspark job success - posted by mi...@nomura.com on 2015/01/07 12:38:44 UTC, 2 replies.
- akka.actor.ActorNotFound In Spark Streaming on Mesos (using ssc.actorStream) - posted by Christophe Billiard <ch...@gmail.com> on 2015/01/07 14:30:56 UTC, 0 replies.
- KafkaUtils not consuming all the data from all partitions - posted by Mukesh Jha <me...@gmail.com> on 2015/01/07 15:00:09 UTC, 5 replies.
- Strange DAG scheduling behavior on currently dependent RDDs - posted by Corey Nolet <cj...@gmail.com> on 2015/01/07 15:12:21 UTC, 1 replies.
- Spark Trainings/ Professional certifications - posted by Saurabh Agrawal <sa...@markit.com> on 2015/01/07 15:38:33 UTC, 4 replies.
- About logistic regression sample codes in pyspark - posted by "cedric.artigue" <ar...@gmail.com> on 2015/01/07 15:49:46 UTC, 0 replies.
- Re: Understanding RDD.GroupBy OutOfMemory Exceptions - posted by asimjalis <as...@gmail.com> on 2015/01/07 15:56:21 UTC, 0 replies.
- Spark on teradata? - posted by gen tang <ge...@gmail.com> on 2015/01/07 16:14:10 UTC, 3 replies.
- Spark History Server can't read event logs - posted by mi...@nomura.com on 2015/01/07 16:45:58 UTC, 6 replies.
- Spark with Hive cluster dependencies - posted by jamborta <ja...@gmail.com> on 2015/01/07 17:27:35 UTC, 2 replies.
- streaming application throws IOException due to Log directory already exists during checkpoint recovery - posted by Max Xu <Ma...@twosigma.com> on 2015/01/07 17:55:57 UTC, 0 replies.
- Join stucks in the last stage step - posted by paja <vy...@gmail.com> on 2015/01/07 18:27:54 UTC, 1 replies.
- calculating the mean of SparseVector RDD - posted by rok <ro...@gmail.com> on 2015/01/07 18:42:34 UTC, 5 replies.
- What does (### skipped) mean in the Spark UI? - posted by Corey Nolet <cj...@gmail.com> on 2015/01/07 21:08:57 UTC, 5 replies.
- Spark with Cassandra - Shuffle opening to many files - posted by Ankur Srivastava <an...@gmail.com> on 2015/01/07 22:06:57 UTC, 2 replies.
- ScalaReflectionException when using saveAsParquetFile in sbt - posted by figpope <dr...@gmail.com> on 2015/01/07 22:54:21 UTC, 2 replies.
- Spark Streaming with Listening Server Socket - posted by gangli72 <ga...@yahoo.com> on 2015/01/07 23:34:51 UTC, 0 replies.
- [MLlib] Scoring GBTs with a variable number of trees - posted by Christopher Thom <Ch...@quantium.com.au> on 2015/01/08 00:01:42 UTC, 0 replies.
- spark 1.1 got error when working with cdh5.3.0 standalone mode - posted by freedafeng <fr...@yahoo.com> on 2015/01/08 01:45:32 UTC, 1 replies.
- When will spark support "push" style shuffle? - posted by 曹雪林 <xu...@gmail.com> on 2015/01/08 02:47:15 UTC, 0 replies.
- Eclipse flags error on KafkaUtils.createStream() - posted by Kah-Chan Low <ka...@yahoo.com.INVALID> on 2015/01/08 04:25:33 UTC, 1 replies.
- [Spare Core] function SparkContext.cancelJobGroup(groupId) doesn't work - posted by Tao Li <li...@gmail.com> on 2015/01/08 04:44:36 UTC, 0 replies.
- Re: MatrixFactorizationModel serialization - posted by wanbo <ge...@163.com> on 2015/01/08 04:53:15 UTC, 1 replies.
- Create DStream consisting of HDFS and (then) Kafka data - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/08 05:53:21 UTC, 3 replies.
- Can spark supports task level resource management? - posted by Xuelin Cao <xu...@gmail.com> on 2015/01/08 07:55:04 UTC, 5 replies.
- Re: Spark Standalone Cluster not correctly configured - posted by frodo777 <ro...@bitmonlab.com> on 2015/01/08 11:34:09 UTC, 1 replies.
- Spark 1.2.0 ec2 launch script hadoop native libraries not found warning - posted by critikaled <is...@gmail.com> on 2015/01/08 11:39:12 UTC, 0 replies.
- Several applications share the same Spark executors (or their cache) - posted by preeze <et...@gmail.com> on 2015/01/08 11:57:45 UTC, 2 replies.
- Trying to execute Spark in Yarn - posted by Guillermo Ortiz <ko...@gmail.com> on 2015/01/08 12:23:08 UTC, 2 replies.
- SPARKonYARN failing on CDH 5.3.0 : container cannot be fetched because of NumberFormatException - posted by Mukesh Jha <me...@gmail.com> on 2015/01/08 12:38:03 UTC, 5 replies.
- Executing Spark, Error creating path from empty String. - posted by Guillermo Ortiz <ko...@gmail.com> on 2015/01/08 14:15:47 UTC, 1 replies.
- Parquet compression codecs not applied - posted by Ayoub Benali <be...@gmail.com> on 2015/01/08 14:59:05 UTC, 4 replies.
- Build spark source code with Maven in Intellij Idea - posted by Todd <bi...@163.com> on 2015/01/08 15:24:59 UTC, 1 replies.
- Spark Project Fails to run multicore in local mode. - posted by mixtou <mi...@gmail.com> on 2015/01/08 15:47:41 UTC, 1 replies.
- Re: ERROR ConnectionManager: Corresponding SendingConnection to ConnectionManagerId - posted by Spidy <yo...@gmail.com> on 2015/01/08 16:05:41 UTC, 1 replies.
- Discrepancy in PCA values - posted by Upul Bandara <up...@gmail.com> on 2015/01/08 17:27:36 UTC, 5 replies.
- Re: Registering custom metrics - posted by Enno Shioji <es...@gmail.com> on 2015/01/08 17:30:21 UTC, 1 replies.
- Join RDDs with DStreams - posted by Asim Jalis <as...@gmail.com> on 2015/01/08 17:50:48 UTC, 2 replies.
- Spark Streaming Checkpointing - posted by Asim Jalis <as...@gmail.com> on 2015/01/08 18:22:20 UTC, 0 replies.
- Find S3 file attributes by Spark - posted by rajnish <ra...@gmail.com> on 2015/01/08 20:10:46 UTC, 0 replies.
- Data locality running Spark on Mesos - posted by mvle <mv...@us.ibm.com> on 2015/01/08 20:44:58 UTC, 4 replies.
- Initial State of updateStateByKey - posted by Asim Jalis <as...@gmail.com> on 2015/01/08 21:06:26 UTC, 0 replies.
- Is the Thrift server right for me? - posted by sjbrunst <sj...@uwaterloo.ca> on 2015/01/08 22:49:00 UTC, 0 replies.
- Spark SQL: Storing AVRO Schema in Parquet - posted by Jerry Lam <ch...@gmail.com> on 2015/01/08 22:50:31 UTC, 4 replies.
- Getting Output From a Cluster - posted by Su She <su...@gmail.com> on 2015/01/08 23:20:47 UTC, 7 replies.
- SparkSQL - posted by Abhi Basu <90...@gmail.com> on 2015/01/08 23:24:20 UTC, 1 replies.
- correct/best way to install custom spark1.2 on cdh5.3.0? - posted by freedafeng <fr...@yahoo.com> on 2015/01/09 00:01:03 UTC, 5 replies.
- Re: Problem with StreamingContext - getting SPARK-2243 - posted by Rishi Yadav <ri...@infoobjects.com> on 2015/01/09 00:35:32 UTC, 0 replies.
- Re: Profiling a spark application. - posted by Rishi Yadav <ri...@infoobjects.com> on 2015/01/09 00:37:50 UTC, 0 replies.
- Re: JavaRDD (Data Aggregation) based on key - posted by Rishi Yadav <ri...@infoobjects.com> on 2015/01/09 00:40:49 UTC, 0 replies.
- Running spark 1.2 on Hadoop + Kerberos - posted by Manoj Samel <ma...@gmail.com> on 2015/01/09 00:49:25 UTC, 3 replies.
- [ANNOUNCE] Apache Science and Healthcare Track @ApacheCon NA 2015 - posted by Lewis John Mcgibbney <le...@gmail.com> on 2015/01/09 03:47:49 UTC, 0 replies.
- Cannot save RDD as text file to local file system - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/09 05:42:49 UTC, 1 replies.
- Failed to save RDD as text file to local file system - posted by NingjunWang <ni...@lexisnexis.com> on 2015/01/09 05:55:07 UTC, 11 replies.
- Did anyone tried overcommit of CPU cores? - posted by Xuelin Cao <xu...@gmail.com> on 2015/01/09 06:45:56 UTC, 3 replies.
- skipping header from each file - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/09 07:18:25 UTC, 3 replies.
- Parallel execution on one node - posted by mikens <ms...@gmail.com> on 2015/01/09 07:57:37 UTC, 1 replies.
- Streaming Checkpointing - posted by Asim Jalis <as...@gmail.com> on 2015/01/09 10:19:31 UTC, 0 replies.
- EventBatch and SparkFlumeProtocol not found in spark codebase? - posted by "bit1129@163.com" <bi...@163.com> on 2015/01/09 11:03:16 UTC, 2 replies.
- Is It Feasible for Spark 1.1 Broadcast to Fully Utilize the Ethernet Card Throughput? - posted by Jun Yang <ya...@gmail.com> on 2015/01/09 11:11:41 UTC, 3 replies.
- KryoDeserialization getting java.io.EOFException - posted by yuemeng1 <yu...@huawei.com> on 2015/01/09 11:32:51 UTC, 0 replies.
- PermGen issues on AWS - posted by Joe Wass <jw...@crossref.org> on 2015/01/09 11:38:41 UTC, 2 replies.
- Queue independent jobs - posted by Anders Arpteg <ar...@spotify.com> on 2015/01/09 11:46:53 UTC, 2 replies.
- OptionalDataException during Naive Bayes Training - posted by jatinpreet <ja...@gmail.com> on 2015/01/09 12:19:45 UTC, 1 replies.
- Zipping RDDs of equal size not possible - posted by Niklas Wilcke <1w...@informatik.uni-hamburg.de> on 2015/01/09 12:40:12 UTC, 1 replies.
- Accidental kill in UI - posted by Joe Wass <jw...@crossref.org> on 2015/01/09 13:51:03 UTC, 2 replies.
- Play Scala Spark Exmaple - posted by Eduardo Cusa <ed...@usmediaconsulting.com> on 2015/01/09 14:47:12 UTC, 2 replies.
- Newbie Question on How Tasks are Executed - posted by mixtou <mi...@gmail.com> on 2015/01/09 14:48:06 UTC, 1 replies.
- Re: Mapping directory structure to columns in SparkSQL - posted by Michael Davies <mi...@gmail.com> on 2015/01/09 15:21:02 UTC, 0 replies.
- Cleaning up spark.local.dir automatically - posted by mi...@nomura.com on 2015/01/09 16:02:58 UTC, 4 replies.
- How to access OpenHashSet in my standalone program? - posted by Tae-Hyuk Ahn <ah...@gmail.com> on 2015/01/09 16:19:55 UTC, 3 replies.
- DeepLearning and Spark ? - posted by Jaonary Rabarisoa <ja...@gmail.com> on 2015/01/09 16:39:44 UTC, 6 replies.
- RE: RowMatrix.multiply() ? - posted by Adrian Mocanu <am...@verticalscope.com> on 2015/01/09 20:13:26 UTC, 1 replies.
- Re: java.io.IOException: Mkdirs failed to create file:/some/path/myapp.csv while using rdd.saveAsTextFile(fileAddress) Spark - posted by firemonk9 <dh...@gmail.com> on 2015/01/09 20:28:50 UTC, 2 replies.
- Parquet predicate pushdown troubles - posted by Yana Kadiyska <ya...@gmail.com> on 2015/01/09 20:56:53 UTC, 0 replies.
- updateStateByKey: cleaning up state for keys not in current window - posted by Simone Franzini <ca...@gmail.com> on 2015/01/09 21:15:55 UTC, 0 replies.
- Questions about Spark and HDFS co-location - posted by zfry <zf...@palantir.com> on 2015/01/09 23:13:36 UTC, 3 replies.
- Re: Reading HBase data - Exception - posted by lmsiva <la...@gmail.com> on 2015/01/09 23:19:40 UTC, 0 replies.
- How to use BigInteger for userId and productId in collaborative Filtering? - posted by nishanthps <ni...@gmail.com> on 2015/01/10 02:12:18 UTC, 4 replies.
- Rank for SQL and ORDER BY? - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/10 02:32:01 UTC, 0 replies.
- OOM exception during row deserialization - posted by Pala M Muthaia <mc...@rocketfuelinc.com> on 2015/01/10 03:30:21 UTC, 2 replies.
- Web Service + Spark - posted by Cui Lin <cu...@hds.com> on 2015/01/10 03:33:05 UTC, 5 replies.
- Issue writing to Cassandra from Spark - posted by Ankur Srivastava <an...@gmail.com> on 2015/01/10 04:14:30 UTC, 6 replies.
- Submitting SparkContext and seeing driverPropsFetcher exception - posted by Corey Nolet <cj...@gmail.com> on 2015/01/10 07:29:58 UTC, 0 replies.
- /tmp directory fills up - posted by Alessandro Baretta <al...@gmail.com> on 2015/01/10 08:32:00 UTC, 1 replies.
- ALS.trainImplicit running out of mem when using higher rank - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/10 10:11:13 UTC, 10 replies.
- status of spark analytics functions? over, rank, percentile, row_number, etc. - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/10 19:12:38 UTC, 2 replies.
- Does Spark automatically run different stages concurrently when possible? - posted by YaoPau <jo...@gmail.com> on 2015/01/10 19:24:17 UTC, 13 replies.
- Re: FileNotFoundException in appcache shuffle files - posted by lucio raimondo <lu...@hotmail.com> on 2015/01/10 21:16:16 UTC, 1 replies.
- Re: IOError: [Errno 2] No such file or directory: '/tmp/spark-9e23f17e-2e23-4c26-9621-3cb4d8b832da/tmp3i3xno' - posted by lucio raimondo <lu...@hotmail.com> on 2015/01/10 21:27:42 UTC, 0 replies.
- Re: Job priority - posted by Mark Hamstra <ma...@clearstorydata.com> on 2015/01/11 02:00:55 UTC, 5 replies.
- train many decision tress with a single spark job - posted by Josh Buffum <jb...@gmail.com> on 2015/01/11 02:53:20 UTC, 6 replies.
- How can I measure the time an RDD takes to execute? - posted by Saiph Kappa <sa...@gmail.com> on 2015/01/11 04:04:54 UTC, 0 replies.
- Re: Spark Graph Visualizer - posted by kevinkim <ke...@apache.org> on 2015/01/11 06:15:40 UTC, 0 replies.
- Does DecisionTree model in MLlib deal with missing values? - posted by Carter <gy...@hotmail.com> on 2015/01/11 07:54:24 UTC, 3 replies.
- Removing JARs from spark-jobserver - posted by Sasi <sa...@gmail.com> on 2015/01/11 08:21:10 UTC, 4 replies.
- How to set UI port #? - posted by YaoPau <jo...@gmail.com> on 2015/01/11 09:38:57 UTC, 2 replies.
- Submit Spark applications from a machine that doesn't have Java installed - posted by Nick Chammas <ni...@gmail.com> on 2015/01/11 22:44:54 UTC, 1 replies.
- propogating edges - posted by dizzy5112 <da...@gmail.com> on 2015/01/12 01:02:12 UTC, 1 replies.
- How to recovery application running records when I restart Spark master? - posted by ChongTang <ct...@virginia.edu> on 2015/01/12 01:08:20 UTC, 6 replies.
- what is the roadmap for Spark SQL dialect in the coming releases? - posted by Niranda Perera <ni...@gmail.com> on 2015/01/12 06:14:46 UTC, 4 replies.
- Support for SQL on unions of tables (merge tables?) - posted by Paul Wais <pa...@gmail.com> on 2015/01/12 06:51:21 UTC, 3 replies.
- GraphX vs GraphLab - posted by Madabhattula Rajesh Kumar <mr...@gmail.com> on 2015/01/12 09:07:12 UTC, 1 replies.
- how to select the first row in each group by group? - posted by LinQili <li...@outlook.com> on 2015/01/12 10:23:15 UTC, 1 replies.
- Manually trigger RDD map function without action - posted by Kevin Jung <it...@samsung.com> on 2015/01/12 10:48:26 UTC, 4 replies.
- creating a single kafka producer object for all partitions - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/12 11:56:39 UTC, 5 replies.
- Re: Spark SQL & Parquet - data are reading very very slow - posted by kaushal <ka...@gmail.com> on 2015/01/12 13:56:20 UTC, 2 replies.
- RowMatrix multiplication - posted by Alex Minnaar <am...@verticalscope.com> on 2015/01/12 15:33:05 UTC, 5 replies.
- Spark does not loop through a RDD.map - posted by rkgurram <rk...@gmail.com> on 2015/01/12 16:49:54 UTC, 1 replies.
- Re: How to use memcached with spark - posted by "octavian.ganea" <oc...@inf.ethz.ch> on 2015/01/12 16:52:13 UTC, 1 replies.
- configuring spark.yarn.driver.memoryOverhead on Spark 1.2.0 - posted by David McWhorter <mc...@ccri.com> on 2015/01/12 17:01:26 UTC, 3 replies.
- Spark executors resources. Blocking? - posted by Luis Guerra <lu...@gmail.com> on 2015/01/12 17:36:18 UTC, 2 replies.
- Pattern Matching / Equals on Case Classes in Spark Not Working - posted by "Rosner, Frank (Allianz SE)" <FR...@ALLIANZ.COM> on 2015/01/12 19:04:36 UTC, 2 replies.
- can I buffer flatMap input at each worker node? - posted by maherrt <ma...@hotmail.com> on 2015/01/12 19:17:25 UTC, 1 replies.
- ReliableKafkaReceiver stopped receiving data after WriteAheadLogBasedBlockHandler throws TimeoutException - posted by Max Xu <Ma...@twosigma.com> on 2015/01/12 21:10:46 UTC, 1 replies.
- no snappyjava in java.library.path - posted by Dan Dong <do...@gmail.com> on 2015/01/12 21:28:34 UTC, 1 replies.
- Spark Framework handling of Mesos master change - posted by Ethan Wolf <et...@alum.mit.edu> on 2015/01/12 21:44:34 UTC, 1 replies.
- How does unmanaged memory work with the executor memory limits? - posted by Michael Albert <m_...@yahoo.com.INVALID> on 2015/01/12 23:06:39 UTC, 1 replies.
- including the spark-mllib in build.sbt - posted by Jianguo Li <fl...@gmail.com> on 2015/01/12 23:27:08 UTC, 1 replies.
- How Spark Calculate partition size automatically - posted by rajnish <ra...@gmail.com> on 2015/01/12 23:33:23 UTC, 0 replies.
- Broadcast joins on RDD - posted by Pala M Muthaia <mc...@rocketfuelinc.com> on 2015/01/13 00:15:35 UTC, 1 replies.
- [mllib] GradientDescent requires huge memory for storing weight vector - posted by Tianshuo Deng <td...@twitter.com.INVALID> on 2015/01/13 01:26:10 UTC, 1 replies.
- Re: Is there any Spark implementation for Item-based Collaborative Filtering? - posted by Simon Chan <si...@gmail.com> on 2015/01/13 03:01:32 UTC, 0 replies.
- quickly counting the number of rows in a partition? - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/13 03:54:06 UTC, 7 replies.
- How to create an empty RDD with a given type? - posted by Xuelin Cao <xu...@gmail.com> on 2015/01/13 06:50:57 UTC, 3 replies.
- Creating RDD from only few columns of a Parquet file - posted by Ajay Srivastava <a_...@yahoo.com.INVALID> on 2015/01/13 07:20:16 UTC, 2 replies.
- Running Spark application from command line - posted by Arun Lists <li...@gmail.com> on 2015/01/13 07:58:49 UTC, 2 replies.
- saveAsTextFile just uses toString and Row@37f108 - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/13 09:03:05 UTC, 1 replies.
- Failing jobs runs twice - posted by Anders Arpteg <ar...@spotify.com> on 2015/01/13 09:32:23 UTC, 4 replies.
- saveAsObjectFile is actually saveAsSequenceFile - posted by Kevin Burton <bu...@spinn3r.com> on 2015/01/13 09:39:21 UTC, 3 replies.
- Spark Sql reading whole table from cache instead of required coulmns - posted by Surbhit <su...@gmail.com> on 2015/01/13 10:46:31 UTC, 1 replies.
- How to define SparkContext with Cassandra connection for spark-jobserver? - posted by Sasi <sa...@gmail.com> on 2015/01/13 13:14:53 UTC, 2 replies.
- Problems with Spark Core 1.2.0 SBT project in IntelliJ - posted by Night Wolf <ni...@gmail.com> on 2015/01/13 13:16:31 UTC, 5 replies.
- IndexedRDD - posted by Jem Tucker <je...@gmail.com> on 2015/01/13 14:35:43 UTC, 3 replies.
- Re: Job getting killed - posted by akhandeshi <am...@gmail.com> on 2015/01/13 16:07:16 UTC, 0 replies.
- Re: Unable to find configuration file at location scalastyle-config.xml - posted by Sean Owen <so...@cloudera.com> on 2015/01/13 17:21:52 UTC, 0 replies.
- Querying over mutliple (avro) files using Spark SQL - posted by thomas j <be...@googlemail.com> on 2015/01/13 18:25:15 UTC, 0 replies.
- Unread block data exception when reading from HBase - posted by jeremy p <at...@gmail.com> on 2015/01/13 18:45:45 UTC, 0 replies.
- Can't run Spark java code from command line - posted by jeremy p <at...@gmail.com> on 2015/01/13 18:45:51 UTC, 2 replies.
- save spark streaming output to single file on hdfs - posted by jamborta <ja...@gmail.com> on 2015/01/13 19:04:12 UTC, 5 replies.
- ExternalSorter - spilling in-memory map - posted by akhandeshi <am...@gmail.com> on 2015/01/13 19:29:30 UTC, 0 replies.
- Why always spilling to disk and how to improve it? - posted by Shuai Zheng <sz...@gmail.com> on 2015/01/13 21:21:10 UTC, 3 replies.
- [SparkSQL] Try2: Parquet predicate pushdown troubles - posted by Yana Kadiyska <ya...@gmail.com> on 2015/01/13 21:56:30 UTC, 4 replies.
- Save RDD with partition information - posted by Puneet Kapoor <pu...@gmail.com> on 2015/01/13 22:30:26 UTC, 3 replies.
- spark.cleaner questions - posted by ankits <an...@gmail.com> on 2015/01/13 22:41:33 UTC, 0 replies.
- Hive UDAF percentile_approx says "This UDAF does not support the deprecated getEvaluator() method." - posted by Jianshi Huang <ji...@gmail.com> on 2015/01/13 22:51:36 UTC, 3 replies.
- Issues with constants in Spark HiveQL queries - posted by Pala M Muthaia <mc...@rocketfuelinc.com> on 2015/01/13 23:25:43 UTC, 7 replies.
- OOM for HiveFromSpark example - posted by Zhan Zhang <zz...@hortonworks.com> on 2015/01/14 00:08:07 UTC, 0 replies.
- spark standalone master with workers on two nodes - posted by Josh J <jo...@gmail.com> on 2015/01/14 03:17:30 UTC, 1 replies.
- Reading resource files in a Spark application - posted by Arun Lists <li...@gmail.com> on 2015/01/14 03:35:59 UTC, 3 replies.
- *ByKey aggregations: performance + order - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/14 04:11:34 UTC, 4 replies.
- use netty shuffle for network cause high gc time - posted by lihu <li...@gmail.com> on 2015/01/14 06:26:42 UTC, 3 replies.
- Spark 1.2.0 not getting connected - posted by Abhideep Chakravarty <Ab...@mindtree.com> on 2015/01/14 07:03:47 UTC, 3 replies.
- Re: OpenCV + Spark : Where to put System.loadLibrary ? - posted by Jishnu Prathap <ji...@wipro.com> on 2015/01/14 07:17:40 UTC, 0 replies.
- How to integrate Spark with OpenCV? - posted by Jishnu Prathap <ji...@wipro.com> on 2015/01/14 07:32:00 UTC, 6 replies.
- spark crashes on second or third call first() on file - posted by Linda Terlouw <li...@icris.nl> on 2015/01/14 09:00:34 UTC, 0 replies.
- Spark with MongoDB problem - posted by Oliver Fernandez <ol...@marfeel.com> on 2015/01/14 09:46:48 UTC, 0 replies.
- about window length and slide interval - posted by Hoai-Thu Vuong <th...@gmail.com> on 2015/01/14 09:58:05 UTC, 4 replies.
- Using Spark SQL with multiple (avro) files - posted by David Jones <le...@gmail.com> on 2015/01/14 10:34:59 UTC, 4 replies.
- How does GraphX internally traverse the Graph? - posted by mas <ma...@gmail.com> on 2015/01/14 11:58:34 UTC, 0 replies.
- java.io.IOException: sendMessageReliably failed without being ACK'd - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/14 12:15:48 UTC, 0 replies.
- View executor logs on YARN mode - posted by lonely Feb <lo...@gmail.com> on 2015/01/14 14:07:56 UTC, 1 replies.
- [spark-jobserver] Submit Job in yarn-cluster mode (?) - posted by Pietro Gentile <pi...@gmail.com> on 2015/01/14 15:03:15 UTC, 0 replies.
- java.lang.NoClassDefFoundError: io/netty/util/TimerTask Error when running sbt test - posted by Jianguo Li <fl...@gmail.com> on 2015/01/14 16:20:46 UTC, 0 replies.
- Re: - posted by Ted Yu <yu...@gmail.com> on 2015/01/14 16:23:31 UTC, 1 replies.
- FileInputDStream missing files - posted by Jem Tucker <je...@gmail.com> on 2015/01/14 16:53:00 UTC, 0 replies.
- reconciling best effort real time with delayed aggregation - posted by Adrian Mocanu <am...@verticalscope.com> on 2015/01/14 17:19:22 UTC, 0 replies.
- Can I save RDD to local file system and then read it back on spark cluster with multiple nodes? - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/14 18:12:11 UTC, 6 replies.
- Re: dockerized spark executor on mesos? - posted by Josh J <jo...@gmail.com> on 2015/01/14 18:13:00 UTC, 2 replies.
- Issues running spark on cluster - posted by TJ Klein <TJ...@gmail.com> on 2015/01/14 18:55:09 UTC, 2 replies.
- component.AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:4040: java.net.BindException: Address already in use - posted by Jianguo Li <fl...@gmail.com> on 2015/01/14 21:30:27 UTC, 1 replies.
- Running "beyond memory limits" in ConnectedComponents - posted by nitinkak001 <ni...@gmail.com> on 2015/01/14 22:18:38 UTC, 8 replies.
- Using a RowMatrix inside a map - posted by Alex Minnaar <am...@verticalscope.com> on 2015/01/14 23:06:54 UTC, 1 replies.
- enable debug-level log output of akka? - posted by Nan Zhu <zh...@gmail.com> on 2015/01/14 23:55:07 UTC, 5 replies.
- how to run python app in yarn? - posted by freedafeng <fr...@yahoo.com> on 2015/01/15 00:14:37 UTC, 4 replies.
- Re: java.lang.ExceptionInInitializerError/Unable to load YARN support - posted by maven <ni...@gmail.com> on 2015/01/15 01:55:04 UTC, 0 replies.
- Custom JSON schema inference - posted by Corey Nolet <cj...@gmail.com> on 2015/01/15 02:18:40 UTC, 0 replies.
- Accumulators - posted by Corey Nolet <cj...@gmail.com> on 2015/01/15 03:19:15 UTC, 2 replies.
- Accumulator value in Spark UI - posted by Justin Yip <yi...@prediction.io> on 2015/01/15 03:46:07 UTC, 2 replies.
- How to replay consuming messages from kafka using spark streaming? - posted by mykidong <my...@gmail.com> on 2015/01/15 04:58:46 UTC, 3 replies.
- Fast HashSets & HashMaps - Spark Collection Utils - posted by Night Wolf <ni...@gmail.com> on 2015/01/15 05:05:17 UTC, 1 replies.
- Spark's equivalent of ShellBolt - posted by Umanga Bista <bi...@gmail.com> on 2015/01/15 05:41:43 UTC, 1 replies.
- Is there Spark's equivalent for Storm's ShellBolt? - posted by umanga <bi...@gmail.com> on 2015/01/15 06:16:44 UTC, 1 replies.
- Serializability: for vs. while loops - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/15 08:37:22 UTC, 3 replies.
- Visualize Spark Job - posted by "Kuromatsu, Nobuyuki" <n....@jp.fujitsu.com> on 2015/01/15 09:50:41 UTC, 0 replies.
- Error connecting to localhost:8060: java.net.ConnectException: Connection refused - posted by Gautam Bajaj <ga...@g.softbank.co.jp> on 2015/01/15 09:55:45 UTC, 0 replies.
- MissingRequirementError with spark - posted by Pierre B <pi...@realimpactanalytics.com> on 2015/01/15 10:12:15 UTC, 3 replies.
- Re: MissingRequirementError with spark 1.2 - posted by sarsol <su...@gmail.com> on 2015/01/15 11:27:39 UTC, 0 replies.
- spark fault tolerance mechanism - posted by YANG Fan <id...@gmail.com> on 2015/01/15 11:42:38 UTC, 0 replies.
- kinesis creating stream scala code exception - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/15 12:28:05 UTC, 1 replies.
- PySpark saveAsTextFile gzip - posted by Tom Seddon <mr...@gmail.com> on 2015/01/15 12:46:21 UTC, 1 replies.
- Spark-Sql not using cluster slaves - posted by ahmedabdelrahman <ah...@sap.com> on 2015/01/15 13:06:32 UTC, 0 replies.
- Using native blas with mllib - posted by lev <ka...@gmail.com> on 2015/01/15 13:41:52 UTC, 0 replies.
- How to query Spark master for cluster status ? - posted by Shing Hing Man <ma...@yahoo.com.INVALID> on 2015/01/15 14:00:22 UTC, 1 replies.
- Some tasks are taking long time - posted by Ajay Srivastava <a_...@yahoo.com.INVALID> on 2015/01/15 14:42:40 UTC, 4 replies.
- Inserting an element in RDD[String] - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/15 15:16:55 UTC, 3 replies.
- SQL JSON array operations - posted by jvuillermet <je...@gmail.com> on 2015/01/15 16:02:43 UTC, 3 replies.
- small error in the docs? - posted by kirillfish <k....@datacentric.ru> on 2015/01/15 17:43:00 UTC, 1 replies.
- using hiveContext to select a nested Map-data-type from an AVROmodel+parquet file - posted by BB <ba...@gmail.com> on 2015/01/15 17:52:04 UTC, 3 replies.
- Is spark suitable for large scale pagerank, such as 200 million nodes, 2 billion edges? - posted by txw <tx...@outlook.com> on 2015/01/15 18:29:50 UTC, 1 replies.
- Re: Testing if an RDD is empty? - posted by Al M <al...@gmail.com> on 2015/01/15 18:33:30 UTC, 3 replies.
- Re: spark crashes on second or third call first() on file - posted by Davies Liu <da...@databricks.com> on 2015/01/15 18:58:20 UTC, 0 replies.
- Error when running SparkPi on Secure HA Hadoop cluster - posted by Manoj Samel <ma...@gmail.com> on 2015/01/15 20:23:10 UTC, 1 replies.
- Executor vs Mapper in Hadoop - posted by Shuai Zheng <sz...@gmail.com> on 2015/01/15 21:16:19 UTC, 2 replies.
- Executor parameter doesn't work for Spark-shell on EMR Yarn - posted by Shuai Zheng <sz...@gmail.com> on 2015/01/15 21:52:22 UTC, 2 replies.
- How to force parallel processing of RDD using multiple thread - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/15 21:54:38 UTC, 6 replies.
- Distributing Computation across slaves - posted by Steve Lewis <lo...@gmail.com> on 2015/01/15 22:15:20 UTC, 0 replies.
- spark streaming python files not packaged in assembly jar - posted by jamborta <ja...@gmail.com> on 2015/01/16 00:49:54 UTC, 0 replies.
- Anyway to make RDD preserve input directories structures? - posted by 逸君曹 <ca...@gmail.com> on 2015/01/16 03:15:02 UTC, 1 replies.
- OutOfMemory error in Spark Core - posted by Anand Mohan <ch...@gmail.com> on 2015/01/16 06:11:32 UTC, 1 replies.
- Spark SQL Custom Predicate Pushdown - posted by Corey Nolet <cj...@gmail.com> on 2015/01/16 06:50:48 UTC, 7 replies.
- Re: Low Level Kafka Consumer for Spark - posted by mykidong <my...@gmail.com> on 2015/01/16 06:55:54 UTC, 5 replies.
- UserGroupInformation: PriviledgedActionException as - posted by spraveen <my...@gmail.com> on 2015/01/16 08:15:58 UTC, 0 replies.
- MatchError in JsonRDD.toLong - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/16 08:25:59 UTC, 7 replies.
- ERROR UserGroupInformation: PriviledgedActionException in standalone mode - posted by kundan kumar <ii...@gmail.com> on 2015/01/16 09:55:33 UTC, 0 replies.
- MLib: How to set preferences for ALS implicit feedback in Collaborative Filtering? - posted by Zork Sail <zo...@gmail.com> on 2015/01/16 10:58:13 UTC, 4 replies.
- Why custom parquet format hive table execute "ParquetTableScan" physical plan, not "HiveTableScan"? - posted by Xiaoyu Wang <wa...@gmail.com> on 2015/01/16 11:09:05 UTC, 8 replies.
- terasort on spark - posted by lonely Feb <lo...@gmail.com> on 2015/01/16 11:24:12 UTC, 0 replies.
- Fwd: Problems with TeraValidate - posted by lonely Feb <lo...@gmail.com> on 2015/01/16 12:10:00 UTC, 0 replies.
- How to 'Pipe' Binary Data in Apache Spark - posted by Nick Allen <ni...@nickallen.org> on 2015/01/16 16:09:32 UTC, 10 replies.
- Re: Scala vs Python performance differences - posted by philpearl <ph...@tanktop.tv> on 2015/01/16 16:38:53 UTC, 1 replies.
- kinesis multiple records adding into stream - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/16 17:08:54 UTC, 2 replies.
- remote Akka client disassociated - some timeout? - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/16 19:00:31 UTC, 2 replies.
- RE: Determine number of running executors - posted by Shuai Zheng <sz...@gmail.com> on 2015/01/16 19:05:12 UTC, 1 replies.
- If an RDD appeared twice in a DAG, of which calculation is triggered by a single action, will this RDD be calculated twice? - posted by Peng Cheng <pc...@uow.edu.au> on 2015/01/16 19:37:43 UTC, 3 replies.
- spark java options - posted by Kane Kim <ka...@gmail.com> on 2015/01/16 20:12:57 UTC, 3 replies.
- Creating Apache Spark-powered “As Service” applications - posted by olegshirokikh <ol...@solver.com> on 2015/01/16 20:31:45 UTC, 4 replies.
- Subscribe - posted by Andrew Musselman <an...@gmail.com> on 2015/01/16 20:51:02 UTC, 1 replies.
- Maven out of memory error - posted by Andrew Musselman <an...@gmail.com> on 2015/01/16 21:03:22 UTC, 11 replies.
- Performance issue - posted by TJ Klein <TJ...@gmail.com> on 2015/01/16 21:26:03 UTC, 1 replies.
- issue with spark-ec2 of spark release 1.1.0 - posted by ey-chih chow <ey...@hotmail.com> on 2015/01/16 21:39:31 UTC, 0 replies.
- Cluster Aware Custom RDD - posted by Jim Carroll <ji...@gmail.com> on 2015/01/16 22:12:28 UTC, 0 replies.
- Spark random forest - string data - posted by Asaf Lahav <as...@gmail.com> on 2015/01/16 22:25:50 UTC, 3 replies.
- Processing .wav files in PySpark - posted by "Venkat, Ankam" <An...@centurylink.com> on 2015/01/16 23:11:35 UTC, 1 replies.
- Problem with File Streams - posted by Leonidas Fegaras <fe...@cse.uta.edu> on 2015/01/16 23:54:59 UTC, 2 replies.
- spark 1.2 compatibility - posted by bhavyateja <bh...@gmail.com> on 2015/01/17 00:17:06 UTC, 8 replies.
- Row similarities - posted by Andrew Musselman <an...@gmail.com> on 2015/01/17 02:18:43 UTC, 13 replies.
- HDFS Namenode in safemode when I turn off my EC2 instance - posted by Su She <su...@gmail.com> on 2015/01/17 04:01:28 UTC, 8 replies.
- Re: pyspark sc.textFile uses only 4 out of 32 threads per node - posted by Gautham Anil <ga...@gmail.com> on 2015/01/17 08:02:29 UTC, 1 replies.
- Futures timed out during unpersist - posted by "Kevin (Sangwoo) Kim" <ke...@apache.org> on 2015/01/17 08:31:32 UTC, 2 replies.
- Bouncing Mails - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2015/01/17 09:56:53 UTC, 2 replies.
- No Output - posted by Deep Pradhan <pr...@gmail.com> on 2015/01/17 10:10:20 UTC, 4 replies.
- Spark Streaming - posted by Rohit Pujari <rp...@hortonworks.com> on 2015/01/17 11:05:18 UTC, 4 replies.
- Re: Discourse: A proposed alternative to the Spark User list - posted by pzecevic <pe...@gmail.com> on 2015/01/17 12:24:50 UTC, 20 replies.
- Error occurs when running Spark SQL example - posted by "bit1129@163.com" <bi...@163.com> on 2015/01/17 12:49:16 UTC, 0 replies.
- spark error in yarn-client mode - posted by Kyounghyun Park <ky...@gmail.com> on 2015/01/17 13:16:44 UTC, 0 replies.
- Is cluster mode is supported by the submit command for standalone clusters? - posted by guxiaobo1982 <gu...@qq.com> on 2015/01/17 14:01:19 UTC, 0 replies.
- Join DStream With Other Datasets - posted by Ji ZHANG <zh...@gmail.com> on 2015/01/17 15:05:32 UTC, 5 replies.
- Cluster hangs in 'ssh-ready' state using Spark 1.2 EC2 launch script - posted by Nathan Murthy <na...@gmail.com> on 2015/01/17 19:00:15 UTC, 2 replies.
- Spark job stuck at RangePartitioner at Exchange.scala:79 - posted by Sunita Arvind <su...@gmail.com> on 2015/01/17 21:56:14 UTC, 1 replies.
- maven doesn't build dependencies with Scala 2.11 - posted by Walrus theCat <wa...@gmail.com> on 2015/01/18 00:43:40 UTC, 4 replies.
- Directory / File Reading Patterns - posted by Steve Nunez <sn...@hortonworks.com> on 2015/01/18 00:48:07 UTC, 3 replies.
- Spark UI and Spark Version on Google Compute Engine - posted by Soumya Simanta <so...@gmail.com> on 2015/01/18 01:47:52 UTC, 1 replies.
- Spark attempts to de/serialize using JavaSerializer despite being configured to use Kryo - posted by waymost <wa...@gmail.com> on 2015/01/18 02:04:00 UTC, 0 replies.
- How to get the master URL at runtime inside driver program? - posted by guxiaobo1982 <gu...@qq.com> on 2015/01/18 03:08:51 UTC, 2 replies.
- spark-submit --py-files remote: "Only local additional python files are supported" - posted by voukka <vl...@kiosked.com> on 2015/01/18 07:05:14 UTC, 4 replies.
- Re: Is spark suitable for large scale pagerank, such as 200 millionnodes, 2 billion edges? - posted by txw <tx...@outlook.com> on 2015/01/18 07:18:02 UTC, 0 replies.
- Not able to run spark job from code on EC2 with spark 1.2.0 - posted by rahulkumar-aws <ra...@gmail.com> on 2015/01/18 08:09:25 UTC, 0 replies.
- How to create distributed matrixes from hive tables. - posted by guxiaobo1982 <gu...@qq.com> on 2015/01/18 13:07:08 UTC, 1 replies.
- Re: running a job on ec2 "Initial job has not accepted any resources" - posted by Grzegorz Dubicki <gr...@gmail.com> on 2015/01/18 13:32:11 UTC, 1 replies.
- Re: How to share a NonSerializable variable among tasks in the same worker node? - posted by "octavian.ganea" <oc...@inf.ethz.ch> on 2015/01/18 13:56:41 UTC, 3 replies.
- Re: Avoid broacasting huge variables - posted by "octavian.ganea" <oc...@inf.ethz.ch> on 2015/01/18 13:56:59 UTC, 1 replies.
- Reducer memory exceeded - posted by "octavian.ganea" <oc...@inf.ethz.ch> on 2015/01/18 14:45:18 UTC, 1 replies.
- ExceptionInInitializerError when using a class defined in REPL - posted by "Kevin (Sangwoo) Kim" <ke...@apache.org> on 2015/01/18 15:01:20 UTC, 1 replies.
- Trying to find where Spark persists RDDs when run with YARN - posted by Hemanth Yamijala <yh...@gmail.com> on 2015/01/18 15:50:30 UTC, 1 replies.
- Spark Streaming with Kafka - posted by Rasika Pohankar <ra...@gmail.com> on 2015/01/18 18:47:32 UTC, 4 replies.
- Recent Git Builds Application WebUI Problem and Exception Stating "Log directory /tmp/spark-events does not exist." - posted by Ganon Pierce <ga...@me.com> on 2015/01/18 22:59:40 UTC, 1 replies.
- Streaming with Java: Expected ReduceByWindow to Return JavaDStream - posted by Jeff Nadler <jn...@srcginc.com> on 2015/01/19 07:04:17 UTC, 2 replies.
- Need some help to create user defined type for ML pipeline - posted by Jaonary Rabarisoa <ja...@gmail.com> on 2015/01/19 09:59:55 UTC, 1 replies.
- Is there any way to support multiple users executing SQL on thrift server? - posted by Yi Tian <ti...@gmail.com> on 2015/01/19 10:00:56 UTC, 1 replies.
- UnknownhostException : home - posted by Rapelly Kartheek <ka...@gmail.com> on 2015/01/19 10:33:37 UTC, 8 replies.
- possible memory leak when re-creating SparkContext's in the same JVM - posted by Noam Barcay <no...@kenshoo.com> on 2015/01/19 11:32:44 UTC, 0 replies.
- is there documentation on spark sql catalyst? - posted by critikaled <is...@gmail.com> on 2015/01/19 12:11:48 UTC, 0 replies.
- Suggestion needed for implementing DROOLS in spark - posted by vishnu86 <vi...@yahoo.com> on 2015/01/19 13:20:23 UTC, 0 replies.
- Spark 1.20 resource issue with Mesos .21.1 - posted by Brian Belgodere <bb...@gmail.com> on 2015/01/19 15:40:08 UTC, 0 replies.
- Spark SQL: Assigning several aliases to the output (several return values) of an UDF - posted by mucks17 <ma...@web.de> on 2015/01/19 15:51:04 UTC, 2 replies.
- unit tests with "java.io.IOException: Could not create FileClient" - posted by Jianguo Li <fl...@gmail.com> on 2015/01/19 15:58:26 UTC, 1 replies.
- [SQL] Using HashPartitioner to distribute by column - posted by Mick Davies <Mi...@gmail.com> on 2015/01/19 16:44:29 UTC, 4 replies.
- Error for first run from iPython Notebook - posted by Dave <dl...@gmail.com> on 2015/01/19 19:50:43 UTC, 3 replies.
- Re: EC2 VPC script - posted by Vladimir Grigor <vl...@kiosked.com> on 2015/01/19 20:40:09 UTC, 0 replies.
- Re: ERROR TaskSchedulerImpl: Lost an executor - posted by suresh <la...@gmail.com> on 2015/01/19 21:04:40 UTC, 3 replies.
- Aggregations based on sort order - posted by "justin.uang" <ju...@gmail.com> on 2015/01/19 23:51:31 UTC, 1 replies.
- How to output to S3 and keep the order - posted by anny9699 <an...@gmail.com> on 2015/01/20 02:37:12 UTC, 2 replies.
- How to compute RDD[(String, Set[String])] that include large Set - posted by jagaximo <ta...@dwango.co.jp> on 2015/01/20 04:38:10 UTC, 7 replies.
- Bind Exception - posted by Deep Pradhan <pr...@gmail.com> on 2015/01/20 05:11:31 UTC, 6 replies.
- com.amazonaws.AmazonClientException: Unable to load AWS credentials from any provider in the chain - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/20 08:21:05 UTC, 1 replies.
- Re: Linkage error - duplicate class definition - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/20 10:21:33 UTC, 0 replies.
- IF statement doesn't work in Spark-SQL? - posted by Xuelin Cao <xu...@gmail.com> on 2015/01/20 10:22:06 UTC, 7 replies.
- Spark on YARN: java.lang.ClassCastException SerializedLambda to org.apache.spark.api.java.function.Function in instance of org.apache.spark.api.java.JavaPairRDD$$anonfun$toScalaFunction$1 - posted by thanhtien522 <th...@gmail.com> on 2015/01/20 11:47:46 UTC, 2 replies.
- spark streaming kinesis issue - posted by Hafiz Mujadid <ha...@gmail.com> on 2015/01/20 11:51:21 UTC, 0 replies.
- spark streaming with checkpoint - posted by "balu.naren" <ba...@gmail.com> on 2015/01/20 12:16:38 UTC, 7 replies.
- Scala Spark SQL row object Ordinal Method Call Aliasing - posted by Night Wolf <ni...@gmail.com> on 2015/01/20 12:39:30 UTC, 3 replies.
- Can multiple streaming apps use the same checkpoint directory? - posted by Ashic Mahtab <as...@live.com> on 2015/01/20 12:58:07 UTC, 0 replies.
- Saving a mllib model in Spark SQL - posted by Divyansh Jain <di...@ideata-analytics.com> on 2015/01/20 14:34:25 UTC, 4 replies.
- Re: Spark Streaming checkpoint recovery causes IO re-execution - posted by RodrigoB <ro...@aspect.com> on 2015/01/20 14:34:29 UTC, 0 replies.
- getting started writing unit tests for my app - posted by Matthew Cornell <ma...@gmail.com> on 2015/01/20 15:26:57 UTC, 0 replies.
- Apply function to all elements along each key - posted by Luis Guerra <lu...@gmail.com> on 2015/01/20 17:24:36 UTC, 0 replies.
- NPE in Parquet - posted by Alessandro Baretta <al...@gmail.com> on 2015/01/20 17:29:37 UTC, 1 replies.
- PySpark Client - posted by Chris Beavers <cb...@trifacta.com> on 2015/01/20 17:36:36 UTC, 2 replies.
- Aggregate order semantics when spilling - posted by Justin Uang <ju...@gmail.com> on 2015/01/20 18:18:14 UTC, 2 replies.
- dynamically change receiver for a spark stream - posted by jamborta <ja...@gmail.com> on 2015/01/20 20:08:52 UTC, 7 replies.
- Confused about shuffle read and shuffle write - posted by Darin McBeath <dd...@yahoo.com.INVALID> on 2015/01/20 20:58:03 UTC, 1 replies.
- Spark 1.2 - com/google/common/base/Preconditions java.lang.NoClassDefFoundErro - posted by Shailesh Birari <sb...@gmail.com> on 2015/01/21 00:55:51 UTC, 8 replies.
- Spark 1.1.0 - spark-submit failed - posted by ey-chih chow <ey...@hotmail.com> on 2015/01/21 01:15:04 UTC, 2 replies.
- Python connector for spark-cassandra - posted by Nishant Sinha <ns...@uw.edu> on 2015/01/21 02:10:08 UTC, 0 replies.
- Re: S3 Bucket Access - posted by bbailey <bb...@vpicu.net> on 2015/01/21 02:15:13 UTC, 0 replies.
- What will happen if the Driver exits abnormally? - posted by personal_email0 <an...@qq.com> on 2015/01/21 02:41:08 UTC, 0 replies.
- MapType in spark-sql - posted by Kevin Jung <it...@samsung.com> on 2015/01/21 02:50:28 UTC, 1 replies.
- Task result deserialization error (1.1.0) - posted by Dmitriy Lyubimov <dl...@gmail.com> on 2015/01/21 03:36:01 UTC, 0 replies.
- Spark 1.1 (slow, working), Spark 1.2 (fast, freezing) - posted by TJ Klein <TJ...@gmail.com> on 2015/01/21 06:00:54 UTC, 9 replies.
- RangePartitioner - posted by Rishi Yadav <ri...@infoobjects.com> on 2015/01/21 06:07:24 UTC, 1 replies.
- Fwd: [Spark Streaming] The FileInputDStream newFilesOnly=false does not work in 1.2 since - posted by Terry Hole <hu...@gmail.com> on 2015/01/21 06:17:14 UTC, 2 replies.
- KNN for large data set - posted by "DEVAN M.S." <ms...@gmail.com> on 2015/01/21 06:55:24 UTC, 3 replies.
- spark 1.2 three times slower than spark 1.1, why? - posted by Fengyun RAO <ra...@gmail.com> on 2015/01/21 07:39:53 UTC, 13 replies.
- Closing over a var with changing value in Streaming application - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/21 08:23:50 UTC, 5 replies.
- Re: SPARK-streaming app running 10x slower on YARN vs STANDALONE cluster - posted by Mukesh Jha <me...@gmail.com> on 2015/01/21 09:42:50 UTC, 2 replies.
- Are these numbers abnormal for spark streaming? - posted by Ashic Mahtab <as...@live.com> on 2015/01/21 12:26:31 UTC, 12 replies.
- ClosureCleaner should use ClassLoader created by SparkContext - posted by Aniket Bhatnagar <an...@gmail.com> on 2015/01/21 13:04:33 UTC, 1 replies.
- NullPointer when access rdd.sparkContext (Spark 1.1.1) - posted by Luis Ángel Vicente Sánchez <la...@gmail.com> on 2015/01/21 13:35:14 UTC, 3 replies.
- Possible to restart (or stop and create) a StreamingContext - posted by jamborta <ja...@gmail.com> on 2015/01/21 13:56:30 UTC, 1 replies.
- Broadcast variable questions - posted by Hao Ren <in...@gmail.com> on 2015/01/21 15:24:28 UTC, 0 replies.
- sparkcontext.objectFile return thousands of partitions - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/21 16:31:10 UTC, 5 replies.
- [mllib] Decision Tree - prediction probabilites of label classes - posted by Zsolt Tóth <to...@gmail.com> on 2015/01/21 16:36:52 UTC, 2 replies.
- How to delete graph checkpoints? - posted by Cheuk Lam <ch...@hotmail.com> on 2015/01/21 18:25:39 UTC, 0 replies.
- [SQL] Conflicts in inferred Json Schemas - posted by Corey Nolet <cj...@gmail.com> on 2015/01/21 18:26:06 UTC, 1 replies.
- Spark job for demoing Spark metrics monitoring? - posted by Otis Gospodnetic <ot...@gmail.com> on 2015/01/21 20:07:25 UTC, 1 replies.
- Connect to Hive metastore (on YARN) from Spark Shell? - posted by YaoPau <jo...@gmail.com> on 2015/01/21 21:35:21 UTC, 1 replies.
- Is Apache Spark less accurate than Scikit Learn? - posted by JacquesH <ja...@gmail.com> on 2015/01/21 21:39:17 UTC, 3 replies.
- loading utf16le file with sc.textFile - posted by Nathan Stott <nr...@gmail.com> on 2015/01/21 22:00:36 UTC, 0 replies.
- Re: Exception in connection from worker to worker - posted by vantoniuk <vi...@jetlore.com> on 2015/01/21 23:35:07 UTC, 1 replies.
- How to use more executors - posted by Larry Liu <la...@gmail.com> on 2015/01/21 23:43:13 UTC, 3 replies.
- Announcing SF / East Bay Area Stream Processing Meetup - posted by Siva Jagadeesan <si...@gmail.com> on 2015/01/22 01:01:33 UTC, 1 replies.
- reading a csv dynamically - posted by daze5112 <da...@ato.gov.au> on 2015/01/22 01:25:27 UTC, 2 replies.
- spark 1.1.0 save data to hdfs failed - posted by ey-chih chow <ey...@hotmail.com> on 2015/01/22 01:51:21 UTC, 16 replies.
- Spark 1.2 – How to change Default (Random) port …. - posted by Shailesh Birari <sb...@gmail.com> on 2015/01/22 03:14:23 UTC, 3 replies.
- Re: Confused why I'm losing workers/executors when writing a large file to S3 - posted by Tsai Li Ming <ma...@ltsai.com> on 2015/01/22 05:43:36 UTC, 0 replies.
- Is there a way to delete hdfs file/directory using spark API? - posted by LinQili <li...@outlook.com> on 2015/01/22 07:45:44 UTC, 2 replies.
- spark-shell has syntax error on windows. - posted by Vladimir Protsenko <pr...@gmail.com> on 2015/01/22 09:16:20 UTC, 4 replies.
- unable to write SequenceFile using saveAsNewAPIHadoopFile - posted by Skanda <sk...@gmail.com> on 2015/01/22 09:42:22 UTC, 2 replies.
- GraphX: ShortestPaths does not terminate on a grid graph - posted by NicolasC <Ni...@inria.fr> on 2015/01/22 11:06:37 UTC, 3 replies.
- Spark performance for small queries - posted by "Saumitra Shahapure (Vizury)" <sa...@vizury.com> on 2015/01/22 11:37:29 UTC, 1 replies.
- Fwd: Spark Team - Paco Nathan said that your team can help - posted by Sudipta Banerjee <as...@gmail.com> on 2015/01/22 12:36:35 UTC, 14 replies.
- Re: Trying to run SparkSQL over Spark Streaming - posted by nirandap <ni...@gmail.com> on 2015/01/22 13:33:37 UTC, 0 replies.
- Exception: NoSuchMethodError: org.apache.spark.streaming.StreamingContext$.toPairDStreamFunctions - posted by Adrian Mocanu <am...@verticalscope.com> on 2015/01/22 16:57:26 UTC, 4 replies.
- Installing Spark Standalone to a Cluster - posted by riginos <sa...@gmail.com> on 2015/01/22 18:06:10 UTC, 6 replies.
- Would Join on PairRDD's result in co-locating data by keys? - posted by Ankur Srivastava <an...@gmail.com> on 2015/01/22 18:44:16 UTC, 0 replies.
- Apache Spark broadcast error: Error sending message as driverActor is null [message = UpdateBlockInfo(BlockManagerId - posted by Edwin <al...@yahoo.com> on 2015/01/22 18:52:54 UTC, 0 replies.
- Using third party libraries in pyspark - posted by Mohit Singh <mo...@gmail.com> on 2015/01/22 20:23:33 UTC, 2 replies.
- How to make spark partition sticky, i.e. stay with node? - posted by mingyu <mi...@gmail.com> on 2015/01/22 20:32:35 UTC, 4 replies.
- Durablility of Spark Streaming Applications - posted by "Wang, Daniel" <Da...@Teradata.com> on 2015/01/22 20:44:44 UTC, 0 replies.
- Apache Spark broadcast error: Error sending message as driverActor is null [message = UpdateBlockInfo(BlockManagerId(4) - posted by Zijing Guo <al...@yahoo.com.INVALID> on 2015/01/22 21:02:58 UTC, 0 replies.
- Large dataset, reduceByKey - java heap space error - posted by Kane Kim <ka...@gmail.com> on 2015/01/22 23:12:52 UTC, 1 replies.
- reducing number of output files - posted by Kane Kim <ka...@gmail.com> on 2015/01/22 23:46:18 UTC, 3 replies.
- Exception in parsley pyspark cassandra hadoop connector - posted by Nishant Sinha <ns...@uw.edu> on 2015/01/23 00:47:05 UTC, 0 replies.
- save a histogram to a file - posted by SK <sk...@gmail.com> on 2015/01/23 01:07:24 UTC, 2 replies.
- Missing output partition file in S3 - posted by Nicolas Mai <ni...@gmail.com> on 2015/01/23 02:32:16 UTC, 0 replies.
- Results never return to driver | Spark Custom Reader - posted by Harihar Nahak <hn...@wynyardgroup.com> on 2015/01/23 04:54:10 UTC, 2 replies.
- Streaming: getting data from Cassandra based on input stream values - posted by Greg Temchenko <so...@dicefield.com> on 2015/01/23 05:42:28 UTC, 1 replies.
- processing large dataset - posted by Kane Kim <ka...@gmail.com> on 2015/01/23 05:52:18 UTC, 3 replies.
- Re: Got java.lang.SecurityException: class "javax.servlet.FilterRegistration"'s when running job from intellij Idea - posted by Marco <ma...@gmail.com> on 2015/01/23 11:57:44 UTC, 2 replies.
- java.io.NotSerializableException: org.apache.spark.streaming.StreamingContext - posted by Nishant Patel <ni...@gmail.com> on 2015/01/23 11:59:41 UTC, 1 replies.
- Can't access nested types with sql - posted by matthes <md...@sensenetworks.com> on 2015/01/23 16:02:03 UTC, 1 replies.
- GroupBy multiple attributes - posted by Boromir Widas <vc...@gmail.com> on 2015/01/23 17:03:43 UTC, 0 replies.
- Large number of pyspark.daemon processes - posted by Sven Krasser <kr...@gmail.com> on 2015/01/23 18:36:15 UTC, 7 replies.
- Spark Streaming action not triggered with Kafka inputs - posted by Chen Song <ch...@gmail.com> on 2015/01/23 20:25:51 UTC, 1 replies.
- spark 1.2 - Writing parque fails for timestamp with "Unsupported datatype TimestampType" - posted by Manoj Samel <ma...@gmail.com> on 2015/01/23 20:40:05 UTC, 5 replies.
- Problems saving a large RDD (1 TB) to S3 as a sequence file - posted by Darin McBeath <dd...@yahoo.com.INVALID> on 2015/01/23 21:04:14 UTC, 0 replies.
- Starting a spark streaming app in init.d - posted by Ashic Mahtab <as...@live.com> on 2015/01/23 21:27:48 UTC, 2 replies.
- Re: Problems saving a large RDD (1 TB) to S3 as a sequence file - posted by Sven Krasser <kr...@gmail.com> on 2015/01/23 23:12:56 UTC, 2 replies.
- Apache Spark standalone mode: number of cores - posted by olegshirokikh <ol...@solver.com> on 2015/01/23 23:44:58 UTC, 1 replies.
- While Loop - posted by Deep Pradhan <pr...@gmail.com> on 2015/01/24 06:02:29 UTC, 2 replies.
- summary for all columns (numeric, strings) in a dataset - posted by kundan kumar <ii...@gmail.com> on 2015/01/24 11:32:32 UTC, 0 replies.
- Analyzing data from non-standard data sources (e.g. AWS Redshift) - posted by Denis Mikhalkin <de...@yahoo.com.INVALID> on 2015/01/24 12:43:13 UTC, 4 replies.
- SparkException: Task not serializable - Jackson Json - posted by mickdelaney <mi...@gmail.com> on 2015/01/24 16:34:18 UTC, 0 replies.
- java.io.IOException: connection closed. - posted by "Kartheek.R" <ka...@gmail.com> on 2015/01/24 17:00:10 UTC, 1 replies.
- Checksum validation failed pulling spark 1.2.0 from Maven Central - posted by Rory Douglas <ro...@gmail.com> on 2015/01/24 19:33:06 UTC, 2 replies.
- Eclipse on spark - posted by riginos <sa...@gmail.com> on 2015/01/24 19:33:46 UTC, 5 replies.
- Project ideas for spark - posted by shrenik <ga...@gmail.com> on 2015/01/24 20:52:21 UTC, 0 replies.
- cannot run spark-shell interactively against cluster from remote host - confusing memory warnings - posted by Joseph Lust <jl...@mc10inc.com> on 2015/01/24 22:10:08 UTC, 1 replies.
- Full per node replication level (architecture question) - posted by Matan Safriel <de...@gmail.com> on 2015/01/24 22:34:15 UTC, 1 replies.
- JDBC sharded solution - posted by Charles Feduke <ch...@gmail.com> on 2015/01/25 00:15:25 UTC, 0 replies.
- Re: Integrerate Spark Streaming and Kafka, but get bad symbolic reference error - posted by mykidong <my...@gmail.com> on 2015/01/25 02:28:34 UTC, 0 replies.
- Improve performance using spark streaming + sparksql - posted by Subacini B <su...@gmail.com> on 2015/01/25 02:38:45 UTC, 0 replies.
- Can't access remote Hive table from spark - posted by guxiaobo1982 <gu...@qq.com> on 2015/01/25 09:18:57 UTC, 2 replies.
- where storagelevel DISK_ONLY persists RDD to - posted by Larry Liu <la...@gmail.com> on 2015/01/25 09:36:03 UTC, 3 replies.
- Shuffle to HDFS - posted by Larry Liu <la...@gmail.com> on 2015/01/25 09:45:02 UTC, 5 replies.
- graph.inDegrees including zero values - posted by scharissis <st...@gmail.com> on 2015/01/25 14:52:26 UTC, 1 replies.
- foreachActive functionality - posted by kundan kumar <ii...@gmail.com> on 2015/01/25 17:18:05 UTC, 2 replies.
- SVD in pyspark ? - posted by Andreas Rhode <m....@gmail.com> on 2015/01/25 20:12:05 UTC, 2 replies.
- key already cancelled error - posted by ilaxes <il...@hotmail.com> on 2015/01/26 00:41:55 UTC, 0 replies.
- Re: Spark webUI - application details page - posted by ilaxes <il...@hotmail.com> on 2015/01/26 00:50:02 UTC, 3 replies.
- Pairwise Processing of a List - posted by Steve Nunez <sn...@hortonworks.com> on 2015/01/26 01:32:38 UTC, 7 replies.
- Lost task - connection closed - posted by "octavian.ganea" <oc...@inf.ethz.ch> on 2015/01/26 07:35:09 UTC, 3 replies.
- No AMI for Spark 1.2 using ec2 scripts - posted by hajons <ha...@gmail.com> on 2015/01/26 08:38:04 UTC, 4 replies.
- Announcement: Generalized K-Means Clustering on Spark - posted by derrickburns <de...@gmail.com> on 2015/01/26 08:51:56 UTC, 0 replies.
- Worker never used by our Spark applications - posted by Federico Ragona <fe...@gmail.com> on 2015/01/26 09:58:58 UTC, 1 replies.
- SparkSQL tasks spend too much time to finish. - posted by lu...@sina.com on 2015/01/26 10:01:13 UTC, 1 replies.
- HW imbalance - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/26 14:06:16 UTC, 9 replies.
- [SQL] Self join with ArrayType columns problems - posted by Pierre B <pi...@realimpactanalytics.com> on 2015/01/26 14:17:30 UTC, 3 replies.
- Broadcast variables: when should I use them? - posted by frodo777 <ro...@bitmonlab.com> on 2015/01/26 14:33:49 UTC, 1 replies.
- Can Spark benefit from Hive-like partitions? - posted by Danny Yates <da...@codeaholics.org> on 2015/01/26 14:40:41 UTC, 6 replies.
- Issues when combining Spark and a third party java library - posted by Staffan <st...@gmail.com> on 2015/01/26 14:58:50 UTC, 3 replies.
- spark context not picking up default hadoop filesystem - posted by jamborta <ja...@gmail.com> on 2015/01/26 15:07:24 UTC, 3 replies.
- Error when cache partitioned Parquet table - posted by "ZHENG, Xu-dong" <do...@gmail.com> on 2015/01/26 16:45:50 UTC, 1 replies.
- Spark (Streaming?) holding on to Mesos resources - posted by Gerard Maas <ge...@gmail.com> on 2015/01/26 21:17:21 UTC, 3 replies.
- large data set to get rid of "exceeds Integer.MAX_VALUE" error - posted by freedafeng <fr...@yahoo.com> on 2015/01/26 21:53:38 UTC, 0 replies.
- Spark and S3 server side encryption - posted by curtkohler <c....@elsevier.com> on 2015/01/26 22:01:40 UTC, 6 replies.
- Spark (Streaming?) holding on to Mesos Resources - posted by Gerard Maas <ge...@gmail.com> on 2015/01/26 22:25:35 UTC, 3 replies.
- spark 1.2 ec2 launch script hang - posted by ey-chih chow <ey...@hotmail.com> on 2015/01/27 02:57:09 UTC, 11 replies.
- saving rdd to multiple files named by the key - posted by Sharon Rapoport <sh...@plaid.com> on 2015/01/27 03:14:30 UTC, 2 replies.
- Spark on Yarn: java.lang.IllegalArgumentException: Invalid rule - posted by maven <ni...@gmail.com> on 2015/01/27 05:17:36 UTC, 5 replies.
- SaveAsTextFile to S3 bucket - posted by "Chen, Kevin" <Ke...@neustar.biz> on 2015/01/27 05:21:49 UTC, 4 replies.
- Mathematical functions in spark sql - posted by 1esha <al...@gmail.com> on 2015/01/27 05:29:40 UTC, 4 replies.
- spark sqlContext udaf - posted by sunwei <hi...@outlook.com> on 2015/01/27 07:56:13 UTC, 2 replies.
- Index wise most frequently occuring element - posted by kundan kumar <ii...@gmail.com> on 2015/01/27 12:35:38 UTC, 1 replies.
- Best way to shut down a stream initiated from the recevier - posted by jamborta <ja...@gmail.com> on 2015/01/27 12:50:56 UTC, 0 replies.
- how to split key from RDD for compute UV - posted by 老赵 <la...@sina.cn> on 2015/01/27 13:14:35 UTC, 1 replies.
- Storing DecisionTreeModel - posted by andresbm84 <an...@gmail.com> on 2015/01/27 16:45:24 UTC, 2 replies.
- NegativeArraySizeException in pyspark when loading an RDD pickleFile - posted by rok <ro...@gmail.com> on 2015/01/27 16:59:30 UTC, 4 replies.
- [documentation] Update the python example ALS of the site? - posted by gen tang <ge...@gmail.com> on 2015/01/27 17:17:35 UTC, 1 replies.
- java.lang.ClassCastException: cannot assign instance of java.lang.invoke.SerializedLambda - posted by Milad khajavi <kh...@gmail.com> on 2015/01/27 19:49:27 UTC, 0 replies.
- Bulk loading into hbase using saveAsNewAPIHadoopFile - posted by Jim Green <op...@gmail.com> on 2015/01/27 19:54:26 UTC, 6 replies.
- Error on block pushing thread (spark streaming) - posted by Matt Silvey <ma...@videoamp.com> on 2015/01/27 20:37:38 UTC, 0 replies.
- SparkSQL Performance Tuning Options - posted by Manoj Samel <ma...@gmail.com> on 2015/01/27 20:38:15 UTC, 2 replies.
- Spark 1.2.x Yarn Auxiliary Shuffle Service - posted by Corey Nolet <cj...@gmail.com> on 2015/01/27 21:00:23 UTC, 0 replies.
- java.lang.OutOfMemoryError: GC overhead limit exceeded - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/27 21:43:38 UTC, 6 replies.
- RDD.combineBy - posted by Mohit Jaggi <mo...@gmail.com> on 2015/01/27 22:15:50 UTC, 1 replies.
- How to start spark master on windows - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/27 22:37:50 UTC, 1 replies.
- Possible Reasons for BlockNotFoundException - posted by Thomas Gerber <th...@radius.com> on 2015/01/27 23:25:45 UTC, 0 replies.
- Running a script on scala-shell on Spark Standalone Cluster - posted by riginos <sa...@gmail.com> on 2015/01/28 01:24:08 UTC, 1 replies.
- performance of saveAsTextFile moving files from _temporary - posted by jwalton <jo...@openbookben.com> on 2015/01/28 01:31:57 UTC, 4 replies.
- Error reporting/collecting for users - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/28 02:26:07 UTC, 4 replies.
- Why must the dstream.foreachRDD(...) parameter be serializable? - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/28 03:15:37 UTC, 4 replies.
- Spark on Windows 2008 R2 serv er does not work - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/28 04:27:37 UTC, 3 replies.
- joins way slow never go to completion - posted by charlie Brown <br...@gmail.com> on 2015/01/28 05:08:41 UTC, 0 replies.
- LeftOuter Join issue - posted by sprookie <cu...@gmail.com> on 2015/01/28 05:10:09 UTC, 0 replies.
- Re: spark-submit conflicts with dependencies - posted by soid <so...@dicefield.com> on 2015/01/28 06:33:52 UTC, 2 replies.
- Partition + equivalent of MapReduce multiple outputs - posted by Corey Nolet <cj...@gmail.com> on 2015/01/28 06:51:00 UTC, 4 replies.
- Conflict between elasticsearch-spark and elasticsearch-hadoop jars - posted by aarthi <aa...@gmail.com> on 2015/01/28 10:08:47 UTC, 1 replies.
- How to unregister/re-register a TempTable in Spark? - posted by shahab <sh...@gmail.com> on 2015/01/28 10:25:43 UTC, 1 replies.
- Issue with SparkContext in cluster - posted by Marco <ma...@gmail.com> on 2015/01/28 10:35:53 UTC, 1 replies.
- ETL process design - posted by Danny Yates <da...@codeaholics.org> on 2015/01/28 10:40:27 UTC, 1 replies.
- Kryo buffer overflows - posted by Tristan Blakers <tr...@blackfrog.org> on 2015/01/28 11:03:15 UTC, 0 replies.
- Running a task over a single input - posted by Matan Safriel <de...@gmail.com> on 2015/01/28 11:14:41 UTC, 3 replies.
- RDD caching, memory & network input - posted by Andrianasolo Fanilo <fa...@worldline.com> on 2015/01/28 13:25:05 UTC, 2 replies.
- Exception when using HttpSolrServer (httpclient) from within Spark Streaming: java.lang.NoSuchMethodError: org.apache.http.impl.conn.SchemeRegistryFactory.createSystemDefault()Lorg/apache/http/conn/scheme/SchemeRegistry - posted by Emre Sevinc <em...@gmail.com> on 2015/01/28 13:59:55 UTC, 6 replies.
- Percentile Calculation - posted by kundan kumar <ii...@gmail.com> on 2015/01/28 14:13:11 UTC, 1 replies.
- Set is not parseable as row field in SparkSql - posted by Jorge Lopez-Malla <jl...@stratio.com> on 2015/01/28 16:15:28 UTC, 2 replies.
- reduceByKeyAndWindow, but using log timestamps instead of clock seconds - posted by YaoPau <jo...@gmail.com> on 2015/01/28 17:54:54 UTC, 6 replies.
- Snappy Crash - posted by Sven Krasser <kr...@gmail.com> on 2015/01/28 18:43:15 UTC, 0 replies.
- MappedRDD signature - posted by Sanjay Subramanian <sa...@yahoo.com.INVALID> on 2015/01/28 20:37:46 UTC, 2 replies.
- spark-shell working in scala-2.11 - posted by Stephen Haberman <st...@gmail.com> on 2015/01/28 21:18:11 UTC, 1 replies.
- Parquet divide by zero - posted by Jim Carroll <ji...@gmail.com> on 2015/01/28 22:28:13 UTC, 3 replies.
- unsubscribe - posted by Abhi Basu <90...@gmail.com> on 2015/01/28 23:16:44 UTC, 2 replies.
- Appending to an hdfs file - posted by Matan Safriel <de...@gmail.com> on 2015/01/28 23:39:23 UTC, 2 replies.
- Dependency unresolved hadoop-yarn-common 1.0.4 when running quickstart example - posted by Sarwar Bhuiyan <sa...@gmail.com> on 2015/01/28 23:50:10 UTC, 3 replies.
- Hive on Spark vs. SparkSQL using Hive ? - posted by ogoh <ok...@gmail.com> on 2015/01/29 00:24:49 UTC, 2 replies.
- is there a master for spark cluster in ec2 - posted by Mohit Singh <mo...@gmail.com> on 2015/01/29 02:11:55 UTC, 1 replies.
- Executors dropping all memory stored RDDs? - posted by Thomas Gerber <th...@radius.com> on 2015/01/29 02:40:04 UTC, 0 replies.
- StackOverflowError with SchemaRDD - posted by ankits <an...@gmail.com> on 2015/01/29 03:50:37 UTC, 1 replies.
- Data are partial to a specific partition after sort - posted by 瀬川　卓也 <ta...@dwango.co.jp> on 2015/01/29 03:57:04 UTC, 1 replies.
- Re: data locality in logs - posted by hnahak <ha...@gmail.com> on 2015/01/29 04:29:40 UTC, 0 replies.
- unknown issue in submitting a spark job - posted by ey-chih chow <ey...@hotmail.com> on 2015/01/29 10:06:28 UTC, 7 replies.
- SQL query over (Long, JSON string) tuples - posted by Tobias Pfeiffer <tg...@preferred.jp> on 2015/01/29 10:12:06 UTC, 3 replies.
- Running a custom "setup task" on all workers - posted by Noam Barcay <no...@kenshoo.com> on 2015/01/29 10:19:55 UTC, 0 replies.
- Streaming: Windowed calculations, Multiple apps - posted by Jared Maulch <jm...@s7s8.com> on 2015/01/29 10:45:52 UTC, 0 replies.
- Failed to locate the winutils binary in the hadoop binary path - posted by Naveen Kumar Pokala <np...@spcapitaliq.com> on 2015/01/29 12:55:37 UTC, 1 replies.
- Split RDD along columns - posted by "Schein, Sagi" <sa...@hp.com> on 2015/01/29 13:39:17 UTC, 0 replies.
- Fail to launch spark-shell on windows 2008 R2 - posted by "Wang, Ningjun (LNG-NPV)" <ni...@lexisnexis.com> on 2015/01/29 16:18:27 UTC, 3 replies.
- Building Spark behind a proxy - posted by Soumya Simanta <so...@gmail.com> on 2015/01/29 16:47:06 UTC, 5 replies.
- schemaRDD.saveAsParquetFile creates large number of small parquet files ... - posted by Manoj Samel <ma...@gmail.com> on 2015/01/29 18:27:49 UTC, 2 replies.
- spark connector for CouchDB - posted by prateek arora <pr...@gmail.com> on 2015/01/29 18:34:57 UTC, 0 replies.
- Re: connector for CouchDB - posted by prateek arora <pr...@gmail.com> on 2015/01/29 18:46:43 UTC, 3 replies.
- Re: RDD.combineBy without intermediate (k,v) pair allocation - posted by Mohit Jaggi <mo...@gmail.com> on 2015/01/29 18:52:00 UTC, 2 replies.
- spark challenge: zip with next??? - posted by derrickburns <de...@gmail.com> on 2015/01/29 20:49:52 UTC, 9 replies.
- Connecting Cassandra by unknow host - posted by oxpeople <vi...@bankofamerica.com> on 2015/01/29 22:33:29 UTC, 1 replies.
- Driver startup error when submitting in cluster mode - posted by "nate.y" <ny...@gmail.com> on 2015/01/29 22:52:10 UTC, 0 replies.
- Error when running spark in debug mode - posted by Ankur Srivastava <an...@gmail.com> on 2015/01/29 23:54:24 UTC, 4 replies.
- spark with cdh 5.2.1 - posted by Mohit Jaggi <mo...@gmail.com> on 2015/01/30 00:33:31 UTC, 3 replies.
- Re: We are migrating Tera Data SQL to Spark SQL. Query is taking long time. Please have a look on this issue - posted by hnahak <ha...@gmail.com> on 2015/01/30 00:34:52 UTC, 0 replies.
- What could cause number of tasks to go down from 2k to 1? - posted by freedafeng <fr...@yahoo.com> on 2015/01/30 01:25:20 UTC, 0 replies.
- Error when get data from hive table. Use python code. - posted by QiuxuanZhu <il...@gmail.com> on 2015/01/30 03:36:05 UTC, 3 replies.
- KMeans with large clusters Java Heap Space - posted by mvsundaresan <mv...@yahoo.com> on 2015/01/30 04:57:36 UTC, 1 replies.
- Read from file and broadcast before every Spark Streaming bucket? - posted by YaoPau <jo...@gmail.com> on 2015/01/30 05:05:38 UTC, 1 replies.
- HiveContext created SchemaRDD's saveAsTable is not working on 1.2.0 - posted by matroyd <de...@healthagen.com> on 2015/01/30 06:38:59 UTC, 4 replies.
- Hi: hadoop 2.5 for spark - posted by Siddharth Ubale <si...@syncoms.com> on 2015/01/30 08:50:20 UTC, 0 replies.
- Re: Hi: hadoop 2.5 for spark - posted by "bit1129@163.com" <bi...@163.com> on 2015/01/30 08:58:56 UTC, 1 replies.
- HBase Thrift API Error on map/reduce functions - posted by mtheofilos <mt...@yahoo.com> on 2015/01/30 12:40:13 UTC, 0 replies.
- WARN NativeCodeLoader warning in spark shell - posted by kundan kumar <ii...@gmail.com> on 2015/01/30 14:04:54 UTC, 1 replies.
- [Graphx & Spark] Error of "Lost executor" and TimeoutException - posted by Yifan LI <ia...@gmail.com> on 2015/01/30 15:20:13 UTC, 3 replies.
- Programmatic Spark 1.2.0 on EMR | S3 filesystem is not working when using - posted by Aniket Bhatnagar <an...@gmail.com> on 2015/01/30 15:44:38 UTC, 2 replies.
- Define size partitions - posted by Guillermo Ortiz <ko...@gmail.com> on 2015/01/30 15:50:42 UTC, 3 replies.
- Negative Accumulators - posted by Peter Thai <th...@gmail.com> on 2015/01/30 17:06:24 UTC, 1 replies.
- Does the kFold in Spark always give you the same split? - posted by Jianguo Li <fl...@gmail.com> on 2015/01/30 17:12:53 UTC, 3 replies.
- Re: spark-shell working in scala-2.11 (breaking change?) - posted by Stephen Haberman <st...@gmail.com> on 2015/01/30 17:37:29 UTC, 4 replies.
- Spark SQL - Unable to use Hive UDF because of ClassNotFoundException - posted by Capitão <mi...@gmail.com> on 2015/01/30 18:17:48 UTC, 1 replies.
- Spark streaming - tracking/deleting processed files - posted by ganterm <ga...@gmail.com> on 2015/01/30 19:07:16 UTC, 2 replies.
- [hive context] Unable to query array once saved as parquet - posted by Ayoub <be...@gmail.com> on 2015/01/30 19:33:41 UTC, 5 replies.
- KafkaWordCount - posted by Eduardo Costa Alfaia <e....@unibs.it> on 2015/01/30 19:58:56 UTC, 0 replies.
- Duplicate key when sorting BytesWritable with Kryo? - posted by "andrew.rowson" <an...@thomsonreuters.com> on 2015/01/30 20:20:46 UTC, 3 replies.
- pyspark and and page allocation failures due to memory fragmentation - posted by Antony Mayi <an...@yahoo.com.INVALID> on 2015/01/30 20:46:14 UTC, 0 replies.
- groupByKey is not working - posted by Amit Behera <am...@gmail.com> on 2015/01/30 21:20:32 UTC, 7 replies.
- Serialized task result size exceeded - posted by ankits <an...@gmail.com> on 2015/01/30 21:46:33 UTC, 1 replies.
- Trouble deploying spark program because of soft link? - posted by Su She <su...@gmail.com> on 2015/01/30 23:11:30 UTC, 2 replies.
- Why is DecimalType separate from DataType ? - posted by Manoj Samel <ma...@gmail.com> on 2015/01/30 23:23:22 UTC, 1 replies.
- Cheapest way to materialize an RDD? - posted by Sean Owen <so...@cloudera.com> on 2015/01/30 23:42:38 UTC, 2 replies.
- Error Compiling - posted by Eduardo Costa Alfaia <e....@unibs.it> on 2015/01/31 01:00:04 UTC, 2 replies.
- Long pauses after writing to sequence files - posted by Corey Nolet <cj...@gmail.com> on 2015/01/31 02:52:07 UTC, 1 replies.
- measuring time taken in map, reduceByKey, filter, flatMap - posted by Josh J <jo...@gmail.com> on 2015/01/31 04:59:14 UTC, 1 replies.
- Build error - posted by Andrew Musselman <an...@gmail.com> on 2015/01/31 05:59:01 UTC, 1 replies.
- Spark on Gordon - posted by Deep Pradhan <pr...@gmail.com> on 2015/01/31 15:54:56 UTC, 0 replies.
- spark on yarn succeeds but exit code 1 in logs - posted by Koert Kuipers <ko...@tresata.com> on 2015/01/31 20:24:16 UTC, 2 replies.