user@spark.apache.org, 2016-03

You are viewing a plain text version of this content. The canonical link for it is here.

- RE: a basic question on first use of PySpark shell and example, which is failing - posted by "Taylor, Ronald C" <Ro...@pnnl.gov> on 2016/03/01 00:07:37 UTC, 0 replies.
- Re: Spark for client - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/01 00:25:02 UTC, 3 replies.
- Spark UI standalone "crashes" after an application finishes - posted by Sumona Routh <su...@gmail.com> on 2016/03/01 00:48:05 UTC, 6 replies.
- DataSet Evidence - posted by Steve Lewis <lo...@gmail.com> on 2016/03/01 01:55:28 UTC, 2 replies.
- Re: Stateful Operation on JavaPairDStream Help Needed !! - posted by "Shixiong(Ryan) Zhu" <sh...@databricks.com> on 2016/03/01 01:58:38 UTC, 0 replies.
- Error when trying to insert data to a Parquet data source in HiveQL - posted by SRK <sw...@gmail.com> on 2016/03/01 03:10:29 UTC, 0 replies.
- Fwd: Mapper side join with DataFrames API - posted by Deepak Gopalakrishnan <dg...@gmail.com> on 2016/03/01 03:14:11 UTC, 6 replies.
- 回复： Spark UI standalone "crashes" after an application finishes - posted by Sea <26...@qq.com> on 2016/03/01 04:27:39 UTC, 0 replies.
- SaveMode, parquet and S3 - posted by Peter Halliday <pj...@cornell.edu> on 2016/03/01 04:34:45 UTC, 0 replies.
- Re: Use maxmind geoip lib to process ip on Spark/Spark Streaming - posted by Zhun Shen <sh...@gmail.com> on 2016/03/01 05:17:22 UTC, 1 replies.
- [ERROR]: Spark 1.5.2 + Hbase 1.1 + Hive 1.2 + HbaseIntegration - posted by Divya Gehlot <di...@gmail.com> on 2016/03/01 05:27:53 UTC, 4 replies.
- Re: perl Kafka::Producer, “Kafka::Exception::Producer”, “code”, -1000, “message”, "Invalid argument - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/01 06:04:37 UTC, 0 replies.
- Support virtualenv in PySpark - posted by Jeff Zhang <zj...@gmail.com> on 2016/03/01 06:07:20 UTC, 2 replies.
- Update edge weight in graphx - posted by "naveen.marri" <na...@gmail.com> on 2016/03/01 06:11:16 UTC, 2 replies.
- Spark Streaming: java.lang.StackOverflowError - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/01 06:13:34 UTC, 1 replies.
- Save DataFrame to Hive Table - posted by Yogesh Vyas <in...@gmail.com> on 2016/03/01 07:22:44 UTC, 5 replies.
- Re: Spark on Windows platform - posted by Sabarish Sasidharan <sa...@manthan.com> on 2016/03/01 09:06:36 UTC, 0 replies.
- Re: [Help]: DataframeNAfunction fill method throwing exception - posted by ai he <he...@gmail.com> on 2016/03/01 09:10:12 UTC, 0 replies.
- Sample sql query using pyspark - posted by Maurin Lenglart <ma...@cuberonlabs.com> on 2016/03/01 09:10:34 UTC, 2 replies.
- Spark streaming from Kafka best fit - posted by Jatin Kumar <jk...@rocketfuelinc.com.INVALID> on 2016/03/01 09:36:48 UTC, 4 replies.
- Converting array to DF - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/01 09:38:23 UTC, 5 replies.
- Re: Is spark.driver.maxResultSize used correctly ? - posted by Reynold Xin <rx...@databricks.com> on 2016/03/01 10:00:52 UTC, 1 replies.
- Re: Spark Streaming - graceful shutdown when stream has no more data - posted by Lars Albertsson <la...@mapflat.com> on 2016/03/01 10:02:14 UTC, 1 replies.
- EMR 4.3.0 spark 1.6 shell problem - posted by Oleg Ruchovets <or...@gmail.com> on 2016/03/01 10:15:08 UTC, 5 replies.
- Re: Mllib Logistic Regression performance relative to Mahout - posted by Sonal Goyal <so...@gmail.com> on 2016/03/01 10:40:18 UTC, 1 replies.
- Dropping parquet file partitions - posted by sparkuser2345 <hm...@gmail.com> on 2016/03/01 12:23:49 UTC, 0 replies.
- Does pyspark still lag far behind the Scala API in terms of features - posted by Joshua Sorrell <js...@gmail.com> on 2016/03/01 14:03:15 UTC, 9 replies.
- Suggested Method to Write to Kafka - posted by Bryan Jeffrey <br...@gmail.com> on 2016/03/01 14:54:57 UTC, 1 replies.
- Spark executor killed without apparent reason - posted by Nirav Patel <np...@xactlycorp.com> on 2016/03/01 15:23:55 UTC, 6 replies.
- local class incompatible: stream classdesc - posted by Nesrine BEN MUSTAPHA <ne...@gmail.com> on 2016/03/01 16:35:05 UTC, 1 replies.
- Get rid of FileAlreadyExistsError - posted by Peter Halliday <pj...@cornell.edu> on 2016/03/01 16:48:08 UTC, 4 replies.
- Re: Spark 1.5 on Mesos - posted by Ashish Soni <as...@gmail.com> on 2016/03/01 17:05:57 UTC, 12 replies.
- RE: Recommendation for a good book on Spark, beginner to moderate knowledge - posted by Mohammed Guller <mo...@glassbeam.com> on 2016/03/01 17:13:41 UTC, 1 replies.
- Re: [Proposal] Enabling time series analysis on spark metrics - posted by Karan Kumar <ka...@gmail.com> on 2016/03/01 17:17:13 UTC, 2 replies.
- Spark Submit using Convert to Marthon REST API - posted by Ashish Soni <as...@gmail.com> on 2016/03/01 17:24:37 UTC, 0 replies.
- performance of personalized page rank - posted by Cesar Flores <ce...@gmail.com> on 2016/03/01 17:27:13 UTC, 0 replies.
- Real time anomaly system - posted by Priya Ch <le...@gmail.com> on 2016/03/01 17:58:16 UTC, 0 replies.
- Union Parquet, DataFrame - posted by An...@wellsfargo.com on 2016/03/01 18:01:44 UTC, 2 replies.
- What version of twitter4j should I use with Spark Streaming?UPDATING thread - posted by Alonso Isidoro Roman <al...@gmail.com> on 2016/03/01 18:08:31 UTC, 0 replies.
- SPARK SQL HiveContext Error - posted by Gourav Sengupta <go...@gmail.com> on 2016/03/01 18:19:14 UTC, 2 replies.
- Fwd: Starting SPARK application in cluster mode from an IDE - posted by Gourav Sengupta <go...@gmail.com> on 2016/03/01 18:20:18 UTC, 0 replies.
- I need some help making datasets with known columns from a JavaBean - posted by Steve Lewis <lo...@gmail.com> on 2016/03/01 18:33:48 UTC, 0 replies.
- SparkR Count vs Take performance - posted by Dirceu Semighini Filho <di...@gmail.com> on 2016/03/01 19:03:41 UTC, 5 replies.
- Using a non serializable third party JSON serializable on a spark worker node throws NotSerializableException - posted by "Yuval.Itzchakov" <yu...@gmail.com> on 2016/03/01 19:30:52 UTC, 3 replies.
- Shuffle guarantees - posted by Corey Nolet <cj...@gmail.com> on 2016/03/01 20:56:19 UTC, 2 replies.
- How to control the number of parquet files getting created under a partition ? - posted by SRK <sw...@gmail.com> on 2016/03/01 22:01:39 UTC, 2 replies.
- Checkpoint RDD ReliableCheckpointRDD at foreachRDD has different number of partitions from original RDD MapPartitionsRDD at reduceByKeyAndWindow - posted by RK <pr...@yahoo.com.INVALID> on 2016/03/02 00:17:49 UTC, 1 replies.
- scikit learn on EMR PySpark - posted by "Gartland, Myles" <My...@Rockhurst.edu> on 2016/03/02 00:20:36 UTC, 1 replies.
- Building a REST Service with Spark back-end - posted by Don Drake <do...@gmail.com> on 2016/03/02 01:30:20 UTC, 5 replies.
- Re: Configure Spark Resource on AWS CLI Not Working - posted by Jonathan Kelly <jo...@gmail.com> on 2016/03/02 02:01:54 UTC, 0 replies.
- Job fails at saveAsHadoopDataset stage due to Lost Executor due to reason unknown so far - posted by Nirav Patel <np...@xactlycorp.com> on 2016/03/02 03:21:36 UTC, 7 replies.
- Does anyone have spark code style guide xml file ？ - posted by zml张明磊 <mi...@Ctrip.com> on 2016/03/02 03:55:04 UTC, 0 replies.
- Does anyone have spark code style guide xml file ？ - posted by Minglei Zhang <mi...@gmail.com> on 2016/03/02 04:02:23 UTC, 1 replies.
- Connect the two tables in spark sql - posted by Angel Angel <ar...@gmail.com> on 2016/03/02 04:13:56 UTC, 3 replies.
- Re: Spark execuotr Memory profiling - posted by Nirav Patel <np...@xactlycorp.com> on 2016/03/02 07:35:35 UTC, 0 replies.
- Spark on Yarn with Dynamic Resource Allocation. Container always marked as failed - posted by Xiaoye Sun <su...@gmail.com> on 2016/03/02 09:26:53 UTC, 4 replies.
- Spark Mllib kmeans execution - posted by Priya Ch <le...@gmail.com> on 2016/03/02 10:29:58 UTC, 1 replies.
- rdd cache name - posted by charles li <ch...@gmail.com> on 2016/03/02 10:48:17 UTC, 2 replies.
- [Spark 1.5.2]: Iterate through Dataframe columns and put it in map - posted by Divya Gehlot <di...@gmail.com> on 2016/03/02 11:22:30 UTC, 1 replies.
- Inconsistent performance across multiple iterations of same application - posted by Harsh Rathi <co...@gmail.com> on 2016/03/02 11:51:43 UTC, 0 replies.
- spark streaming - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/02 12:02:34 UTC, 2 replies.
- Spark streaming: StorageLevel.MEMORY_AND_DISK_SER setting for KafkaUtils.createDirectStream - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/02 12:08:24 UTC, 3 replies.
- Configuring Ports for Network Security - posted by zgpinnadhari <gp...@zaloni.com> on 2016/03/02 15:14:20 UTC, 2 replies.
- org.apache.spark.sql.types.GenericArrayData cannot be cast to org.apache.spark.sql.catalyst.InternalRow - posted by dmt <dm...@ymail.com> on 2016/03/02 15:47:08 UTC, 2 replies.
- Add Jars to Master/Worker classpath - posted by Matthias Niehoff <ma...@codecentric.de> on 2016/03/02 17:01:09 UTC, 4 replies.
- please add Christchurch Apache Spark Meetup Group - posted by Raazesh Sainudiin <ra...@gmail.com> on 2016/03/02 18:16:54 UTC, 1 replies.
- How to achieve nested for loop in Spark - posted by Vikash Kumar <vi...@gmail.com> on 2016/03/02 18:33:14 UTC, 0 replies.
- Unit testing framework for Spark Jobs? - posted by SRK <sw...@gmail.com> on 2016/03/02 18:54:15 UTC, 9 replies.
- Re: Selecting column in dataframe created with incompatible schema causes AnalysisException - posted by Michael Armbrust <mi...@databricks.com> on 2016/03/02 19:07:47 UTC, 7 replies.
- SFTP Compressed CSV into Dataframe - posted by Benjamin Kim <bb...@gmail.com> on 2016/03/02 20:17:02 UTC, 2 replies.
- Re: SFTP Compressed CSV into Dataframe - posted by Holden Karau <ho...@pigscanfly.ca> on 2016/03/02 20:28:03 UTC, 2 replies.
- Avro SerDe Issue w/ Manual Partitions? - posted by Chris Miller <cm...@gmail.com> on 2016/03/02 21:33:45 UTC, 5 replies.
- Spark Streaming 1.6 mapWithState not working well with Kryo Serialization - posted by Aris <ar...@gmail.com> on 2016/03/02 22:41:33 UTC, 1 replies.
- AVRO vs Parquet - posted by Timothy Spann <ti...@airisdata.com> on 2016/03/02 22:49:04 UTC, 8 replies.
- Does DataFrame.collect() maintain the underlying schema? - posted by Mohammad Tariq <do...@gmail.com> on 2016/03/03 00:21:39 UTC, 5 replies.
- getPreferredLocations race condition in spark 1.6.0? - posted by Andy Sloane <an...@gmail.com> on 2016/03/03 00:46:27 UTC, 2 replies.
- Re: spark 1.6 new memory management - some issues with tasks not using all executors - posted by Koert Kuipers <ko...@tresata.com> on 2016/03/03 01:35:29 UTC, 1 replies.
- Spark job on YARN ApplicationMaster DEBUG log - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/03 01:42:59 UTC, 0 replies.
- Using netlib-java in Spark 1.6 on linux - posted by cindymc <ci...@oracle.com> on 2016/03/03 02:06:53 UTC, 3 replies.
- Re: Fair scheduler pool details - posted by Eugene Morozov <ev...@gmail.com> on 2016/03/03 03:20:03 UTC, 2 replies.
- select count(*) return wrong row counts - posted by Jesse F Chen <jf...@us.ibm.com> on 2016/03/03 03:38:36 UTC, 2 replies.
- Renaming sc variable in sparkcontext throws task not serializable - posted by Rahul Palamuttam <ra...@gmail.com> on 2016/03/03 03:43:37 UTC, 3 replies.
- Stage contains task of large size - posted by Bijuna <bi...@gmail.com> on 2016/03/03 05:20:25 UTC, 2 replies.
- convert SQL multiple Join in Spark - posted by Vikash Kumar <vi...@gmail.com> on 2016/03/03 05:28:36 UTC, 2 replies.
- Spark sql query taking long time - posted by Angel Angel <ar...@gmail.com> on 2016/03/03 06:33:36 UTC, 3 replies.
- Sorting the RDD - posted by Angel Angel <ar...@gmail.com> on 2016/03/03 08:39:49 UTC, 1 replies.
- MetadataFetchFailedException: Missing an output location for shuffle 0 - posted by Pierre Villard <pi...@gmail.com> on 2016/03/03 09:29:48 UTC, 0 replies.
- How to display the web ui when running Spark on YARN? - posted by Shady Xu <sh...@gmail.com> on 2016/03/03 10:17:33 UTC, 2 replies.
- building a package with sbt failing on unresolved dependency - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/03 10:28:17 UTC, 1 replies.
- Reducer doesn't operate in parallel - posted by "octavian.ganea" <oc...@inf.ethz.ch> on 2016/03/03 10:41:44 UTC, 0 replies.
- Spark mllin k-means taking too much time - posted by Priya Ch <le...@gmail.com> on 2016/03/03 11:40:31 UTC, 0 replies.
- OutOfMemorryError after chaning to .persist(StorageLevel.MEMORY_ONLY_SER) - posted by Jake Yoon <su...@gmail.com> on 2016/03/03 12:48:36 UTC, 0 replies.
- Using Spark SQL / Hive on AWS EMR - posted by "Afshartous, Nick" <na...@turbine.com> on 2016/03/03 14:20:00 UTC, 0 replies.
- mapWithState not compacting removed state - posted by Iain Cundy <Ia...@amdocs.com> on 2016/03/03 15:45:20 UTC, 0 replies.
- Spark SQL Json Parse - posted by barisak <ba...@gmail.com> on 2016/03/03 16:10:02 UTC, 1 replies.
- Re: Using Spark SQL / Hive on AWS EMR - posted by Gourav Sengupta <go...@gmail.com> on 2016/03/03 16:43:08 UTC, 1 replies.
- Re: Serializing collections in Datasets - posted by Daniel Siegmann <da...@teamaol.com> on 2016/03/03 16:54:55 UTC, 0 replies.
- spark master ui to proxy app and worker ui - posted by Gurvinder Singh <gu...@uninett.no> on 2016/03/03 20:12:07 UTC, 0 replies.
- getting null values from hive partitioned table after upgrading Spark to 1.5.0 - posted by Jyothi Mandava <jm...@kogentix.com> on 2016/03/03 23:51:30 UTC, 0 replies.
- Configuring/Optimizing Spark - posted by Chadha Pooja <Ch...@bcg.com> on 2016/03/04 00:30:47 UTC, 1 replies.
- Re: an OOM while persist as DISK_ONLY - posted by Andy Dang <na...@gmail.com> on 2016/03/04 00:59:41 UTC, 3 replies.
- [Issue:]Getting null values for Numeric types while accessing hive tables (Registered on Hbase,created through Phoenix) - posted by Divya Gehlot <di...@gmail.com> on 2016/03/04 03:52:29 UTC, 0 replies.
- Do we need schema for Parquet files with Spark? - posted by ashokkumar rajendran <as...@gmail.com> on 2016/03/04 04:32:18 UTC, 5 replies.
- Re: No event log in /tmp/spark-events - posted by PatrickYu <ha...@gmail.com> on 2016/03/04 04:57:05 UTC, 2 replies.
- Spark 1.5.2 - Read custom schema from file - posted by Divya Gehlot <di...@gmail.com> on 2016/03/04 06:38:13 UTC, 0 replies.
- Spark 1.5.2 : change datatype in programaticallly generated schema - posted by Divya Gehlot <di...@gmail.com> on 2016/03/04 08:58:20 UTC, 1 replies.
- Sorting the dataframe - posted by Angel Angel <ar...@gmail.com> on 2016/03/04 09:18:17 UTC, 4 replies.
- Facing issue with floor function in spark SQL query - posted by ashokkumar rajendran <as...@gmail.com> on 2016/03/04 09:34:11 UTC, 4 replies.
- [Kinesis] multiple KinesisRecordProcessor threads. - posted by Li Ming Tsai <ma...@ltsai.com> on 2016/03/04 10:54:18 UTC, 0 replies.
- Number Of Jobs In Spark Streaming - posted by Sandip Mehta <sa...@gmail.com> on 2016/03/04 11:02:17 UTC, 0 replies.
- Spark 1.5.2 -Better way to create custom schema - posted by Divya Gehlot <di...@gmail.com> on 2016/03/04 12:13:17 UTC, 0 replies.
- DataFrame .filter only seems to work when .cache is called in local mode in 1.6.0 - posted by James Hammerton <ja...@gluru.co> on 2016/03/04 13:01:50 UTC, 7 replies.
- Spark SQL - udf with entire row as parameter - posted by Nisrina Luthfiyati <ni...@gmail.com> on 2016/03/04 15:41:27 UTC, 1 replies.
- Issue with sbt failing on amplab succinct - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/04 15:46:06 UTC, 5 replies.
- Re: Spark Streaming - posted by anbucheeralan <al...@gmail.com> on 2016/03/04 17:04:41 UTC, 0 replies.
- 1.6.0 spark.sql datetime conversion problem - posted by Michal Vince <vi...@gmail.com> on 2016/03/04 18:08:19 UTC, 1 replies.
- Does Spark 1.5.x really still support Hive 0.12? - posted by Yong Zhang <ja...@hotmail.com> on 2016/03/04 20:20:19 UTC, 1 replies.
- Installing Spark on Mac - posted by Aida <Ai...@gmail.com> on 2016/03/04 21:18:58 UTC, 38 replies.
- S3 DirectParquetOutputCommitter + PartitionBy + SaveMode.Append - posted by Jelez Raditchkov <je...@hotmail.com> on 2016/03/04 21:59:49 UTC, 5 replies.
- How to get the singleton instance of SQLContext/HiveContext: val sqlContext = SQLContext.getOrCreate(rdd.sparkContext) - posted by Jelez Raditchkov <je...@hotmail.com> on 2016/03/04 22:05:01 UTC, 0 replies.
- Best way to merge files from streaming jobs - posted by Jelez Raditchkov <je...@hotmail.com> on 2016/03/04 22:09:59 UTC, 0 replies.
- Spark reduce serialization question - posted by James Jia <ja...@berkeley.edu> on 2016/03/04 22:11:19 UTC, 2 replies.
- Error building a self contained Spark app - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/04 22:14:59 UTC, 15 replies.
- SSL support for Spark Thrift Server - posted by Sourav Mazumder <so...@gmail.com> on 2016/03/04 22:16:11 UTC, 1 replies.
- How to get the singleton instance of SQLContext/HiveContext: val sqlContext = SQLContext.getOrCreate(rdd.sparkContext)‏ - posted by jelez <je...@hotmail.com> on 2016/03/04 22:23:43 UTC, 2 replies.
- Best way to merge files from streaming jobs‏ on S3 - posted by jelez <je...@hotmail.com> on 2016/03/04 22:24:29 UTC, 1 replies.
- spark driver in docker - posted by yanlin wang <ya...@me.com> on 2016/03/04 22:37:19 UTC, 3 replies.
- Use cases for kafka direct stream messageHandler - posted by Cody Koeninger <co...@koeninger.org> on 2016/03/04 22:39:14 UTC, 4 replies.
- RethinkDB as a Datasource - posted by pnakibar <pe...@xdevel.com.br> on 2016/03/05 00:19:23 UTC, 1 replies.
- OOM When Running with Mesos Fine-grained Mode - posted by SLiZn Liu <sl...@gmail.com> on 2016/03/05 04:29:54 UTC, 2 replies.
- Spark Streaming - Travis CI and GitHub custom receiver - continuous data but empty RDD? - posted by Dominik Safaric <do...@gmail.com> on 2016/03/05 13:57:16 UTC, 1 replies.
- Spark SQL drops the HIVE table in "overwrite" mode while writing into table - posted by Dhaval Modi <dh...@gmail.com> on 2016/03/05 16:01:54 UTC, 2 replies.
- problems with my code that stimulate task failure - task is not resubmitted - posted by Gil Vernik <GI...@il.ibm.com> on 2016/03/05 18:53:03 UTC, 0 replies.
- How can I pass a Data Frame from object to another class - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/05 21:56:46 UTC, 5 replies.
- Looking for Collaborator - Boston ( Spark Training ) - posted by Ashish Soni <as...@gmail.com> on 2016/03/05 22:00:18 UTC, 0 replies.
- Dynamic partitions reallocations with added worker nodes - posted by Eugene Morozov <ev...@gmail.com> on 2016/03/05 23:54:38 UTC, 2 replies.
- MLLib + Streaming - posted by Lan Jiang <lj...@gmail.com> on 2016/03/06 02:37:36 UTC, 4 replies.
- Spark + Kafka all messages being used in 1 batch - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/06 07:02:40 UTC, 5 replies.
- Add the sql record having same field. - posted by Angel Angel <ar...@gmail.com> on 2016/03/06 07:28:20 UTC, 1 replies.
- Continuous deployment to Spark Streaming application with sessionization - posted by "Yuval.Itzchakov" <yu...@gmail.com> on 2016/03/06 10:12:03 UTC, 0 replies.
- Re: Spark Streaming fileStream vs textFileStream - posted by "Yuval.Itzchakov" <yu...@gmail.com> on 2016/03/06 10:27:27 UTC, 0 replies.
- how to flatten the dataframe - posted by "shubham@celebal" <sh...@celebal.com> on 2016/03/06 12:10:51 UTC, 1 replies.
- Streaming UI tab misleading for window operations - posted by Jatin Kumar <jk...@rocketfuelinc.com.INVALID> on 2016/03/06 13:06:48 UTC, 4 replies.
- Get Offset when using Spark Streaming + Kafka - posted by Zhun Shen <sh...@gmail.com> on 2016/03/06 15:39:41 UTC, 1 replies.
- how to implement ALS with csv file? getting error while calling Rating class - posted by Shishir Anshuman <sh...@gmail.com> on 2016/03/06 17:22:50 UTC, 3 replies.
- how to implements a distributed system ? - posted by Minglei Zhang <mi...@gmail.com> on 2016/03/06 17:35:34 UTC, 1 replies.
- Is Spark right for us? - posted by Laumegui Deaulobi <gu...@gmail.com> on 2016/03/06 18:17:31 UTC, 12 replies.
- Spark ML and Streaming - posted by Lan Jiang <lj...@gmail.com> on 2016/03/06 20:22:35 UTC, 1 replies.
- Spark Custom Partitioner not picked - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/06 21:48:05 UTC, 0 replies.
- YARN nodemanager always uses its own hostname - posted by HIGUCHI Daisuke <d-...@creationline.com> on 2016/03/07 04:19:11 UTC, 0 replies.
- Understanding the Web_UI 4040 - posted by Angel Angel <ar...@gmail.com> on 2016/03/07 04:40:08 UTC, 2 replies.
- reading the parquet file in spark sql - posted by Angel Angel <ar...@gmail.com> on 2016/03/07 06:47:26 UTC, 1 replies.
- New Spark User Group in Florida - posted by "☼ R Nair (रविशंकर नायर)" <ra...@gmail.com> on 2016/03/07 08:29:50 UTC, 0 replies.
- Steps to Run Spark Scala job from Oozie on EC2 Hadoop clsuter - posted by Divya Gehlot <di...@gmail.com> on 2016/03/07 10:14:51 UTC, 4 replies.
- PYSPARK_PYTHON doesn't work in spark worker - posted by "guoqing0629@yahoo.com.hk" <gu...@yahoo.com.hk> on 2016/03/07 10:28:09 UTC, 1 replies.
- Editing spark.ml package code in Pyspark - posted by Khaled Ali <kh...@gmail.com> on 2016/03/07 11:36:32 UTC, 0 replies.
- Re: Spark Aggregations/Joins - posted by Ricardo Paiva <ri...@corp.globo.com> on 2016/03/07 13:49:06 UTC, 0 replies.
- using MongoDB Tailable Cursor in Spark Streaming - posted by Shams ul Haque <sh...@cashcare.in> on 2016/03/07 15:15:28 UTC, 0 replies.
- [Streaming] Difference between windowed stream and stream with large batch size? - posted by Hao Ren <in...@gmail.com> on 2016/03/07 15:38:32 UTC, 2 replies.
- Setting PYSPARK_PYTHON in spark-env.sh vs from driver program - posted by Kostas Chalikias <ko...@chalikias.com> on 2016/03/07 18:04:53 UTC, 1 replies.
- Saving Spark generated table into underlying Hive table using Functional programming - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/07 20:55:19 UTC, 3 replies.
- understanding performance what does it mean if a stage is skipped? - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/07 21:42:24 UTC, 3 replies.
- Updating reference data once a day in Spark Streaming job - posted by Karthikeyan Muthukumar <mk...@gmail.com> on 2016/03/07 21:46:51 UTC, 0 replies.
- Spark ML - Scaling logistic regression for many features - posted by Daniel Siegmann <da...@teamaol.com> on 2016/03/07 22:03:26 UTC, 13 replies.
- streaming app performance when would increasing execution size or adding more cores - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/07 22:53:54 UTC, 1 replies.
- how to implement and deploy robust streaming apps - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/07 23:10:58 UTC, 0 replies.
- streaming will I loose data if spark.streaming.backpressure.enabled=true - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/07 23:27:41 UTC, 0 replies.
- Spark Streaming, very slow processing and increasing scheduling delay of kafka input stream - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/07 23:52:57 UTC, 7 replies.
- OOM exception during Broadcast - posted by Arash <ar...@gmail.com> on 2016/03/08 00:29:58 UTC, 14 replies.
- Job Jar files located in s3, driver never starts the job - posted by Scott Reynolds <sr...@twilio.com> on 2016/03/08 00:51:00 UTC, 0 replies.
- Adding hive context gives error - posted by Suniti Singh <su...@gmail.com> on 2016/03/08 01:15:37 UTC, 7 replies.
- converting to map partitions - posted by dizzy5112 <da...@gmail.com> on 2016/03/08 02:34:21 UTC, 0 replies.
- Does anyone implement org.apache.spark.serializer.Serializer in their own code? - posted by Josh Rosen <jo...@databricks.com> on 2016/03/08 03:57:44 UTC, 2 replies.
- overwriting a spark output using pyspark - posted by Devesh Raj Singh <ra...@gmail.com> on 2016/03/08 08:06:43 UTC, 0 replies.
- How to compile Spark with private build of Hadoop - posted by "Lu, Yingqi" <yi...@intel.com> on 2016/03/08 08:09:30 UTC, 5 replies.
- Spark Partitioner vs Spark Shuffle Manager - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/08 08:19:53 UTC, 0 replies.
- Spark Twitter streaming - posted by Soni spark <so...@gmail.com> on 2016/03/08 08:54:31 UTC, 1 replies.
- Spark structured streaming - posted by Praveen Devarao <pr...@in.ibm.com> on 2016/03/08 10:38:05 UTC, 4 replies.
- SparkFiles.get() returns with driver path Instead of Worker Path - posted by ashikvc <vc...@gmail.com> on 2016/03/08 12:31:32 UTC, 2 replies.
- Need some instruction on gbdt - posted by Charles Li <le...@gmail.com> on 2016/03/08 12:56:47 UTC, 0 replies.
- Quetions about Actor model of Computation. - posted by Minglei Zhang <mi...@gmail.com> on 2016/03/08 13:49:58 UTC, 2 replies.
- Output the data to external database at particular time in spark streaming - posted by Abhishek Anand <ab...@gmail.com> on 2016/03/08 14:19:33 UTC, 4 replies.
- [Streaming + MLlib] Is it only Linear regression supported by online learning? - posted by diplomatic Guru <di...@gmail.com> on 2016/03/08 15:06:00 UTC, 1 replies.
- Spark ML Interaction - posted by amarouni <am...@talend.com> on 2016/03/08 15:18:26 UTC, 1 replies.
- FileAlreadyExistsException and Streaming context - posted by Peter Halliday <pj...@cornell.edu> on 2016/03/08 17:29:30 UTC, 0 replies.
- Spark on RAID - posted by Eddie Esquivel <ed...@gmail.com> on 2016/03/08 17:34:27 UTC, 3 replies.
- Re: how to implement and deploy robust streaming apps - posted by Xinh Huynh <xi...@gmail.com> on 2016/03/08 17:49:56 UTC, 0 replies.
- PySpark/SQL Octet Length - posted by Ro...@thomsonreuters.com on 2016/03/08 18:30:45 UTC, 1 replies.
- Using dynamic allocation and shuffle service in Standalone Mode - posted by "Yuval.Itzchakov" <yu...@gmail.com> on 2016/03/08 18:41:41 UTC, 7 replies.
- Analyzing json Data streams using sparkSQL in spark streaming returns java.lang.ClassNotFoundException - posted by Nesrine BEN MUSTAPHA <ne...@gmail.com> on 2016/03/08 18:59:44 UTC, 1 replies.
- Not able to write data after running fpgrowth in pyspark - posted by goutham koneru <go...@gmail.com> on 2016/03/08 19:10:34 UTC, 0 replies.
- Not able to save data after running fpgrowth in pyspark - posted by goutham koneru <go...@gmail.com> on 2016/03/08 19:55:43 UTC, 0 replies.
- Re: Best practices of maintaining a long running SparkContext - posted by Zhong Wang <wa...@gmail.com> on 2016/03/08 21:41:23 UTC, 1 replies.
- How to add a custom jar file to the Spark driver? - posted by Gerhard Fiedler <gf...@algebraixdata.com> on 2016/03/08 22:41:27 UTC, 3 replies.
- Hive Context: Hive Metastore Client - posted by Alex F <th...@gmail.com> on 2016/03/08 23:23:41 UTC, 4 replies.
- Streaming job delays - posted by jleaniz <ju...@gmail.com> on 2016/03/08 23:28:35 UTC, 3 replies.
- SparkML. RandomForest scalability question. - posted by Eugene Morozov <ev...@gmail.com> on 2016/03/09 00:39:55 UTC, 0 replies.
- Saving multiple outputs in the same job - posted by Andy Sloane <an...@a1k0n.net> on 2016/03/09 02:31:22 UTC, 2 replies.
- Confusing RDD function - posted by Hemminger Jeff <je...@atware.co.jp> on 2016/03/09 02:41:07 UTC, 3 replies.
- updating the Books section on the Spark documentation page - posted by Mohammed Guller <mo...@glassbeam.com> on 2016/03/09 02:45:19 UTC, 2 replies.
- pyspark spark-cassandra-connector java.io.IOException: Failed to open native connection to Cassandra at {192.168.1.126}:9042 - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/09 03:02:09 UTC, 5 replies.
- Spark Scheduler creating Straggler Node - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/09 05:17:10 UTC, 2 replies.
- S3 Zip File Loading Advice - posted by Benjamin Kim <bb...@gmail.com> on 2016/03/09 06:03:43 UTC, 6 replies.
- reading the parquet file - posted by Angel Angel <ar...@gmail.com> on 2016/03/09 07:00:34 UTC, 1 replies.
- Fwd: Dynamic allocation doesn't work on YARN - posted by Jy Chen <ch...@gmail.com> on 2016/03/09 09:29:01 UTC, 5 replies.
- [Error]Run Spark job as hdfs user from oozie workflow - posted by Divya Gehlot <di...@gmail.com> on 2016/03/09 10:11:49 UTC, 0 replies.
- DataFrame support for hadoop glob patterns - posted by Jakub Liska <li...@gmail.com> on 2016/03/09 13:38:37 UTC, 7 replies.
- Re: How to use graphx to partition a graph which could assign topologically-close vertices on a same machine? - posted by Robineast <Ro...@xense.co.uk> on 2016/03/09 15:48:51 UTC, 0 replies.
- HBASE - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/09 16:06:47 UTC, 2 replies.
- Multiple Spark taks with Akka FSM - posted by Andrés Ivaldi <ia...@gmail.com> on 2016/03/09 17:46:52 UTC, 1 replies.
- Re: spark 1.6.0 connect to hive metastore - posted by Dave Maughan <da...@gmail.com> on 2016/03/09 18:00:05 UTC, 4 replies.
- How to obtain JavaHBaseContext to connection SparkStreaming with HBase - posted by Rachana Srivastava <Ra...@markmonitor.com> on 2016/03/09 18:12:35 UTC, 0 replies.
- binary file deserialization - posted by Ruslan Dautkhanov <da...@gmail.com> on 2016/03/09 18:15:28 UTC, 3 replies.
- Specify log4j properties file - posted by Ashic Mahtab <as...@live.com> on 2016/03/09 18:57:00 UTC, 3 replies.
- spark streaming doesn't pick new files from HDFS - posted by srimugunthan dhandapani <sr...@gmail.com> on 2016/03/09 19:00:47 UTC, 2 replies.
- Request to add a new book to the Books section on Spark's website - posted by Mohammed Guller <mo...@glassbeam.com> on 2016/03/09 20:45:12 UTC, 1 replies.
- trouble with NUMPY constructor in UDF - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/10 00:09:59 UTC, 0 replies.
- Re: trouble with NUMPY constructor in UDF - posted by Ted Yu <yu...@gmail.com> on 2016/03/10 00:28:34 UTC, 2 replies.
- Re: How to obtain JavaHBaseContext to connection SparkStreaming with HBase - posted by Ted Yu <yu...@gmail.com> on 2016/03/10 00:41:11 UTC, 0 replies.
- spark executor memory, just for cache or the runtime memory ? - posted by charles li <ch...@gmail.com> on 2016/03/10 02:59:48 UTC, 2 replies.
- Re: Problem mixing MESOS Cluster Mode and Docker task execution - posted by Eran Chinthaka Withana <er...@gmail.com> on 2016/03/10 04:26:24 UTC, 13 replies.
- [Streaming] Batch interval and bulk export - posted by Li Ming Tsai <ma...@ltsai.com> on 2016/03/10 04:49:44 UTC, 0 replies.
- "bootstrapping" DStream state - posted by "Zalzberg, Idan (Agoda)" <Id...@agoda.com> on 2016/03/10 07:35:28 UTC, 2 replies.
- Is there Graph Partitioning impl for Scala/Spark? - posted by Alexander Pivovarov <ap...@gmail.com> on 2016/03/10 07:40:34 UTC, 1 replies.
- Running Java Program using Eclipse on Existing Spark Cluster - posted by Gaini Rajeshwar <ra...@gmail.com> on 2016/03/10 08:09:47 UTC, 0 replies.
- Zeppelin Integration - posted by ayan guha <gu...@gmail.com> on 2016/03/10 09:58:49 UTC, 5 replies.
- PySpark API signature mismatch compared to Scala - posted by Li Ming Tsai <ma...@ltsai.com> on 2016/03/10 09:59:20 UTC, 0 replies.
- sql functions: row_number, percent_rank, rank,rowNumber - posted by AlexModestov <Al...@gmail.com> on 2016/03/10 10:24:19 UTC, 0 replies.
- Correlation Matrix Limits - posted by Sebastian Kuepers <se...@publicispixelpark.de> on 2016/03/10 12:48:13 UTC, 0 replies.
- does spark needs dedicated machines to run on - posted by Shams ul Haque <sh...@cashcare.in> on 2016/03/10 15:32:44 UTC, 3 replies.
- how does dimsum works for categorical data - posted by "naveen.marri" <na...@gmail.com> on 2016/03/10 16:29:09 UTC, 0 replies.
- Spark job for Reading time series data from Cassandra - posted by "Prateek ." <pr...@aricent.com> on 2016/03/10 16:36:58 UTC, 3 replies.
- log4j pains - posted by Ashic Mahtab <as...@live.com> on 2016/03/10 16:40:20 UTC, 3 replies.
- Problem with union of DirectStream - posted by Guillermo Ortiz <ko...@gmail.com> on 2016/03/10 17:56:11 UTC, 1 replies.
- Achieving 700 Spark SQL Queries Per Second - posted by Evan Chan <ve...@gmail.com> on 2016/03/10 19:38:43 UTC, 1 replies.
- Re: Can we use spark inside a web service? - posted by "velvia.github" <ve...@gmail.com> on 2016/03/10 19:40:58 UTC, 15 replies.
- RDD recomputation - posted by souri datta <so...@gmail.com> on 2016/03/10 20:31:12 UTC, 1 replies.
- Dropping nested dataframe column - posted by Ro...@thomsonreuters.com on 2016/03/10 20:48:25 UTC, 0 replies.
- DataFrames - Kryo registration issue - posted by Raghava Mutharaju <m....@gmail.com> on 2016/03/10 20:54:19 UTC, 0 replies.
- Partitioning to speed up processing? - posted by Gerhard Fiedler <gf...@algebraixdata.com> on 2016/03/10 20:54:36 UTC, 2 replies.
- [MLlib - ALS] Merging two Models? - posted by Colin Woodbury <co...@gmail.com> on 2016/03/10 21:01:02 UTC, 4 replies.
- GraphX Pagerank Subgraphs - posted by adamsmith <ad...@gmail.com> on 2016/03/10 21:30:57 UTC, 0 replies.
- Job submission failure exception - unserializable TaskEndReason - posted by Chris Westin <cw...@yahoo.com.INVALID> on 2016/03/10 21:41:39 UTC, 0 replies.
- [ANNOUNCE] Announcing Spark 1.6.1 - posted by Michael Armbrust <mi...@databricks.com> on 2016/03/10 22:08:04 UTC, 0 replies.
- Graphx - posted by Andrew A <an...@gmail.com> on 2016/03/10 22:44:05 UTC, 12 replies.
- Running MesosClusterDispatcher through marathon with bridged mode - posted by Eran Chinthaka Withana <er...@gmail.com> on 2016/03/10 23:08:43 UTC, 0 replies.
- Spark configuration with 5 nodes - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/10 23:15:05 UTC, 8 replies.
- Re: Spark Streaming, processing time increasing with time - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/10 23:21:07 UTC, 0 replies.
- Flashback: RDD.aggregate versus accumulables... - posted by jiml <ji...@megalearningllc.com> on 2016/03/11 01:06:41 UTC, 0 replies.
- Does anyone have experience processing large volume images on Spark cluster - posted by greg huang <de...@gmail.com> on 2016/03/11 02:34:03 UTC, 0 replies.
- Why the shuffle write is not the exactly same as shuffle read of next stage - posted by canan chen <cc...@gmail.com> on 2016/03/11 04:08:26 UTC, 0 replies.
- Running ALS on comparitively large RDD - posted by Deepak Gopalakrishnan <dg...@gmail.com> on 2016/03/11 04:52:35 UTC, 4 replies.
- Kafka + Spark streaming, RDD partitions not processed in parallel - posted by Mukul Gupta <mu...@aricent.com> on 2016/03/11 04:55:44 UTC, 6 replies.
- Get output of the ALS algorithm. - posted by Shishir Anshuman <sh...@gmail.com> on 2016/03/11 04:57:37 UTC, 3 replies.
- lint-r checks failing - posted by Gayathri Murali <ga...@gmail.com> on 2016/03/11 05:48:17 UTC, 1 replies.
- How can I join two DataSet of same case class? - posted by 박주형 <dk...@gmail.com> on 2016/03/11 06:09:24 UTC, 2 replies.
- Python unit tests - Unable to ru it with Python 2.6 or 2.7 - posted by Gayathri Murali <ga...@gmail.com> on 2016/03/11 08:17:47 UTC, 5 replies.
- Spark REST APIs not working when application deployed in CLUSTER mode - posted by rakesh rakshit <ih...@gmail.com> on 2016/03/11 08:30:35 UTC, 0 replies.
- Strange behavior of collectNeighbors API in GraphX - posted by Zhaokang Wang <wa...@foxmail.com> on 2016/03/11 09:11:36 UTC, 2 replies.
- can checkpoint and write ahead log save the data in queued batch? - posted by Yu Xie <yu...@gmail.com> on 2016/03/11 10:36:09 UTC, 1 replies.
- How to efficiently query a large table with multiple dimensional table? - posted by ashokkumar rajendran <as...@gmail.com> on 2016/03/11 10:52:00 UTC, 1 replies.
- kill Spark Streaming job gracefully - posted by Shams ul Haque <sh...@cashcare.in> on 2016/03/11 11:10:54 UTC, 1 replies.
- ALS update without re-computing everything - posted by Roberto Pagliari <ro...@asos.com> on 2016/03/11 12:03:55 UTC, 0 replies.
- Re: ALS update without re-computing everything - posted by Nick Pentreath <ni...@gmail.com> on 2016/03/11 13:18:08 UTC, 2 replies.
- BlockFetchFailed Exception - posted by Priya Ch <le...@gmail.com> on 2016/03/11 13:45:09 UTC, 0 replies.
- Doubt on data frame - posted by ram kumar <ra...@gmail.com> on 2016/03/11 14:02:07 UTC, 3 replies.
- udf StructField to JSON String - posted by Caires Vinicius <ca...@gmail.com> on 2016/03/11 14:15:58 UTC, 8 replies.
- Spark on YARN memory consumption - posted by Jan Štěrba <in...@jansterba.com> on 2016/03/11 14:27:20 UTC, 2 replies.
- Does Spark support in-memory shuffling? - posted by Xudong Zheng <do...@gmail.com> on 2016/03/11 15:37:03 UTC, 1 replies.
- spark 1.6 foreachPartition only appears to be running on one executor - posted by Darin McBeath <dd...@yahoo.com.INVALID> on 2016/03/11 18:57:24 UTC, 5 replies.
- Newbie question - Help with runtime error on augmentString - posted by vasu20 <va...@gmail.com> on 2016/03/11 19:33:47 UTC, 8 replies.
- hive.metastore.metadb.dir not working programmatically - posted by harirajaram <ha...@gmail.com> on 2016/03/11 19:36:36 UTC, 0 replies.
- adding rows to a DataFrame - posted by Stefan Panayotov <sp...@msn.com> on 2016/03/11 19:45:59 UTC, 4 replies.
- Spark property parameters priority - posted by Cesar Flores <ce...@gmail.com> on 2016/03/11 20:06:49 UTC, 1 replies.
- How to distribute dependent files (.so , jar ) across spark worker nodes - posted by prateek arora <pr...@gmail.com> on 2016/03/11 20:07:19 UTC, 8 replies.
- sliding Top N window - posted by "Yakubovich, Alexey" <Al...@searshc.com> on 2016/03/11 21:09:19 UTC, 8 replies.
- YARN process with Spark - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/11 22:58:28 UTC, 7 replies.
- Repeating Records w/ Spark + Avro? - posted by Chris Miller <cm...@gmail.com> on 2016/03/12 00:19:01 UTC, 3 replies.
- Spark Streaming: java.lang.NoClassDefFoundError: org/apache/kafka/common/message/KafkaLZ4BlockOutputStream - posted by Siva <sb...@gmail.com> on 2016/03/12 02:00:50 UTC, 3 replies.
- Spark Serializer VS Hadoop Serializer - posted by Fei Hu <hu...@gmail.com> on 2016/03/12 03:09:29 UTC, 0 replies.
- Spark session dies in about 2 days: HDFS_DELEGATION_TOKEN token can't be found - posted by Ruslan Dautkhanov <da...@gmail.com> on 2016/03/12 03:10:01 UTC, 0 replies.
- Spark with Yarn Client - posted by Divya Gehlot <di...@gmail.com> on 2016/03/12 04:50:52 UTC, 1 replies.
- spark-submit with cluster deploy mode fails with ClassNotFoundException (jars are not passed around properley?) - posted by Hiroyuki Yamada <mo...@gmail.com> on 2016/03/12 07:23:23 UTC, 0 replies.
- NullPointerException - posted by Saurabh Guru <sa...@gmail.com> on 2016/03/12 08:01:14 UTC, 7 replies.
- Correct way to use spark streaming with apache zeppelin - posted by trung kien <ki...@gmail.com> on 2016/03/12 08:13:21 UTC, 9 replies.
- Spark SQL is not returning records for HIVE transactional tables on HDP - posted by "@Sanjiv Singh" <sa...@gmail.com> on 2016/03/12 09:24:23 UTC, 4 replies.
- Problem running JavaDirectKafkaWordCount - posted by Martin Andreoni <ma...@gta.ufrj.br> on 2016/03/12 17:01:29 UTC, 1 replies.
- spark-submit returns nothing with spark 1.6 - posted by Emmanuel <el...@msn.com> on 2016/03/12 19:26:20 UTC, 0 replies.
- Too Many Accumulators in my Spark Job - posted by Harshvardhan Chauhan <ha...@gumgum.com> on 2016/03/12 23:03:07 UTC, 0 replies.
- Spark Streaming stateful transformation mapWithState function getting error scala.MatchError: [Ljava.lang.Object] - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/12 23:09:50 UTC, 0 replies.
- Re: forgetfulness in clustering algorithm - posted by Priya Ch <le...@gmail.com> on 2016/03/13 07:42:39 UTC, 1 replies.
- Re: Why KMeans with mllib is so slow ? - posted by Chitturi Padma <le...@gmail.com> on 2016/03/13 07:58:48 UTC, 2 replies.
- Save the model produced after training with ALS. - posted by Shishir Anshuman <sh...@gmail.com> on 2016/03/13 18:33:09 UTC, 0 replies.
- Re: Spark Job on YARN accessing Hbase Table - posted by Benjamin Kim <bb...@gmail.com> on 2016/03/13 19:39:45 UTC, 6 replies.
- Trying to serialize/deserialize Spark ML Pipeline (RandomForest) Spark 1.6 - posted by Mario Lazaro <ma...@gumgum.com> on 2016/03/13 23:01:41 UTC, 0 replies.
- Re: Hive on Spark performance - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/14 00:36:11 UTC, 0 replies.
- append rows to dataframe - posted by Divya Gehlot <di...@gmail.com> on 2016/03/14 04:44:45 UTC, 4 replies.
- Can someone fix this download URL? - posted by Akhil Das <ak...@sigmoidanalytics.com> on 2016/03/14 05:22:19 UTC, 2 replies.
- Hive Query on Spark fails with OOM - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/14 06:23:33 UTC, 11 replies.
- spark streaming web ui remains completed jobs as active jobs - posted by t7s <zh...@umeng.com> on 2016/03/14 06:35:44 UTC, 1 replies.
- Spark 1.6.1 : SPARK-12089 : java.lang.NegativeArraySizeException - posted by Ravindra Rawat <ra...@gmail.com> on 2016/03/14 06:39:37 UTC, 1 replies.
- Terminate Spark job in eclipse - posted by Soni spark <so...@gmail.com> on 2016/03/14 08:17:45 UTC, 0 replies.
- how to convert the RDD[Array[Double]] to RDD[Double] - posted by "lizhenmxcz@163.com" <li...@163.com> on 2016/03/14 09:28:25 UTC, 1 replies.
- Re: Error while deploying spark 1.6.1 on EC2 - posted by sandesh deshmane <sa...@gmail.com> on 2016/03/14 09:50:37 UTC, 0 replies.
- java.lang.IllegalArgumentException: Unable to create serializer "com.esotericsoftware.kryo.serializers.FieldSerializer" - posted by Nagu Kothapalli <na...@gmail.com> on 2016/03/14 10:00:28 UTC, 0 replies.
- How to Catch Spark Streaming Twitter Exception ( Written Java) - posted by Soni spark <so...@gmail.com> on 2016/03/14 10:18:37 UTC, 0 replies.
- Re: java.lang.OutOfMemoryError: Requested array size exceeds VM limit - posted by nir <ni...@gmail.com> on 2016/03/14 10:32:51 UTC, 0 replies.
- Possible memory leak - posted by adamreith <r....@reply.it> on 2016/03/14 10:36:43 UTC, 0 replies.
- OOM Exception in my spark streaming application - posted by adamreith <r....@reply.it> on 2016/03/14 10:41:28 UTC, 6 replies.
- Performance tuning of spark pipeline - posted by Jatin Kumar <jk...@rocketfuelinc.com.INVALID> on 2016/03/14 13:19:52 UTC, 0 replies.
- Printing MLpipeline model in Python. - posted by VISHNU SUBRAMANIAN <jo...@gmail.com> on 2016/03/14 13:31:31 UTC, 0 replies.
- mess spark cluster mode error - posted by sjk <sh...@163.com> on 2016/03/14 14:55:20 UTC, 1 replies.
- RE: [MARKETING] Spark Streaming stateful transformation mapWithState function getting error scala.MatchError: [Ljava.lang.Object] - posted by Iain Cundy <Ia...@amdocs.com> on 2016/03/14 15:06:19 UTC, 1 replies.
- Spark Streaming Twiiter and Standalone cluster - posted by palamaury <ma...@hotmail.fr> on 2016/03/14 15:07:26 UTC, 0 replies.
- Re: Spark session dies in about 2 days: HDFS_DELEGATION_TOKEN token can'tbe found - posted by Nikhil Gs <gs...@gmail.com> on 2016/03/14 15:31:52 UTC, 0 replies.
- Reducing multiple values - posted by Kevin Mc Ghee <ke...@gmail.com> on 2016/03/14 16:11:42 UTC, 0 replies.
- Spark SQL / Parquet - Dynamic Schema detection - posted by Anthony Andras <pr...@gmail.com> on 2016/03/14 17:35:15 UTC, 1 replies.
- Reading an RDD from a checkpoint. - posted by Daniel Imberman <da...@gmail.com> on 2016/03/14 20:00:45 UTC, 0 replies.
- Exceptions when accessing Spark metrics with REST API - posted by Boric Tan <it...@gmail.com> on 2016/03/14 20:12:50 UTC, 4 replies.
- Spark-submit, Spark 1.6, how to get status of Job? - posted by Emmanuel <el...@msn.com> on 2016/03/14 20:27:22 UTC, 0 replies.
- Re: Changing number of workers for benchmarking purposes - posted by lisak <li...@gmail.com> on 2016/03/14 21:43:58 UTC, 1 replies.
- Docker configuration for akka spark streaming - posted by David Gomez Saavedra <mi...@gmail.com> on 2016/03/14 21:45:22 UTC, 3 replies.
- shuffle in spark - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/14 22:59:33 UTC, 1 replies.
- Hive query works in spark-shell not spark-submit - posted by rhuang <rh...@amobee.com> on 2016/03/15 00:20:38 UTC, 1 replies.
- Failing MiMa tests - posted by Gayathri Murali <ga...@gmail.com> on 2016/03/15 03:22:54 UTC, 4 replies.
- Compare a column in two different tables/find the distance between column data - posted by Suniti Singh <su...@gmail.com> on 2016/03/15 04:46:38 UTC, 3 replies.
- Documentation for "hidden" RESTful API for submitting jobs (not history server) - posted by Hyukjin Kwon <gu...@gmail.com> on 2016/03/15 06:02:26 UTC, 0 replies.
- [How To :]Custom Logging of Spark Scala scripts - posted by Divya Gehlot <di...@gmail.com> on 2016/03/15 06:23:32 UTC, 0 replies.
- sparkR issues ? - posted by roni <ro...@gmail.com> on 2016/03/15 06:44:28 UTC, 7 replies.
- Launch Spark shell using differnt python version - posted by Stuti Awasthi <st...@hcl.com> on 2016/03/15 07:22:29 UTC, 2 replies.
- create hive context in spark application - posted by antoniosi <an...@gmail.com> on 2016/03/15 07:28:12 UTC, 2 replies.
- Streaming app consume multiple kafka topics - posted by Imre Nagi <im...@gmail.com> on 2016/03/15 07:35:33 UTC, 5 replies.
- unsubscribe - posted by satish chandra j <js...@gmail.com> on 2016/03/15 08:26:56 UTC, 3 replies.
- is there any way to make WEB UI auto-refresh? - posted by charles li <ch...@gmail.com> on 2016/03/15 09:43:08 UTC, 1 replies.
- Spark streaming - update configuration while retaining write ahead log data? - posted by Ewan Leith <ew...@realitymine.com> on 2016/03/15 10:12:53 UTC, 3 replies.
- the "DAG Visualiztion" in 1.6 not works fine here - posted by charles li <ch...@gmail.com> on 2016/03/15 10:53:42 UTC, 2 replies.
- reading file from S3 - posted by Yasemin Kaya <go...@gmail.com> on 2016/03/15 11:33:03 UTC, 9 replies.
- Building Spark packages with SBTor Maven - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/15 11:42:13 UTC, 13 replies.
- Compress individual RDD - posted by Nirav Patel <np...@xactlycorp.com> on 2016/03/15 12:03:36 UTC, 3 replies.
- Spark work distribution among execs - posted by Borislav Kapukaranov <b....@gmail.com> on 2016/03/15 13:46:24 UTC, 5 replies.
- Imporvement the cube with the Fast Cubing In apache Kylin - posted by 李承霖 <li...@126.com> on 2016/03/15 13:52:52 UTC, 1 replies.
- mapwithstate Hangs with Error cleaning broadcast - posted by manasdebashiskar <po...@gmail.com> on 2016/03/15 14:04:30 UTC, 3 replies.
- Re: how to set log level of spark executor on YARN(using yarn-cluster mode) - posted by jkukul <ja...@gmail.com> on 2016/03/15 16:09:48 UTC, 0 replies.
- Release Announcement: XGBoost4J - Portable Distributed XGBoost in Spark, Flink and Dataflow - posted by Nan Zhu <zh...@gmail.com> on 2016/03/15 16:53:11 UTC, 0 replies.
- Questions about Spark On Mesos - posted by Shuai Lin <li...@gmail.com> on 2016/03/15 18:22:20 UTC, 0 replies.
- Parition RDD by key to create DataFrames - posted by Mohamed Nadjib MAMI <ma...@iai.uni-bonn.de> on 2016/03/15 18:33:44 UTC, 1 replies.
- 回复： mapwithstate Hangs with Error cleaning broadcast - posted by Sea <26...@qq.com> on 2016/03/15 18:36:59 UTC, 0 replies.
- bug? using withColumn with colName with dot can't replace column - posted by Emmanuel <el...@msn.com> on 2016/03/15 18:51:15 UTC, 1 replies.
- Best way to process values for key in sorted order - posted by James Hammerton <ja...@gluru.co> on 2016/03/15 19:09:48 UTC, 0 replies.
- RE: [MARKETING] Re: mapwithstate Hangs with Error cleaning broadcast - posted by Iain Cundy <Ia...@amdocs.com> on 2016/03/15 19:30:55 UTC, 0 replies.
- newbie HDFS S3 best practices - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/15 19:45:03 UTC, 3 replies.
- How to select from table name using IF(condition, tableA, tableB)? - posted by Rex X <dn...@gmail.com> on 2016/03/15 20:08:50 UTC, 0 replies.
- Microsoft SQL dialect issues - posted by Andrés Ivaldi <ia...@gmail.com> on 2016/03/15 20:09:02 UTC, 2 replies.
- How to convert Parquet file to a text file. - posted by Shishir Anshuman <sh...@gmail.com> on 2016/03/15 21:34:30 UTC, 1 replies.
- Re: Spark and KafkaUtils - posted by Vinti Maheshwari <vi...@gmail.com> on 2016/03/15 21:42:26 UTC, 0 replies.
- Spark streaming with akka association with remote system failure - posted by David Gomez Saavedra <mi...@gmail.com> on 2016/03/15 21:50:16 UTC, 1 replies.
- Error building spark app with Maven - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/15 23:08:46 UTC, 11 replies.
- spark.ml : eval model outside sparkContext - posted by Emmanuel <el...@msn.com> on 2016/03/15 23:47:49 UTC, 1 replies.
- what is the best practice to read configure file in spark streaming - posted by yaoxiaohua <ya...@outlook.com> on 2016/03/16 00:28:36 UTC, 0 replies.
- How to add an accumulator for a Set in Spark - posted by SRK <sw...@gmail.com> on 2016/03/16 00:29:14 UTC, 4 replies.
- what is the pyspark inverse of registerTempTable()? - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/16 00:40:42 UTC, 3 replies.
- Spark UI Completed Jobs - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/16 01:14:02 UTC, 5 replies.
- Re: filter by dict() key in pySpark - posted by Davies Liu <da...@databricks.com> on 2016/03/16 01:31:23 UTC, 0 replies.
- Spark Thriftserver - posted by ayan guha <gu...@gmail.com> on 2016/03/16 01:39:52 UTC, 6 replies.
- PySpark Issue: "org.apache.spark.shuffle.FetchFailedException: Failed to connect to..." - posted by craigiggy <cr...@effect-tech.com> on 2016/03/16 03:03:55 UTC, 2 replies.
- Does parallelize and collect preserve the original order of list? - posted by JoneZhang <jo...@gmail.com> on 2016/03/16 03:16:07 UTC, 2 replies.
- Job failed while submitting python to yarn programatically - posted by sy...@tsmc.com on 2016/03/16 03:54:32 UTC, 3 replies.
- Fwd: Connection failure followed by bad shuffle files during shuffle - posted by Eric Martin <er...@ericmart.in> on 2016/03/16 03:56:47 UTC, 0 replies.
- Get Pair of Topic and Message from Kafka + Spark Streaming - posted by Imre Nagi <im...@gmail.com> on 2016/03/16 04:58:08 UTC, 2 replies.
- convert row to map of key as int and values as arrays - posted by Divya Gehlot <di...@gmail.com> on 2016/03/16 05:11:09 UTC, 0 replies.
- Reg:Reading a csv file with String label into labelepoint - posted by Dharmin Siddesh J <si...@gmail.com> on 2016/03/16 06:41:55 UTC, 1 replies.
- Unable to serialize dataframe - posted by shyam <sh...@philips.com> on 2016/03/16 07:36:16 UTC, 0 replies.
- exception while running job as pyspark - posted by ram kumar <ra...@gmail.com> on 2016/03/16 08:00:45 UTC, 1 replies.
- Enabling spark_shuffle service without restarting YARN Node Manager - posted by Vinay Kashyap <vi...@gmail.com> on 2016/03/16 10:12:46 UTC, 3 replies.
- The build-in indexes in ORC file does not work. - posted by Joseph <wx...@sina.com> on 2016/03/16 11:23:56 UTC, 6 replies.
- [Streaming] textFileStream has no events shown in web UI - posted by Hao Ren <in...@gmail.com> on 2016/03/16 11:51:07 UTC, 0 replies.
- [Package Release] Widely accepted XGBoost now available in Spark - posted by Nan Zhu <zh...@gmail.com> on 2016/03/16 12:17:57 UTC, 0 replies.
- Extra libs in executor classpath - posted by Леонид Поляков <ow...@gmail.com> on 2016/03/16 12:22:14 UTC, 4 replies.
- Setting up log4j2/logback with Spark 1.6.0 - posted by "Yuval.Itzchakov" <yu...@gmail.com> on 2016/03/16 14:43:33 UTC, 0 replies.
- df.dtypes -> pyspark.sql.types - posted by Ruslan Dautkhanov <da...@gmail.com> on 2016/03/16 17:18:38 UTC, 3 replies.
- best practices: running multi user jupyter notebook server - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/16 18:36:49 UTC, 0 replies.
- Re: Unit test with sqlContext - posted by Vikas Kawadia <ka...@gmail.com> on 2016/03/16 21:48:10 UTC, 0 replies.
- [discuss] making SparkEnv private in Spark 2.0 - posted by Reynold Xin <rx...@databricks.com> on 2016/03/16 22:52:27 UTC, 3 replies.
- Re: HP customer support @ www.globalpccure.com/Support/Support-for-HP.aspx - posted by nsalian <ns...@cloudera.com> on 2016/03/16 23:18:41 UTC, 0 replies.
- Improving Spark Scheduler Delay - posted by Prabhu Joseph <pr...@gmail.com> on 2016/03/17 02:27:10 UTC, 0 replies.
- best way to do deep learning on spark ? - posted by charles li <ch...@gmail.com> on 2016/03/17 03:00:59 UTC, 4 replies.
- Fwd: Apache Spark Exception in thread “main” java.lang.NoClassDefFoundError: scala/collection/GenTraversableOnce$class - posted by satyajit vegesna <sa...@gmail.com> on 2016/03/17 03:05:42 UTC, 2 replies.
- [Error] : dynamically union All + adding new column - posted by Divya Gehlot <di...@gmail.com> on 2016/03/17 03:29:11 UTC, 2 replies.
- Stop spark application when the job is complete. - posted by Imre Nagi <im...@gmail.com> on 2016/03/17 05:17:59 UTC, 1 replies.
- Joins in Spark - posted by Stuti Awasthi <st...@hcl.com> on 2016/03/17 07:42:01 UTC, 1 replies.
- Incomplete data when reading from S3 - posted by Blaž Šnuderl <sn...@gmail.com> on 2016/03/17 08:44:57 UTC, 1 replies.
- [Spark-1.5.2]Column renaming with withColumnRenamed has no effect - posted by Divya Gehlot <di...@gmail.com> on 2016/03/17 10:02:26 UTC, 1 replies.
- Zip File and XML parsing with Spark Streaming - posted by tjb305 <to...@mrtydiablo.co.uk> on 2016/03/17 12:36:29 UTC, 1 replies.
- Error in "java.io.IOException: No input paths specified in job" - posted by tinyocean <ha...@gmail.com> on 2016/03/17 14:22:11 UTC, 1 replies.
- Limit pyspark.daemon threads - posted by "Carlile, Ken" <ca...@janelia.hhmi.org> on 2016/03/17 15:43:49 UTC, 4 replies.
- 回复： Limit pyspark.daemon threads - posted by Sea <26...@qq.com> on 2016/03/17 15:52:58 UTC, 0 replies.
- The error to read HDFS custom file in spark. - posted by Tony Liu <to...@gmail.com> on 2016/03/17 16:21:02 UTC, 5 replies.
- ClassNotFoundException in RDD.map - posted by Dirceu Semighini Filho <di...@gmail.com> on 2016/03/17 16:32:53 UTC, 4 replies.
- Restarting an executor during execution causes it to lose AWS credentials (anyone seen this?) - posted by Allen George <al...@gmail.com> on 2016/03/17 17:01:40 UTC, 1 replies.
- Can't zip RDDs with unequal numbers of partitions - posted by Jiří Syrový <sy...@gmail.com> on 2016/03/17 18:03:57 UTC, 2 replies.
- Apache Beam Spark runner - posted by "Sela, Amit" <AN...@paypal.com.INVALID> on 2016/03/17 18:26:59 UTC, 1 replies.
- unix_timestamp() time zone problem - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/17 21:28:27 UTC, 1 replies.
- sql timestamp timezone bug - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/17 23:02:53 UTC, 4 replies.
- installing packages with pyspark - posted by Ajinkya Kale <ka...@gmail.com> on 2016/03/18 01:36:19 UTC, 7 replies.
- Subquery performance - posted by Younes Naguib <Yo...@tritondigital.com> on 2016/03/18 01:53:06 UTC, 3 replies.
- ERROR ArrayBuffer(java.nio.channels.ClosedChannelException - posted by Ascot Moss <as...@gmail.com> on 2016/03/18 03:28:17 UTC, 4 replies.
- Error using collectAsMap() in scala - posted by Shishir Anshuman <sh...@gmail.com> on 2016/03/18 04:55:15 UTC, 7 replies.
- Handling Missing Values in MLLIB Decision Tree - posted by Abir Chakraborty <ab...@247-inc.com> on 2016/03/18 05:51:50 UTC, 1 replies.
- MLPC model can not be saved - posted by HanPan <pa...@thinkingdata.cn> on 2016/03/18 12:14:53 UTC, 0 replies.
- How to gracefully handle Kafka OffsetOutOfRangeException - posted by Ramkumar Venkataraman <ra...@gmail.com> on 2016/03/18 12:16:44 UTC, 5 replies.
- DistributedLDAModel missing APIs in org.apache.spark.ml - posted by cindymc <ci...@oracle.com> on 2016/03/18 15:34:44 UTC, 1 replies.
- Saving the DataFrame based RandomForestClassificationModels - posted by James Hammerton <ja...@gluru.co> on 2016/03/18 15:42:54 UTC, 0 replies.
- CfP 11th Workshop on Virtualization in High-Performance Cloud Computing (VHPC '16) - posted by VHPC 16 <vh...@gmail.com> on 2016/03/18 16:03:10 UTC, 1 replies.
- Checkpoint of DStream joined with RDD - posted by Lubomir Nerad <lu...@oracle.com> on 2016/03/18 16:05:34 UTC, 4 replies.
- Rename Several Aggregated Columns - posted by An...@wellsfargo.com on 2016/03/18 17:10:41 UTC, 2 replies.
- Issue regarding removal of duplicates from RDD - posted by "Thamme Gowda N." <tg...@gmail.com> on 2016/03/18 17:10:55 UTC, 0 replies.
- help coercing types - posted by "Bauer, Robert" <Ro...@asurion.com> on 2016/03/18 17:20:12 UTC, 1 replies.
- bug spark should not use java.sql.timestamp was: sql timestamp timezone bug - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/18 20:16:00 UTC, 0 replies.
- Spark 1.5.2, why the broadcast join shuffle so much data in the last step - posted by Yong Zhang <ja...@hotmail.com> on 2016/03/18 21:54:16 UTC, 17 replies.
- Setting up spark to run on two nodes - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/18 23:31:06 UTC, 2 replies.
- SparkContext.stop() takes too long to complete - posted by Nezih Yigitbasi <ny...@netflix.com.INVALID> on 2016/03/19 00:16:24 UTC, 2 replies.
- Saving intermediate results in mapPartitions - posted by Krishna <re...@gmail.com> on 2016/03/19 00:55:20 UTC, 1 replies.
- Fwd: DF creation - posted by satyajit vegesna <sa...@gmail.com> on 2016/03/19 01:30:38 UTC, 1 replies.
- Request for comments: Tensorframes, an integration library between TensorFlow and Spark DataFrames - posted by Tim Hunter <ti...@databricks.com> on 2016/03/19 02:18:50 UTC, 0 replies.
- Potential conflict with org.iq80.snappy in Spark 1.6.0 environment? - posted by vasu20 <va...@gmail.com> on 2016/03/19 03:19:32 UTC, 2 replies.
- spark shuffle service on yarn - posted by Koert Kuipers <ko...@tresata.com> on 2016/03/19 03:25:50 UTC, 2 replies.
- What is the most efficient and scalable way to get all the recommendation results from ALS model ? - posted by Hiroyuki Yamada <mo...@gmail.com> on 2016/03/19 11:58:41 UTC, 2 replies.
- Spark jobs running in serial mode on yarn client - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/19 17:46:19 UTC, 0 replies.
- Fwd: Spark 2.0 Shell -csv package weirdness - posted by Vincent Ohprecio <oh...@gmail.com> on 2016/03/19 20:18:03 UTC, 5 replies.
- Spark performance issues - posted by Khaled Ammar <kh...@gmail.com> on 2016/03/20 01:21:04 UTC, 0 replies.
- Re: spark launching range is 10 mins - posted by Jialin Liu <ja...@lbl.gov> on 2016/03/20 07:34:41 UTC, 1 replies.
- (Unknown) - posted by Vinay Varma <vi...@gmail.com> on 2016/03/20 11:53:34 UTC, 0 replies.
- spark-submit reset JVM - posted by Udo Fholl <ud...@gmail.com> on 2016/03/20 14:20:13 UTC, 1 replies.
- Re: Stanford CoreNLP sentiment extraction: lost executor - posted by tundo <en...@gmail.com> on 2016/03/20 15:53:37 UTC, 0 replies.
- Flume with Spark Streaming Sink - posted by Daniel Haviv <da...@veracity-group.com> on 2016/03/20 17:22:01 UTC, 2 replies.
- reading csv file, operation on column or columns - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/20 22:47:37 UTC, 4 replies.
- support vector machine question - posted by prem09 <pr...@hotmail.com> on 2016/03/21 00:20:56 UTC, 0 replies.
- Building spark submodule source code - posted by Tenghuan He <te...@gmail.com> on 2016/03/21 03:44:41 UTC, 3 replies.
- Spark: The build-in indexes in ORC file do not work. - posted by Joseph <wx...@sina.com> on 2016/03/21 04:33:35 UTC, 0 replies.
- Get the number of days dynamically in with Column - posted by Divya Gehlot <di...@gmail.com> on 2016/03/21 04:42:59 UTC, 1 replies.
- Re: best practices: running multi user jupyter notebook server - posted by charles li <ch...@gmail.com> on 2016/03/21 06:17:11 UTC, 0 replies.
- Best way to store Avro Objects as Parquet using SPARK - posted by Manivannan Selvadurai <sm...@gmail.com> on 2016/03/21 06:55:03 UTC, 4 replies.
- Run External R script from Spark - posted by sujeet jog <su...@gmail.com> on 2016/03/21 07:09:44 UTC, 1 replies.
- How to name features and perform custom cross validation in ML - posted by iguana314 <gr...@gmail.com> on 2016/03/21 07:29:40 UTC, 0 replies.
- declare constant as date - posted by Divya Gehlot <di...@gmail.com> on 2016/03/21 07:51:52 UTC, 1 replies.
- Issue with wholeTextFiles - posted by Sarath Chandra <sa...@algofusiontech.com> on 2016/03/21 09:12:42 UTC, 7 replies.
- java.lang.OutOfMemoryError: Direct buffer memory when using broadcast join - posted by "Dai, Kevin" <yu...@paypal.com.INVALID> on 2016/03/21 09:25:59 UTC, 1 replies.
- 答复: java.lang.OutOfMemoryError: Direct buffer memory when using broadcast join - posted by "Dai, Kevin" <yu...@paypal.com.INVALID> on 2016/03/21 09:34:34 UTC, 0 replies.
- SparkSQL 2.0 snapshot - thrift server behavior - posted by Raymond Honderdors <Ra...@sizmek.com> on 2016/03/21 10:10:55 UTC, 0 replies.
- subscribe - posted by Namrata Thanvi <na...@gmail.com> on 2016/03/21 11:35:29 UTC, 0 replies.
- How to collect data for some particular point in spark streaming - posted by Nagu Kothapalli <na...@gmail.com> on 2016/03/21 13:28:53 UTC, 1 replies.
- Saving model S3 - posted by Yasemin Kaya <go...@gmail.com> on 2016/03/21 14:19:55 UTC, 3 replies.
- cluster randomly re-starting jobs - posted by Roberto Pagliari <ro...@asos.com> on 2016/03/21 14:21:19 UTC, 3 replies.
- Spark SQL Optimization - posted by gtinside <gt...@gmail.com> on 2016/03/21 14:27:04 UTC, 5 replies.
- Re: Using lz4 in Kafka seems to be broken by jpountz dependency upgrade in Spark 1.5.x+ - posted by Marcin Kuthan <ma...@gmail.com> on 2016/03/21 15:22:17 UTC, 0 replies.
- Can not kill driver properly - posted by Hao Ren <in...@gmail.com> on 2016/03/21 16:16:22 UTC, 2 replies.
- HADOOP_HOME or hadoop.home.dir are not set - posted by Hari Krishna Dara <ha...@gmail.com> on 2016/03/21 16:54:10 UTC, 0 replies.
- Spark Metrics Framework? - posted by Mike Sukmanowsky <mi...@gmail.com> on 2016/03/21 16:54:38 UTC, 7 replies.
- Extending Spark Catalyst optimizer with own rules - posted by tolyasik <an...@gmail.com> on 2016/03/21 17:20:56 UTC, 0 replies.
- Error selecting from a Hive ORC table in Spark-sql - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/21 17:39:18 UTC, 1 replies.
- Find all invoices more than 6 months from csv file - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/21 18:57:22 UTC, 1 replies.
- Re: SparkML algos limitations question. - posted by Eugene Morozov <ev...@gmail.com> on 2016/03/21 19:22:20 UTC, 1 replies.
- Merging ML Estimator and Model - posted by Joseph Bradley <jo...@databricks.com> on 2016/03/21 19:53:29 UTC, 0 replies.
- Work out date column in CSV more than 6 months old (datediff or something) - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/21 22:53:06 UTC, 3 replies.
- ALS setIntermediateRDDStorageLevel - posted by Roberto Pagliari <ro...@asos.com> on 2016/03/21 23:09:29 UTC, 0 replies.
- pyspark sql convert long to timestamp? - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/22 00:19:28 UTC, 2 replies.
- Unable to run Python Unit tests - posted by Gayathri Murali <ga...@gmail.com> on 2016/03/22 04:05:13 UTC, 2 replies.
- Spark 1.6.0 op CDH 5.6.0 - posted by Michel Hubert <mi...@phact.nl> on 2016/03/22 10:13:00 UTC, 1 replies.
- Is there a way to submit spark job to your by YARN REST API? - posted by "tony.yan@tendcloud.com" <to...@tendcloud.com> on 2016/03/22 10:27:59 UTC, 3 replies.
- Issues facing while Running Spark Streaming Job in YARN cluster mode - posted by Soni spark <so...@gmail.com> on 2016/03/22 10:46:49 UTC, 1 replies.
- Spark Streaming UI duration numbers mismatch - posted by Jatin Kumar <jk...@rocketfuelinc.com> on 2016/03/22 11:00:18 UTC, 3 replies.
- Add org.apache.spark.mllib model .predict() method to models in org.apache.spark.ml? - posted by James Hammerton <ja...@gluru.co> on 2016/03/22 11:02:39 UTC, 0 replies.
- trying to implement mini-batch GD in pyspark - posted by sethirot <as...@combotag.com> on 2016/03/22 11:16:23 UTC, 0 replies.
- Re: ALS setIntermediateRDDStorageLevel - posted by Sean Owen <so...@cloudera.com> on 2016/03/22 11:58:14 UTC, 2 replies.
- Issue wihle applying filters/conditions in DataFrame in Spark - posted by Hafsa Asif <ha...@matchinguu.com> on 2016/03/22 13:43:30 UTC, 5 replies.
- Spark schema evolution - posted by gtinside <gt...@gmail.com> on 2016/03/22 14:34:44 UTC, 2 replies.
- new object store driver for Spark - posted by Gil Vernik <GI...@il.ibm.com> on 2016/03/22 14:35:32 UTC, 1 replies.
- Serialization issue with Spark - posted by Hafsa Asif <ha...@matchinguu.com> on 2016/03/22 15:00:15 UTC, 4 replies.
- Direct Kafka input stream and window(…) function - posted by Martin Soch <Ma...@oracle.com> on 2016/03/22 16:14:51 UTC, 3 replies.
- Problem using saveAsNewAPIHadoopFile API - posted by vetal king <gr...@gmail.com> on 2016/03/22 18:26:02 UTC, 8 replies.
- Expose spark pre-computed data via thrift server - posted by rjtokenring <in...@gmail.com> on 2016/03/22 18:56:23 UTC, 1 replies.
- Additional classpaths / java options - posted by Ashic Mahtab <as...@live.com> on 2016/03/22 19:12:14 UTC, 0 replies.
- Mapping csv columns and reformatting date string - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/22 23:10:47 UTC, 1 replies.
- Using Spark to retrieve a HDFS file protected by Kerberos - posted by Nkechi Achara <nk...@googlemail.com> on 2016/03/23 00:47:52 UTC, 1 replies.
- Cached Parquet file paths problem - posted by Piotr Smoliński <pi...@gmail.com> on 2016/03/23 01:03:28 UTC, 2 replies.
- MLlib for Spark - posted by Abid Muslim Malik <ab...@gmail.com> on 2016/03/23 02:51:51 UTC, 0 replies.
- DataFrame vs RDD - posted by asethia <se...@gmail.com> on 2016/03/23 03:08:18 UTC, 5 replies.
- [Critical] Issue with cached RDDs created from hadoop sequence files - posted by "Thamme Gowda N." <tg...@gmail.com> on 2016/03/23 03:56:04 UTC, 4 replies.
- Does anyone install netlib-java on AWS EMR Spark? - posted by greg huang <de...@gmail.com> on 2016/03/23 04:17:57 UTC, 0 replies.
- find the matching and get the value - posted by Divya Gehlot <di...@gmail.com> on 2016/03/23 06:08:04 UTC, 0 replies.
- Plot DataFrame with matplotlib - posted by Yavuz Nuzumlalı <ma...@gmail.com> on 2016/03/23 08:30:20 UTC, 4 replies.
- Applying filter to a date column - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/23 11:32:07 UTC, 0 replies.
- [Spark -1.5.2]Dynamically creation of caseWhen expression - posted by Divya Gehlot <di...@gmail.com> on 2016/03/23 12:50:48 UTC, 0 replies.
- DataFrames UDAF with array and struct - posted by Matthias Niehoff <ma...@codecentric.de> on 2016/03/23 13:25:23 UTC, 0 replies.
- Spark with Druid - posted by Raymond Honderdors <Ra...@sizmek.com> on 2016/03/23 13:59:09 UTC, 3 replies.
- Spark and DB connection pool - posted by rjtokenring <in...@gmail.com> on 2016/03/23 15:56:54 UTC, 3 replies.
- Streaming bisecting k-means possible? - posted by Dustin Decker <du...@indeed.com> on 2016/03/23 16:02:38 UTC, 0 replies.
- running fpgrowth -- run method - posted by "Bauer, Robert" <Ro...@asurion.com> on 2016/03/23 16:22:02 UTC, 0 replies.
- Spark thrift issue 8659 (changing subject) - posted by ayan guha <gu...@gmail.com> on 2016/03/23 22:01:36 UTC, 0 replies.
- Is streaming bisecting k-means possible? - posted by dustind <du...@indeed.com> on 2016/03/23 22:02:54 UTC, 1 replies.
- Converting array of string type to datetime - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/23 22:20:49 UTC, 2 replies.
- Forcing data from disk to memory - posted by Daniel Imberman <da...@gmail.com> on 2016/03/24 00:22:11 UTC, 5 replies.
- Best way to determine # of workers - posted by Ajaxx <aj...@pobox.com> on 2016/03/24 00:23:47 UTC, 6 replies.
- calling individual columns from spark temporary table - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/24 01:10:15 UTC, 5 replies.
- What's the benifit of RDD checkpoint against RDD save - posted by Todd <bi...@163.com> on 2016/03/24 03:14:07 UTC, 6 replies.
- BinaryFiles to ZipInputStream - posted by Benjamin Kim <bb...@gmail.com> on 2016/03/24 05:55:47 UTC, 0 replies.
- what happened if cache a RDD for multiple time? - posted by charles li <ch...@gmail.com> on 2016/03/24 09:28:43 UTC, 2 replies.
- No active SparkContext - posted by Max Schmidt <ma...@datapath.io> on 2016/03/24 09:54:14 UTC, 5 replies.
- Spark SQL - java.lang.StackOverflowError after caching table - posted by Mohamed Nadjib MAMI <ma...@iai.uni-bonn.de> on 2016/03/24 10:43:40 UTC, 4 replies.
- Output is being stored on the clusters (slaves). - posted by Shishir Anshuman <sh...@gmail.com> on 2016/03/24 11:09:50 UTC, 1 replies.
- Write RDD to Elasticsearch - posted by Jakub Stransky <st...@gmail.com> on 2016/03/24 11:09:58 UTC, 1 replies.
- Spark DataFrames Array functions - posted by Viktor Taranenko <vi...@gmail.com> on 2016/03/24 12:17:20 UTC, 0 replies.
- multiple tables for join - posted by pseudo oduesp <ps...@gmail.com> on 2016/03/24 13:12:16 UTC, 1 replies.
- Re: join multiple 14 tables with lot of columns - posted by Malouke <ps...@gmail.com> on 2016/03/24 13:51:10 UTC, 0 replies.
- REST-API for Killing a Streaming Application - posted by Christian Kurz <ch...@oracle.com> on 2016/03/24 13:51:25 UTC, 0 replies.
- Create one DB connection per executor - posted by Manas <ma...@hotmail.com> on 2016/03/24 14:00:39 UTC, 3 replies.
- apache spark errors - posted by Michel Hubert <mi...@phact.nl> on 2016/03/24 14:12:40 UTC, 6 replies.
- Converting a string of format of 'dd/MM/yyyy' in Spark sql - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/24 14:29:59 UTC, 9 replies.
- DataFrame python UDF performnce too slow - posted by Bijay Pathak <bi...@cloudwick.com> on 2016/03/24 17:20:25 UTC, 0 replies.
- Reading Back a Cached RDD - posted by "Afshartous, Nick" <na...@turbine.com> on 2016/03/24 19:02:27 UTC, 4 replies.
- Slaves died, but jobs not picked up by standby slaves - posted by Dillian Murphey <cr...@gmail.com> on 2016/03/24 19:20:05 UTC, 1 replies.
- Column explode a map - posted by Michał Zieliński <zi...@gmail.com> on 2016/03/24 20:01:35 UTC, 2 replies.
- Extending Spark REST API - posted by Sebastian Kochman <se...@outlook.com> on 2016/03/24 21:09:34 UTC, 1 replies.
- Converting String to Datetime using map - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/24 22:29:27 UTC, 2 replies.
- nullable in spark-sql - posted by Koert Kuipers <ko...@tresata.com> on 2016/03/25 01:13:36 UTC, 0 replies.
- python support of mapWithState - posted by Cyril Scetbon <cy...@free.fr> on 2016/03/25 01:41:40 UTC, 2 replies.
- Testing spark with AWS spot instances - posted by Dillian Murphey <cr...@gmail.com> on 2016/03/25 06:15:27 UTC, 2 replies.
- Does SparkSql has official jdbc/odbc driver? - posted by sage <lk...@gmail.com> on 2016/03/25 07:33:59 UTC, 12 replies.
- DataFrameWriter.save fails job with one executor failure - posted by Vinoth Chandar <vi...@uber.com> on 2016/03/25 12:03:44 UTC, 3 replies.
- This simple UDF is not working! - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/25 15:36:42 UTC, 7 replies.
- SparkSQL and multiple roots in 1.6 - posted by suresk <su...@gmail.com> on 2016/03/25 18:15:38 UTC, 5 replies.
- is there any way to submit spark application from outside of spark cluster - posted by prateek arora <pr...@gmail.com> on 2016/03/25 18:39:05 UTC, 6 replies.
- [SQL] Two columns in output vs one when joining DataFrames? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/03/25 21:19:00 UTC, 2 replies.
- Finding out the time a table was created - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/25 23:12:41 UTC, 9 replies.
- Hive table created by Spark seems to end up in default - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/25 23:48:56 UTC, 1 replies.
- Someone explain the /mnt and /mnt2 folders on spark-ec2 slaves - posted by Dillian Murphey <cr...@gmail.com> on 2016/03/26 00:27:16 UTC, 0 replies.
- Is this expected in Spark 1.6.1, derby.log file created when spark shell starts - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/26 12:09:27 UTC, 1 replies.
- Fwd: Any plans to migrate Transformer API to Spark SQL (closer to DataFrames)? - posted by Michał Zieliński <zi...@gmail.com> on 2016/03/26 14:12:37 UTC, 1 replies.
- whether a certain piece can be assigned to a specicified node by some codes in my program. - posted by chenyong <cy...@hotmail.com> on 2016/03/26 15:41:49 UTC, 3 replies.
- A problem involving Spark & HBase. - posted by ManasjyotiSharma <ma...@hotmail.com> on 2016/03/26 20:17:07 UTC, 0 replies.
- Hive on Spark engine - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/26 22:47:20 UTC, 4 replies.
- Databricks fails to read the csv file with blank line at the file header - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/27 03:25:06 UTC, 7 replies.
- Re: SparkSQL exception on spark.sql.codegen - posted by song ma <ma...@163.com> on 2016/03/27 14:54:37 UTC, 0 replies.
- Sessionization with DF Window functions - posted by Giorgi Jvaridze <gi...@gmail.com> on 2016/03/27 15:19:56 UTC, 0 replies.
- Non-classification neural networks - posted by Jim Carroll <ji...@gmail.com> on 2016/03/27 15:24:59 UTC, 1 replies.
- IntelliJ idea not work well with spark - posted by 吴文超 <wu...@miaozhen.com> on 2016/03/27 16:20:34 UTC, 3 replies.
- Custom RDD in spark, cannot find custom method - posted by Tenghuan He <te...@gmail.com> on 2016/03/27 18:22:41 UTC, 11 replies.
- This works to filter transactions older than certain months - posted by Mich Talebzadeh <mi...@gmail.com> on 2016/03/28 00:50:37 UTC, 3 replies.
- Fwd: NoSuchElementException in ChiSqSelector fit method (version 1.6.0) - posted by Joshua Cason <jo...@gmail.com> on 2016/03/28 03:50:40 UTC, 1 replies.
- --packages configuration equivalent item name? - posted by Russell Jurney <ru...@gmail.com> on 2016/03/28 04:22:28 UTC, 1 replies.
- StateSpec raises error "missing arguments for method" - posted by Cyril Scetbon <cy...@free.fr> on 2016/03/28 05:57:33 UTC, 1 replies.
- Twitter receiver not running in spark 1.6.0 - posted by lokeshkumar <lo...@dataken.net> on 2016/03/28 07:01:28 UTC, 1 replies.
- since spark can not parallelize/serialize functions, how to distribute algorithms on the same data? - posted by charles li <ch...@gmail.com> on 2016/03/28 09:50:41 UTC, 3 replies.
- StackOverflow in updateStateByKey - posted by Vikash Pareek <vi...@infoobjects.com> on 2016/03/28 11:25:18 UTC, 0 replies.
- Unable to Limit UI to localhost interface - posted by David O'Gwynn <do...@acm.org> on 2016/03/28 16:32:42 UTC, 5 replies.
- Aggregate subsequenty x row values together. - posted by sujeet jog <su...@gmail.com> on 2016/03/28 18:21:21 UTC, 3 replies.
- Re: org.apache.hadoop.util.NativeCrc32.nativeComputeChunkedSumsByteArray error in nelwy build Hbase - posted by Ted Yu <yu...@gmail.com> on 2016/03/28 20:04:45 UTC, 0 replies.
- DataFrame --> JSON objects, instead of un-named array of fields - posted by Russell Jurney <ru...@gmail.com> on 2016/03/28 21:54:46 UTC, 2 replies.
- println not appearing in libraries when running job using spark-submit --master local - posted by kpeng1 <kp...@gmail.com> on 2016/03/28 22:39:50 UTC, 2 replies.
- Dynamically adding/removing slaves throuh start-slave.sh and stop-slave.sh - posted by Sung Hwan Chung <co...@cs.stanford.edu> on 2016/03/28 23:06:29 UTC, 7 replies.
- [Spark SQL] Unexpected Behaviour - posted by Jerry Lam <ch...@gmail.com> on 2016/03/28 23:34:21 UTC, 7 replies.
- Strange ML pipeline errors from HashingTF using v1.6.1 - posted by Timothy Potter <th...@gmail.com> on 2016/03/29 01:11:34 UTC, 3 replies.
- looking for an easy to to find the max value of a column in a data frame - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/29 02:15:49 UTC, 5 replies.
- PySpark saving to MongoDB: expected zero arguments for construction of ClassDict (for pyspark.sql.types._create_row) - posted by Russell Jurney <ru...@gmail.com> on 2016/03/29 03:20:15 UTC, 7 replies.
- pyspark unable to convert dataframe column to a vector: Unable to instantiate org.apache.hadoop.hive.ql.metadata.SessionHiveMetaStoreClient - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/29 03:29:37 UTC, 1 replies.
- Unsubscribe - posted by Andrew Heinrichs <an...@gmail.com> on 2016/03/29 03:36:41 UTC, 0 replies.
- Master options Cluster/Client descrepencies. - posted by satyajit vegesna <sa...@gmail.com> on 2016/03/29 04:19:45 UTC, 2 replies.
- run spark job - posted by Fei Hu <hu...@gmail.com> on 2016/03/29 06:26:22 UTC, 4 replies.
- Does SparkSql thrift server support insert/update/delete sql statement - posted by sage <lk...@gmail.com> on 2016/03/29 07:30:58 UTC, 1 replies.
- overriding spark.streaming.blockQueueSize default value - posted by Spark Newbie <sp...@gmail.com> on 2016/03/29 07:40:01 UTC, 1 replies.
- Change TimeZone Setting in Spark 1.5.2 - posted by Divya Gehlot <di...@gmail.com> on 2016/03/29 08:35:15 UTC, 1 replies.
- StreamCorruptedException during deserialization - posted by Robert Schmidtke <ro...@gmail.com> on 2016/03/29 11:25:37 UTC, 2 replies.
- SparkML RandomForest java.lang.StackOverflowError - posted by Eugene Morozov <ev...@gmail.com> on 2016/03/29 12:12:36 UTC, 5 replies.
- Continuously INFO JobScheduler:59 - Added jobs for time *** ms, in my Spark Standalone Cluster. - posted by Charan Adabala <ch...@gmail.com> on 2016/03/29 12:31:11 UTC, 0 replies.
- Do not wrap result of a UDAF in an Struct - posted by Matthias Niehoff <ma...@codecentric.de> on 2016/03/29 12:32:35 UTC, 1 replies.
- Sending events to Kafka from spark job - posted by fanooos <de...@gmail.com> on 2016/03/29 12:37:47 UTC, 3 replies.
- hadoop.ParquetOutputCommitter: could not write summary file - posted by 李铖 <li...@gmail.com> on 2016/03/29 12:38:27 UTC, 0 replies.
- How to reduce the Executor Computing Time. - posted by Charan Adabala <ch...@gmail.com> on 2016/03/29 12:42:08 UTC, 1 replies.
- Spark streaming spilling all the data to disk even if memory available - posted by Mayur Mohite <ma...@applift.com> on 2016/03/29 14:40:57 UTC, 3 replies.
- Unable to execute query on SAPHANA using SPARK - posted by reena upadhyay <re...@impetus.co.in> on 2016/03/29 16:54:59 UTC, 4 replies.
- Re: Stream are not serializable - posted by hokam chauhan <ho...@gmail.com> on 2016/03/29 17:59:28 UTC, 0 replies.
- Vectors.sparse exception: TypeError: indices array must be sorted - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/29 20:42:01 UTC, 0 replies.
- Running Spark on Yarn - posted by Vineet Mishra <cl...@gmail.com> on 2016/03/29 22:15:06 UTC, 10 replies.
- Using spark.memory.useLegacyMode true does not yield expected behavior - posted by Tom Hubregtsen <th...@gmail.com> on 2016/03/29 22:16:35 UTC, 0 replies.
- Spark and N-tier architecture - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/29 23:07:04 UTC, 11 replies.
- data frame problem preserving sort order with repartition() and coalesce() - posted by Andy Davidson <An...@SantaCruzIntegration.com> on 2016/03/29 23:49:48 UTC, 0 replies.
- aggregateByKey on PairRDD - posted by Suniti Singh <su...@gmail.com> on 2016/03/30 02:36:20 UTC, 3 replies.
- Null pointer exception when using com.databricks.spark.csv - posted by Selvam Raman <se...@gmail.com> on 2016/03/30 05:44:44 UTC, 4 replies.
- Re: data frame problem preserving sort order with repartition() and coalesce() - posted by Takeshi Yamamuro <li...@gmail.com> on 2016/03/30 08:45:11 UTC, 0 replies.
- Checkpoints in Spark - posted by Guillermo Ortiz <ko...@gmail.com> on 2016/03/30 12:49:20 UTC, 0 replies.
- Trouble facing with Timestamp column in SparkR when loading CSV file from S3 - posted by ps30 <pr...@gmail.com> on 2016/03/30 14:09:00 UTC, 0 replies.
- spark 1.5.2 - value filterByRange is not a member of org.apache.spark.rdd.RDD[(myKey, myData)] - posted by Nirav Patel <np...@xactlycorp.com> on 2016/03/30 14:20:20 UTC, 1 replies.
- Unable to set cores while submitting Spark job - posted by vetal king <gr...@gmail.com> on 2016/03/30 14:46:16 UTC, 2 replies.
- Configuring log4j Spark - posted by Guillermo Ortiz <ko...@gmail.com> on 2016/03/30 15:42:22 UTC, 1 replies.
- Loading multiple packages while starting spark-shell - posted by Mustafa Elbehery <el...@gmail.com> on 2016/03/30 16:15:14 UTC, 2 replies.
- Does Spark CSV accept a CSV String - posted by Benjamin Kim <bb...@gmail.com> on 2016/03/30 16:17:27 UTC, 5 replies.
- pyspark read json file with high dimensional sparse data - posted by Yavuz Nuzumlalı <ma...@gmail.com> on 2016/03/30 17:17:13 UTC, 1 replies.
- Spark 1.5.2 Master OOM - posted by Yong Zhang <ja...@hotmail.com> on 2016/03/30 17:46:20 UTC, 0 replies.
- How to design the input source of spark stream - posted by "kramer2009@126.com" <kr...@126.com> on 2016/03/31 05:08:05 UTC, 3 replies.
- SparkSQL Dataframe : partitionColumn, lowerBound, upperBound, numPartitions in context of reading from MySQL - posted by Soumya Simanta <so...@gmail.com> on 2016/03/31 06:31:26 UTC, 0 replies.
- sqlContext.cacheTable + yarn client mode - posted by Soam Acharya <so...@altiscale.com> on 2016/03/31 07:24:08 UTC, 1 replies.
- Adding Recurrent Neural Network to Spark pipeline. - posted by Thamali Wijewardhana <th...@wso2.com> on 2016/03/31 07:52:52 UTC, 0 replies.
- Unable to Run Spark Streaming Job in Hadoop YARN mode - posted by Soni spark <so...@gmail.com> on 2016/03/31 07:57:14 UTC, 1 replies.
- Exposing dataframe via thrift server - posted by ram kumar <ra...@gmail.com> on 2016/03/31 07:59:05 UTC, 1 replies.
- Restart App and consume from checkpoint using direct kafka API - posted by vimal dinakaran <vi...@gmail.com> on 2016/03/31 09:14:45 UTC, 2 replies.
- confusing about Spark SQL json format - posted by charles li <ch...@gmail.com> on 2016/03/31 10:23:18 UTC, 9 replies.
- Spark for Log Analytics - posted by ashish rawat <dc...@gmail.com> on 2016/03/31 10:37:04 UTC, 4 replies.
- SPARK-13900 - Join with simple OR conditions take too long - posted by ashokkumar rajendran <as...@gmail.com> on 2016/03/31 10:58:13 UTC, 2 replies.
- Read Parquet in Java Spark - posted by Ramkumar V <ra...@gmail.com> on 2016/03/31 11:21:16 UTC, 2 replies.
- Execution error during ALS execution in spark - posted by Pankaj Rawat <pa...@nagarro.com> on 2016/03/31 13:26:53 UTC, 1 replies.
- Select per Dataset attribute (Scala) not possible? Why no Seq().as[type] for Datasets? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/03/31 14:02:44 UTC, 2 replies.
- transformation - spark vs cassandra - posted by asethia <se...@gmail.com> on 2016/03/31 17:19:53 UTC, 3 replies.
- Re: Concurrent Spark jobs - posted by emlyn <em...@swiftkey.com> on 2016/03/31 17:56:37 UTC, 0 replies.
- Problem with jackson lib running on spark - posted by Marcelo Oikawa <ma...@webradar.com> on 2016/03/31 18:50:00 UTC, 8 replies.
- Spark master keeps running out of RAM - posted by Dillian Murphey <cr...@gmail.com> on 2016/03/31 20:16:14 UTC, 1 replies.
- Re: Calling spark from a java web application. - posted by Ricardo Paiva <ri...@corp.globo.com> on 2016/03/31 20:30:43 UTC, 0 replies.
- Disk Full on one Worker is leading to Job Stuck and Executor Unresponsive - posted by Abhishek Anand <ab...@gmail.com> on 2016/03/31 20:32:15 UTC, 1 replies.
- [SQL] A bug with withColumn? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/03/31 21:08:19 UTC, 2 replies.
- OutOfMemory with wide (289 column) dataframe - posted by ludflu <lu...@gmail.com> on 2016/03/31 22:21:16 UTC, 0 replies.
- Spark process creating and writing to a Hive ORC table - posted by Ashok Kumar <as...@yahoo.com.INVALID> on 2016/03/31 23:00:02 UTC, 0 replies.