You are viewing a plain text version of this content. The canonical link for it is here.
- Error when loading json to spark - posted by Raymond Xie <xi...@gmail.com> on 2017/01/01 03:58:35 UTC, 5 replies.
- RE: [PySpark - 1.6] - Avoid object serialization - posted by Sidney Feiner <si...@startapp.com> on 2017/01/01 13:47:33 UTC, 0 replies.
- What is missing here to use sql in spark? - posted by Raymond Xie <xi...@gmail.com> on 2017/01/02 04:22:49 UTC, 2 replies.
- 24/7 Spark Streaming on YARN in Production - posted by Bernhard Schäfer <bs...@inovex.de> on 2017/01/02 07:29:33 UTC, 0 replies.
- Re: Difference in R and Spark Output - posted by Saroj C <sa...@tcs.com> on 2017/01/02 07:34:30 UTC, 3 replies.
- RE: Broadcast destroy - posted by br...@gmail.com on 2017/01/02 15:26:01 UTC, 1 replies.
- Spark Converting dataframe to Rdd reduces partitions - posted by manish jaiswal <ma...@gmail.com> on 2017/01/02 15:55:56 UTC, 0 replies.
- Re: Issue with SparkR setup on RStudio - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/02 15:58:35 UTC, 2 replies.
- Re: What's the best practice to load data from RDMS to Spark - posted by Jacek Laskowski <ja...@japila.pl> on 2017/01/02 16:20:51 UTC, 0 replies.
- Re: Spark Streaming prediction - posted by Marco Mistroni <mm...@gmail.com> on 2017/01/02 20:07:07 UTC, 2 replies.
- [Spark Kafka] How to update batch size of input dynamically for spark kafka consumer? - posted by 周家帅 <zj...@gmail.com> on 2017/01/03 10:00:40 UTC, 1 replies.
- Re: [Spark Structured Streaming]: Is it possible to ingest data from a jdbc data source incrementally? - posted by Yuanzhe Yang <yy...@gmail.com> on 2017/01/03 11:03:30 UTC, 12 replies.
- Re: Question about Spark and filesystems - posted by Steve Loughran <st...@hortonworks.com> on 2017/01/03 11:45:14 UTC, 0 replies.
- Re: How to load a big csv to dataframe in Spark 1.6 - posted by Steve Loughran <st...@hortonworks.com> on 2017/01/03 11:50:32 UTC, 0 replies.
- can UDF accept "Any"/"AnyVal"/"AnyRef"(java Object) as parameter or as return type ? - posted by Linyuxin <li...@huawei.com> on 2017/01/03 12:46:19 UTC, 1 replies.
- top-k function for Window - posted by Andy Dang <na...@gmail.com> on 2017/01/03 13:06:46 UTC, 9 replies.
- Re: Broadcast Join and Inner Join giving different result on same DataFrame - posted by Patrick <ti...@gmail.com> on 2017/01/03 14:04:41 UTC, 1 replies.
- RBackendHandler Error while running ML algorithms with SparkR on RStudio - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/03 15:14:00 UTC, 0 replies.
- Storage history in web UI - posted by Joseph Naegele <jn...@grierforensics.com> on 2017/01/03 15:14:05 UTC, 2 replies.
- Mysql table upsate in spark - posted by Santlal J Gupta <Sa...@bitwiseglobal.com> on 2017/01/03 15:43:12 UTC, 0 replies.
- Re: Apache Hive with Spark Configuration - posted by Ryan Blue <rb...@netflix.com.INVALID> on 2017/01/03 20:32:37 UTC, 1 replies.
- Spark test error - posted by Yanwei Wayne Zhang <ac...@hotmail.com> on 2017/01/03 22:36:08 UTC, 0 replies.
- Dynamic scheduling not respecting spark.executor.cores - posted by Nirav Patel <np...@xactlycorp.com> on 2017/01/03 22:51:32 UTC, 0 replies.
- Re: OS killing Executor due to high (possibly off heap) memory usage - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/04 00:25:01 UTC, 0 replies.
- Migrate spark sql to rdd for better performance - posted by geoHeil <ge...@gmail.com> on 2017/01/04 05:55:56 UTC, 0 replies.
- SparkAppHandle returns unknown state forever - posted by "Mevada, Vatsal" <Me...@sky.optymyze.com> on 2017/01/04 07:49:01 UTC, 0 replies.
- Re: [External] Re: [Spark Structured Streaming]: Is it possible to ingest data from a jdbc data source incrementally? - posted by Ben Teeuwen <be...@booking.com> on 2017/01/04 08:44:55 UTC, 0 replies.
- Re: Error: PartitioningCollection requires all of its partitionings have the same numPartitions. - posted by mhornbech <mo...@datasolvr.com> on 2017/01/04 10:50:11 UTC, 0 replies.
- Re: Dependency Injection and Microservice development with Spark - posted by Chetan Khatri <ch...@gmail.com> on 2017/01/04 11:34:48 UTC, 2 replies.
- Re: Approach: Incremental data load from HBASE - posted by Chetan Khatri <ch...@gmail.com> on 2017/01/04 11:37:45 UTC, 4 replies.
- Initial job has not accepted any resources - posted by Igor Berman <ig...@gmail.com> on 2017/01/04 14:58:12 UTC, 0 replies.
- spark sql in Cloudera package - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/01/04 15:17:04 UTC, 1 replies.
- Fwd: (send this email to subscribe) - posted by Anahita Talebi <an...@gmail.com> on 2017/01/04 16:34:27 UTC, 2 replies.
- Spark 2.x OFF_HEAP persistence - posted by Vin J <wi...@gmail.com> on 2017/01/04 18:50:13 UTC, 3 replies.
- Slow metastore list tables in Spark 2.x - posted by Everett Anderson <ev...@nuna.com.INVALID> on 2017/01/04 19:26:11 UTC, 1 replies.
- Converting an InternalRow to a Row - posted by Andy Dang <na...@gmail.com> on 2017/01/04 19:27:15 UTC, 0 replies.
- Re: Dynamic Allocation not respecting spark.executor.cores - posted by Nirav Patel <np...@xactlycorp.com> on 2017/01/04 19:58:55 UTC, 0 replies.
- [Spark GraphX] Graph Aggregation - posted by Will Swank <wi...@gmail.com> on 2017/01/04 21:28:56 UTC, 0 replies.
- IBM Fluid query versus Spark - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/01/04 21:57:13 UTC, 0 replies.
- Spark Aggregator for array of doubles - posted by Anil Langote <an...@gmail.com> on 2017/01/04 22:23:15 UTC, 0 replies.
- Re: Spark Aggregator for array of doubles - posted by Anton Okolnychyi <an...@gmail.com> on 2017/01/04 22:34:14 UTC, 0 replies.
- RE: Best way to process lookup ETL with Dataframes - posted by "Sesterhenn, Mike" <ms...@cars.com> on 2017/01/04 23:29:48 UTC, 0 replies.
- L1 regularized Logistic regression ? - posted by Yang <te...@gmail.com> on 2017/01/05 00:13:15 UTC, 2 replies.
- Spark GraphFrame ConnectedComponents - posted by Ankur Srivastava <an...@gmail.com> on 2017/01/05 00:40:02 UTC, 12 replies.
- query on Spark Log directory - posted by Divya Gehlot <di...@gmail.com> on 2017/01/05 08:01:42 UTC, 0 replies.
- Re: Spark Python in Jupyter Notebook - posted by neil90 <ne...@icloud.com> on 2017/01/05 08:05:39 UTC, 2 replies.
- Re: Setting Spark Properties on Dataframes - posted by neil90 <ne...@icloud.com> on 2017/01/05 08:07:05 UTC, 1 replies.
- Spark java with Google Store - posted by Manohar753 <ma...@happiestminds.com> on 2017/01/05 08:23:30 UTC, 0 replies.
- Re: [TorrentBroadcast] Pyspark Application terminated saying "Failed to get broadcast_1_ piece0 of broadcast_1 in Spark 2.0.0" - posted by Palash Gupta <sp...@yahoo.com.INVALID> on 2017/01/05 09:00:04 UTC, 4 replies.
- Spark Read from Google store and save in AWS s3 - posted by Manohar753 <ma...@happiestminds.com> on 2017/01/05 09:58:50 UTC, 5 replies.
- ToLocalIterator vs collect - posted by Rohit Verma <ro...@rokittech.com> on 2017/01/05 10:39:39 UTC, 1 replies.
- unsubscribe - posted by Nikola Z <gr...@gmail.com> on 2017/01/05 10:57:12 UTC, 3 replies.
- [Spark 2.1.0] Resource Scheduling Challenge in pyspark sparkSession - posted by Palash Gupta <sp...@yahoo.com.INVALID> on 2017/01/05 13:35:32 UTC, 0 replies.
- Re: Help in generating unique Id in spark row - posted by Olivier Girardot <o....@lateral-thoughts.com> on 2017/01/05 19:53:35 UTC, 0 replies.
- Re: Spark SQL - Applying transformation on a struct inside an array - posted by Olivier Girardot <o....@lateral-thoughts.com> on 2017/01/05 20:01:45 UTC, 0 replies.
- Writing Parquet from Avro objects - cannot write null value for numeric fields - posted by Sunita Arvind <su...@gmail.com> on 2017/01/05 20:47:36 UTC, 0 replies.
- newAPIHadoopFile bad performance - posted by Mudasar <mu...@gmail.com> on 2017/01/06 04:17:10 UTC, 0 replies.
- How do I read data in dockerized kafka from a spark streaming application - posted by shyla deshpande <de...@gmail.com> on 2017/01/06 08:13:08 UTC, 0 replies.
- CompileException with Maps in Spark 2.1.0 - posted by Nils Grabbert <ni...@numberfour.eu> on 2017/01/06 08:28:11 UTC, 1 replies.
- Kafka 0.8 + Spark 2.0 Partition Issue - posted by Raghu Vadapalli <ra...@aol.com> on 2017/01/06 13:33:05 UTC, 0 replies.
- Re: Kafka 0.8 + Spark 2.0 Partition Issue - posted by Cody Koeninger <co...@koeninger.org> on 2017/01/06 16:36:44 UTC, 0 replies.
- Spark SQL 1.6.3 ORDER BY and partitions - posted by Joseph Naegele <jn...@grierforensics.com> on 2017/01/06 18:14:29 UTC, 1 replies.
- How to use an anonymous function with DataFrame.explode() ? - posted by dpapathanasiou <de...@gmail.com> on 2017/01/07 18:39:54 UTC, 0 replies.
- Spark 2.0.2, KyroSerializer, double[] is not registered. - posted by "颜发才 (Yan Facai)" <ya...@gmail.com> on 2017/01/08 05:21:51 UTC, 4 replies.
- Unable to explain the job kicked off for spark.read.csv - posted by Appu K <ku...@gmail.com> on 2017/01/08 15:11:43 UTC, 3 replies.
- Spark UI - Puzzling “Input Size / Records” in Stage Details - posted by Appu K <ku...@gmail.com> on 2017/01/08 17:52:33 UTC, 0 replies.
- [META] What to do about "This post has NOT been accepted by the mailing list yet." ? - posted by dpapathanasiou <de...@gmail.com> on 2017/01/08 19:44:18 UTC, 0 replies.
- Docker image for Spark streaming app - posted by shyla deshpande <de...@gmail.com> on 2017/01/08 20:51:16 UTC, 1 replies.
- Efficient look up in Key Pair RDD - posted by Anil Langote <an...@gmail.com> on 2017/01/09 01:03:54 UTC, 5 replies.
- subsription - posted by Raymond Xie <xi...@gmail.com> on 2017/01/09 03:16:20 UTC, 0 replies.
- How to connect Tableau to databricks spark? - posted by Raymond Xie <xi...@gmail.com> on 2017/01/09 03:30:22 UTC, 5 replies.
- Re: A note about MLlib's StandardScaler - posted by Holden Karau <ho...@pigscanfly.ca> on 2017/01/09 03:30:43 UTC, 0 replies.
- Re: handling of empty partitions - posted by Holden Karau <ho...@pigscanfly.ca> on 2017/01/09 05:40:25 UTC, 0 replies.
- AVRO Append HDFS using saveAsNewAPIHadoopFile - posted by awkysam <co...@gmail.com> on 2017/01/09 08:58:54 UTC, 2 replies.
- Machine Learning in Spark 1.6 vs Spark 2.0 - posted by Ankur Jain <an...@yash.com> on 2017/01/09 10:19:19 UTC, 3 replies.
- Fwd: Entering the variables in the Argument part in Submit job section to run a spark code on Google Cloud - posted by Anahita Talebi <an...@gmail.com> on 2017/01/09 12:43:39 UTC, 1 replies.
- Tuning spark.executor.cores - posted by Appu K <ku...@gmail.com> on 2017/01/09 13:52:09 UTC, 1 replies.
- How to hint Spark to use HashAggregate() for UDAF - posted by Andy Dang <na...@gmail.com> on 2017/01/09 13:52:42 UTC, 2 replies.
- What is the difference between hive on spark and spark on hive? - posted by 李斌松 <li...@gmail.com> on 2017/01/09 15:05:19 UTC, 1 replies.
- [PySpark] py4j.Py4JException: PythonFunction Does Not Exist - posted by Tegan Snyder <ts...@mmm.com> on 2017/01/09 15:50:52 UTC, 0 replies.
- Spark Master stops abruptly - posted by streamly tester <st...@gmail.com> on 2017/01/09 18:16:05 UTC, 1 replies.
- Spark UI not coming up in EMR - posted by "Saurabh Malviya (samalviy)" <sa...@cisco.com> on 2017/01/09 18:58:36 UTC, 1 replies.
- Could not parse Master URL for Mesos on Spark 2.1.0 - posted by Richard Siebeling <rs...@gmail.com> on 2017/01/09 21:55:14 UTC, 8 replies.
- UNSUBSCRIBE - posted by "Chris Murphy - ChrisSMurphy.com" <Co...@chrissmurphy.com> on 2017/01/10 00:41:00 UTC, 2 replies.
- spark-shell running out of memory even with 6GB ? - posted by Kevin Burton <bu...@spinn3r.com> on 2017/01/10 01:00:51 UTC, 4 replies.
- Re: Problem with Generalized Regression Model - posted by sethah <sh...@us.ibm.com> on 2017/01/10 03:06:53 UTC, 0 replies.
- Spark JDBC Data type mapping (Float and smallInt) Issue - posted by santlal56 <sa...@bitwiseglobal.com> on 2017/01/10 09:07:20 UTC, 0 replies.
- Spark ML's RandomForestClassifier OOM - posted by Julio Antonio Soto <ju...@esbet.es> on 2017/01/10 10:07:00 UTC, 2 replies.
- Kryo On Spark 1.6.0 - posted by Enrico DUrso <en...@everis.com> on 2017/01/10 11:10:42 UTC, 4 replies.
- Which is better algorithm to use - posted by Rohit Verma <ro...@rokittech.com> on 2017/01/10 12:45:00 UTC, 0 replies.
- backward compatibility - posted by pradeepbill <pr...@gmail.com> on 2017/01/10 16:14:30 UTC, 1 replies.
- Shortest path performance in Graphx with Spark - posted by Gerard Casey <ge...@gmail.com> on 2017/01/10 18:20:55 UTC, 1 replies.
- Nested ifs in sparksql - posted by Raghavendra Pandey <ra...@gmail.com> on 2017/01/10 19:04:35 UTC, 4 replies.
- SparkAppHandle.Listener: infoChanged - posted by Benson Qiu <be...@salesforce.com> on 2017/01/10 19:20:55 UTC, 0 replies.
- Dataset Type safety - posted by A Shaikh <sh...@gmail.com> on 2017/01/10 19:34:10 UTC, 1 replies.
- Library dependencies in Spark - posted by Keith Turner <ke...@deenlo.com> on 2017/01/10 20:02:54 UTC, 0 replies.
- Spark in docker over EC2 - posted by Darren Govoni <da...@ontrenet.com> on 2017/01/10 23:49:30 UTC, 1 replies.
- large number representation - posted by Zephod <ze...@tlen.pl> on 2017/01/11 03:15:02 UTC, 0 replies.
- how the sparksession initialization, set currentDatabase value? - posted by 李斌松 <li...@gmail.com> on 2017/01/11 03:46:03 UTC, 1 replies.
- Spark sql query plan contains all the partitions from hive table even though filtering of partitions is provided - posted by Raju Bairishetti <ra...@apache.org> on 2017/01/11 04:14:28 UTC, 4 replies.
- Book recommendations - posted by Esa Heikkinen <es...@student.tut.fi> on 2017/01/11 09:05:03 UTC, 0 replies.
- RE: Kryo On Spark 1.6.0 [Solution in this email] - posted by Enrico DUrso <en...@everis.com> on 2017/01/11 09:54:38 UTC, 0 replies.
- Kryo and Spark 1.6.0 - Does it require a default empty constructor? - posted by Enrico DUrso <en...@everis.com> on 2017/01/11 09:57:27 UTC, 0 replies.
- Time-Series Analysis with Spark - posted by Rishabh Bhardwaj <rb...@gmail.com> on 2017/01/11 10:11:07 UTC, 4 replies.
- Handling null in dataset - posted by A Shaikh <sh...@gmail.com> on 2017/01/11 17:11:34 UTC, 1 replies.
- Unable to build spark documentation - posted by Krishna Kalyan <kr...@gmail.com> on 2017/01/11 18:22:02 UTC, 1 replies.
- structured streaming polling timeouts - posted by Timothy Chan <tc...@lumoslabs.com> on 2017/01/11 19:05:16 UTC, 3 replies.
- Give a task more resources - posted by Pat Ferrel <pa...@occamsmachete.com> on 2017/01/11 22:08:24 UTC, 0 replies.
- Handling Input Error in wholeTextFiles - posted by khwunchai jaengsawang <kh...@ku.th> on 2017/01/12 03:51:37 UTC, 0 replies.
- how to change datatype by useing StructType - posted by lk_spark <lk...@163.com> on 2017/01/12 06:24:11 UTC, 6 replies.
- [Spark Core] Re-using dataframes with limit() produces unexpected results - posted by Ant <th...@googlemail.com> on 2017/01/12 07:18:42 UTC, 2 replies.
- Re: Add row IDs column to data frame - posted by akbar501 <ak...@gmail.com> on 2017/01/12 07:55:21 UTC, 2 replies.
- [Spark Streaming] - Spark Streaming Optimization - posted by Sidney Feiner <si...@startapp.com> on 2017/01/12 08:02:38 UTC, 6 replies.
- How to save spark-ML model in Java? - posted by Minudika Malshan <mi...@gmail.com> on 2017/01/12 09:09:47 UTC, 4 replies.
- How to save a pipeline model in spark-ML(JAVA) ? - posted by Minudika Malshan <mi...@gmail.com> on 2017/01/12 09:13:37 UTC, 0 replies.
- Spark and Kafka integration - posted by "Phadnis, Varun" <ph...@sky.optymyze.com> on 2017/01/12 13:57:46 UTC, 3 replies.
- Spark with oozie #Not implemented by the TFS FileSystem# issue - posted by Rohit Mishra <ro...@mindagroup.com> on 2017/01/12 14:13:10 UTC, 0 replies.
- failed to launch org.apache.spark.deploy.master.Master - posted by "Soheila S." <so...@gmail.com> on 2017/01/12 14:37:28 UTC, 0 replies.
- Support of Theta Join - posted by Mahender Sarangam <Ma...@outlook.com> on 2017/01/12 15:19:51 UTC, 0 replies.
- [Spark Streaming] NoClassDefFoundError : StateSpec - posted by Ramkumar Venkataraman <ra...@gmail.com> on 2017/01/12 15:35:10 UTC, 1 replies.
- mysql and Spark jdbc - posted by Jorge Machado <jo...@me.com> on 2017/01/12 15:49:10 UTC, 2 replies.
- Running a spark code using submit job in google cloud platform - posted by Anahita Talebi <an...@gmail.com> on 2017/01/12 15:51:13 UTC, 4 replies.
- spark locality - posted by vincent gromakowski <vi...@gmail.com> on 2017/01/12 15:55:37 UTC, 6 replies.
- spark rdd map error: too many arguments for unapply pattern, maximum = 22 - posted by Anton Kravchenko <kr...@gmail.com> on 2017/01/12 17:24:34 UTC, 0 replies.
- H2O DataFrame to Spark RDD/DataFrame - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/12 18:17:26 UTC, 1 replies.
- Can't load a RandomForestClassificationModel in Spark job - posted by Sumona Routh <su...@gmail.com> on 2017/01/12 18:39:18 UTC, 2 replies.
- Is RAND() in SparkSQL deterministic when used on MySql data sources? - posted by Gabriele Del Prete <gd...@triplelift.com> on 2017/01/12 21:37:50 UTC, 0 replies.
- problem detecting FAILED state with SparkLauncher and SparkAppHandle - posted by adam kramer <ad...@gmail.com> on 2017/01/13 01:00:19 UTC, 0 replies.
- Any suggestions for dbScan - posted by shobhit gupta <sm...@gmail.com> on 2017/01/13 01:06:13 UTC, 0 replies.
- Data frame writing - posted by Rajendra Bhat <ra...@gmail.com> on 2017/01/13 06:02:11 UTC, 2 replies.
- Re: Sporadic ClassNotFoundException with Kryo - posted by Nirmal Fernando <ni...@wso2.com> on 2017/01/13 06:20:57 UTC, 0 replies.
- Spark SQL DataFrame to Kafka Topic - posted by Senthil Kumar <se...@gmail.com> on 2017/01/13 11:32:09 UTC, 5 replies.
- [Spark SQL - Scala] TestHive not working in Spark 2 - posted by Nicolas Tallineau <ni...@ubisoft.com> on 2017/01/13 14:40:37 UTC, 4 replies.
- Re: Schema evolution in tables - posted by sim <si...@swoop.com> on 2017/01/13 15:56:53 UTC, 0 replies.
- filter rows based on all columns - posted by Xiaomeng Wan <sh...@gmail.com> on 2017/01/13 22:06:54 UTC, 0 replies.
- Debugging a PythonException with no details - posted by Nicholas Chammas <ni...@gmail.com> on 2017/01/14 01:40:18 UTC, 2 replies.
- Spark streaming app that processes Kafka DStreams produces no output and no error - posted by shyla deshpande <de...@gmail.com> on 2017/01/14 06:46:46 UTC, 4 replies.
- java.io.NotSerializableException: org.apache.spark.SparkConf - posted by streamly tester <st...@gmail.com> on 2017/01/14 20:19:43 UTC, 0 replies.
- Equally split a RDD partition into two partition at the same node - posted by Fei Hu <hu...@gmail.com> on 2017/01/14 23:58:54 UTC, 10 replies.
- What can mesos or yarn do that spark standalone cannot do? - posted by kant kodali <ka...@gmail.com> on 2017/01/15 13:54:58 UTC, 1 replies.
- Running Spark on EMR - posted by Marco Mistroni <mm...@gmail.com> on 2017/01/15 14:34:28 UTC, 6 replies.
- TDD in Spark - posted by A Shaikh <sh...@gmail.com> on 2017/01/15 18:14:50 UTC, 4 replies.
- Old version of Spark [v1.2.0] - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/15 21:16:59 UTC, 6 replies.
- Spark Log information - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/01/16 03:41:19 UTC, 2 replies.
- log4j2 support in Spark - posted by Appu K <ku...@gmail.com> on 2017/01/16 05:25:39 UTC, 0 replies.
- filter push down on har file - posted by Yang Cao <cy...@gmail.com> on 2017/01/16 09:08:30 UTC, 0 replies.
- [Spark DataFrames/Streaming]: Bad performance with window function in streaming job - posted by Julian Keppel <ju...@gmail.com> on 2017/01/16 09:21:41 UTC, 0 replies.
- Re: ML PIC - posted by Nick Pentreath <ni...@gmail.com> on 2017/01/16 11:07:16 UTC, 0 replies.
- Flume and Spark Streaming - posted by Guillermo Ortiz <ko...@gmail.com> on 2017/01/16 11:44:03 UTC, 2 replies.
- Importing a github project on sbt - posted by marcos rebelo <ol...@gmail.com> on 2017/01/16 13:59:21 UTC, 1 replies.
- groupByKey vs mapPartitions for efficient grouping within a Partition - posted by Patrick <ti...@gmail.com> on 2017/01/16 14:21:39 UTC, 1 replies.
- About saving DataFrame to Hive 1.2.1 with Spark 2.0.1 - posted by Chetan Khatri <ch...@gmail.com> on 2017/01/16 19:18:23 UTC, 1 replies.
- Spark 2.0 vs MongoDb /Cannot find dependency using sbt - posted by Marco Mistroni <mm...@gmail.com> on 2017/01/16 21:32:20 UTC, 1 replies.
- filter rows by all columns - posted by Shawn Wan <sh...@gmail.com> on 2017/01/16 22:27:03 UTC, 2 replies.
- mapPartition iterator - posted by AnilKumar B <ak...@gmail.com> on 2017/01/16 22:28:33 UTC, 0 replies.
- Metadata is not propagating with Dataset.map() - posted by tovbinm <to...@gmail.com> on 2017/01/16 23:15:43 UTC, 1 replies.
- Spark vs MongoDB: saving DataFrame to db raises missing database name exception - posted by Marco Mistroni <mm...@gmail.com> on 2017/01/16 23:37:36 UTC, 4 replies.
- partition size inherited from parent: auto coalesce - posted by "Suzen, Mehmet" <ms...@gmail.com> on 2017/01/17 00:50:06 UTC, 2 replies.
- how to use newAPIHadoopFile - posted by lk_spark <lk...@163.com> on 2017/01/17 01:43:13 UTC, 0 replies.
- Apache Spark example split/merge shards - posted by noppanit <no...@gmail.com> on 2017/01/17 02:51:33 UTC, 1 replies.
- ScalaReflectionException (class not found) error for user class in spark 2.1.0 - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/17 04:51:13 UTC, 2 replies.
- Weird experience Hive with Spark Transformations - posted by Chetan Khatri <ch...@gmail.com> on 2017/01/17 05:36:05 UTC, 0 replies.
- GroupBy and Spark Performance issue - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/01/17 05:39:26 UTC, 1 replies.
- need a hive generic udf which also works on spark sql - posted by Sirisha Cheruvu <si...@gmail.com> on 2017/01/17 08:31:15 UTC, 7 replies.
- Spark/Parquet/Statistics question - posted by djiang <dj...@dataxu.com> on 2017/01/17 14:28:56 UTC, 3 replies.
- Quick but probably silly question... - posted by Michael Segel <ms...@hotmail.com> on 2017/01/17 16:21:02 UTC, 0 replies.
- spark main thread quit, but the Jvm of driver don't crash - posted by John Fang <xi...@alibaba-inc.com> on 2017/01/17 16:32:49 UTC, 0 replies.
- Middleware-wrappers for Spark - posted by Rick Moritz <ra...@gmail.com> on 2017/01/17 16:49:29 UTC, 2 replies.
- Re: Quick but probably silly question... - posted by Jörn Franke <jo...@gmail.com> on 2017/01/17 16:57:46 UTC, 0 replies.
- spark main thread quit, but the driver don't crash at standalone cluster - posted by John Fang <xi...@alibaba-inc.com> on 2017/01/17 16:58:14 UTC, 0 replies.
- Struct as parameter - posted by Tomas Carini <to...@gmail.com> on 2017/01/17 17:11:31 UTC, 0 replies.
- Re: How State of mapWithState is distributed on nodes - posted by manasdebashiskar <po...@gmail.com> on 2017/01/17 18:45:59 UTC, 0 replies.
- How to access metrics for Structured Streaming 2.1 - posted by Heji Kim <hs...@gmail.com> on 2017/01/18 01:01:00 UTC, 1 replies.
- how to dynamic partition dataframe - posted by lk_spark <lk...@163.com> on 2017/01/18 02:23:00 UTC, 1 replies.
- Please help me out !!!!Getting error while trying to hive java generic udf in spark - posted by Sirisha Cheruvu <si...@gmail.com> on 2017/01/18 02:52:56 UTC, 0 replies.
- anyone from bangalore wants to work on spark projects along with me - posted by Sirisha Cheruvu <si...@gmail.com> on 2017/01/18 03:02:25 UTC, 3 replies.
- Spark / Elasticsearch Error: Maybe ES was overloaded? How to throttle down Spark as it writes to ES - posted by Russell Jurney <ru...@gmail.com> on 2017/01/18 03:13:15 UTC, 3 replies.
- Spark ANSI SQL Support - posted by Rishabh Bhardwaj <rb...@gmail.com> on 2017/01/18 04:09:15 UTC, 2 replies.
- Assembly for Kafka >= 0.10.0, Spark 2.2.0, Scala 2.11 - posted by Karamba <ph...@web.de> on 2017/01/18 08:21:46 UTC, 1 replies.
- apache-spark doesn't work correktly with russian alphabet - posted by AlexModestov <Al...@gmail.com> on 2017/01/18 12:53:06 UTC, 1 replies.
- Accumulators and Datasets - posted by Hanna Mäki <ha...@comptel.com> on 2017/01/18 14:15:57 UTC, 1 replies.
- Do jobs fail because of other users of a cluster? - posted by David Frese <da...@active-group.de> on 2017/01/18 15:25:12 UTC, 3 replies.
- Spark #cores - posted by Saliya Ekanayake <es...@gmail.com> on 2017/01/18 15:26:07 UTC, 10 replies.
- Triplet vertices differ from vertices - posted by Lyndon Ollar <lb...@gmail.com> on 2017/01/18 15:41:17 UTC, 0 replies.
- ApacheCon CFP closing soon (11 February) - posted by Rich Bowen <rb...@apache.org> on 2017/01/18 16:45:41 UTC, 0 replies.
- Creating UUID using SparksSQL - posted by Ninad Shringarpure <ni...@cloudera.com> on 2017/01/18 19:23:15 UTC, 1 replies.
- what does dapply actually do? - posted by Xiao Liu1 <li...@us.ibm.com> on 2017/01/18 19:30:23 UTC, 1 replies.
- Sorting each partitions and writing to CSVs - posted by Ivan Gozali <iv...@lecida.com> on 2017/01/18 20:14:37 UTC, 1 replies.
- Re: New runtime exception after switch to Spark 2.1.0 - posted by mhornbech <mo...@datasolvr.com> on 2017/01/18 20:51:06 UTC, 3 replies.
- Parsing RDF data with Spark - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/18 21:00:50 UTC, 0 replies.
- SparkStreaming add Max Line of each RDD throwing an exception - posted by Nipun Arora <ni...@gmail.com> on 2017/01/18 21:10:54 UTC, 0 replies.
- Spark Job hangs when one of the nodemanager goes down - posted by KumarP <kp...@marinsoftware.com> on 2017/01/18 21:23:20 UTC, 1 replies.
- Anyone has any experience using spark in the banking industry? - posted by kant kodali <ka...@gmail.com> on 2017/01/18 21:50:26 UTC, 2 replies.
- [SparkStreaming] SparkStreaming not allowing to do parallelize within a transform operation to generate a new RDD - posted by Nipun Arora <ni...@gmail.com> on 2017/01/18 22:25:53 UTC, 2 replies.
- is partitionBy of DataFrameWriter supported in 1.6.x? - posted by Richard Xin <ri...@yahoo.com.INVALID> on 2017/01/19 05:44:06 UTC, 1 replies.
- Writing Spark SQL output in Local and HDFS path - posted by Ravi Prasad <ra...@gmail.com> on 2017/01/19 10:45:25 UTC, 3 replies.
- "Unable to load native-hadoop library for your platform" while running Spark jobs - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/19 10:57:37 UTC, 3 replies.
- Yarn resource management for Spark with IBM Platform Symphony - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/01/19 15:23:03 UTC, 2 replies.
- Spark-submit: where do --files go? - posted by jeff saremi <je...@hotmail.com> on 2017/01/19 17:35:36 UTC, 3 replies.
- freeing up memory occupied by processed Stream Blocks - posted by Andrew Milkowski <am...@gmail.com> on 2017/01/19 18:17:49 UTC, 3 replies.
- spark 2.02 error when writing to s3 - posted by "VND Tremblay, Paul" <Tr...@bcg.com> on 2017/01/19 20:15:37 UTC, 9 replies.
- dataset aggregators with kryo encoder very slow - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/19 21:17:07 UTC, 4 replies.
- Executors - running out of memory - posted by blondowski <da...@dice.com> on 2017/01/19 21:21:01 UTC, 0 replies.
- Re: Executors - running out of memory - posted by Venkata D <dv...@gmail.com> on 2017/01/19 22:02:53 UTC, 1 replies.
- Spark Source Code Configuration - posted by Deepu Raj <de...@outlook.com> on 2017/01/19 22:49:53 UTC, 2 replies.
- Non-linear (curved?) regression line - posted by Ganesh <ma...@ganeshkrishnan.com> on 2017/01/20 02:10:11 UTC, 1 replies.
- Will be in around 12:30pm due to some personal stuff - posted by Manohar753 <ma...@happiestminds.com> on 2017/01/20 05:48:54 UTC, 3 replies.
- How to do dashboard reporting in spark - posted by Gaurav1809 <ga...@gmail.com> on 2017/01/20 07:18:43 UTC, 1 replies.
- physical memory usage keep increasing for spark app on Yarn - posted by Yang Cao <cy...@gmail.com> on 2017/01/20 09:35:43 UTC, 4 replies.
- Saving from Dataset to Bigquery Table - posted by A Shaikh <sh...@gmail.com> on 2017/01/20 10:54:02 UTC, 3 replies.
- help,I want to call spark-submit from java shell - posted by lk_spark <lk...@163.com> on 2017/01/20 11:56:34 UTC, 0 replies.
- Running Hive Beeline .hql file in Spark - posted by Ravi Prasad <ra...@gmail.com> on 2017/01/20 13:36:44 UTC, 1 replies.
- Dataframe caching - posted by "☼ R Nair (रविशंकर नायर)" <ra...@gmail.com> on 2017/01/20 14:27:42 UTC, 2 replies.
- Differing triplet and vertex data - posted by lbollar <lb...@gmail.com> on 2017/01/20 16:10:06 UTC, 1 replies.
- too noisy - posted by Alvin Chen <ac...@gmail.com> on 2017/01/20 17:21:11 UTC, 0 replies.
- FunctionRegistry - posted by "Bowden, Chris" <ch...@hpe.com> on 2017/01/20 18:35:44 UTC, 0 replies.
- Re: - posted by Jacek Laskowski <ja...@japila.pl> on 2017/01/20 19:09:12 UTC, 4 replies.
- is this something to worry about? HADOOP_HOME or hadoop.home.dir are not set - posted by kant kodali <ka...@gmail.com> on 2017/01/20 21:27:09 UTC, 1 replies.
- java.io.InvalidClassException: org.apache.spark.executor.TaskMetrics - posted by kant kodali <ka...@gmail.com> on 2017/01/20 21:30:19 UTC, 2 replies.
- Force mesos to provide GPUs to Spark - posted by Ji Yan <ji...@drive.ai> on 2017/01/21 00:14:55 UTC, 0 replies.
- Kryo (with Spark 1.6.3) class registration slows down processing - posted by N B <nb...@gmail.com> on 2017/01/21 01:15:35 UTC, 0 replies.
- Ingesting data in parallel across workers in Data Frame - posted by Abhishek Gupta <je...@gmail.com> on 2017/01/21 05:03:28 UTC, 1 replies.
- tuning the spark.locality.wait - posted by Cesar <ce...@gmail.com> on 2017/01/21 10:06:07 UTC, 1 replies.
- mvn deploy tries to upload artifacts multiple times - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/21 22:43:43 UTC, 0 replies.
- Why StringIndexer uses double instead of int for indexing? - posted by Shiyuan <gs...@gmail.com> on 2017/01/22 01:32:18 UTC, 1 replies.
- Contradiction about shuffle in the documentation - posted by Mars Xu <xu...@gmail.com> on 2017/01/22 03:20:06 UTC, 1 replies.
- Setting startingOffsets to earliest in structured streaming never catches up - posted by Timothy Chan <tc...@lumoslabs.com> on 2017/01/22 18:22:29 UTC, 3 replies.
- Re: Using mapWithState without a checkpoint - posted by shyla deshpande <de...@gmail.com> on 2017/01/23 08:30:22 UTC, 1 replies.
- How to write Spark DataFrame to salesforce table - posted by Niraj Kumar <nk...@incedoinc.com> on 2017/01/23 14:10:20 UTC, 0 replies.
- Spark Streaming proactive monitoring - posted by Lan Jiang <lj...@gmail.com> on 2017/01/23 18:45:13 UTC, 1 replies.
- Aggregator mutate b1 in place in merge - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/23 19:31:51 UTC, 3 replies.
- why does spark web UI keeps changing its port? - posted by kant kodali <ka...@gmail.com> on 2017/01/23 19:47:58 UTC, 8 replies.
- Spark streaming multiple kafka topic doesn't work at-least-once - posted by hakanilter <ha...@gmail.com> on 2017/01/23 21:14:45 UTC, 7 replies.
- converting timestamp column to a java.util.Date - posted by Marco Mistroni <mm...@gmail.com> on 2017/01/23 23:18:09 UTC, 1 replies.
- what would be the recommended production requirements? - posted by kant kodali <ka...@gmail.com> on 2017/01/24 01:09:15 UTC, 0 replies.
- How to make the state in a streaming application idempotent? - posted by shyla deshpande <de...@gmail.com> on 2017/01/24 01:41:04 UTC, 12 replies.
- hc.sql("hive udf query") not able to convert Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: java.lang.ClassCastException: java.lang.Long cannot be cast to org.apache.hadoop.io.LongWritable - posted by Sirisha Cheruvu <si...@gmail.com> on 2017/01/24 04:24:53 UTC, 1 replies.
- pyspark.ml Pipeline stages are corrupted under multi-threaded access - is this a bug? - posted by Vinayak Joshi5 <vi...@in.ibm.com> on 2017/01/24 09:41:12 UTC, 0 replies.
- Can I use speed up my sparse vector operator with mkl? - posted by haowei tian <lu...@gmail.com> on 2017/01/24 11:07:14 UTC, 0 replies.
- Wierd performance on windows laptop - posted by "Mendelson, Assaf" <As...@rsa.com> on 2017/01/24 11:39:47 UTC, 0 replies.
- help!!!----issue with spark-sql type cast form long to longwritable - posted by Sirisha Cheruvu <si...@gmail.com> on 2017/01/24 11:59:22 UTC, 5 replies.
- Failure handling - posted by Erwan ALLAIN <ea...@gmail.com> on 2017/01/24 13:50:45 UTC, 2 replies.
- printSchema showing incorrect datatype? - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/24 16:28:01 UTC, 3 replies.
- PrefixSpan - posted by Madabhattula Rajesh Kumar <mr...@gmail.com> on 2017/01/24 17:12:04 UTC, 0 replies.
- Node guardian implementation and Spark standalone process - posted by Fernando Avalos <ga...@gmail.com> on 2017/01/24 18:52:54 UTC, 0 replies.
- best practice for paralleling model training - posted by Shiyuan <gs...@gmail.com> on 2017/01/24 21:48:31 UTC, 1 replies.
- How do I dynamically add nodes to spark standalone cluster and be able to discover them? - posted by kant kodali <ka...@gmail.com> on 2017/01/24 22:41:23 UTC, 1 replies.
- json_tuple fails to parse string with emoji - posted by Andrew Ehrlich <an...@aehrlich.com> on 2017/01/25 01:14:57 UTC, 1 replies.
- How many spark masters and do I need to tolerate one failure in one DC and two AZ? - posted by kant kodali <ka...@gmail.com> on 2017/01/25 01:37:12 UTC, 1 replies.
- Cached table details - posted by kumar r <ku...@gmail.com> on 2017/01/25 04:54:33 UTC, 2 replies.
- [ML - Intermediate - Debug] - Loading Customized Transformers in Apache Spark raised a NullPointerException - posted by Saulo Ricci <in...@gmail.com> on 2017/01/25 05:47:15 UTC, 0 replies.
- Recovering from checkpoint question - posted by shyla deshpande <de...@gmail.com> on 2017/01/25 06:33:52 UTC, 0 replies.
- Scala Developers - posted by marcos rebelo <ol...@gmail.com> on 2017/01/25 08:24:23 UTC, 2 replies.
- is it possible to read .mdb file in spark - posted by Selvam Raman <se...@gmail.com> on 2017/01/25 10:47:56 UTC, 1 replies.
- HBaseContext with Spark - posted by Chetan Khatri <ch...@gmail.com> on 2017/01/25 11:32:37 UTC, 7 replies.
- Java heap error during matrix multiplication - posted by Petr Shestov <pe...@gmail.com> on 2017/01/25 12:23:17 UTC, 1 replies.
- Catalyst Expression(s) - Cleanup - posted by "Bowden, Chris" <ch...@hpe.com> on 2017/01/25 18:13:47 UTC, 1 replies.
- Spark Summit East in Boston ‒ 20% off Code - posted by Scott walent <sc...@gmail.com> on 2017/01/25 19:06:04 UTC, 0 replies.
- spark intermediate data fills up the disk - posted by kant kodali <ka...@gmail.com> on 2017/01/25 19:30:24 UTC, 5 replies.
- Decompressing Spark Eventlogs with snappy (*.snappy) - posted by satishl <sa...@gmail.com> on 2017/01/25 19:32:24 UTC, 0 replies.
- [ML - Beginner - How To] - GaussianMixtureModel and GaussianMixtureModel$ - posted by Saulo Ricci <in...@gmail.com> on 2017/01/25 20:20:11 UTC, 0 replies.
- Drop Partition Fails - posted by Subacini Balakrishnan <su...@gmail.com> on 2017/01/25 20:23:47 UTC, 0 replies.
- can we plz open up encoder on dataset - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/25 21:17:43 UTC, 4 replies.
- where is mapWithState executed? - posted by shyla deshpande <de...@gmail.com> on 2017/01/25 22:33:57 UTC, 2 replies.
- SparkML 1.6 GBTRegressor crashes with high maxIter hyper-parameter? - posted by Aris <ar...@gmail.com> on 2017/01/25 23:35:49 UTC, 0 replies.
- Question about DStreamCheckpointData - posted by Nikhil Goyal <no...@gmail.com> on 2017/01/25 23:52:38 UTC, 0 replies.
- Issue returning Map from UDAF - posted by Ankur Srivastava <an...@gmail.com> on 2017/01/26 03:07:39 UTC, 2 replies.
- Dataframe fails to save to MySQL table in spark app, but succeeds in spark shell - posted by Xuan Dzung Doan <do...@yahoo.com.INVALID> on 2017/01/26 03:42:34 UTC, 3 replies.
- do I need to run spark standalone master with supervisord? - posted by kant kodali <ka...@gmail.com> on 2017/01/26 06:48:59 UTC, 0 replies.
- Ingesting Large csv File to relational database - posted by Eric Dain <er...@gmail.com> on 2017/01/26 07:13:50 UTC, 1 replies.
- [PySpark 2.1.0] - SparkContext not properly initialized by SparkConf - posted by Sidney Feiner <si...@startapp.com> on 2017/01/26 07:25:36 UTC, 1 replies.
- DML in Spark ETL - posted by A Shaikh <sh...@gmail.com> on 2017/01/26 11:28:14 UTC, 0 replies.
- How to tune number of tesks - posted by "Soheila S." <so...@gmail.com> on 2017/01/26 16:21:34 UTC, 1 replies.
- How to reduce number of tasks and partitions in Spark job? - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/26 17:13:02 UTC, 1 replies.
- eager? in dataframe's checkpoint - posted by Jean Georges Perrin <jg...@jgp.net> on 2017/01/26 18:36:23 UTC, 3 replies.
- Oracle JDBC - Spark SQL - Key Not Found: Scale - posted by ayan guha <gu...@gmail.com> on 2017/01/26 23:18:54 UTC, 5 replies.
- structured streaming 2.1.0 kafka driver --packages 'org.apache.spark:spark-sql-kafka-0-10_2.11:2.1.0' works on YARN but having trouble on standalone cluster mode - posted by Heji Kim <hs...@gmail.com> on 2017/01/26 23:43:29 UTC, 0 replies.
- Issue creating row with java.util.Map type - posted by Ankur Srivastava <an...@gmail.com> on 2017/01/27 01:12:58 UTC, 3 replies.
- kafka structured streaming source refuses to read - posted by Koert Kuipers <ko...@tresata.com> on 2017/01/27 03:33:25 UTC, 9 replies.
- spark narrow vs wide dependency - posted by Shushant Arora <sh...@gmail.com> on 2017/01/27 04:02:54 UTC, 1 replies.
- spark driver UI points to the wrong ip. dont know why? - posted by kant kodali <ka...@gmail.com> on 2017/01/27 04:08:55 UTC, 0 replies.
- Kinesis streaming misunderstanding..? - posted by Graham Clark <gr...@gmail.com> on 2017/01/27 05:54:41 UTC, 4 replies.
- outdated documentation? SparkSession - posted by Wojciech Indyk <wo...@gmail.com> on 2017/01/27 08:36:56 UTC, 1 replies.
- Text - posted by "Soheila S." <so...@gmail.com> on 2017/01/27 09:44:20 UTC, 4 replies.
- Making withColumn nullable - posted by Ninad Shringarpure <ni...@cloudera.com> on 2017/01/27 15:32:23 UTC, 1 replies.
- Issue with caching - posted by Anil Langote <an...@gmail.com> on 2017/01/27 16:02:51 UTC, 0 replies.
- Dynamic resource allocation to Spark on Mesos - posted by Ji Yan <ji...@drive.ai> on 2017/01/27 17:35:42 UTC, 5 replies.
- Converting timezones in Spark - posted by Don Drake <do...@gmail.com> on 2017/01/27 18:01:03 UTC, 0 replies.
- CFP for Spark Summit San Francisco closes on Feb. 6 - posted by Scott walent <sc...@gmail.com> on 2017/01/28 00:05:40 UTC, 0 replies.
- spark architecture question -- Pleas Read - posted by Sirisha Cheruvu <si...@gmail.com> on 2017/01/28 01:14:15 UTC, 13 replies.
- mapWithState question - posted by shyla deshpande <de...@gmail.com> on 2017/01/28 08:30:12 UTC, 6 replies.
- issue with running Spark streaming with spark-shell - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/01/28 10:20:36 UTC, 2 replies.
- [ANNOUNCE] Apache Bahir 2.0.2 - posted by Christian Kadner <ck...@apache.org> on 2017/01/28 14:44:44 UTC, 0 replies.
- DAG Visualization option is missing on Spark Web UI - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/28 18:02:44 UTC, 4 replies.
- Complex types handling with spark SQL and parquet - posted by Antoine HOM <an...@gmail.com> on 2017/01/28 19:09:23 UTC, 0 replies.
- question on spark streaming based on event time - posted by kant kodali <ka...@gmail.com> on 2017/01/29 03:05:04 UTC, 2 replies.
- Error Saving Dataframe to Hive with Spark 2.0.0 - posted by Chetan Khatri <ch...@gmail.com> on 2017/01/29 08:24:27 UTC, 2 replies.
- Hbase and Spark - posted by Masf <ma...@gmail.com> on 2017/01/29 12:22:22 UTC, 1 replies.
- Examples in graphx - posted by Deepak Sharma <de...@gmail.com> on 2017/01/29 12:28:19 UTC, 2 replies.
- nvitation to speak about GraphX at London Opensource Graph Technologies Meetup - posted by haikal <ha...@grakn.ai> on 2017/01/29 13:53:15 UTC, 0 replies.
- forcing dataframe groupby partitioning - posted by "Mendelson, Assaf" <As...@rsa.com> on 2017/01/29 16:33:03 UTC, 2 replies.
- Streaming jobs getting longer - posted by Saulo Ricci <in...@gmail.com> on 2017/01/30 03:06:26 UTC, 0 replies.
- Having multiple spark context - posted by ja...@accenture.com on 2017/01/30 05:08:40 UTC, 0 replies.
- No Reducer scenarios - posted by "☼ R Nair (रविशंकर नायर)" <ra...@gmail.com> on 2017/01/30 05:31:48 UTC, 0 replies.
- Failures on JavaSparkContext. - "Futures timed out after [10000 milliseconds]" - posted by Gili Nachum <gi...@gmail.com> on 2017/01/30 06:35:37 UTC, 0 replies.
- Re: Having multiple spark context - posted by Mark Hamstra <ma...@clearstorydata.com> on 2017/01/30 06:54:50 UTC, 5 replies.
- ML model to associate search terms with objects and reranking them - posted by "dilip.sridhar@unvired.com" <di...@unvired.com> on 2017/01/30 10:17:19 UTC, 0 replies.
- userClassPathFirst=true prevents SparkContext to be initialized - posted by Roberto Coluccio <ro...@gmail.com> on 2017/01/30 10:23:30 UTC, 1 replies.
- Pruning decision tree in Spark - posted by "Md. Rezaul Karim" <re...@insight-centre.org> on 2017/01/30 10:27:54 UTC, 0 replies.
- Reason behind mapping of StringType with CLOB nullType - posted by Amiya Mishra <Am...@bitwiseglobal.com> on 2017/01/30 12:14:10 UTC, 0 replies.
- how to compare two avro format hive tables - posted by Alex <si...@gmail.com> on 2017/01/30 15:37:10 UTC, 1 replies.
- Pyspark 2.1.0 weird behavior with repartition - posted by Blaž Šnuderl <sn...@gmail.com> on 2017/01/30 19:19:02 UTC, 0 replies.
- Saving parquet file in Spark giving error when Encryption at Rest is implemented - posted by morfious902002 <an...@gmail.com> on 2017/01/30 19:47:40 UTC, 0 replies.
- Tableau BI on Spark SQL - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/01/30 20:57:15 UTC, 4 replies.
- graphframes stateful motif - posted by geoHeil <ge...@gmail.com> on 2017/01/30 23:03:37 UTC, 0 replies.
- Cosine Similarity Implementation in Spark - posted by Manish Tripathi <tr...@gmail.com> on 2017/01/30 23:20:17 UTC, 0 replies.
- RDD unpersisted still showing in my Storage tab UI - posted by Saulo Ricci <in...@gmail.com> on 2017/01/31 01:08:30 UTC, 0 replies.
- Spark 2.1.0 and Shapeless - posted by Timothy Chan <tc...@lumoslabs.com> on 2017/01/31 04:24:21 UTC, 2 replies.
- does both below code do the same thing? I had to refactor code to fit in spark-sql - posted by Alex <si...@gmail.com> on 2017/01/31 07:01:09 UTC, 0 replies.
- alternatives for long to longwritable typecasting in spark sql - posted by Alex <si...@gmail.com> on 2017/01/31 07:32:44 UTC, 0 replies.
- Jars directory in Spark 2.0 - posted by Sidney Feiner <si...@startapp.com> on 2017/01/31 08:40:07 UTC, 1 replies.
- ML version of Kmeans - posted by Madabhattula Rajesh Kumar <mr...@gmail.com> on 2017/01/31 09:24:03 UTC, 3 replies.
- Error when loading saved ml model on pyspark (2.0.1) - posted by Matheus Braun Magrin <br...@gmail.com> on 2017/01/31 10:39:08 UTC, 0 replies.
- Roadblock -- stuck for 10 days :( how come same hive udf giving different results in spark and hive - posted by Alex <si...@gmail.com> on 2017/01/31 14:34:17 UTC, 0 replies.
- Multiple quantile calculations - posted by Aaron Perrin <ap...@gravyanalytics.com> on 2017/01/31 15:42:16 UTC, 0 replies.
- Unique Partition Id per partition - posted by "Chawla,Sumit " <su...@gmail.com> on 2017/01/31 17:08:22 UTC, 0 replies.
- Resource Leak in Spark Streaming - posted by Nipun Arora <ni...@gmail.com> on 2017/01/31 18:37:43 UTC, 6 replies.
- JavaRDD text matadata(file name) findings - posted by Manohar753 <ma...@happiestminds.com> on 2017/01/31 18:58:13 UTC, 0 replies.
- HBase Spark - posted by Benjamin Kim <bb...@gmail.com> on 2017/01/31 20:17:09 UTC, 2 replies.
- Question about "Output Op Duration" in SparkStreaming Batch details UX - posted by satishl <sa...@gmail.com> on 2017/01/31 20:56:53 UTC, 1 replies.
- increasing cross join speed - posted by Kürşat Kurt <ku...@kursatkurt.com> on 2017/01/31 21:35:08 UTC, 0 replies.
- Kafka dependencies in Eclipse project /Pls assist - posted by Marco Mistroni <mm...@gmail.com> on 2017/01/31 21:49:38 UTC, 1 replies.