You are viewing a plain text version of this content. The canonical link for it is here.
- Is Spark's KMeans unable to handle bigdata? - posted by Georgios Samaras <ge...@gmail.com> on 2016/09/01 22:35:23 UTC, 7 replies.
- shuffle files not deleted after executor restarted - posted by 汪洋 <ti...@icloud.com> on 2016/09/02 04:18:48 UTC, 6 replies.
- Dynamic Partitions When Writing Parquet - posted by Liz Bai <li...@icloud.com> on 2016/09/02 05:51:36 UTC, 0 replies.
- Support for Hive 2.x - posted by Rostyslav Sotnychenko <r....@gmail.com> on 2016/09/02 07:51:44 UTC, 2 replies.
- sparkR array type not supported - posted by Paul R <pj...@gmail.com> on 2016/09/02 15:26:26 UTC, 1 replies.
- help from other committers on getting started - posted by Dayne Sorvisto <da...@yahoo.ca.INVALID> on 2016/09/02 15:53:53 UTC, 2 replies.
- Re: help getting started - posted by dayne sorvisto <da...@gmail.com> on 2016/09/02 18:56:52 UTC, 1 replies.
- Re: critical bugs to be fixed in Spark 2.0.1? - posted by tomerk11 <to...@gmail.com> on 2016/09/02 19:32:13 UTC, 2 replies.
- Committing Kafka offsets when using DirectKafkaInputDStream - posted by vonnagy <iv...@vadio.com> on 2016/09/02 22:50:47 UTC, 1 replies.
- Catalog, SessionCatalog and ExternalCatalog in spark 2.0 - posted by Kapil Malik <ka...@snapdeal.com> on 2016/09/03 12:19:51 UTC, 1 replies.
- Subscription - posted by Omkar Reddy <om...@gmail.com> on 2016/09/03 14:18:53 UTC, 1 replies.
- Contribution to Apache Spark - posted by aditya1702 <ad...@gmail.com> on 2016/09/03 19:58:30 UTC, 2 replies.
- Re: spark cassandra issue - posted by Russell Spitzer <ru...@gmail.com> on 2016/09/04 16:31:24 UTC, 1 replies.
- Active tasks is a negative number spark ui - posted by Georgios Samaras <ge...@gmail.com> on 2016/09/04 17:52:00 UTC, 1 replies.
- Re: Update Data in mySql using spark - posted by dsorvisto <da...@gmail.com> on 2016/09/04 18:40:07 UTC, 2 replies.
- Fwd: seeing this message repeatedly. - posted by kant kodali <ka...@gmail.com> on 2016/09/05 09:08:32 UTC, 1 replies.
- Replacement for SparkSqlSerializer.deserialize[ - posted by Ted Yu <yu...@gmail.com> on 2016/09/06 19:42:48 UTC, 0 replies.
- df.groupBy('m).agg(sum('n)).show dies with 10^3 elements? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/06 20:32:36 UTC, 2 replies.
- BlockMatrix Multiplication fails with Out of Memory - posted by vinodep <vp...@andrew.cmu.edu> on 2016/09/06 22:37:56 UTC, 0 replies.
- Unable to run docker jdbc integrations test ? - posted by Suresh Thalamati <su...@gmail.com> on 2016/09/06 23:05:21 UTC, 0 replies.
- Discuss SparkR executors/workers support virtualenv - posted by Yanbo Liang <yb...@gmail.com> on 2016/09/07 06:36:48 UTC, 1 replies.
- Removing published kinesis, ganglia artifacts due to license issues? - posted by Sean Owen <so...@cloudera.com> on 2016/09/07 08:29:05 UTC, 10 replies.
- implement UDF/UDAF supporting whole stage codegen - posted by "assaf.mendelson" <as...@rsa.com> on 2016/09/07 09:38:26 UTC, 0 replies.
- How to get 2 years prior date from currentdate using Spark Sql - posted by "farman.bsse1855" <fa...@zigron.com> on 2016/09/07 11:27:20 UTC, 3 replies.
- Re: Unable to run docker jdbc integrations test ? - posted by Luciano Resende <lu...@gmail.com> on 2016/09/07 21:36:29 UTC, 3 replies.
- FileStreamSource source checks path eagerly? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/08 06:33:28 UTC, 5 replies.
- @scala.annotation.varargs or @_root_.scala.annotation.varargs? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/08 12:24:57 UTC, 9 replies.
- I'm working on SPARK-6235 Address various 2G limits. - posted by "liguoqiang (I)" <li...@huawei.com> on 2016/09/09 00:45:38 UTC, 0 replies.
- Video analytics on SPark - posted by Priya Ch <le...@gmail.com> on 2016/09/09 09:16:54 UTC, 0 replies.
- Change the settings in AppVeyor to prevent triggering the tests in other PRs in other branches - posted by Hyukjin Kwon <gu...@gmail.com> on 2016/09/09 13:55:26 UTC, 6 replies.
- scalable-deeplearning 1.0.0 released - posted by "Ulanov, Alexander" <al...@hpe.com> on 2016/09/09 19:25:45 UTC, 0 replies.
- Test fails when compiling spark with tests - posted by "assaf.mendelson" <as...@rsa.com> on 2016/09/12 05:49:18 UTC, 2 replies.
- UDF and native functions performance - posted by "assaf.mendelson" <as...@rsa.com> on 2016/09/12 10:43:32 UTC, 4 replies.
- Re: Fwd: HANA data access from SPARK - posted by whitefalcon <ar...@hotmail.com> on 2016/09/12 13:16:35 UTC, 0 replies.
- GZIP compression support for Spark internal data - posted by Nasser Ebrahim <en...@linux.vnet.ibm.com> on 2016/09/12 14:00:40 UTC, 2 replies.
- Why CatalogImpl.makeDataset and SparkSession.createDataset? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/12 14:23:48 UTC, 0 replies.
- Re: Organizing Spark ML example packages - posted by Nick Pentreath <ni...@gmail.com> on 2016/09/12 16:09:29 UTC, 1 replies.
- [build system] brief jenkins downtime this morning - posted by shane knapp <sk...@berkeley.edu> on 2016/09/12 16:31:25 UTC, 1 replies.
- Spark SQL - Applying transformation on a struct inside an array - posted by Olivier Girardot <o....@lateral-thoughts.com> on 2016/09/13 15:08:47 UTC, 1 replies.
- Nominal Attribute - posted by Danil Kirsanov <da...@gmail.com> on 2016/09/13 23:45:59 UTC, 0 replies.
- REST api for monitoring Spark Streaming - posted by Chan Chor Pang <ch...@indetail.co.jp> on 2016/09/14 01:13:57 UTC, 0 replies.
- sqlContext.registerDataFrameAsTable is not working properly in pyspark 2.0 - posted by sririshindra <sr...@gmail.com> on 2016/09/14 09:57:40 UTC, 0 replies.
- Question about impersonation on Spark executor - posted by Tao Li <tl...@hortonworks.com> on 2016/09/14 17:42:03 UTC, 0 replies.
- Not all KafkaReceivers processing the data Why? - posted by Rachana Srivastava <Ra...@markmonitor.com> on 2016/09/14 19:33:38 UTC, 1 replies.
- Re: Saving less data to improve Pregel performance in GraphX? - posted by Reynold Xin <rx...@databricks.com> on 2016/09/14 19:44:20 UTC, 0 replies.
- CSV Reader with row numbers - posted by Akshay Sachdeva <ak...@gmail.com> on 2016/09/14 22:58:30 UTC, 1 replies.
- Compatibility of 1.6 spark.eventLog with a 2.0 History Server - posted by Mario Ds Briggs <ma...@in.ibm.com> on 2016/09/15 17:21:34 UTC, 6 replies.
- Why we get 0 when the key is null? - posted by WangJianfei <wa...@otcaix.iscas.ac.cn> on 2016/09/16 01:15:25 UTC, 3 replies.
- What's the use of RangePartitioner.hashCode - posted by WangJianfei <wa...@otcaix.iscas.ac.cn> on 2016/09/16 01:17:52 UTC, 6 replies.
- What's the meaning when the partitions is zero? - posted by WangJianfei <wa...@otcaix.iscas.ac.cn> on 2016/09/16 06:54:58 UTC, 4 replies.
- Spark 2.0.1 release? - posted by Ewan Leith <ew...@realitymine.com> on 2016/09/16 18:16:32 UTC, 3 replies.
- Re: Spark 1.x/2.x qualifiers in downstream artifact names - posted by Michael Heuer <he...@gmail.com> on 2016/09/16 19:03:39 UTC, 0 replies.
- Doubt about ExternalSorter.spillMemoryIteratorToDisk - posted by WangJianfei <wa...@otcaix.iscas.ac.cn> on 2016/09/17 03:41:14 UTC, 0 replies.
- Different versions of dependencies in assembly/target/scala-2.11/jars? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/17 19:14:11 UTC, 4 replies.
- Fwd: Question regarding merging to two RDDs - posted by Hiral Mehta <hi...@gmail.com> on 2016/09/17 20:32:17 UTC, 1 replies.
- java.lang.NoClassDefFoundError, is this a bug? - posted by Xiang Gao <qa...@gmail.com> on 2016/09/17 21:08:23 UTC, 8 replies.
- Memory usage for spark types - posted by "assaf.mendelson" <as...@rsa.com> on 2016/09/18 16:06:33 UTC, 2 replies.
- Continuous warning while consuming using new kafka-spark010 API - posted by Nitin Goyal <ni...@gmail.com> on 2016/09/19 16:57:19 UTC, 0 replies.
- Re: Is RankingMetrics' NDCG implementation correct? - posted by Nick Pentreath <ni...@gmail.com> on 2016/09/20 09:10:15 UTC, 0 replies.
- Using Spark as a Maven dependency but with Hadoop 2.6 - posted by Olivier Girardot <o....@lateral-thoughts.com> on 2016/09/22 06:05:26 UTC, 6 replies.
- Memory usage by Spark jobs - posted by Hemant Bhanawat <he...@gmail.com> on 2016/09/22 06:36:50 UTC, 1 replies.
- R docs no longer building for branch-2.0 - posted by Reynold Xin <rx...@databricks.com> on 2016/09/22 06:47:37 UTC, 2 replies.
- Open source Spark based projects - posted by tahirhn <ta...@icloud.com> on 2016/09/22 10:19:09 UTC, 0 replies.
- Deserializing InternalRow using a case class - how to avoid creating attrs manually? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/22 10:27:17 UTC, 0 replies.
- A Spark resource scheduling order question - posted by Bi Linfeng <Li...@outlook.com> on 2016/09/22 11:11:29 UTC, 0 replies.
- [SPARK-15717][GraphX] status - posted by Asher Krim <ak...@hubspot.com> on 2016/09/22 21:49:37 UTC, 2 replies.
- [VOTE] Release Apache Spark 2.0.1 (RC2) - posted by Reynold Xin <rx...@databricks.com> on 2016/09/23 06:01:04 UTC, 22 replies.
- Spark job fails as soon as it starts. Driver requested a total number of 168510 executor - posted by Yash Sharma <ya...@gmail.com> on 2016/09/23 07:04:06 UTC, 7 replies.
- Documentation for package ‘SparkR’ version mismatch - posted by Jagadeesan As <as...@us.ibm.com> on 2016/09/23 07:25:43 UTC, 1 replies.
- Re: Spark Yarn Cluster with Reference File - posted by Aditya <ad...@augmentiq.co.in> on 2016/09/23 07:43:18 UTC, 0 replies.
- Why Expression.deterministic method and Nondeterministic trait? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/23 15:28:45 UTC, 4 replies.
- [VOTE] Release Apache Spark 2.0.1 (RC3) - posted by Reynold Xin <rx...@databricks.com> on 2016/09/24 22:08:35 UTC, 36 replies.
- Master, branches and versioning - posted by Sean Owen <so...@cloudera.com> on 2016/09/25 15:57:08 UTC, 0 replies.
- ArrayType support in Spark SQL - posted by Jason White <ja...@shopify.com> on 2016/09/25 22:13:30 UTC, 4 replies.
- Deep Equals support on Maptype - posted by Lakshmi Rajagopalan <la...@indix.com> on 2016/09/26 10:09:58 UTC, 5 replies.
- increase efficiency of working with mongo and mysql database - posted by Yang Cao <cy...@gmail.com> on 2016/09/26 15:22:31 UTC, 0 replies.
- Sliding Window Memory use - posted by Jeremy Davis <je...@speakeasy.net> on 2016/09/26 16:03:53 UTC, 2 replies.
- StructuredStreaming Custom Sinks (motivated by Structured Streaming Machine Learning) - posted by Holden Karau <ho...@pigscanfly.ca> on 2016/09/26 20:38:50 UTC, 1 replies.
- Re: renaming "minor release" to "feature release" - posted by Reynold Xin <rx...@databricks.com> on 2016/09/27 04:04:52 UTC, 0 replies.
- Should LeafExpression have children final override (like Nondeterministic)? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/27 07:53:43 UTC, 1 replies.
- https://issues.apache.org/jira/browse/SPARK-17691 - posted by "assaf.mendelson" <as...@rsa.com> on 2016/09/27 14:02:13 UTC, 1 replies.
- [discuss] Spark 2.x release cadence - posted by Reynold Xin <rx...@databricks.com> on 2016/09/27 19:06:38 UTC, 9 replies.
- Help required in validating an architecture using Structured Streaming - posted by Aravindh <ma...@aravindh.io> on 2016/09/28 04:08:47 UTC, 0 replies.
- Spark Executor Lost issue - posted by Aditya <ad...@augmentiq.co.in> on 2016/09/28 06:47:29 UTC, 3 replies.
- java.util.NoSuchElementException when serializing Map with default value - posted by Maciej Szymkiewicz <ms...@gmail.com> on 2016/09/28 07:18:02 UTC, 3 replies.
- IllegalArgumentException: spark.sql.execution.id is already set - posted by Grant Digby <di...@gmail.com> on 2016/09/28 08:46:04 UTC, 6 replies.
- Broadcast big dataset - posted by WangJianfei <wa...@otcaix.iscas.ac.cn> on 2016/09/28 14:03:24 UTC, 2 replies.
- Spark SQL JSON Column Support - posted by Michael Armbrust <mi...@databricks.com> on 2016/09/28 17:52:21 UTC, 7 replies.
- [VOTE] Release Apache Spark 2.0.1 (RC4) - posted by Reynold Xin <rx...@databricks.com> on 2016/09/29 02:14:31 UTC, 24 replies.
- Dynamic allocation / killing executors work? Perhaps it's just web UI? - posted by Jacek Laskowski <ja...@japila.pl> on 2016/09/29 14:08:51 UTC, 0 replies.
- Questions about DataFrame's filter() - posted by Samy Dindane <sa...@dindane.com> on 2016/09/29 16:16:39 UTC, 1 replies.
- Running Spark master/slave instances in non Daemon mode - posted by jpuro <jp...@mustwin.com> on 2016/09/29 22:46:51 UTC, 2 replies.
- [question] Why Spark SQL grammar allows : ? - posted by Tejas Patil <te...@gmail.com> on 2016/09/30 01:54:27 UTC, 3 replies.
- Issues in compiling spark 2.0.0 code using scala-maven-plugin - posted by satyajit vegesna <sa...@gmail.com> on 2016/09/30 02:00:16 UTC, 1 replies.
- Catalyst - ObjectType for Encoders - posted by Aleksander Eskilson <al...@gmail.com> on 2016/09/30 13:36:20 UTC, 1 replies.
- code questions, sql.functions.scala - posted by Peter Figliozzi <pe...@gmail.com> on 2016/09/30 15:40:02 UTC, 0 replies.
- Re: Restful WS for Spark - posted by Mahendra Kutare <ma...@gmail.com> on 2016/09/30 18:09:05 UTC, 0 replies.