You are viewing a plain text version of this content. The canonical link for it is here.
- RE: SPARK Issue in Standalone cluster - posted by Mahesh Sawaiker <ma...@persistent.com> on 2017/08/01 03:50:27 UTC, 15 replies.
- Heap Settings for History Server - posted by N Sa <ne...@gmail.com> on 2017/08/01 04:29:29 UTC, 0 replies.
- java.io.OptionalDataException during task deserialization - posted by Viacheslav Krot <kr...@gmail.com> on 2017/08/01 11:29:44 UTC, 1 replies.
- Spark ES Connector -- AWS Managed ElasticSearch Services - posted by Deepak Sharma <de...@gmail.com> on 2017/08/01 12:53:26 UTC, 0 replies.
- Re: Spark parquet file read problem ! - posted by 萝卜丝炒饭 <14...@qq.com> on 2017/08/01 14:03:07 UTC, 0 replies.
- How can i remove the need for calling cache - posted by jeff saremi <je...@hotmail.com> on 2017/08/01 18:05:37 UTC, 14 replies.
- [Spark SQL Lack of ForEach Sink in Python]: Is there anyway to use a ForEach sink in a Python application? - posted by Denis Li <dl...@asperasoft.com> on 2017/08/01 18:35:22 UTC, 0 replies.
- Cannot connect to Python process in Spark Streaming - posted by canan chen <cc...@gmail.com> on 2017/08/02 00:31:19 UTC, 0 replies.
- PySpark Streaming S3 checkpointing - posted by Riccardo Ferrari <fe...@gmail.com> on 2017/08/02 09:34:15 UTC, 2 replies.
- Spark-twitter Streaming - posted by deependra singh <de...@outlook.com> on 2017/08/02 10:40:03 UTC, 0 replies.
- Inserting content of df to partitioned hive table (parquet format) - posted by Jens Johannsen <je...@gmail.com> on 2017/08/02 11:56:58 UTC, 0 replies.
- Quick one on evaluation - posted by Jean Georges Perrin <jg...@jgp.net> on 2017/08/02 12:16:44 UTC, 5 replies.
- Reparitioning Hive tables - Container killed by YARN for exceeding memory limits - posted by Chetan Khatri <ch...@gmail.com> on 2017/08/02 12:58:31 UTC, 6 replies.
- Reading spark-env.sh from configured directory - posted by Lior Chaga <li...@taboola.com> on 2017/08/02 13:34:22 UTC, 0 replies.
- UNSUBSCRIBE - posted by Jnana Sagar <jn...@gmail.com> on 2017/08/02 13:43:53 UTC, 4 replies.
- Runnig multiple spark jobs on yarn - posted by serkan taş <se...@hotmail.com> on 2017/08/02 14:42:38 UTC, 2 replies.
- [Debug] Upgrade from 1.4.1 to 2.0.0 breaks job - posted by Druhin Goel <dr...@quantifind.com> on 2017/08/02 17:12:32 UTC, 0 replies.
- Projection Pushdown and Predicate Pushdown in Parquet for Nested Column - posted by Patrick <ti...@gmail.com> on 2017/08/02 19:05:42 UTC, 0 replies.
- Spark Streaming: Async action scheduling inside foreachRDD - posted by Andrii Biletskyi <an...@yahoo.com.INVALID> on 2017/08/02 20:24:17 UTC, 2 replies.
- DataSet creation not working Spark 1.6.0 , populating wrong data CDH 5.7.1 - posted by Rabin Banerjee <de...@gmail.com> on 2017/08/03 10:09:12 UTC, 4 replies.
- mapPartitioningWithIndex in Dataframe - posted by "Lalwani, Jayesh" <Ja...@capitalone.com> on 2017/08/03 14:19:50 UTC, 1 replies.
- SparkEventListener dropping events - posted by Miles Crawford <mi...@allenai.org> on 2017/08/03 17:31:08 UTC, 0 replies.
- Unsubscribe - posted by Parijat Mazumdar <ma...@gmail.com> on 2017/08/04 04:39:20 UTC, 4 replies.
- [pyspark] java.lang.NoSuchMethodError: net.jpountz.util.Utils.checkRange error - posted by "kulasama@gmail.com" <11...@qq.com> on 2017/08/04 04:56:55 UTC, 0 replies.
- Spark Streaming failed jobs due to hardware issue - posted by Alapati VenuGopal <ve...@gmail.com> on 2017/08/04 09:04:56 UTC, 0 replies.
- the uniqueSource in StreamExecution, where is it be changed please? - posted by 萝卜丝炒饭 <14...@qq.com> on 2017/08/05 05:00:00 UTC, 0 replies.
- PySpark Streaming keeps dying - posted by Riccardo Ferrari <fe...@gmail.com> on 2017/08/05 07:55:23 UTC, 0 replies.
- Trying to connect Spark 1.6 to Hive - posted by toletum <to...@toletum.org> on 2017/08/05 21:04:06 UTC, 1 replies.
- kafka settting, enable.auto.commit to false is being overridden and I lose data. please help! - posted by shyla deshpande <de...@gmail.com> on 2017/08/05 22:10:16 UTC, 9 replies.
- spark-shell - modes - posted by karan alang <ka...@gmail.com> on 2017/08/06 17:07:01 UTC, 1 replies.
- How can i split dataset to multi dataset - posted by Jone Zhang <jo...@gmail.com> on 2017/08/07 02:51:52 UTC, 1 replies.
- spark-shell not getting launched - Queue's AM resource limit exceeded. - posted by karan alang <ka...@gmail.com> on 2017/08/07 03:17:10 UTC, 0 replies.
- - posted by Sumit Saraswat <su...@gmail.com> on 2017/08/07 09:27:48 UTC, 1 replies.
- [SS] Console sink not supporting recovering from checkpoint location? Why? - posted by Jacek Laskowski <ja...@japila.pl> on 2017/08/07 09:58:37 UTC, 2 replies.
- Spark 2.1 table loaded from Hive Metastore has null values - posted by Shmuel Blitz <sh...@similarweb.com> on 2017/08/07 10:05:16 UTC, 0 replies.
- tuning - Spark data serialization for cache() ? - posted by Ofir Manor <of...@equalum.io> on 2017/08/07 17:04:26 UTC, 3 replies.
- Spark sample submitted with cluster deploy-mode does not work in Standalone - posted by ctang <ct...@gmail.com> on 2017/08/07 20:43:33 UTC, 0 replies.
- [spark-core] Choosing the correct number of partitions while joining two RDDs with partitioner set on one - posted by Piyush Narang <pn...@twitter.com.INVALID> on 2017/08/07 21:53:03 UTC, 0 replies.
- KafkaUtils.createRDD , How do I read all the data from kafka in a batch program for a given topic? - posted by shyla deshpande <de...@gmail.com> on 2017/08/08 01:03:44 UTC, 6 replies.
- Re: Matrix multiplication and cluster / partition / blocks configuration - posted by Phillip Henry <lo...@gmail.com> on 2017/08/08 06:56:31 UTC, 0 replies.
- Spark Streaming job statistics - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/08 14:15:11 UTC, 2 replies.
- IndexOutOfBoundException in catalyst when doing multiple approxDistinctCount - posted by AssafMendelson <as...@rsa.com> on 2017/08/08 15:38:25 UTC, 0 replies.
- unsubscribe - posted by Ramesh Krishnan <ra...@gmail.com> on 2017/08/08 15:48:14 UTC, 2 replies.
- Question about 'Structured Streaming' - posted by Brian Wylie <br...@gmail.com> on 2017/08/08 16:35:15 UTC, 3 replies.
- speculative execution in spark - posted by john_test_test <jo...@hotmail.com> on 2017/08/08 17:09:44 UTC, 0 replies.
- Fwd: Python question about 'Structured Streaming' - posted by Brian Wylie <br...@gmail.com> on 2017/08/08 17:20:15 UTC, 0 replies.
- count exceed int.MaxValue - posted by makoto <to...@gmail.com> on 2017/08/08 17:26:33 UTC, 1 replies.
- Unsubscribe - posted by Benjamin Soemartopo <be...@eureka.ai> on 2017/08/08 19:44:11 UTC, 0 replies.
- [Spark Structured Streaming]: truncated Parquet after driver crash or kill - posted by dcam <dc...@digitalocean.com> on 2017/08/08 20:19:08 UTC, 1 replies.
- Re: Spark streaming: java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration ... on restart from checkpoint - posted by dcam <dc...@digitalocean.com> on 2017/08/08 20:33:54 UTC, 0 replies.
- How to get the lag of a column in a spark streaming dataframe? - posted by Prashanth Kumar Murali <pr...@gmail.com> on 2017/08/08 21:42:48 UTC, 0 replies.
- StructuredStreaming: java.util.concurrent.TimeoutException: Cannot fetch record for offset - posted by aravias <as...@homeaway.com> on 2017/08/08 22:10:32 UTC, 0 replies.
- Reusing dataframes for streaming (spark 1.6) - posted by Ashwin Raju <th...@gmail.com> on 2017/08/09 02:55:15 UTC, 1 replies.
- Multiple queries on same stream - posted by Raghavendra Pandey <ra...@gmail.com> on 2017/08/09 05:05:38 UTC, 2 replies.
- [Structured Streaming] Recommended way of joining streams - posted by Priyank Shrivastava <pr...@asperasoft.com> on 2017/08/09 07:05:03 UTC, 1 replies.
- Is there an operation to create multi record for every element in a RDD? - posted by lu...@sina.com on 2017/08/09 08:29:17 UTC, 4 replies.
- 回复：Re: Is there an operation to create multi record for every element in a RDD? - posted by lu...@sina.com on 2017/08/09 09:08:33 UTC, 0 replies.
- 回复：Re: Re: Is there an operation to create multi record for every element in a RDD? - posted by lu...@sina.com on 2017/08/09 09:38:39 UTC, 0 replies.
- Re[2]: Trying to connect Spark 1.6 to Hive - posted by toletum <to...@toletum.org> on 2017/08/09 09:41:34 UTC, 1 replies.
- Re[4]: Trying to connect Spark 1.6 to Hive - posted by toletum <to...@toletum.org> on 2017/08/09 12:01:04 UTC, 0 replies.
- StreamingQueryListner spark structered Streaming - posted by purna pradeep <pu...@gmail.com> on 2017/08/09 12:18:45 UTC, 0 replies.
- Spark SVD benchmark for dense matrices - posted by Jose Francisco Saray Villamizar <js...@gmail.com> on 2017/08/09 13:18:56 UTC, 1 replies.
- Anyone has come across incorta that relies on Spark,Parquet and open source ibraries. - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/08/09 19:45:03 UTC, 3 replies.
- --jars from spark-submit on master on YARN don't get added properly to the executors - ClassNotFoundException - posted by "Mikhailau, Alex" <Al...@mlb.com> on 2017/08/09 21:52:37 UTC, 2 replies.
- spark.write.csv is not able write files to specified path, but is writing to unintended subfolder _temporary/0/task_xxx folder on worker nodes - posted by Hemanth Gudela <he...@qvantel.com> on 2017/08/10 07:17:51 UTC, 8 replies.
- How can I tell if a Spark job is successful or not? - posted by 陈宇航 <yu...@foxmail.com> on 2017/08/10 09:23:03 UTC, 2 replies.
- Spark streaming - Processing time keeps on increasing under following scenario - posted by Ravi Gurram <rk...@gmail.com> on 2017/08/10 14:20:35 UTC, 0 replies.
- How do I pass multiple cassandra hosts in spark submit? - posted by shyla deshpande <de...@gmail.com> on 2017/08/10 18:59:25 UTC, 1 replies.
- Does Spark SQL uses Calcite? - posted by kant kodali <ka...@gmail.com> on 2017/08/10 20:13:51 UTC, 12 replies.
- SQL specific documentation for recent Spark releases - posted by Stephen Boesch <ja...@gmail.com> on 2017/08/10 20:46:26 UTC, 3 replies.
- Issues when trying to recover a textFileStream from checkpoint in Spark streaming - posted by SRK <sw...@gmail.com> on 2017/08/11 00:04:23 UTC, 1 replies.
- Spark Thriftserver ERROR - posted by Ascot Moss <as...@gmail.com> on 2017/08/11 06:25:00 UTC, 0 replies.
- XML Parsing with Spark and SCala - posted by Etisha Jain <et...@infoobjects.com> on 2017/08/11 07:30:34 UTC, 1 replies.
- Spark ThriftServer Error - posted by Ascot Moss <as...@gmail.com> on 2017/08/11 08:14:14 UTC, 0 replies.
- ThriftServer Start Error - posted by Ascot Moss <as...@gmail.com> on 2017/08/11 08:15:15 UTC, 1 replies.
- Structured Streaming + Kafka Integration unable to read new messages after sometimes - posted by NikhilP <ni...@ril.com> on 2017/08/11 09:29:42 UTC, 1 replies.
- [Spark Core] Is it possible to insert a function directly into the Logical Plan? - posted by Lukas Bradley <lu...@gmail.com> on 2017/08/11 14:45:04 UTC, 3 replies.
- Write only one output file in Spark SQL - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/11 15:52:58 UTC, 5 replies.
- Structured Streaming: multiple sinks - posted by aravias <as...@homeaway.com> on 2017/08/11 19:55:00 UTC, 4 replies.
- [StructuredStreaming] multiple queries of the socket source: only one query works. - posted by Gerard Maas <ge...@gmail.com> on 2017/08/11 21:53:52 UTC, 4 replies.
- how to fetch schema froma dynamic nested JSON - posted by sk skk <sp...@gmail.com> on 2017/08/12 15:16:35 UTC, 0 replies.
- ERROR transport.TSaslTransport: SASL negotiation failure javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: No valid credentials provided (Mechanism level: Failed to find any Kerberos tgt)] - posted by Ascot Moss <as...@gmail.com> on 2017/08/13 01:42:56 UTC, 1 replies.
- ThriftServer on HTTPS - posted by Ascot Moss <as...@gmail.com> on 2017/08/13 03:27:36 UTC, 0 replies.
- [BlockMatrix] multiply is an action or a transformation ? - posted by Jose Francisco Saray Villamizar <js...@gmail.com> on 2017/08/13 14:30:35 UTC, 1 replies.
- WARN HIVE: Failed to access metastore. This class should not accessed in runtime - posted by Ascot Moss <as...@gmail.com> on 2017/08/14 07:58:15 UTC, 0 replies.
- DAGScheduler - two runtimes - posted by "Kaepke, Marc" <ma...@haw-hamburg.de> on 2017/08/14 10:58:16 UTC, 1 replies.
- Spark 2.2 streaming with append mode: empty output - posted by Ashwin Raju <th...@gmail.com> on 2017/08/14 23:09:03 UTC, 2 replies.
- Apache Spark on Kubernetes: New Release for Spark 2.2 - posted by Erik Erlandson <ee...@redhat.com> on 2017/08/14 23:31:35 UTC, 0 replies.
- How to calculating CPU time for a Spark Job? - posted by 钟文波 <zh...@gmail.com> on 2017/08/15 11:21:54 UTC, 0 replies.
- Restart streaming query spark 2.1 structured streaming - posted by purna pradeep <pu...@gmail.com> on 2017/08/15 16:40:01 UTC, 7 replies.
- How to force Spark Kafka Direct to start from the latest offset when the lag is huge in kafka 10? - posted by SRK <sw...@gmail.com> on 2017/08/15 18:18:31 UTC, 3 replies.
- Hive Metastore open connections even after closing Spark context and session - posted by Rohit Damkondwar <ro...@gmail.com> on 2017/08/15 20:53:20 UTC, 0 replies.
- Re: SPIP: Spark on Kubernetes - posted by "lucas.gary@gmail.com" <lu...@gmail.com> on 2017/08/16 00:07:41 UTC, 0 replies.
- Reading CSV with multiLine option invalidates encoding option. - posted by Han-Cheol Cho <pr...@gmail.com> on 2017/08/16 04:32:45 UTC, 4 replies.
- Thrift-Server JDBC ResultSet Cursor Reset or Previous - posted by Imran Rajjad <ra...@gmail.com> on 2017/08/16 06:18:59 UTC, 0 replies.
- Reading parquet file in stream - posted by HARSH TAKKAR <ta...@gmail.com> on 2017/08/16 12:56:44 UTC, 0 replies.
- Reading Excel (.xlsm) file through PySpark 2.1.1 with external JAR is causing fatal conversion of data type - posted by Aakash Basu <aa...@gmail.com> on 2017/08/16 17:41:14 UTC, 7 replies.
- Working with hadoop har file in spark - posted by Nicolas Paris <ni...@gmail.com> on 2017/08/17 09:45:16 UTC, 0 replies.
- Spark 2 | Java | Dataset - posted by Jean Georges Perrin <jg...@jgp.net> on 2017/08/17 13:25:00 UTC, 0 replies.
- Spark Yarn mode - unsupported exception - posted by Darshan Pandya <da...@gmail.com> on 2017/08/17 23:15:33 UTC, 0 replies.
- GC overhead exceeded - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/18 04:36:11 UTC, 4 replies.
- [SS] Why is a streaming aggregation required for complete output mode? - posted by Jacek Laskowski <ja...@japila.pl> on 2017/08/18 12:25:07 UTC, 7 replies.
- Persist performace in Spark - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/18 13:55:45 UTC, 0 replies.
- Spark Web UI SSL Encryption - posted by Anshuman Kumar <an...@gmail.com> on 2017/08/18 17:49:16 UTC, 2 replies.
- Failing jobs with Spark 2.2 running on Yarn with HDFS - posted by Jan-Hendrik Zab <za...@l3s.de> on 2017/08/18 17:59:26 UTC, 1 replies.
- How to authenticate to ADLS from within spark job on the fly - posted by Imtiaz Ahmed <em...@gmail.com> on 2017/08/19 01:42:04 UTC, 4 replies.
- Fwd: PageRank - 4x slower then Spark?! - posted by kant kodali <ka...@gmail.com> on 2017/08/19 02:19:19 UTC, 0 replies.
- Logging in unit tests - posted by Pascal Stammer <st...@deichbrise.de> on 2017/08/19 09:58:56 UTC, 1 replies.
- How is data desensitization (example: select bank_no from users)? - posted by 李斌松 <li...@gmail.com> on 2017/08/19 15:42:13 UTC, 1 replies.
- Spark hive overwrite is very very slow - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/20 01:18:45 UTC, 10 replies.
- Huber regression in PySpark? - posted by Jeff Gates <ga...@gmail.com> on 2017/08/20 07:19:26 UTC, 1 replies.
- Spark billing on shared Clusters - posted by Jorge Machado <jo...@me.com> on 2017/08/20 08:32:36 UTC, 1 replies.
- Question on how to get appended data from structured streaming - posted by Yanpeng Lin <yp...@gmail.com> on 2017/08/20 16:23:51 UTC, 2 replies.
- a set of practice and LAB - posted by Mohsen Pahlevanzadeh <mo...@pahlevanzadeh.org> on 2017/08/20 20:49:17 UTC, 2 replies.
- Netty Issues - posted by Pascal Stammer <st...@deichbrise.de> on 2017/08/21 10:43:45 UTC, 2 replies.
- Update MySQL table via Spark/SparkR? - posted by Jake Russ <jr...@bloomintelligence.com> on 2017/08/21 14:50:51 UTC, 4 replies.
- Chaining Spark Streaming Jobs - posted by Sunita Arvind <su...@gmail.com> on 2017/08/21 18:02:47 UTC, 1 replies.
- 'Premature end of Content-Length' using S3A to read huge data - posted by Tushar Sudake <et...@gmail.com> on 2017/08/21 21:24:33 UTC, 0 replies.
- Re: issue in add row functionality - posted by abhimadav <ab...@gmail.com> on 2017/08/22 00:55:29 UTC, 0 replies.
- Re: Scala closure exceeds ByteArrayOutputStream limit (~2gb) - posted by Mungeol Heo <mu...@gmail.com> on 2017/08/22 09:08:30 UTC, 0 replies.
- Structured streaming (Kafka) error with Union - posted by upkar_kohli <up...@gmail.com> on 2017/08/22 09:12:35 UTC, 5 replies.
- Re: UI for spark machine learning. - posted by Sea aj <sa...@gmail.com> on 2017/08/22 10:58:44 UTC, 3 replies.
- Fwd: ORC Transaction Table - Spark - posted by Aviral Agarwal <av...@gmail.com> on 2017/08/22 12:40:11 UTC, 2 replies.
- A bug in spark or hadoop RPC with kerberos authentication? - posted by "Sun, Keith" <ai...@ebay.com> on 2017/08/22 15:48:14 UTC, 3 replies.
- Re: Spark submit OutOfMemory Error in local mode - posted by shitijkuls <ku...@gmail.com> on 2017/08/22 18:16:06 UTC, 3 replies.
- What is the right way to stop a streaming application? - posted by shyla deshpande <de...@gmail.com> on 2017/08/22 18:29:09 UTC, 0 replies.
- [Streaming][Structured Streaming] Understanding dynamic allocation in streaming jobs - posted by Karthik Palaniappan <ka...@hotmail.com> on 2017/08/22 19:24:48 UTC, 2 replies.
- [Spark Streaming] Streaming Dynamic Allocation is broken (at least on YARN) - posted by Karthik Palaniappan <ka...@hotmail.com> on 2017/08/22 20:38:10 UTC, 2 replies.
- Spark Authentication on Mesos Client Mode - posted by Kalvin Chau <wo...@gmail.com> on 2017/08/22 22:17:55 UTC, 0 replies.
- Training A ML Model on a Huge Dataframe - posted by Sea aj <sa...@gmail.com> on 2017/08/23 12:27:57 UTC, 4 replies.
- filter function works incorretly (Python) - posted by AlexanderModestov <Al...@yandex.ru> on 2017/08/23 15:40:16 UTC, 0 replies.
- Joining 2 dataframes, getting result as nested list/structure in dataframe - posted by JG Perrin <jp...@lumeris.com> on 2017/08/23 18:30:04 UTC, 2 replies.
- ReduceByKeyAndWindow checkpoint recovery issues in Spark Streaming - posted by SRK <sw...@gmail.com> on 2017/08/23 19:26:02 UTC, 0 replies.
- PySpark, Structured Streaming and Kafka - posted by Brian Wylie <br...@gmail.com> on 2017/08/23 20:41:28 UTC, 4 replies.
- Livy with Spark package - posted by ayan guha <gu...@gmail.com> on 2017/08/24 00:11:30 UTC, 2 replies.
- SparkStreaming connection exception - posted by Likith_Kailas <ka...@gmail.com> on 2017/08/24 13:05:17 UTC, 0 replies.
- NoSuchMethodError CatalogTable.copy - posted by Lionel Luffy <li...@gmail.com> on 2017/08/24 13:32:06 UTC, 0 replies.
- Restarting the SparkContext in pyspark - posted by Alexander Czech <al...@googlemail.com> on 2017/08/24 15:59:55 UTC, 0 replies.
- SWOT Analysis on Apache Spark - posted by Irfan Kabli <ir...@gmail.com> on 2017/08/24 18:49:40 UTC, 0 replies.
- [Spark] Can Apache Spark be used with time series processing? - posted by Alexandr Porunov <al...@gmail.com> on 2017/08/24 20:52:20 UTC, 3 replies.
- Re: unable to stream kafka messages - posted by cbowden <cb...@gmail.com> on 2017/08/25 02:45:38 UTC, 0 replies.
- Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster - posted by SRK <sw...@gmail.com> on 2017/08/25 19:19:07 UTC, 8 replies.
- Why do checkpoints work the way they do? - posted by Hugo Reinwald <hu...@gmail.com> on 2017/08/26 02:41:51 UTC, 2 replies.
- pyspark on windows (Upgrade from 1.6 to 2.0.2): sqlContext.read.format fails - posted by Shiv Onkar Kumar <sh...@yahoo.com.INVALID> on 2017/08/26 04:13:11 UTC, 0 replies.
- Kafka Consumer Pre Fetch Messages + Async commits - posted by Julia Wistance <ju...@gmail.com> on 2017/08/26 06:07:31 UTC, 2 replies.
- spark dataframe jdbc Amazon RDS problem - posted by 刘虓 <ip...@gmail.com> on 2017/08/26 17:00:17 UTC, 1 replies.
- different behaviour linux/Unix vs windows when load spark context in scala method called from R function using rscala package - posted by Simone Pallotta <si...@mail.polimi.it> on 2017/08/27 07:46:53 UTC, 1 replies.
- Kill Spark Streaming JOB from Spark UI or Yarn - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/27 17:27:29 UTC, 1 replies.
- [Spark Streaming] One Batch hangs always and others process correctly - posted by 李书明 <al...@126.com> on 2017/08/28 07:27:41 UTC, 1 replies.
- Oracle Table not resolved [Spark 2.1.1] - posted by Imran Rajjad <ra...@gmail.com> on 2017/08/28 08:06:46 UTC, 2 replies.
- add me to email list - posted by Michael Artz <mi...@gmail.com> on 2017/08/28 12:43:24 UTC, 1 replies.
- Time window on Processing Time - posted by madhu phatak <ph...@gmail.com> on 2017/08/28 12:46:33 UTC, 2 replies.
- Predicate Pushdown Doesn't Work With Data Source API - posted by Anton Puzanov <AN...@il.ibm.com> on 2017/08/28 12:48:46 UTC, 0 replies.
- Spark 2.2 structured streaming with mapGroupsWithState + window functions - posted by daniel williams <da...@gmail.com> on 2017/08/28 14:06:35 UTC, 1 replies.
- Collecting Multiple Aggregation query result on one Column as collectAsMap - posted by Patrick <ti...@gmail.com> on 2017/08/28 14:47:05 UTC, 6 replies.
- Spark SQL vs HiveQL - posted by Michael Artz <mi...@gmail.com> on 2017/08/28 14:50:25 UTC, 3 replies.
- Help taking last value in each group (aggregates) - posted by Everett Anderson <ev...@nuna.com.INVALID> on 2017/08/28 16:19:17 UTC, 1 replies.
- Re: apache thrift server - posted by MidwestMike <mi...@gmail.com> on 2017/08/28 16:26:18 UTC, 0 replies.
- from_json() - posted by JG Perrin <jp...@lumeris.com> on 2017/08/28 16:57:40 UTC, 3 replies.
- [Spark Streaming] Application is stopped after stopping a worker - posted by "Davide.Mandrini" <da...@gmail.com> on 2017/08/28 19:36:48 UTC, 0 replies.
- Referencing YARN application id, YARN container hostname, Executor ID and YARN attempt for jobs running on Spark EMR 5.7.0 in log statements? - posted by "Mikhailau, Alex" <Al...@mlb.com> on 2017/08/28 20:43:45 UTC, 4 replies.
- use WithColumn with external function in a java jar - posted by purna pradeep <pu...@gmail.com> on 2017/08/29 01:23:46 UTC, 2 replies.
- unable to import graphframes - posted by Imran Rajjad <ra...@gmail.com> on 2017/08/29 07:13:52 UTC, 0 replies.
- Terminating Structured Streaming Applications on Source Failure - posted by Yuval Itzchakov <yu...@gmail.com> on 2017/08/29 09:09:18 UTC, 2 replies.
- Spark 2.0.0 and Hive metastore - posted by Andrés Ivaldi <ia...@gmail.com> on 2017/08/29 13:34:25 UTC, 2 replies.
- setup and cleanup function in spark - posted by Mohammad Kargar <mk...@phemi.com> on 2017/08/29 15:12:59 UTC, 0 replies.
- Spark standalone API... - posted by muthu <ba...@gmail.com> on 2017/08/29 15:41:32 UTC, 0 replies.
- Re: Kill Spark Application programmatically in Spark standalone cluster - posted by muthu <ba...@gmail.com> on 2017/08/29 15:45:01 UTC, 0 replies.
- add arraylist to dataframe - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2017/08/29 18:21:15 UTC, 1 replies.
- How to select the entire row that has max timestamp for every key in Spark Structured Streaming 2.1.1? - posted by kant kodali <ka...@gmail.com> on 2017/08/29 19:59:40 UTC, 15 replies.
- Spark2 create hive external table - posted by antoniosi <an...@gmail.com> on 2017/08/29 22:48:56 UTC, 0 replies.
- Select entire row based on a logic applied on 2 columns across multiple rows - posted by purna pradeep <pu...@gmail.com> on 2017/08/30 00:11:23 UTC, 7 replies.
- [Upvote] for Apache Spark for 2017 Innovation Award - posted by Jules Damji <dm...@comcast.net> on 2017/08/30 01:41:48 UTC, 0 replies.
- spark streaming and reactive streams - posted by Mich Talebzadeh <mi...@gmail.com> on 2017/08/30 07:37:47 UTC, 0 replies.
- Different watermark for different kafka partitions in Structured Streaming - posted by 张万新 <ke...@gmail.com> on 2017/08/30 07:54:18 UTC, 3 replies.
- [SS] StateStoreSaveExec in Complete output mode and metrics in stateOperators - posted by Jacek Laskowski <ja...@japila.pl> on 2017/08/30 08:59:02 UTC, 0 replies.
- Re: Updates on migration guides - posted by Nick Pentreath <ni...@gmail.com> on 2017/08/30 15:21:11 UTC, 0 replies.
- Sync commit to kafka 0.10 - posted by "krot.vyacheslav" <kr...@gmail.com> on 2017/08/30 15:29:30 UTC, 0 replies.
- Do we always need to go through spark-submit? - posted by kant kodali <ka...@gmail.com> on 2017/08/30 15:57:24 UTC, 2 replies.
- [Structured Streaming]Data processing and output trigger should be decoupled - posted by KevinZwx <ke...@gmail.com> on 2017/08/30 16:26:01 UTC, 2 replies.
- Python UDF to convert timestamps (performance question) - posted by Brian Wylie <br...@gmail.com> on 2017/08/30 18:45:40 UTC, 2 replies.
- Design aspects of Data partitioning for Window functions - posted by Vasu Gourabathina <vg...@gmail.com> on 2017/08/30 19:33:48 UTC, 0 replies.
- [Structured Streaming]Usage of watermark - posted by KevinZwx <ke...@gmail.com> on 2017/08/31 06:42:47 UTC, 0 replies.
- Re: Issue with Spark Twitter Streaming - posted by grumi <gm...@gmail.com> on 2017/08/31 11:16:53 UTC, 0 replies.
- Delay in Initial Execution Time in Spark for Benchmarking Parquet - posted by austinldv <au...@gmail.com> on 2017/08/31 16:27:06 UTC, 0 replies.
- Inconsistent results with combineByKey API - posted by Swapnil Shinde <sw...@gmail.com> on 2017/08/31 16:27:32 UTC, 0 replies.
- Cloudwatch metrics sink problem - posted by "Mikhailau, Alex" <Al...@mlb.com> on 2017/08/31 21:50:07 UTC, 0 replies.
- [SPARK-SQL] Spark Persist slower than non-persist calls - posted by saurabh raval <sf...@yahoo.com.INVALID> on 2017/08/31 21:58:13 UTC, 0 replies.
- Re: Checkpointing With NOT Serializable - posted by ayan guha <gu...@gmail.com> on 2017/08/31 23:44:36 UTC, 0 replies.