You are viewing a plain text version of this content. The canonical link for it is here.
- Re: [Spark Core, PySpark] Separate stage level scheduling for consecutive map functions - posted by Gourav Sengupta <go...@gmail.com> on 2021/08/01 16:53:38 UTC, 5 replies.
- Sparse vs. Dense vector memory usage - posted by Gerard Maas <ge...@gmail.com> on 2021/08/02 20:01:32 UTC, 0 replies.
- Reading the last line of each file in a set of text files - posted by Sayeh Roshan <ag...@gmail.com> on 2021/08/02 22:50:44 UTC, 1 replies.
- Collecting list of errors across executors - posted by Sachit Murarka <co...@gmail.com> on 2021/08/03 07:51:48 UTC, 1 replies.
- Unsubscribe - posted by Edward Wu <da...@gmail.com> on 2021/08/03 14:15:27 UTC, 11 replies.
- UnspecifiedDistribution Error using AQE - posted by Jesse Lord <jl...@vectra.ai.INVALID> on 2021/08/03 18:36:53 UTC, 1 replies.
- How can I write data to hive with jdbc - posted by igyu <ig...@21cn.com> on 2021/08/04 09:33:49 UTC, 3 replies.
- Convert timestamp to unix miliseconds - posted by Tzahi File <tz...@is.com.INVALID> on 2021/08/04 20:42:47 UTC, 1 replies.
- How can transform RDD[Seq[String]] to RDD[ROW] - posted by igyu <ig...@21cn.com> on 2021/08/05 07:14:38 UTC, 2 replies.
- Reading SPARK 3.1.x generated parquet in SPARK 2.4.x - posted by Gourav Sengupta <go...@gmail.com> on 2021/08/05 08:17:45 UTC, 0 replies.
- Re: Performance Problems Migrating to S3A Committers - posted by James Yu <ja...@ispot.tv> on 2021/08/05 21:22:06 UTC, 0 replies.
- Is operation subtracting two dataframe valid. - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/08/06 22:08:38 UTC, 0 replies.
- Rotating expired kubernetes oauth token (SPARK-27997) - posted by "Alfred S." <me...@haodemon.com> on 2021/08/07 00:32:49 UTC, 0 replies.
- error: java.lang.UnsupportedOperationException: sun.misc.Unsafe or java.nio.DirectByteBuffer.(long, int) not available - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/08/07 18:08:25 UTC, 6 replies.
- How can I read ftp - posted by igyu <ig...@21cn.com> on 2021/08/09 03:17:49 UTC, 2 replies.
- How can I write to ftp - posted by igyu <ig...@21cn.com> on 2021/08/09 06:56:06 UTC, 0 replies.
- Is the pandas version in doc of using pyarrow in spark wrong - posted by Jeff Zhang <zj...@gmail.com> on 2021/08/09 09:24:24 UTC, 0 replies.
- unsubscribe - posted by Vijay Gharge <vi...@gmail.com> on 2021/08/09 13:24:03 UTC, 0 replies.
- Performance of PySpark jobs on the Kubernetes cluster - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/08/09 19:20:03 UTC, 3 replies.
- How can I write data to ftp - posted by igyu <ig...@21cn.com> on 2021/08/10 00:55:51 UTC, 0 replies.
- ExecutorMoniitor timeout - posted by Zhenyu Hu <cs...@gmail.com> on 2021/08/10 06:41:05 UTC, 0 replies.
- Spark Streaming - unpersist() method's execution time gradually increase with time - posted by András Kolbert <ko...@gmail.com> on 2021/08/10 07:35:49 UTC, 4 replies.
- Facing weird problem while reading Parquet - posted by Prateek Rajput <pr...@flipkart.com.INVALID> on 2021/08/10 08:02:01 UTC, 0 replies.
- Spark Issues while upgrade to 2.4 from 1.6 in Parcels - posted by Harsh Sharma <ha...@gmail.com> on 2021/08/11 07:44:22 UTC, 0 replies.
- How can I write data to hive with spark jdbc - posted by igyu <ig...@21cn.com> on 2021/08/11 09:31:38 UTC, 2 replies.
- I can't write data to hive with spark jdbc - posted by igyu <ig...@21cn.com> on 2021/08/11 09:55:52 UTC, 0 replies.
- Dynamic Allocation& ExecutorMonitor Shuffle Timeout & CacheTimeout - posted by Zhenyu Hu <cs...@gmail.com> on 2021/08/11 16:35:03 UTC, 0 replies.
- about ShellBasedUnixGroupsMapping question - posted by igyu <ig...@21cn.com> on 2021/08/12 02:04:37 UTC, 0 replies.
- Spark DStream Dynamic Allocation - posted by Zhenyu Hu <cs...@gmail.com> on 2021/08/12 02:33:29 UTC, 0 replies.
- Spark Structured Streaming Dyanamic Allocation - posted by Zhenyu Hu <cs...@gmail.com> on 2021/08/12 02:35:40 UTC, 0 replies.
- Register an Aggregator as an UDAF for Spark SQL 3 - posted by AlstonWilliams <ps...@gmail.com> on 2021/08/12 03:20:11 UTC, 0 replies.
- How can I config hive.metastore.warehouse.dir - posted by igyu <ig...@21cn.com> on 2021/08/12 03:31:59 UTC, 2 replies.
- Missing accumulator data when a task is speculated and the original task fails with TaskCommitDenied - posted by jelmer <jk...@gmail.com> on 2021/08/12 08:34:02 UTC, 0 replies.
- K8S submit client vs. cluster - posted by "Bode, Meikel, NMA-CFD" <Me...@Bertelsmann.de> on 2021/08/12 11:34:54 UTC, 5 replies.
- Re: [EXTERNAL] [Marketing Mail] Reading SPARK 3.1.x generated parquet in SPARK 2.4.x - posted by Saurabh Gulati <sa...@fedex.com.INVALID> on 2021/08/12 15:14:51 UTC, 1 replies.
- Replacing BroadcastNestedLoopJoin - posted by Eric Beabes <ma...@gmail.com> on 2021/08/12 23:10:13 UTC, 0 replies.
- Re: Naming files while saving a Dataframe - posted by Eric Beabes <ma...@gmail.com> on 2021/08/12 23:34:31 UTC, 0 replies.
- [PySpark] how to use a JAR model to score a dataset? - posted by Alex Martishius <al...@gmail.com> on 2021/08/13 12:11:34 UTC, 0 replies.
- Creating docker images for Data Science - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/08/14 06:46:52 UTC, 0 replies.
- spark-submit not running on macbook pro - posted by karan alang <ka...@gmail.com> on 2021/08/17 05:56:14 UTC, 1 replies.
- Databricks notebook - cluster taking a long time to get created, often timing out - posted by karan alang <ka...@gmail.com> on 2021/08/17 06:10:52 UTC, 2 replies.
- Java : Testing RDD aggregateByKey - posted by Pedro Tuero <tu...@gmail.com> on 2021/08/17 14:13:39 UTC, 4 replies.
- about spark on hbase problem - posted by igyu <ig...@21cn.com> on 2021/08/18 04:36:38 UTC, 0 replies.
- How can I LoadIncrementalHFiles - posted by igyu <ig...@21cn.com> on 2021/08/19 07:31:31 UTC, 0 replies.
- [Announce] Spark on MR3 - posted by Sungwoo Park <gl...@gmail.com> on 2021/08/19 12:39:01 UTC, 0 replies.
- Is memory-only no-disk Spark possible? - posted by Jacek Laskowski <ja...@japila.pl> on 2021/08/20 11:49:59 UTC, 6 replies.
- Re: Is memory-only no-disk Spark possible? [Marketing Mail] - posted by Jack Kolokasis <ko...@ics.forth.gr> on 2021/08/20 12:18:03 UTC, 0 replies.
- Spark Thriftserver is failing for when submitting command from beeline - posted by Pralabh Kumar <pr...@gmail.com> on 2021/08/20 13:50:06 UTC, 1 replies.
- How can I use sparkContext.addFile - posted by igyu <ig...@21cn.com> on 2021/08/20 15:49:39 UTC, 1 replies.
- How can I read two different hbase cluster with kerberos - posted by igyu <ig...@21cn.com> on 2021/08/23 03:53:17 UTC, 0 replies.
- AWS EMR SPARK 3.1.1 date issues - posted by Gourav Sengupta <go...@gmail.com> on 2021/08/23 10:11:37 UTC, 5 replies.
- Kafka Sink Issue - posted by Amit Sharma <am...@gmail.com> on 2021/08/23 14:17:39 UTC, 0 replies.
- Processing Multiple Streams in a Single Job - posted by Artemis User <ar...@dtechspace.com> on 2021/08/24 22:36:02 UTC, 8 replies.
- From scala to sql - posted by Rita RSilva <ri...@gmail.com> on 2021/08/25 07:43:30 UTC, 5 replies.
- Spark Structured Streaming Continuous Trigger on multiple sinks - posted by S <sh...@gmail.com> on 2021/08/25 08:44:48 UTC, 0 replies.
- [ANNOUNCE] Apache Zeppelin 0.10.0 is released, Spark on Zeppelin Improved - posted by Jeff Zhang <zj...@gmail.com> on 2021/08/26 16:05:42 UTC, 0 replies.
- Spark submit on openshift - posted by Markus Gierich <Ma...@fiduciagad.de> on 2021/08/27 08:07:26 UTC, 0 replies.
- Performance Degradation in Spark 3.0.2 compared to Spark 3.0.1 - posted by "Sharma, Prakash (Nokia - IN/Bangalore)" <pr...@nokia.com> on 2021/08/27 12:01:57 UTC, 5 replies.
- Classpath conflicts. - posted by Jatin Puri <ja...@microsoft.com.INVALID> on 2021/08/27 12:57:31 UTC, 1 replies.
- Re: [EXTERNAL] Re: Classpath conflicts. - posted by Jatin Puri <ja...@microsoft.com.INVALID> on 2021/08/27 14:03:17 UTC, 0 replies.
- Question regarding Projection PushDown - posted by satyajit vegesna <sa...@gmail.com> on 2021/08/27 18:29:12 UTC, 0 replies.
- Issue with spark 3.1.2 accessing Cloud bucket throwing errors - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/08/28 08:08:40 UTC, 0 replies.
- java.lang.AssertionError: assertion failed: Found duplicate rewrite attributes - posted by Kiran Biswal <bi...@gmail.com> on 2021/08/28 21:44:04 UTC, 0 replies.
- Can���t write to PVC in K8S - posted by Bj��rn J��rgensen <bj...@gmail.com> on 2021/08/30 13:07:49 UTC, 2 replies.
- Connection reset by peer : failed to remove cache rdd - posted by Harsh Sharma <ha...@gmail.com> on 2021/08/30 13:26:05 UTC, 1 replies.
- Re: Can’t write to PVC in K8S - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/08/30 20:50:22 UTC, 6 replies.
- spark 3.2 release date - posted by infa elance <in...@gmail.com> on 2021/08/31 04:06:25 UTC, 1 replies.
- Spark Stream on Kubernetes Cannot Set up JavaSparkContext - posted by Stelios Philippou <st...@gmail.com> on 2021/08/31 07:44:21 UTC, 3 replies.
- memory_and_disk persistence level algorithm - posted by Zilvinas Saltys <zi...@verizonmedia.com.INVALID> on 2021/08/31 13:18:22 UTC, 0 replies.