You are viewing a plain text version of this content. The canonical link for it is here.
- Re: Structuring a PySpark Application - posted by Gourav Sengupta <go...@gmail.com> on 2021/07/01 00:08:13 UTC, 4 replies.
- OutOfMemoryError - posted by javaguy Java <ja...@gmail.com> on 2021/07/01 05:09:39 UTC, 3 replies.
- Hive on Spark vs Spark on Hive(HiveContext) - posted by Pralabh Kumar <pr...@gmail.com> on 2021/07/01 09:51:17 UTC, 3 replies.
- Increase batch interval in case of delay - posted by András Kolbert <ko...@gmail.com> on 2021/07/01 11:31:27 UTC, 3 replies.
- Unsubscribe - posted by kushagra deep <ku...@gmail.com> on 2021/07/01 12:55:53 UTC, 15 replies.
- [Spark conf setting] spark.sql.parquet.cacheMetadata = true still invalidates cache in memory. - posted by Parag Mohanty <pa...@gmail.com> on 2021/07/01 14:25:12 UTC, 0 replies.
- RE: DataSource API v2 & Spark-SQL - posted by "Lavelle, Shawn" <Sh...@osii.com.INVALID> on 2021/07/02 13:01:10 UTC, 0 replies.
- How to run spark benchmark on standalone cluster? - posted by Kevin Su <pi...@gmail.com> on 2021/07/02 14:41:45 UTC, 0 replies.
- Spark AQE Post-Shuffle partitions coalesce don't work as expected, and even make data skew in some partitions. Need help to debug issue. - posted by Nick Grigoriev <gr...@gmail.com> on 2021/07/03 13:45:23 UTC, 3 replies.
- Spark on minikube hanging when doing simple rdd.collect() - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/04 11:56:51 UTC, 2 replies.
- RE: Thrift2 Server on Kubernetes? - posted by "Bode, Meikel, NMA-CFD" <Me...@Bertelsmann.de> on 2021/07/05 08:13:34 UTC, 0 replies.
- Bechmarks on Spark running on Yarn versus Spark on K8s - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/05 17:42:27 UTC, 9 replies.
- How to specify “positive class” in sparkml classification? - posted by Reed Villanueva <vi...@gmail.com> on 2021/07/08 00:18:47 UTC, 1 replies.
- Re: Spark on Kubernetes scheduler variety - posted by Holden Karau <ho...@pigscanfly.ca> on 2021/07/08 18:04:15 UTC, 1 replies.
- Spark problem - posted by shashank patel <pa...@gmail.com> on 2021/07/09 06:04:57 UTC, 0 replies.
- [Spark Structured Streaming] retry/replay failed messages - posted by Bruno Oliveira <br...@gmail.com> on 2021/07/09 07:40:49 UTC, 12 replies.
- spark perform slow in eclipse rich client platform - posted by ji...@xtronica.no on 2021/07/09 19:52:04 UTC, 0 replies.
- Why planInputPartitions is called multiple times in a micro-batch? - posted by kineret M <ki...@gmail.com> on 2021/07/12 10:33:36 UTC, 0 replies.
- Performance Improvement with Hive/Thrift Server - posted by Artemis User <ar...@dtechspace.com> on 2021/07/12 15:14:23 UTC, 0 replies.
- Re: CVEs - posted by Eric Richardson <ek...@gmail.com> on 2021/07/12 17:44:40 UTC, 0 replies.
- Question about query local dirs when fetching HostLocalBlocks - posted by 徐涛 <xu...@163.com> on 2021/07/13 07:24:04 UTC, 0 replies.
- How to generate unique incrementing identifier in a structured streaming dataframe - posted by Felix Kizhakkel Jose <fe...@gmail.com> on 2021/07/13 18:52:25 UTC, 6 replies.
- Unable to write data into hive table using Spark via Hive JDBC driver Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED - posted by Badrinath Patchikolla <pb...@gmail.com> on 2021/07/15 08:37:51 UTC, 9 replies.
- Re: compile spark 3.1.1 error - posted by jiahong li <mo...@gmail.com> on 2021/07/15 08:54:38 UTC, 0 replies.
- [Spark SQL] : at org.apache.spark.sql.execution.datasources.orc.OrcColumnVector.getDecimal(OrcColumnVector.java:158) - posted by Ragini Manjaiah <ra...@gmail.com> on 2021/07/15 09:19:44 UTC, 0 replies.
- Blog post introducing (Apache) DataFu-Spark - posted by Eyal Allweil <ey...@apache.org> on 2021/07/15 17:36:37 UTC, 0 replies.
- Naming files while saving a Dataframe - posted by Eric Beabes <ma...@gmail.com> on 2021/07/16 23:10:14 UTC, 8 replies.
- import yaml fails with docker or kubernetes but works ok when run wiyh YARN - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/19 10:26:58 UTC, 0 replies.
- unsubscribe - posted by Du Li <li...@gmail.com> on 2021/07/20 19:11:23 UTC, 0 replies.
- Unpacking and using external modules with PySpark inside k8s - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/20 21:51:10 UTC, 0 replies.
- Advanced GC Tuning - posted by "Kuznetsov, Oleksandr" <ol...@deloitte.com.INVALID> on 2021/07/20 22:38:07 UTC, 1 replies.
- Append to an existing Delta Lake using structured streaming - posted by eu...@gmail.com on 2021/07/21 09:49:55 UTC, 2 replies.
- This is a blog post explaining how to use a new Spark library, datafu-spark - posted by Shay Elbaz <se...@paypal.com.INVALID> on 2021/07/21 11:15:29 UTC, 0 replies.
- [Announcement] Analytics Zoo 0.11.0 release - posted by Jason Dai <ja...@gmail.com> on 2021/07/22 00:09:37 UTC, 0 replies.
- [Spark SQL] Why doesn't Spark SQL use code generation for my custom expression? - posted by Han You <yo...@umich.edu> on 2021/07/23 15:04:05 UTC, 0 replies.
- Kubernetes reading a yaml file with Pyspark fails - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/23 18:57:16 UTC, 0 replies.
- Installing Distributed apache spark cluster with Cluster mode on Docker - posted by Dinakar Chennubotla <ch...@gmail.com> on 2021/07/24 09:06:35 UTC, 9 replies.
- spark-submit --files causes spark context to fail in Kubernetes - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/24 10:50:16 UTC, 0 replies.
- Why PySpark with spark-submit throws error trying to untar --archives pyspark_venv.tar.gz - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/26 18:43:01 UTC, 0 replies.
- Shutdown Spark application with failed state - posted by Anil Dasari <ad...@guidewire.com> on 2021/07/26 21:18:52 UTC, 1 replies.
- Spark Architecture Question - posted by Renganathan Mutthiah <re...@gmail.com> on 2021/07/29 11:47:08 UTC, 1 replies.
- Connection Reset by Peer : failed to remove cached rdd - posted by "Big data developer need help relat to spark gateway roles in 2.0" <ha...@gmail.com> on 2021/07/29 12:46:01 UTC, 3 replies.
- Well balanced Python code with Pandas compared to PySpark - posted by "ashok34668@yahoo.com.INVALID" <as...@yahoo.com.INVALID> on 2021/07/29 13:02:52 UTC, 2 replies.
- Hacking my way through Kubernetes docker file - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/07/29 21:56:52 UTC, 0 replies.
- Running Spark Rapids on GPU-Powered Spark Cluster - posted by Artemis User <ar...@dtechspace.com> on 2021/07/30 01:44:48 UTC, 6 replies.
- How can I sync 2 hive cluster - posted by igyu <ig...@21cn.com> on 2021/07/30 02:47:10 UTC, 0 replies.
- How can I write data with hive.metastore.uris parameter - posted by igyu <ig...@21cn.com> on 2021/07/30 04:47:59 UTC, 0 replies.
- How can I write data to hive with jdbc - posted by igyu <ig...@21cn.com> on 2021/07/30 09:21:09 UTC, 1 replies.
- Cloudera Parcel : spark issues after upgrade 1.6 to 2.4 - posted by Harsh Sharma <ha...@gmail.com> on 2021/07/30 13:34:54 UTC, 0 replies.
- Re: Cloudera Parcel : spark issues after upgrade 1.6 to 2.4 - posted by Sean Owen <sr...@gmail.com> on 2021/07/30 13:36:46 UTC, 0 replies.
- Spark-SQL plugin into HIVE - posted by Renganathan Mutthiah <re...@gmail.com> on 2021/07/30 17:42:36 UTC, 0 replies.
- [Spark Core, PySpark] Separate stage level scheduling for consecutive map functions - posted by Andreas Kunft <an...@gmail.com> on 2021/07/31 08:45:59 UTC, 1 replies.