You are viewing a plain text version of this content. The canonical link for it is here.
- Re: Ubuntu 18.04: Docker: start-master.sh: command not found - posted by JB Data31 <jb...@gmail.com> on 2021/04/01 05:33:51 UTC, 1 replies.
- RE: FW: Email to Spark Org please - posted by "Williams, David (Risk Value Stream)" <Da...@Lloydsbanking.com.INVALID> on 2021/04/01 15:35:07 UTC, 1 replies.
- PySpark functions for various sources and sinks - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/02 11:29:41 UTC, 0 replies.
- [SPARK SQL] Sometimes spark does not scale down on k8s - posted by Alexei <dm...@yandex.ru> on 2021/04/02 14:47:25 UTC, 1 replies.
- Writing to Google Cloud Storage with v2 algorithm safe? - posted by Jacek Laskowski <ja...@japila.pl> on 2021/04/03 16:12:21 UTC, 4 replies.
- Spark structured streaming + offset management in kafka + kafka headers - posted by Ali Gouta <al...@gmail.com> on 2021/04/03 19:02:07 UTC, 8 replies.
- Re: Source.getBatch and schema vs qe.analyzed.schema? - posted by Jacek Laskowski <ja...@japila.pl> on 2021/04/03 21:45:32 UTC, 0 replies.
- Ordering pushdown for Spark Datasources - posted by Kohki Nishio <ta...@gmail.com> on 2021/04/04 22:53:58 UTC, 3 replies.
- Spark doesn't add _SUCCESS file when 'partitionBy' is used - posted by Eric Beabes <ma...@gmail.com> on 2021/04/05 16:48:49 UTC, 0 replies.
- Tuning spark job to make count faster. - posted by Krishna Chakka <kr...@gmail.com> on 2021/04/06 06:59:20 UTC, 0 replies.
- jar incompatibility with Spark 3.1.1 for structured streaming with kafka - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/06 08:14:09 UTC, 18 replies.
- Re: Spark Structured Streaming with PySpark throwing error in execution - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/06 10:07:21 UTC, 0 replies.
- unsubscribe - posted by Latha Appanna <la...@gmail.com> on 2021/04/06 10:09:22 UTC, 0 replies.
- Dynamic Allocation Backlog Property in Spark on Kubernetes - posted by Ranju Jain <Ra...@ericsson.com.INVALID> on 2021/04/06 11:58:30 UTC, 6 replies.
- Re: Tuning spark job to make count faster. - posted by Sean Owen <sr...@gmail.com> on 2021/04/06 12:23:20 UTC, 0 replies.
- Spark performance over S3 - posted by Tzahi File <tz...@ironsrc.com> on 2021/04/06 18:44:53 UTC, 6 replies.
- Data Lakes using Spark - posted by Boris Litvak <bo...@skf.com> on 2021/04/07 06:32:58 UTC, 0 replies.
- Mesos + Spark users going forward? - posted by Sean Owen <sr...@apache.org> on 2021/04/07 12:11:35 UTC, 2 replies.
- Re: Invite Spark community as Pulsar Summit NA 2021 Community Partner - posted by Dianjin Wang <dj...@streamnative.io.INVALID> on 2021/04/07 14:17:34 UTC, 0 replies.
- Apache ML Agorithm Solution - posted by "SRITHALAM, ANUPAMA (Risk Value Stream)" <An...@lloydsbanking.com.INVALID> on 2021/04/07 16:12:58 UTC, 0 replies.
- Re: Apache ML Agorithm Solution - posted by Adi Polak <po...@gmail.com> on 2021/04/07 16:43:26 UTC, 2 replies.
- How to adapt PySpark to optimize handling of large no. of partitions? - posted by iashiq5 <is...@gmail.com> on 2021/04/07 20:29:56 UTC, 0 replies.
- Big Broadcast Hash Join with Dynamic Partition Pruning gives wrong results - posted by Tomas Bartalos <to...@gmail.com> on 2021/04/07 23:51:24 UTC, 1 replies.
- Why is Spark 3.0.x is faster than Spark 3.1.x - posted by maziyar <ma...@iscpif.fr> on 2021/04/08 10:38:24 UTC, 0 replies.
- Why is Spark 3.0.x faster than Spark 3.1.x - posted by maziyar <ma...@iscpif.fr> on 2021/04/08 10:47:10 UTC, 13 replies.
- possible bug - posted by "Weiand, Markus, NMA-CFD" <ma...@bertelsmann.de> on 2021/04/08 12:52:11 UTC, 12 replies.
- Evaluating Apache Spark with Data Orchestration using TPC-DS - posted by Bin Fan <fa...@gmail.com> on 2021/04/08 20:25:09 UTC, 0 replies.
- [Spark SQL]:to calculate distance between four coordinates(Latitude1, Longtitude1, Latitude2, Longtitude2) in the pysaprk dataframe - posted by Rao Bandaru <ra...@outlook.com> on 2021/04/09 11:24:37 UTC, 6 replies.
- How to use spark steaming data to plot live line chart - posted by Muhammed Favas <fa...@expeedsoftware.com> on 2021/04/09 12:33:55 UTC, 3 replies.
- GPU job in Spark 3 - posted by Martin Somers <so...@gmail.com> on 2021/04/09 16:18:10 UTC, 5 replies.
- Spark Hbase Hive error in EMR - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/09 18:15:20 UTC, 0 replies.
- Automated setup of a multi-node cluster for Apache Spark - posted by Dhruv Kumar <ga...@gmail.com> on 2021/04/10 08:51:18 UTC, 1 replies.
- Tasks are skewed to one executor - posted by AndrĂ¡s Kolbert <ko...@gmail.com> on 2021/04/10 13:26:53 UTC, 24 replies.
- Spark and Bintray's shutdown - posted by Florian CASTELAIN <Fl...@redlab.io> on 2021/04/12 16:05:24 UTC, 3 replies.
- Spark Session error with 30s - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/12 18:55:38 UTC, 6 replies.
- [Spark Core][Advanced]: Problem with data locality when running Spark query with local nature on apache Hadoop - posted by Mohamadreza Rostami <mo...@gmail.com> on 2021/04/13 08:47:19 UTC, 2 replies.
- Spark2.4 json Jackson errors - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/13 23:46:38 UTC, 0 replies.
- Overirde Jackson jar - Spark Submit - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/14 15:57:20 UTC, 0 replies.
- Python level of knowledge for Spark and PySpark - posted by "ashok34668@yahoo.com.INVALID" <as...@yahoo.com.INVALID> on 2021/04/14 16:18:24 UTC, 3 replies.
- Spark submit hbase issue - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/14 21:38:59 UTC, 1 replies.
- full SQL query graph not shown in monitoring when using cache - posted by Kalin Stoyanov <kg...@gmail.com> on 2021/04/15 12:54:18 UTC, 4 replies.
- Column names returned as rows and other jdbc weirdness - posted by Alun ap Rhisiart <co...@alunaprhisiart.uk> on 2021/04/16 11:13:55 UTC, 3 replies.
- Loading Hadoop-Azure in Kubernetes - posted by Nick Stenroos-Dam <Ni...@project.bi> on 2021/04/16 13:25:37 UTC, 4 replies.
- [Spark Core][Advanced]: Wrong memory allocation on standalone mode cluster - posted by Mohamadreza Rostami <mo...@gmail.com> on 2021/04/18 09:07:41 UTC, 1 replies.
- 4th generation Data Warehousing and Spark - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/18 20:17:15 UTC, 1 replies.
- Mapping stages in DAG to line of code in pyspark - posted by Dhruv Kumar <dh...@umn.edu.INVALID> on 2021/04/19 01:27:19 UTC, 0 replies.
- Re: Column names returned as rows and other jdbc weirdness --Solved - posted by Alun ap Rhisiart <co...@alunaprhisiart.uk> on 2021/04/19 10:08:49 UTC, 1 replies.
- Regarding ParquetDataSourceV2 - posted by rvakkada <ra...@gmail.com> on 2021/04/19 16:50:46 UTC, 0 replies.
- Spark Issue : Reg - posted by Rakesh Eppa <ra...@gmail.com> on 2021/04/20 10:39:54 UTC, 0 replies.
- spark hbase - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/20 21:30:48 UTC, 0 replies.
- Graceful shutdown SPARK Structured Streaming - posted by Gourav Sengupta <go...@gmail.com> on 2021/04/21 09:06:28 UTC, 0 replies.
- Benchmarks for Many-to-Many Joins - posted by Dhruv Kumar <dh...@umn.edu.INVALID> on 2021/04/21 16:55:28 UTC, 1 replies.
- Spark Structured Streaming 'bool' object is not callable, quitting - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/21 22:34:55 UTC, 3 replies.
- Dealing with two topics in Spark Structured Streaming - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/22 09:29:42 UTC, 5 replies.
- Spark RDD - HBASE error - posted by KhajaAsmath Mohammed <md...@gmail.com> on 2021/04/22 13:25:17 UTC, 0 replies.
- Shutting down spark structured streaming when the streaming process completed current process - posted by Mich Talebzadeh <mi...@gmail.com> on 2021/04/23 09:36:50 UTC, 1 replies.
- Sleep behavior - posted by Praneeth Shishtla <pr...@gmail.com> on 2021/04/23 10:51:18 UTC, 0 replies.
- Re: java.lang.IllegalArgumentException: Unsupported class file major version 55 - posted by chansonzhang <zh...@gmail.com> on 2021/04/23 14:04:20 UTC, 1 replies.
- Spark Streaming with Files - posted by ayan guha <gu...@gmail.com> on 2021/04/23 14:39:36 UTC, 2 replies.
- pyspark sql load with path of special character - posted by Regin Quinoa <sw...@gmail.com> on 2021/04/23 15:29:37 UTC, 1 replies.
- Accelerating Spark SQL / Dataframe using GPUs & Alluxio - posted by Bin Fan <fa...@gmail.com> on 2021/04/23 17:54:03 UTC, 0 replies.
- Is a Hive installation necessary for Spark SQL? - posted by krchia <ka...@gmail.com> on 2021/04/25 09:38:33 UTC, 1 replies.
- Talk info share - "Advancing GPU Analytics with RAPIDS Accelerator for Spark and Alluxio" - posted by Jasmine Wang <ja...@alluxio.com> on 2021/04/26 04:16:04 UTC, 0 replies.
- Bintray replacement for spark-packages.org - posted by Bo Zhang <bo...@databricks.com> on 2021/04/26 06:55:06 UTC, 2 replies.
- [Spark-Streaming] moving average on categorical data with time windowing - posted by halil <ha...@gmail.com> on 2021/04/26 14:27:43 UTC, 1 replies.
- Spark Streaming non functional requirements - posted by "ashok34668@yahoo.com.INVALID" <as...@yahoo.com.INVALID> on 2021/04/26 15:52:30 UTC, 3 replies.
- [Spark in Kubernetes] Question about running in client mode - posted by Shiqi Sun <ja...@gmail.com> on 2021/04/26 22:02:14 UTC, 2 replies.
- com.google.protobuf.Parser.parseFrom() method Can't use in spark - posted by null <10...@qq.com> on 2021/04/27 02:38:07 UTC, 2 replies.
- How to calculate percentiles in Scala Spark 2.4.x - posted by Ivan Petrov <ca...@gmail.com> on 2021/04/27 08:52:00 UTC, 1 replies.
- Handling skew in window functions - posted by Michael Doo <mi...@gopuff.com> on 2021/04/27 21:14:34 UTC, 3 replies.
- [Announcement] Analytics Zoo 0.10.0 release - posted by Jason Dai <ja...@gmail.com> on 2021/04/28 14:46:59 UTC, 0 replies.
- [Spark SQL]: Does Spark SQL can have better performance? - posted by Amin Borjian <bo...@outlook.com> on 2021/04/29 05:09:32 UTC, 1 replies.
- Spark DataFrame CodeGeneration in Java generates Scala specific code? - posted by Rico Bergmann <in...@ricobergmann.de> on 2021/04/29 12:39:33 UTC, 5 replies.
- Re: DataSource API v2 & Spark-SQL - posted by roizaig <ro...@gmail.com> on 2021/04/29 12:42:17 UTC, 0 replies.
- Limiting initial execution in spark structured steaming - posted by dimakamalov <di...@gmail.com> on 2021/04/29 20:51:46 UTC, 1 replies.
- Spark JDBC errors out - posted by Farhan Misarwala <fa...@gmail.com> on 2021/04/30 08:31:32 UTC, 3 replies.
- Cypher language on spark - posted by jonnysettle <jo...@googlemail.com.INVALID> on 2021/04/30 09:26:50 UTC, 1 replies.
- Recursive Queries or Recursive UDF? - posted by "Bode, Meikel, NMA-CFD" <Me...@Bertelsmann.de> on 2021/04/30 10:16:04 UTC, 0 replies.
- [Spark Catalog API] Support for metadata Backup/Restore - posted by Tianchen Zhang <du...@gmail.com> on 2021/04/30 20:32:31 UTC, 0 replies.