You are viewing a plain text version of this content. The canonical link for it is here.
- [jira] [Created] (SPARK-37510) Support TimedeltaIndex in pandas API on Spark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/01 02:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/01 02:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 02:38:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 02:38:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 02:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 02:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/01 02:46:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37497) Promote ExecutorPods[PollingSnapshot|WatchSnapshot]Source to DeveloperApi - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 02:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37503) Improve SparkSession startup issue - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/01 02:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37498) test_reuse_worker_of_parallelize_range is flaky - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/01 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/01 03:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37504) pyspark should not pass all options to session states. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 03:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37504) pyspark should not pass all options to session states. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 03:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/01 04:12:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37490) Show hint if analyzer fails due to ANSI type coercion - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/01 04:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37376) Introduce a new DataSource V2 interface HasPartitionKey - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 05:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37376) Introduce a new DataSource V2 interface HasPartitionKey - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 05:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/01 05:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37389) Check unclosed bracketed comments - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 06:23:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37330) Migrate ReplaceTableStatement to v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 06:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37330) Migrate ReplaceTableStatement to v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 06:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37487) CollectMetrics is executed twice if it is followed by a sort - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 06:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37513) additive expression of date and interval returns different data type between Spark3.2 and Spark3.1 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/01 06:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37513) Additive expression of date and interval returns different data type between Spark3.2 and Spark3.1 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/01 06:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37513) Additive expression of date and interval returns different data type between Spark3.2 and Spark3.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 06:42:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37513) Additive expression of date and interval returns different data type between Spark3.2 and Spark3.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 06:42:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 06:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 06:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37326) Support TimestampNTZ in CSV data source - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/01 07:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37326) Support TimestampNTZ in CSV data source - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/01 07:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)" - posted by "Francois MARTIN (Jira)" <ji...@apache.org> on 2021/12/01 07:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37210) An error occurred while concurrently writing to different static partitions - posted by "Zhen Wang (Jira)" <ji...@apache.org> on 2021/12/01 07:46:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37513) date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/01 07:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37458) Remove unnecessary object serialization on foreachBatch - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 08:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37458) Remove unnecessary object serialization on foreachBatch - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 08:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37513) date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/01 08:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37513) date +/- interval with only day-time fields returns different data type between Spark3.2 and Spark3.1 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/01 08:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/01 08:30:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37461) yarn-client mode client's appid value is null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 08:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35332) Not Coalesce shuffle partitions when cache table - posted by "zhangyangyang (Jira)" <ji...@apache.org> on 2021/12/01 08:49:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-35332) Not Coalesce shuffle partitions when cache table - posted by "zhangyangyang (Jira)" <ji...@apache.org> on 2021/12/01 08:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37511) Introduce TimedeltaIndex to pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/01 09:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37508) Add CONTAINS() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/01 09:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37508) Add CONTAINS() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/01 09:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/01 12:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-11150) Dynamic partition pruning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 12:15:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37460) ALTER (DATABASE|SCHEMA|NAMESPACE) ... SET LOCATION command not documented - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/01 12:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses UTC time zone - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 12:19:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/01 14:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37501) CREATE/REPLACE TABLE should qualify location for v2 command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/01 14:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 15:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37326) Support TimestampNTZ in CSV data source - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/01 15:51:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-37476) udaf doesnt work with nullable (or option of) case class result - posted by "koert kuipers (Jira)" <ji...@apache.org> on 2021/12/01 16:58:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37480) Configurations in docs/running-on-kubernetes.md are not uptodate - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/01 17:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-26589) proper `median` method for spark dataframe - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/01 17:35:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/01 23:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/01 23:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37514) Remove workarounds due to older pandas - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/12/02 00:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37514) Remove workarounds due to older pandas - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 00:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37514) Remove workarounds due to older pandas - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 00:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) - posted by "Sungpeo Kook (Jira)" <ji...@apache.org> on 2021/12/02 00:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 00:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) - posted by "Sungpeo Kook (Jira)" <ji...@apache.org> on 2021/12/02 00:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py - posted by "Jyoti Singh (Jira)" <ji...@apache.org> on 2021/12/02 01:01:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-37430) Inline type hints for python/pyspark/mllib/linalg/distributed.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/02 01:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37514) Remove workarounds due to older pandas - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/02 01:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33898) Support SHOW CREATE TABLE in v2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 03:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/02 04:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37494) Unify v1 and v2 options output of `SHOW CREATE TABLE` command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/02 04:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/02 04:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 04:54:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 04:54:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37512) Support TimedeltaIndex creation given a timedelta Series/Index - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 05:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36396) Implement DataFrame.cov - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 06:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37512) Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/02 06:33:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/02 08:08:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37517) Keep consistent order of columns with user specify for v1 table - posted by "PengLei (Jira)" <ji...@apache.org> on 2021/12/02 10:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37518) inject a early scan push down rule - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/02 10:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37518) inject a early scan push down rule - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/02 10:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37519) Support Relation With LateralView - posted by "Tongwei (Jira)" <ji...@apache.org> on 2021/12/02 10:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37519) Support Relation With LateralView - posted by "Tongwei (Jira)" <ji...@apache.org> on 2021/12/02 10:35:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37518) inject a early scan pushdown rule - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/02 11:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37518) inject a early scan pushdown rule - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 11:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37518) inject a early scan pushdown rule - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 11:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37517) Keep consistent order of columns with user specify for v1 table - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 11:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37517) Keep consistent order of columns with user specify for v1 table - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 11:38:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37520) Add the startswith() and endswith() string functions - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/02 12:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37520) Add the startswith() and endswith() string functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 12:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37520) Add the startswith() and endswith() string functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 12:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37521) insert overwrite table but didn't change the message of metastore - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/02 13:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/02 14:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37442) In AQE, wrong InMemoryRelation size estimation causes "Cannot broadcast the table that is larger than 8GB: 8 GB" failure - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/02 14:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) - posted by "Sungpeo Kook (Jira)" <ji...@apache.org> on 2021/12/02 14:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case) - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/02 17:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37450) Spark SQL reads unnecessary nested fields (another type of pruning case) - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/02 17:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37521) insert overwrite table but didn't change the message of metastore - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/02 17:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37521) insert overwrite table but didn't change the message of metastore - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/02 17:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37521) insert overwrite table but the partition information stored in Metastore was not changed - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/02 17:28:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37522) Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/02 17:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37522) Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 17:50:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37522) Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 17:50:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37522) Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/02 18:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/02 19:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 19:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 19:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)" - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/12/02 23:36:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-37508) Add CONTAINS() function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/02 23:41:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37504) pyspark should not pass all options to session states. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/02 23:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37520) Add the startswith() and endswith() string functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/03 00:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37524) We should drop all tables after testing dynamic partition pruning - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/03 02:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37524) We should drop all tables after testing dynamic partition pruning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 02:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37524) We should drop all tables after testing dynamic partition pruning - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 02:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37525) Support basic operations of timedelta Series/Index - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/03 03:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37512) Support TimedeltaIndex creation (from Series/Index) and TimedeltaIndex.astype - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/03 03:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37526) Add Java17 PySpark daily test coverage - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/03 03:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37526) Add Java17 PySpark daily test coverage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 03:18:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37526) Add Java17 PySpark daily test coverage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 03:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37527) Translate more standard aggregate functions for pushdown - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/03 03:28:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37527) Translate more standard aggregate functions for pushdown - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/03 03:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37519) Support Relation With LateralView - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 03:36:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37524) We should drop all tables after testing dynamic partition pruning - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/03 03:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-18105) LZ4 failed to decompress a stream of shuffled data - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/03 03:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37528) Support reorder tasks during scheduling by shuffle partition size in AQE - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/12/03 04:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37526) Add Java17 PySpark daily test coverage - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/03 05:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37528) Support reorder tasks during scheduling by shuffle partition size in AQE - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/12/03 05:26:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37529) Support K8s integration tests for Java 17 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/03 05:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37529) Support K8s integration tests for Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 05:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37529) Support K8s integration tests for Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 05:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37528) Support reorder tasks during scheduling by shuffle partition size in AQE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 06:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37528) Support reorder tasks during scheduling by shuffle partition size in AQE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 06:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37510) Support TimedeltaIndex in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 06:19:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37510) Support TimedeltaIndex in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 06:19:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/12/03 07:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 07:32:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 07:32:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37531) Use PyArrow 6.0.0 in PySpark UT GitHub Action job - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/03 07:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37531) Use PyArrow 6.0.0 in Python 3.9 tests at GitHub Action job - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/03 07:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37531) Use PyArrow 6.0.0 in Python 3.9 tests at GitHub Action job - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 07:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37531) Use PyArrow 6.0.0 in Python 3.9 tests at GitHub Action job - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 07:51:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37532) RDD name could be very long and memory costly - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/12/03 07:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37523) Support optimize skewed partitions in Distribution and Ordering if numPartitions is not specified - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/03 08:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37532) RDD name could be very long and memory costly - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 08:20:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37532) RDD name could be very long and memory costly - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 08:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-35162) New SQL functions: TRY_ADD/TRY_DIVIDE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 09:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37533) New SQL function: try_element_at - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/03 09:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37534) Bump dev.ludovic.netlib to 2.2.1 - posted by "Ludovic Henry (Jira)" <ji...@apache.org> on 2021/12/03 09:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37534) Bump dev.ludovic.netlib to 2.2.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 09:23:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37534) Bump dev.ludovic.netlib to 2.2.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 09:23:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37533) New SQL function: try_element_at - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 09:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37533) New SQL function: try_element_at - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 09:24:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37531) Use PyArrow 6.0.0 in Python 3.9 tests at GitHub Action job - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/03 09:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37534) Bump dev.ludovic.netlib to 2.2.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/03 09:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37534) Bump dev.ludovic.netlib to 2.2.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/03 09:34:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37530) Spark reads many paths very slow though newAPIHadoopFile - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/12/03 09:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37535) Change default spark.io.compression.codec to zstd - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/03 09:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37535) Change default spark.io.compression.codec to zstd - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 10:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37535) Change default spark.io.compression.codec to zstd - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 10:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37536) Allow for API user to disable Shuffle Operations while running locally - posted by "Rodrigo Boavida (Jira)" <ji...@apache.org> on 2021/12/03 10:37:00 UTC, 0 replies.
- [jira] (SPARK-37527) Translate more standard aggregate functions for pushdown - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/03 11:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37527) Translate more standard aggregate functions for pushdown - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 11:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-36902) Migrate CreateTableAsSelectStatement to v2 command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 13:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36902) Migrate CreateTableAsSelectStatement to v2 command - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 13:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 13:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 13:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37455) Replace hash with sort aggregate if child is already sorted - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 13:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37455) Replace hash with sort aggregate if child is already sorted - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 13:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37537) Spark 3.2.0 driver pod does not mount checkpoint filesystem from Kubernetes PVC - posted by "Petri (Jira)" <ji...@apache.org> on 2021/12/03 13:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37538) Replace single projection Expand with Project - posted by "Tanel Kiis (Jira)" <ji...@apache.org> on 2021/12/03 15:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37539) Create Spark interface for creating UDFs - posted by "Almaz Murzabekov (Jira)" <ji...@apache.org> on 2021/12/03 15:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37538) Replace single projection Expand with Project - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 15:13:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37538) Replace single projection Expand with Project - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 15:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37286) Move compileAggregates from JDBCRDD to JdbcDialect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 15:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37540) Detect more unsupported time travel - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 16:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37540) Detect more unsupported time travel - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 16:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37540) Detect more unsupported time travel - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/03 16:16:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37471) spark-sql support nested bracketed comment - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 16:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37471) spark-sql support nested bracketed comment - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/03 16:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36529) Decouple CPU with IO work in vectorized Parquet reader - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/03 17:42:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-34287) Aggregation improvement - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/12/03 22:03:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-34287) Spark aggregate improvement - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/12/03 22:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-34287) Spark Aggregate improvement - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/12/03 22:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37500) Incorrect scope when using named_windows in CTEs - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2021/12/03 22:10:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37541) Remove protobuf-java dependency from distribution - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 00:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37541) Remove protobuf-java dependency - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 00:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37541) Remove protobuf-java dependency from distribution - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 00:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37541) Remove protobuf-java dependency from distribution - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 00:55:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37541) Remove protobuf-java dependency from distribution - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 01:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/04 01:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37495) Skip identical index checking of Series.compare when config 'compute.eager_check' is disabled - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/04 01:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37510) Support TimedeltaIndex in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/04 01:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37330) Migrate ReplaceTableStatement to v2 command - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/04 02:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37542) Improve the Dynamic partition pruning - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/04 05:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37542) Improve the Dynamic partition pruning - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/04 05:47:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-37543) Add JDK17 support to the document - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37543) Add Java 17 support to the document - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37543) Add JDK11 support to the document - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37543) Document Java 17 support - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37544) sequence over dates with month interval is producing incorrect results - posted by "Vsevolod Ostapenko (Jira)" <ji...@apache.org> on 2021/12/04 06:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37543) Document Java 17 support - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37543) Document Java 17 support - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:10:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37110) Add Java 17 support for spark pull request builds - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 06:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37543) Document Java 17 support - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 06:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37542) optimize the dynamic partitioning prune rules to avoid inserting unnecessary predicates to improve performance - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/04 06:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37542) Optimize the dynamic partitioning prune rules to avoid inserting unnecessary predicates to improve performance - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/04 06:15:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37542) Optimize the dynamic partitioning prune rules to avoid inserting unnecessary predicates to improve performance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 06:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37542) Optimize the dynamic partitioning prune rules to avoid inserting unnecessary predicates to improve performance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 06:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37545) V2 CreateTableAsSelect command should qualify location - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/04 06:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37545) V2 CreateTableAsSelect command should qualify location - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/04 07:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37545) V2 CreateTableAsSelect command should qualify location - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 07:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37545) V2 CreateTableAsSelect command should qualify location - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 07:14:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37533) New SQL function: try_element_at - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/04 15:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37546) V2 ReplaceTableAsSelect command should qualify location - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/04 23:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37529) Support K8s integration tests for Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/04 23:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37546) V2 ReplaceTableAsSelect command should qualify location - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 23:29:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37546) V2 ReplaceTableAsSelect command should qualify location - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/04 23:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37547) Unexpected NullPointerException when Aggregator.finish returns null - posted by "Andrei (Jira)" <ji...@apache.org> on 2021/12/04 23:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37548) Add Java17 SparkR daily test coverage - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/05 00:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37548) Add Java17 SparkR daily test coverage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 00:16:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37548) Add Java17 SparkR daily test coverage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 00:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37548) Add Java17 SparkR daily test coverage - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/05 02:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37545) V2 CreateTableAsSelect command should qualify location - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/05 04:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33325) Spark executors pod are not shutting down when losing driver connection - posted by "wineternity (Jira)" <ji...@apache.org> on 2021/12/05 07:20:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-33325) Spark executors pod are not shutting down when losing driver connection - posted by "wineternity (Jira)" <ji...@apache.org> on 2021/12/05 07:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37549) Support set parallel through data source properties - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/05 12:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37550) from_json documentation lacks examples for complex types - posted by "Brian Yue (Jira)" <ji...@apache.org> on 2021/12/05 12:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37550) from_json documentation lacks examples for complex types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 12:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37550) from_json documentation lacks examples for complex types - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 12:51:00 UTC, 2 replies.
- [jira] (SPARK-37515) minRatePerPartition works as "max messages per partition per a batch" (it should be per seconds) - posted by "Sungpeo Kook (Jira)" <ji...@apache.org> on 2021/12/05 13:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37549) Support set parallel through data source properties - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 13:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37549) Support set parallel through data source properties - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 13:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 14:20:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/05 14:20:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37551) Argument 1 to "rename" of "DataFrame" has incompatible type in pandas.LocIndexerLike.__getitem__ - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/05 15:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37551) Argument 1 to "rename" of "DataFrame" has incompatible type in pandas.LocIndexerLike.__getitem__ - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/05 15:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37552) Add the convert_timezone() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/05 18:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37552) Add the convert_timezone() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/05 19:20:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37553) pandas.DataFrame.pivot_table KeyError on underscore in name - posted by "Nicholas Gustafson (Jira)" <ji...@apache.org> on 2021/12/05 23:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37525) Support basic operations of timedelta Series/Index - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 01:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 01:19:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 01:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 01:19:00 UTC, 2 replies.
- [jira] [Reopened] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 01:20:00 UTC, 0 replies.
- [jira] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 01:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37525) Support TimedeltaIndex in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 01:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37510) Support TimedeltaIndex in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 01:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37554) Add PyArrow, pandas and plotly to release Docker image dependencies - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 02:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37554) Add PyArrow, pandas and plotly to release Docker image dependencies - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 02:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37554) Add PyArrow, pandas and plotly to release Docker image dependencies - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 02:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37554) Add PyArrow, pandas and plotly to release Docker image dependencies - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 02:56:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37554) Add PyArrow, pandas and plotly to release Docker image dependencies - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 03:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37555) spark-sql should pass last unclosed comment to backend and execute throw a exception - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/06 03:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 05:47:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 05:47:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37550) from_json documentation lacks examples for complex types - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 05:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37555) spark-sql should pass last unclosed comment to backend and execute throw a exception - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 06:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37555) spark-sql should pass last unclosed comment to backend and execute throw a exception - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 06:20:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37556) Deser void class fail with Java serialization - posted by "Daniel Dai (Jira)" <ji...@apache.org> on 2021/12/06 06:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37556) Deser void class fail with Java serialization - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 06:45:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37556) Deser void class fail with Java serialization - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 06:45:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37552) Add the convert_timezone() function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 07:28:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37557) Replace object hash with sort aggregate if child is already sorted - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/12/06 07:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37540) Detect more unsupported time travel - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/06 08:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37360) Support TimestampNTZ in JSON data source - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/06 08:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37360) Support TimestampNTZ in JSON data source - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/06 08:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37004) Job cancellation causes py4j errors on Jupyter due to pinned thread mode - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/06 08:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33849) Unify v1 and v2 DROP TABLE tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 09:27:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37552) Add the convert_timezone() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/06 09:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 10:05:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 10:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37546) V2 ReplaceTableAsSelect command should qualify location - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/06 10:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37558) Improve spark-sql cli command doc - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/06 10:57:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37558) Improve spark-sql cli command doc - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/06 10:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37559) ShuffledRowRDD get preferred locations order by reduce size - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/12/06 11:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37559) ShuffledRowRDD get preferred locations order by reduce size - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 12:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37559) ShuffledRowRDD get preferred locations order by reduce size - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 12:06:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37558) Improve spark-sql cli command doc - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 12:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37560) equality comparison for map type field - posted by "omar (Jira)" <ji...@apache.org> on 2021/12/06 14:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37561) Avoid loading all functions when obtaining hive's DelegationToken - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2021/12/06 14:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37561) Avoid loading all functions when obtaining hive's DelegationToken - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2021/12/06 14:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37561) Avoid loading all functions when obtaining hive's DelegationToken - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 15:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37561) Avoid loading all functions when obtaining hive's DelegationToken - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 15:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)" - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/06 18:54:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37562) Add Spark History Server Links for Kubernetes & other CMs - posted by "Holden Karau (Jira)" <ji...@apache.org> on 2021/12/06 19:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37562) Add Spark History Server Links for Kubernetes & other CMs - posted by "Holden Karau (Jira)" <ji...@apache.org> on 2021/12/06 19:01:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37557) Replace object hash with sort aggregate if child is already sorted - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 01:09:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37557) Replace object hash with sort aggregate if child is already sorted - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 01:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37553) pandas.DataFrame.pivot_table KeyError on underscore in name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 03:47:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37553) pandas.DataFrame.pivot_table KeyError on underscore in name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 03:47:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37506) Change the never changed 'var' to 'val' - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/07 04:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37506) Change the never changed 'var' to 'val' - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/07 04:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37506) Change the never changed 'var' to 'val' - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/07 04:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37557) Replace object hash with sort aggregate if child is already sorted - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/07 04:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37555) spark-sql should pass last unclosed comment to backend and execute throw a exception - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/07 04:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37563) Implement days, seconds, microseconds properties of TimedeltaIndex - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/07 04:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37469) Unified "fetchWaitTime" and "shuffleReadTime" metrics On UI - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/07 05:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37564) Support sort aggregate code-gen without grouping keys - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/12/07 05:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37564) Support sort aggregate code-gen without grouping keys - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 05:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37564) Support sort aggregate code-gen without grouping keys - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 05:26:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27 - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/07 05:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 05:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 05:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37563) Implement days, seconds, microseconds properties of TimedeltaIndex - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 06:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37563) Implement days, seconds, microseconds properties of TimedeltaIndex - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 06:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37560) equality comparison for map type field - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/07 06:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37544) sequence over dates with month interval is producing incorrect results - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/07 06:26:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37537) Spark 3.2.0 driver pod does not mount checkpoint filesystem from Kubernetes PVC - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/07 06:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37539) Create Spark interface for creating UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/07 06:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37539) Create Spark interface for creating UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/07 06:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37566) The sampling job will lead to the wrong statistics - posted by "Fu Chen (Jira)" <ji...@apache.org> on 2021/12/07 09:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37566) The sampling job will lead to the wrong statistics - posted by "Fu Chen (Jira)" <ji...@apache.org> on 2021/12/07 09:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37566) The sampling job will lead to the wrong statistics - posted by "Fu Chen (Jira)" <ji...@apache.org> on 2021/12/07 09:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37567) reuse Exchange failed - posted by "junbiao chen (Jira)" <ji...@apache.org> on 2021/12/07 09:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37567) reuse Exchange failed - posted by "junbiao chen (Jira)" <ji...@apache.org> on 2021/12/07 09:52:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-37567) reuse Exchange failed - posted by "junbiao chen (Jira)" <ji...@apache.org> on 2021/12/07 10:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37566) The sampling job will lead to the wrong statistics - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 10:16:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-32225) Parquet footer information is read twice - posted by "Stijn De Haes (Jira)" <ji...@apache.org> on 2021/12/07 12:38:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-32225) Parquet footer information is read twice - posted by "Stijn De Haes (Jira)" <ji...@apache.org> on 2021/12/07 12:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37478) Unify v1 and v2 DROP NAMESPACE tests - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/07 12:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37568) Support 2-arguments by the convert_timezone() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/07 12:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37568) Support 2-arguments by the convert_timezone() function - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/07 12:59:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37556) Deser void class fail with Java serialization - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/07 15:32:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-23607) Use HDFS extended attributes to store application summary to improve the Spark History Server performance - posted by "Thejdeep Gudivada (Jira)" <ji...@apache.org> on 2021/12/07 18:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23607) Use HDFS extended attributes to store application summary to improve the Spark History Server performance - posted by "Thejdeep Gudivada (Jira)" <ji...@apache.org> on 2021/12/07 18:54:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-23607) Use HDFS extended attributes to store application summary to improve the Spark History Server performance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/07 18:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37569) View Analysis incorrectly marks nested fields as nullable - posted by "Shardul Mahadik (Jira)" <ji...@apache.org> on 2021/12/08 00:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37570) mypy breaks on pyspark.pandas.plot.core.Bucketizer - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/08 01:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37571) decouple jenkins from spark builds and tests - posted by "Shane Knapp (Jira)" <ji...@apache.org> on 2021/12/08 01:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37571) decouple amplab jenkins from spark website, builds and tests - posted by "Shane Knapp (Jira)" <ji...@apache.org> on 2021/12/08 01:17:00 UTC, 6 replies.
- [jira] [Commented] (SPARK-37571) decouple amplab jenkins from spark website, builds and tests - posted by "Shane Knapp (Jira)" <ji...@apache.org> on 2021/12/08 01:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37572) Flexible ways of launching executors - posted by "Dagang Wei (Jira)" <ji...@apache.org> on 2021/12/08 02:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37572) Flexible ways of launching executors - posted by "Dagang Wei (Jira)" <ji...@apache.org> on 2021/12/08 02:12:00 UTC, 16 replies.
- [jira] [Resolved] (SPARK-37445) Update hadoop-profile - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/08 02:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37445) Update hadoop-profile - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/08 02:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37573) IsolatedClient fallbackVersion should be build in version, not always 2.7.4 - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/08 03:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37573) IsolatedClient fallbackVersion should be build in version, not always 2.7.4 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 03:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37573) IsolatedClient fallbackVersion should be build in version, not always 2.7.4 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 03:52:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37574) Simplify fetchBlocks w/o retry - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2021/12/08 04:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37574) Simplify fetchBlocks w/o retry - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 04:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37574) Simplify fetchBlocks w/o retry - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 04:45:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37516) Uses Python's standard string formatter for SQL API in PySpark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/08 04:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37392) Catalyst optimizer very time-consuming and memory-intensive with some "explode(array)" - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/08 05:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37575) Empty strings and null values are both saved as quoted empty Strings "" rather than "" (for empty strings) and nothing(for null values) - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/08 05:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37575) Empty strings and null values are both saved as quoted empty Strings "" rather than "" (for empty strings) and nothing(for null values) - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/08 05:46:00 UTC, 11 replies.
- [jira] [Created] (SPARK-37576) Support built-in K8s executor roll plugin - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/08 05:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37576) Support built-in K8s executor roll plugin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 05:54:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37576) Support built-in K8s executor roll plugin - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 05:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37570) mypy breaks on pyspark.pandas.plot.core.Bucketizer - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/08 05:55:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37575) Empty strings and null values are both saved as quoted empty Strings "" rather than "" (for empty strings) and nothing(for null values) - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/08 06:03:00 UTC, 7 replies.
- [jira] [Updated] (SPARK-37575) Empty strings and null values are both saved as quoted empty Strings "" rather than "" (for empty strings) and nothing(for null values) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/08 06:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37570) mypy breaks on pyspark.pandas.plot.core.Bucketizer - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/08 07:53:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/08 08:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37578) DSV2 is not updating Output Metrics - posted by "Sandeep Katta (Jira)" <ji...@apache.org> on 2021/12/08 09:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37579) Called spark.sql multiple times,union multiple DataFrame, groupBy and pivot, join other table view cause exception - posted by "page (Jira)" <ji...@apache.org> on 2021/12/08 09:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37580) Optimize current TaskSetManager abort logic when task failed count reach the threshold - posted by "wangshengjie (Jira)" <ji...@apache.org> on 2021/12/08 09:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37580) Optimize current TaskSetManager abort logic when task failed count reach the threshold - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 10:02:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37580) Optimize current TaskSetManager abort logic when task failed count reach the threshold - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 10:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37581) sql hang at planning stage - posted by "ocean (Jira)" <ji...@apache.org> on 2021/12/08 11:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37582) Support the binary type by contains() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/08 11:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37582) Support the binary type by contains() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/08 12:01:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37583) Support the binary type by startswith() and endswith() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/08 12:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37584) New function: map_contains_key - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/08 12:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37445) Update hadoop-profile - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 12:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37584) New SQL function: map_contains_key - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/08 12:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37584) New SQL function: map_contains_key - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 12:15:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37584) New SQL function: map_contains_key - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 12:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37585) DSV2 InputMetrics are not getting update in corner case - posted by "Sandeep Katta (Jira)" <ji...@apache.org> on 2021/12/08 14:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37583) Support the binary type by startswith() and endswith() - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/08 14:13:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37576) Support built-in K8s executor roll plugin - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/08 15:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37586) Add cipher mode option and set default cipher mode for aes_encrypt and aes_decrypt - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/08 15:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37586) Add cipher mode option and set default cipher mode for aes_encrypt and aes_decrypt - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 16:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37586) Add cipher mode option and set default cipher mode for aes_encrypt and aes_decrypt - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 16:09:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/08 16:14:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/08 16:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/08 17:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37205) Support mapreduce.job.send-token-conf when starting containers in YARN - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/08 17:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37587) Forever-running streams get completed with finished status when k8s worker is lost - posted by "In-Ho Yi (Jira)" <ji...@apache.org> on 2021/12/08 18:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37569) View Analysis incorrectly marks nested fields as nullable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 19:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37569) View Analysis incorrectly marks nested fields as nullable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/08 19:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37581) sql hang at planning stage - posted by "ocean (Jira)" <ji...@apache.org> on 2021/12/09 01:25:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37561) Avoid loading all functions when obtaining hive's DelegationToken - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/09 01:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-31785) Add a helper function to test all parquet readers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 01:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37581) sql hang at planning stage - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/09 01:58:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/09 01:59:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37579) Called spark.sql multiple times,union multiple DataFrame, groupBy and pivot, join other table view cause exception - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/09 01:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/09 02:09:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/09 02:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37588) lot of strings get accumulated in the heap dump of spark thrift server - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/12/09 02:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37588) lot of strings get accumulated in the heap dump of spark thrift server - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/12/09 02:40:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37589) Improve the performance of PlanParserSuite - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/09 02:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37589) Improve the performance of PlanParserSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 03:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37589) Improve the performance of PlanParserSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 03:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37579) Called spark.sql multiple times,union multiple DataFrame, groupBy and pivot, join other table view cause exception - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/09 03:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/09 04:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 04:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 04:17:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-36137) HiveShim always fallback to getAllPartitionsOf regardless of whether directSQL is enabled in remote HMS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 04:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37586) Add cipher mode option and set default cipher mode for aes_encrypt and aes_decrypt - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/09 05:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37591) Support the GCM mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/09 05:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37591) Support the GCM mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/09 05:52:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37581) sql hang at planning stage - posted by "ocean (Jira)" <ji...@apache.org> on 2021/12/09 06:07:00 UTC, 1 replies.
- [jira] (SPARK-37581) sql hang at planning stage - posted by "ocean (Jira)" <ji...@apache.org> on 2021/12/09 07:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37592) Improve performance for JoinSelection - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/09 07:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37592) Improve performance of JoinSelection - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/09 07:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37592) Improve performance of JoinSelection - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 08:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37592) Improve performance of JoinSelection - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 08:05:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 08:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37593) Optimize HeapMemoryAllocator to avoid memory waste in humongous allocation when using G1GC - posted by "EdisonWang (Jira)" <ji...@apache.org> on 2021/12/09 09:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37593) Optimize HeapMmeoryAllocator to avoid memory waste in humongous allocation when using G1GC - posted by "EdisonWang (Jira)" <ji...@apache.org> on 2021/12/09 09:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37578) DSV2 is not updating Output Metrics - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/09 09:25:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/09 09:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37593) Optimize HeapMemoryAllocator to avoid memory waste in humongous allocation when using G1GC - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 09:35:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37593) Optimize HeapMemoryAllocator to avoid memory waste in humongous allocation when using G1GC - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 09:35:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 09:39:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 09:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34399) Add file commit time to metrics and shown in SQL Tab UI - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 09:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37595) DatasourceV2 `exists ... select *` column push down - posted by "wang-zhun (Jira)" <ji...@apache.org> on 2021/12/09 09:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37595) DatasourceV2 `exists ... select *` column push down - posted by "wang-zhun (Jira)" <ji...@apache.org> on 2021/12/09 09:45:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37582) Support the binary type by contains() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 10:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37583) Support the binary type by startswith() and endswith() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 10:53:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37596) Add the support for struct type column in the DropDuplicate in spark - posted by "Saurabh Chawla (Jira)" <ji...@apache.org> on 2021/12/09 11:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37596) Add the support for struct type column in the DropDuplicate in spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 11:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37596) Add the support for struct type column in the DropDuplicate in spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 11:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37597) Deduplicate the right side of left-semi join and left-anti join - posted by "zhengruifeng (Jira)" <ji...@apache.org> on 2021/12/09 12:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37597) Deduplicate the right side of left-semi join and left-anti join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 13:02:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37597) Deduplicate the right side of left-semi join and left-anti join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 13:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37584) New SQL function: map_contains_key - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/09 14:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-28955) Support for LocalDateTime semantics - posted by "Bill Schneider (Jira)" <ji...@apache.org> on 2021/12/09 16:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37451) Performance improvement regressed String to Decimal cast - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/09 17:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37591) Support the GCM mode by aes_encrypt()/aes_decrypt() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 17:29:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37589) Improve the performance of PlanParserSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/09 17:36:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37589) Improve the performance of PlanParserSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/09 17:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37598) Pyspark's newAPIHadoopRDD() method fails with ShortWritables - posted by "Keith Massey (Jira)" <ji...@apache.org> on 2021/12/09 17:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37598) Pyspark's newAPIHadoopRDD() method fails with ShortWritables - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 18:03:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37598) Pyspark's newAPIHadoopRDD() method fails with ShortWritables - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 18:03:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37575) Empty strings and null values are both saved as quoted empty Strings "" rather than "" (for empty strings) and nothing(for null values) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 18:33:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37599) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/09 18:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-34332) Unify v1 and v2 ALTER NAMESPACE .. SET LOCATION tests - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/09 18:41:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37599) Unify v1 and v2 ALTER TABLE .. SET LOCATION tests - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/09 18:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34332) Unify v1 and v2 ALTER NAMESPACE .. SET LOCATION tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 18:52:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37600) Upgrade to Hadoop 3.3.2 - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/09 19:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37575) Null values are saved as quoted empty Strings "" rather than nothing - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/09 19:14:00 UTC, 0 replies.
- [jira] (SPARK-37575) Null values are saved as quoted empty Strings "" rather than nothing - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/09 19:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37600) Upgrade to Hadoop 3.3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 19:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37600) Upgrade to Hadoop 3.3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/09 19:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-30471) Fix issue when compare string and IntegerType - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/10 12:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37474) Migrate SparkR documentation to pkgdown - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/10 14:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37474) Migrate SparkR documentation to pkgdown - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/10 14:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37474) Migrate SparkR documentation to pkgdown - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/10 14:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/10 16:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37594) Make UT test("SPARK-34399: Add job commit duration metrics for DataWritingCommand") more stable - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/10 16:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37606) ALTER NAMESPACE ... SET PROPERTIES v2 command should use existing properties in addition to new properties - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/10 18:01:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-37606) ALTER NAMESPACE ... SET PROPERTIES v2 command should use existing properties in addition to new properties - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/10 18:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37608) Can anyone help me to compile a scala file - posted by "Gary Liu (Jira)" <ji...@apache.org> on 2021/12/10 18:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37608) Can anyone help me to compile a scala file - posted by "Gary Liu (Jira)" <ji...@apache.org> on 2021/12/10 19:49:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters? - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/10 21:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters? - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/10 21:45:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-25299) Use remote storage for persisting shuffle data - posted by "BoYang (Jira)" <ji...@apache.org> on 2021/12/10 22:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-25299) Use remote storage for persisting shuffle data - posted by "BoYang (Jira)" <ji...@apache.org> on 2021/12/10 22:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/10 22:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/10 23:52:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-37609) Transient StackOverflowError on DataFrame from Catalyst QueryPlan - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/10 23:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37610) Anonymized/obfuscated query plan? - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/11 00:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37610) Anonymized/obfuscated query plan? - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/11 00:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/11 02:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 02:47:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 02:47:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37565) Upgrade mysql-connector-java to 8.0.27 - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/11 03:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-27974) Add built-in Aggregate Function: array_agg - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 03:02:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-27974) Support ANSI Aggregate Function: array_agg - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 03:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37612) Support PostgreSql window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 03:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37612) Support window frame ORDER BY i ROWS BETWEEN (('foo' < 'foobar')::integer) PRECEDING AND CURRENT ROW - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 03:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-27974) Support ANSI Aggregate Function: array_agg - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 03:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-27974) Support ANSI Aggregate Function: array_agg - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 03:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37613) Support ANSI Aggregate Function: regr_count - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 07:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37613) Support ANSI Aggregate Function: regr_count - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 07:41:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37613) Support ANSI Aggregate Function: regr_count - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 07:41:00 UTC, 2 replies.
- [jira] (SPARK-27974) Support ANSI Aggregate Function: array_agg - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 08:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 11:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 11:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/11 11:34:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37611) Remove upper limit of spark.kubernetes.memoryOverheadFactor - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/11 12:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 12:53:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37614) Support ANSI Aggregate Function: regr_avgx & regr_avgy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/11 12:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as supposed to be - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/11 14:54:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as supposed to be - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/11 15:02:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as supposed to be - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/11 16:24:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37615) Upgrade SBT to 1.5.6 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/12 04:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37615) Upgrade SBT to 1.5.6 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 04:03:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37615) Upgrade SBT to 1.5.6 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 04:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37615) Upgrade SBT to 1.5.6 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/12 05:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37615) Upgrade SBT to 1.5.6 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/12 05:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/12 09:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 11:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37616) Support pushing down a dynamic partition pruning from one join to other joins - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 11:56:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" by default settings - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/12 13:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema - posted by "jiahong.li (Jira)" <ji...@apache.org> on 2021/12/12 15:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 15:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 15:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37618) Support cleaning up shuffle blocks from external shuffle service - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2021/12/12 15:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37619) Upgrade Maven to 3.8.4 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/12 18:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37619) Upgrade Maven to 3.8.4 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 18:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37619) Upgrade Maven to 3.8.4 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/12 18:15:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37152) Inline type hints for python/pyspark/context.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/12 21:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37152) Inline type hints for python/pyspark/context.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/12 21:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm) - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/12 21:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm) - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/12 21:47:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37621) ClassCastException when trying to persist the result of a join between two Iceberg tables - posted by "Ciprian Gerea (Jira)" <ji...@apache.org> on 2021/12/12 23:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37598) Pyspark's newAPIHadoopRDD() method fails with ShortWritables - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37617) In CTAS,replace alias to normal column that satisfy parquet schema - posted by "jiahong.li (Jira)" <ji...@apache.org> on 2021/12/13 00:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37621) ClassCastException when trying to persist the result of a join between two Iceberg tables - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:30:00 UTC, 3 replies.
- [jira] [Updated] (SPARK-37610) Anonymized/obfuscated query plan - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37610) Anonymized/obfuscated query plan? - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37608) Can anyone help me to compile a scala file - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37607) Refactor antlr4 syntax file - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:35:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37608) Can anyone help me to compile a scala file - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37607) Refactor antlr4 syntax file - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37603) org.apache.spark.sql.catalyst.expressions.ListQuery; no valid constructor - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37619) Upgrade Maven to 3.8.4 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 00:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37622) Support K8s executor rolling policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/13 00:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36038) Basic speculation metrics at stage level - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/13 01:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37622) Support K8s executor rolling policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 01:04:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37622) Support K8s executor rolling policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 01:04:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/13 01:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/13 01:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/13 02:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/13 02:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/13 02:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37623) Support ANSI Aggregate Function: regr_slope - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/13 02:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37623) Support ANSI Aggregate Function: regr_slope - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/13 02:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37300) TaskSchedulerImpl should ignore task finished event if its task was already finished state - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/13 03:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37590) Unify v1 and v2 ALTER NAMESPACE ... SET PROPERTIES tests - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/13 04:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37569) View Analysis incorrectly marks nested fields as nullable - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/13 04:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 05:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37624) Surppress warnings for live pandas-on-Spark quickstart notebooks - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 05:08:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/13 05:14:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 05:17:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 05:21:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 05:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36571) Optimized FileOutputCommitter with StagingDir - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/13 06:13:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-36571) Optimized FileOutputCommitter with StagingDir - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/13 06:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36995) Add new SQLFileCommitProtocol - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/13 06:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37625) update log4j to 2.15 - posted by "weifeng zhang (Jira)" <ji...@apache.org> on 2021/12/13 07:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37625) update log4j to 2.15 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 07:06:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37625) update log4j to 2.15 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 07:06:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37626) Upgrade libthrift to 1.15.0 - posted by "Bo Zhang (Jira)" <ji...@apache.org> on 2021/12/13 07:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37577) ClassCastException: ArrayType cannot be cast to StructType - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/13 07:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37626) Upgrade libthrift to 1.15.0 - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/13 07:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37626) Upgrade libthrift to 0.15.0 - posted by "Bo Zhang (Jira)" <ji...@apache.org> on 2021/12/13 07:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37626) Upgrade libthrift to 0.15.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 07:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37626) Upgrade libthrift to 0.15.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 07:27:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37626) Upgrade libthrift to 0.15.0 - posted by "Bo Zhang (Jira)" <ji...@apache.org> on 2021/12/13 07:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37627) Add sorted column in BucketTransform - posted by "Huaxin Gao (Jira)" <ji...@apache.org> on 2021/12/13 07:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37627) Add sorted column in BucketTransform - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 07:48:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37627) Add sorted column in BucketTransform - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 07:48:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37624) Suppress warnings for live pandas-on-Spark quickstart notebooks - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/13 08:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/13 09:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-6305) Add support for log4j 2.x to Spark - posted by "Swapnil (Jira)" <ji...@apache.org> on 2021/12/13 09:21:00 UTC, 8 replies.
- [jira] [Resolved] (SPARK-37622) Support K8s executor rolling policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/13 09:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.71 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/13 11:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.71 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 11:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.71 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 11:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 11:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 11:50:00 UTC, 1 replies.
- [jira] (SPARK-37623) Support ANSI Aggregate Function: regr_slope & regr_intercept - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/13 11:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37591) Support the GCM mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/13 13:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37629) speed up Expression.canonicalized - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/13 13:37:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37625) update log4j to 2.15 - posted by "Gustavo Martin (Jira)" <ji...@apache.org> on 2021/12/13 13:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37493) expose driver gc time and duration time - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/13 14:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37493) expose driver gc time and duration time - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/13 14:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37629) speed up Expression.canonicalized - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 14:49:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37629) speed up Expression.canonicalized - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 14:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37493) expose driver gc time and duration time - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/13 14:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37627) Add sorted column in BucketTransform - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/13 14:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37631) Code clean up on promoting strings in math functions - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/13 15:28:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37630) Security issue from Log4j 0day exploit - posted by "Ismail Hrimech (Jira)" <ji...@apache.org> on 2021/12/13 15:28:00 UTC, 6 replies.
- [jira] [Created] (SPARK-37630) Security issue from Log4j 0day exploit - posted by "Ismail Hrimech (Jira)" <ji...@apache.org> on 2021/12/13 15:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37631) Code clean up on promoting strings in math functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 15:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37631) Code clean up on promoting strings in math functions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 15:35:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-36571) Optimized FileOutputCommitter with StagingDir - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 16:48:00 UTC, 1 replies.
- [jira] (SPARK-37625) update log4j to 2.15 - posted by "Gustavo Martin (Jira)" <ji...@apache.org> on 2021/12/13 16:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37621) ClassCastException when trying to persist the result of a join between two Iceberg tables - posted by "Erik Krogen (Jira)" <ji...@apache.org> on 2021/12/13 18:21:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-36969) Inline type hints for SparkContext - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/13 18:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37630) Security issue from Log4j 0day exploit - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/13 19:27:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-34511) Current Security vulnerabilities in spark libraries - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/13 19:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37632) Drop code targetting Python < 3.7 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/13 23:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37632) Drop code targetting Python < 3.7 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/13 23:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37632) Drop code targetting Python < 3.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 23:17:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37632) Drop code targetting Python < 3.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/13 23:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37633) Unwrap cast should skip if downcast failed with ansi enabled - posted by "Manu Zhang (Jira)" <ji...@apache.org> on 2021/12/14 00:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37518) inject an early scan pushdown rule - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 01:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37633) Unwrap cast should skip if downcast failed with ansi enabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 02:21:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37633) Unwrap cast should skip if downcast failed with ansi enabled - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 02:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37634) Jline throw NoSuchMethodError when compiling Spark on windows - posted by "JianSheng Zhang (Jira)" <ji...@apache.org> on 2021/12/14 02:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle - posted by "Mr.黄 (Jira)" <ji...@apache.org> on 2021/12/14 02:38:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-4105) FAILED_TO_UNCOMPRESS(5) errors when fetching shuffle data with sort-based shuffle - posted by "Mr.黄 (Jira)" <ji...@apache.org> on 2021/12/14 02:39:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37631) Code clean up on promoting strings in math functions - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/14 03:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37217) The number of dynamic partitions should early check when writing to external tables - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/14 03:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37217) The number of dynamic partitions should early check when writing to external tables - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/14 03:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings - posted by "Guo Wei (Jira)" <ji...@apache.org> on 2021/12/14 03:59:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37481) Disappearance of skipped stages mislead the bug hunting - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/14 04:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37217) The number of dynamic partitions should early check when writing to external tables - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 04:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37634) Jline throw NoSuchMethodError when compiling Spark on windows - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/14 04:19:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37635) SHOW TBLPROPERTIES should print the fully qualified table name - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/14 04:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37635) SHOW TBLPROPERTIES should print the fully qualified table name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 04:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37635) SHOW TBLPROPERTIES should print the fully qualified table name - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 04:32:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/14 05:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 05:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37637) Migrate SHOW TABLES EXTENDED to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/14 05:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 05:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37636) Migrate CREATE NAMESPACE to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/14 05:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37637) Migrate SHOW TABLES EXTENDED to use v2 command by default - posted by "Terry Kim (Jira)" <ji...@apache.org> on 2021/12/14 05:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm) - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 06:07:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37638) Make static and core configuration log less noisy when creating a Spark session - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/14 06:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37638) Make static and core configuration log less noisy when creating a Spark session - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/14 06:36:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-28869) Roll over event log files - posted by "muhong (Jira)" <ji...@apache.org> on 2021/12/14 06:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37639) spark history server clean event log directory with out check status file - posted by "muhong (Jira)" <ji...@apache.org> on 2021/12/14 06:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37640) rolled event log still need be clean after compact - posted by "muhong (Jira)" <ji...@apache.org> on 2021/12/14 06:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37641) Support ANSI Aggregate Function: regr_r2 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 07:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37639) spark history server clean event log directory with out check status file - posted by "muhong (Jira)" <ji...@apache.org> on 2021/12/14 07:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37641) Support ANSI Aggregate Function: regr_r2 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 07:09:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37638) Use existing active Spark session instead of SparkSession.getOrCreate in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/14 07:14:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37638) Use existing active Spark session instead of SparkSession.getOrCreate in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 07:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37638) Use existing active Spark session instead of SparkSession.getOrCreate in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 07:25:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37634) Jline throw NoSuchMethodError when compiling Spark on windows - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/14 07:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37641) Support ANSI Aggregate Function: regr_r2 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 08:00:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37642) Fall back to SortMergeJoin if BroadcastHashJoin has OOM issue - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2021/12/14 08:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/14 08:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/14 08:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37641) Support ANSI Aggregate Function: regr_r2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 08:50:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-6305) Add support for log4j 2.x to Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 09:30:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect - posted by "YuanGuanhu (Jira)" <ji...@apache.org> on 2021/12/14 09:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect - posted by "YuanGuanhu (Jira)" <ji...@apache.org> on 2021/12/14 09:32:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37630) Security issue from Log4j 1.X exploit - posted by "Ismail H (Jira)" <ji...@apache.org> on 2021/12/14 09:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37630) Security issue from Log4j 1.X exploit - posted by "Ismail H (Jira)" <ji...@apache.org> on 2021/12/14 09:48:00 UTC, 5 replies.
- [jira] (SPARK-37641) Support ANSI Aggregate Function: regr_r2 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 09:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37310) Migrate ALTER NAMESPACE ... SET PROPERTIES to use v2 command by default - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/14 10:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37635) SHOW TBLPROPERTIES should print the fully qualified table name - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/14 10:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37644) Support datasource v2 complete aggregate pushdown - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 12:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37644) Support datasource v2 complete aggregate pushdown - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/14 12:34:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-37568) Support 2-arguments by the convert_timezone() function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 13:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37567) reuse Exchange failed - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/14 13:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37645) Word spell error - "labeled" spells as "labled" - posted by "qian (Jira)" <ji...@apache.org> on 2021/12/14 13:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37645) Word spell error - "labeled" spells as "labled" - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 14:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37645) Word spell error - "labeled" spells as "labled" - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 14:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37592) Improve performance of JoinSelection - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/14 14:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 16:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37643) when charVarcharAsString is true, char datatype partition table query incorrect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 16:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-28884) [Spark]Spark driver cores is showing 0 instead of 1 in UI for cluster mode deployment - posted by "Aleksey Tsalolikhin (Jira)" <ji...@apache.org> on 2021/12/14 16:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-28884) [Spark]Spark driver cores is showing 0 instead of 1 in UI for cluster mode deployment - posted by "Aleksey Tsalolikhin (Jira)" <ji...@apache.org> on 2021/12/14 16:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function - posted by "Shixiong Zhu (Jira)" <ji...@apache.org> on 2021/12/14 18:06:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function - posted by "Shixiong Zhu (Jira)" <ji...@apache.org> on 2021/12/14 18:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/14 18:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37217) The number of dynamic partitions should early check when writing to external tables - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/14 18:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37645) Word spell error - "labeled" spells as "labled" - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/14 20:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37647) Expose percentile function in Scala/Python APIs - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/14 20:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37645) Word spell error - "labeled" spells as "labled" - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/14 20:20:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-26589) proper `median` method for spark dataframe - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/14 20:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24853) Support Column type for withColumn and withColumnRenamed apis - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/14 20:38:00 UTC, 4 replies.
- [jira] [Commented] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/14 21:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-25150) Joining DataFrames derived from the same source yields confusing/incorrect results - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/14 21:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37648) Spark catalog and Delta tables - posted by "Hanna Liashchuk (Jira)" <ji...@apache.org> on 2021/12/14 21:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37146) Inline type hints for python/pyspark/__init__.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/14 22:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37146) Inline type hints for python/pyspark/__init__.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/14 22:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-26404) set spark.pyspark.python or PYSPARK_PYTHON doesn't work in k8s client-cluster mode. - posted by "Tim Sanders (Jira)" <ji...@apache.org> on 2021/12/14 22:41:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37625) update log4j to 2.15 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/15 00:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37630) Security issue from Log4j 1.X exploit - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/15 00:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm) - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/15 00:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36584) ExecutorMonitor#onBlockUpdated will receive event from driver - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/15 00:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh` - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/15 00:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 00:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37626) Upgrade libthrift to 0.15.0 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/15 00:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37274) When the value of this parameter is greater than the maximum value of int type, the value will be thrown out of bounds. The document description of this parameter should remind the user of this risk point - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/15 00:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 00:36:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 00:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37650) Tell spark-env.sh the python interpreter - posted by "Andrew Malone Melo (Jira)" <ji...@apache.org> on 2021/12/15 00:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37650) Tell spark-env.sh the python interpreter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 01:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37650) Tell spark-env.sh the python interpreter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 01:05:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37629) speed up Expression.canonicalized - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 01:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37649) Switch default index to distributed-sequence by default in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 02:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37638) Use existing active Spark session instead of SparkSession.getOrCreate in pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 02:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37563) Implement days, seconds, microseconds properties of TimedeltaIndex - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 02:49:00 UTC, 0 replies.
- [jira] (SPARK-37154) Inline type hints for python/pyspark/rdd.py - posted by "Byron Hsu (Jira)" <ji...@apache.org> on 2021/12/15 03:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37646) Avoid touching Scala reflection APIs in the lit function - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 03:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37644) Support datasource v2 complete aggregate pushdown - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 04:19:00 UTC, 2 replies.
- [jira] (SPARK-37644) Support datasource v2 complete aggregate pushdown - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/15 04:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37575) null values should be saved as nothing rather than quoted empty Strings "" with default settings - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 04:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.72 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/15 05:29:00 UTC, 2 replies.
- [jira] [Closed] (SPARK-36168) Support Scala 2.13 in `dev/test-dependencies.sh` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/15 05:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37639) spark history server clean event log directory with out check status file - posted by "muhong (Jira)" <ji...@apache.org> on 2021/12/15 06:21:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37639) spark history server clean event log directory with out check status file - posted by "muhong (Jira)" <ji...@apache.org> on 2021/12/15 06:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/15 06:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-32294) GroupedData Pandas UDF 2Gb limit - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/15 06:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 06:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 06:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-34735) Add modified configs for SQL execution in UI - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 08:47:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37373) Collect LocalSparkContext worker logs in case of test failure - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/15 08:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37652) Support optimize skewed join through union - posted by "mcdull_zhang (Jira)" <ji...@apache.org> on 2021/12/15 12:21:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37652) Support optimize skewed join through union - posted by "mcdull_zhang (Jira)" <ji...@apache.org> on 2021/12/15 12:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/15 12:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37652) Support optimize skewed join through union - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 12:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37652) Support optimize skewed join through union - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 12:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 12:58:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 12:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37060) Report driver status does not handle response from backup masters - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/15 13:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37060) Report driver status does not handle response from backup masters - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/15 13:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37060) Report driver status does not handle response from backup masters - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 13:47:00 UTC, 2 replies.
- [jira] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as supposed to be - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 14:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) The parameter emptyValueInRead in CSVOptions is not designed as it supposed to be - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 14:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37558) Improve spark-sql cli command doc - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/15 14:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) The parameter emptyValueInRead is suggested to be designed that any fields matching this string will be set as empty values "" when reading to be - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 14:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) The parameter emptyValueInRead is suggested to be designed that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 14:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) The parameter emptyValueInRead is suggested to be designed as that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 14:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) The parameter emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 14:36:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37593) Optimize HeapMemoryAllocator to avoid memory waste when using G1GC - posted by "EdisonWang (Jira)" <ji...@apache.org> on 2021/12/15 15:12:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 15:15:00 UTC, 21 replies.
- [jira] [Resolved] (SPARK-37483) Support push down top N to JDBC data source V2 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/15 16:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37483) Support push down top N to JDBC data source V2 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/15 16:26:00 UTC, 3 replies.
- [jira] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 16:32:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 16:44:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-37604) The option emptyValueInRead(in CSVOptions) is suggested to be designed as that any fields matching this string will be set as empty values "" when reading - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 16:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37604) Change emptyValueInRead's effect to that any fields matching this string will be set as "" when reading csv files - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 17:46:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null - posted by "Brandon Dahler (Jira)" <ji...@apache.org> on 2021/12/15 17:59:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37604) Change emptyValueInRead's effect to that any fields matching this string will be set as "" when reading csv files - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 17:59:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null - posted by "Brandon Dahler (Jira)" <ji...@apache.org> on 2021/12/15 17:59:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37604) Change emptyValueInRead's effect to that any fields matching this string will be set as "" when reading csv files - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/15 18:04:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37633) Unwrap cast should skip if downcast failed with ansi enabled - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/15 19:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37633) Unwrap cast should skip if downcast failed with ansi enabled - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2021/12/15 19:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37154) Inline type hints for python/pyspark/rdd.py - posted by "Byron Hsu (Jira)" <ji...@apache.org> on 2021/12/15 20:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37655) Add RocksDB Implementation for KVStore - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/15 22:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37655) Add RocksDB Implementation for KVStore - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 22:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37655) Add RocksDB Implementation for KVStore - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/15 22:29:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/15 22:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37653) Upgrade RoaringBitmap to 0.9.23 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/15 22:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37655) Add RocksDB Implementation for KVStore - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/15 22:53:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37483) Support push down top N to JDBC data source V2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 00:15:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-37483) Support push down top N to JDBC data source V2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 00:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-34198) Add RocksDB StateStore implementation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 01:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-34198) Add RocksDB StateStore implementation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 01:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37656) Upgrade SBT to 1.5.7 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/16 01:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37656) Upgrade SBT to 1.5.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 01:59:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37656) Upgrade SBT to 1.5.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 01:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37657) Fix the bug in ps.DataFrame.describe() - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/16 02:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37657) Fix the bug in ps.DataFrame.describe() - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/16 02:13:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37657) Fix the bug in ps.DataFrame.describe() - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/16 02:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35355) improve execution performance in insert...select...limit case - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 02:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37632) Drop code targetting Python < 3.7 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 03:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37658) Skip PIP packaging test if Python version is lower than 3.7 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 03:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37658) Skip PIP packaging test if Python version is lower than 3.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 04:04:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37658) Skip PIP packaging test if Python version is lower than 3.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 04:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 04:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37656) Upgrade SBT to 1.5.7 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 05:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37657) Fix the bug in ps.(Series|DataFrame).describe() - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/16 05:31:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37483) Support push down top N to JDBC data source V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type - posted by "Bryan Cutler (Jira)" <ji...@apache.org> on 2021/12/16 06:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37659) Fix FsHistoryProvider race condition between list and delet log info - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/12/16 06:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-32294) GroupedData Pandas UDF 2Gb limit - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 06:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37658) Skip PIP packaging test if Python version is lower than 3.7 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 06:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37656) Upgrade SBT to 1.5.7 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 06:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37659) Fix FsHistoryProvider race condition between list and delet log info - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 07:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37659) Fix FsHistoryProvider race condition between list and delet log info - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 07:24:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37060) Report driver status does not handle response from backup masters - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/16 07:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working - posted by "Bhavya Raj Sharma (Jira)" <ji...@apache.org> on 2021/12/16 07:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/12/16 08:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37662) exception when handling late data with watermarking and window - posted by "luigi (Jira)" <ji...@apache.org> on 2021/12/16 09:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 09:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37661) SparkSQLCLIDriver will use hive defaults to resolve warehouse dir - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 09:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37663) SPARK-37315][ML][TEST] Mitigate ConcurrentModificationException thrown from a test in SparkContextSuite - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/16 09:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37663) Mitigate ConcurrentModificationException thrown from a test in SparkContextSuite - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/16 09:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/16 09:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/16 09:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-9853) Optimize shuffle fetch of contiguous partition IDs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/16 09:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/16 09:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 09:55:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 09:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 10:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 10:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37665) JDBC: Provide generic metadata functions - posted by "Daniel Haviv (Jira)" <ji...@apache.org> on 2021/12/16 13:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35739) [Spark Sql] Add Java-comptable Dataset.join overloads - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 14:31:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37630) Security issue from Log4j 1.X exploit - posted by "Ismail H (Jira)" <ji...@apache.org> on 2021/12/16 16:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 17:15:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37664) Add InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark Java 11/17 result - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 17:41:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37664) Supplement benchmark result of InMemoryColumnarBenchmark and StateStoreBasicOperationsBenchmark for Java 11 and Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 17:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()` - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/16 19:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 19:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 19:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-34521) spark.createDataFrame does not support Pandas StringDtype extension type - posted by "Bryan Cutler (Jira)" <ji...@apache.org> on 2021/12/16 19:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37667) Spark throws TreeNodeException during variable expansion - posted by "Kellan B Cummings (Jira)" <ji...@apache.org> on 2021/12/16 20:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37668) 'Index' object has no attribute 'levels' - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/16 20:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion - posted by "Kellan B Cummings (Jira)" <ji...@apache.org> on 2021/12/16 20:51:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/16 20:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37667) Spark throws TreeNodeException during wildcard column expansion - posted by "Kellan B Cummings (Jira)" <ji...@apache.org> on 2021/12/16 20:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/16 20:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37669) Remove unnecessary usages of OrderedDict - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/12/16 21:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37669) Remove unnecessary usages of OrderedDict - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/12/16 21:51:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-35781) Support Spark on Apple Silicon on macOS natively on Java 17 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37272) Add `ExtendedRocksDBTest` and disable RocksDB tests on Apple Silicon - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37282) Add ExtendedLevelDBTest and disable LevelDB tests on Apple Silicon - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37522) Fix MultilayerPerceptronClassifierTest.test_raw_and_probability_prediction - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37317) Reduce weights in GaussianMixtureSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:07:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36019) Cannot run leveldb related UTs on Mac OS of M1 architecture - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/16 22:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37669) Remove unnecessary usages of OrderedDict - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/16 22:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-34544) pyspark toPandas() should return pd.DataFrame - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 00:19:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-34544) pyspark toPandas() should return pd.DataFrame - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 00:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/17 01:15:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 01:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 01:51:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37666) Set `GCM` as the default mode in `aes_encrypt()`/`aes_decrypt()` - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/17 01:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37669) Remove unnecessary usages of OrderedDict - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/17 02:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37613) Support ANSI Aggregate Function: regr_count - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/17 03:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37654) Regression - NullPointerException in Row.getSeq when field null - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/17 04:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs - posted by "Wei Xue (Jira)" <ji...@apache.org> on 2021/12/17 05:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 05:21:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37670) Support predicate pushdown and column pruning for de-duped CTEs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 05:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37671) Support ANSI Aggregation Function of regression - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/17 05:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37613) Support ANSI Aggregate Function: regr_count - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/17 05:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/17 05:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe() - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/17 05:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/17 05:46:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 05:51:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe() - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 05:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37673) Implement `ps.timedelta_range` method - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/17 06:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37673) Implement `ps.timedelta_range` method - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 06:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37673) Implement `ps.timedelta_range` method - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 06:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36088) 'spark.archives' does not extract the archive file into the driver under client mode - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/17 06:53:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-36088) 'spark.archives' does not extract the archive file into the driver under client mode - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/17 06:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37674) Reduce the output partition of output stage to avoid producing small files. - posted by "weixiuli (Jira)" <ji...@apache.org> on 2021/12/17 08:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37258) Upgrade kubernetes-client to 5.11.0 - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/17 08:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37258) Upgrade kubernetes-client to 5.11.0 (add Volcano support) - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/17 08:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37258) Upgrade kubernetes-client to 5.11.0 to support Volcano - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/17 08:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37674) Reduce the output partition of output stage to avoid producing small files. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 08:57:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37674) Reduce the output partition of output stage to avoid producing small files. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 08:57:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37675) Fix calculate approxChunkSize when bitmaps isEmpty - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2021/12/17 10:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/17 10:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/17 10:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37675) Fix calculate approxChunkSize when bitmaps isEmpty - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 10:26:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37675) Fix calculate approxChunkSize when bitmaps isEmpty - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 10:26:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-37521) insert overwrite table but the partition information stored in Metastore was not changed - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/17 10:46:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-27974) Support ANSI Aggregate Function: array_agg - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/17 11:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 12:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 12:08:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/17 12:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37564) Support sort aggregate code-gen without grouping keys - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/17 12:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/17 12:25:00 UTC, 7 replies.
- [jira] [Updated] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/17 12:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect) - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/17 12:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37343) Implement createIndex and IndexExists in JDBC (Postgres dialect) - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/17 12:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-32307) Aggression that use map type input UDF as group expression can fail - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/17 14:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37675) Return PushMergedRemoteMetaFailedFetchResult if no available push-merged block - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2021/12/17 14:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/17 18:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/17 18:35:00 UTC, 5 replies.
- [jira] [Resolved] (SPARK-37655) Add RocksDB Implementation for KVStore - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/17 19:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37620) Use more precise types for SparkContext Optional fields (i.e. _gateway, _jvm) - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/17 19:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37663) Mitigate ConcurrentModificationException thrown from tests in SparkContextSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/17 20:23:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/12/17 21:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37679) Add a new executor roll policy, FAILED_TASKS - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/18 00:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37679) Add a new executor roll policy, FAILED_TASKS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 00:05:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37679) Add a new executor roll policy, FAILED_TASKS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 00:05:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37679) Add a new executor roll policy, FAILED_TASKS - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/18 01:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37331) Add the ability to creating resources before driver pod - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/18 01:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37331) Add the ability to creating resources before driver pod - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/18 01:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37604) Change emptyValueInRead's effect to that any fields matching this string will be set as "" when reading csv files - posted by "Wei Guo (Jira)" <ji...@apache.org> on 2021/12/18 04:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37258) Upgrade kubernetes-client to 5.11.0 to support Volcano - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 04:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37258) Upgrade kubernetes-client to 5.11.0 to support Volcano - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 04:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-6305) Add support for log4j 2.x to Spark - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/18 05:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37673) Implement `ps.timedelta_range` method - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/18 06:30:00 UTC, 0 replies.
- [jira] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/18 06:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37680) Support RocksDB backend in Spark History Server - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/18 07:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37680) Support RocksDB backend in Spark History Server - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 07:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37680) Support RocksDB backend in Spark History Server - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 07:44:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 07:54:00 UTC, 1 replies.
- [jira] (SPARK-37672) Support ANSI Aggregate Function: regr_sxx - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/18 07:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/18 07:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/18 07:57:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37682) Reduce memory pressure of RewriteDistinctAggregates - posted by "Kevin Liu (Jira)" <ji...@apache.org> on 2021/12/18 12:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37683) Nondeterministic type checker error in data tests - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/18 12:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37683) Nondeterministic type checker error in data tests - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/18 12:42:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37683) Nondeterministic type checker error in data tests - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 13:15:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37680) Support RocksDB backend in Spark History Server - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/18 17:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37684) Upgrade to 2.17 - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/18 17:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37684) Upgrade log4j to 2.17 - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/18 17:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37684) Upgrade log4j to 2.17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 17:55:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37684) Upgrade log4j to 2.17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 17:55:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37685) Make log event immutable for LogAppender - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/18 21:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37685) Make log event immutable for LogAppender - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 21:26:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37685) Make log event immutable for LogAppender - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 21:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/18 23:11:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37684) Upgrade log4j to 2.17 - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/19 01:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37682) Reduce memory pressure of RewriteDistinctAggregates - posted by "Kevin Liu (Jira)" <ji...@apache.org> on 2021/12/19 07:47:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37685) Make log event immutable for LogAppender - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/19 08:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/19 08:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/19 08:28:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37648) Spark catalog and Delta tables - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/19 08:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37640) rolled event log still need be clean after compact - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/19 08:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37588) lot of strings get accumulated in the heap dump of spark thrift server - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/19 08:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37686) Migrare remaining pyspark.sql.functions to _invoke_* style - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/19 10:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37686) Migrate remaining pyspark.sql.functions to _invoke_* style - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/19 10:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37686) Migrate remaining pyspark.sql.functions to _invoke_* style - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/19 10:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37686) Migrate remaining pyspark.sql.functions to _invoke_* style - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/19 10:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37648) Spark catalog and Delta tables - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2021/12/20 02:37:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37648) Spark catalog and Delta tables - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2021/12/20 02:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37687) Cleanup direct usage of OkHttpClient - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/20 03:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active - posted by "hujiahua (Jira)" <ji...@apache.org> on 2021/12/20 03:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active - posted by "hujiahua (Jira)" <ji...@apache.org> on 2021/12/20 03:16:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37682) Reduce memory pressure of RewriteDistinctAggregates - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 04:03:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37682) Reduce memory pressure of RewriteDistinctAggregates - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 04:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37689) Expand should be supported PropagateEmptyRelationBase - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/20 06:31:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37689) Expand should be supported PropagateEmptyRelationBase - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/20 06:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37689) Expand should be supported PropagateEmptyRelation - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/20 06:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37689) Expand should be supported PropagateEmptyRelation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 07:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37689) Expand should be supported PropagateEmptyRelation - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 07:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`) - posted by "Robin (Jira)" <ji...@apache.org> on 2021/12/20 07:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`) - posted by "Robin (Jira)" <ji...@apache.org> on 2021/12/20 07:51:00 UTC, 5 replies.
- [jira] [Assigned] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 08:00:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37688) ExecutorMonitor should ignore SparkListenerBlockUpdated event if executor was not active - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 08:00:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37660) Spark-3.2.0 Fetch Hbase Data not working - posted by "Bhavya Raj Sharma (Jira)" <ji...@apache.org> on 2021/12/20 08:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 08:26:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/20 08:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/20 08:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37692) sql-migration-guide wrong description - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2021/12/20 08:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37692) sql-migration-guide wrong description - posted by "JacobZheng (Jira)" <ji...@apache.org> on 2021/12/20 08:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter - posted by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2021/12/20 08:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36406) No longer do file truncate operation before delete a write failed file held by DiskBlockObjectWriter - posted by "Attila Zsolt Piros (Jira)" <ji...@apache.org> on 2021/12/20 08:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/20 09:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 09:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 09:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-34763) col(), $"" and df("name") should handle quoted column names properly. - posted by "feiwang (Jira)" <ji...@apache.org> on 2021/12/20 09:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37689) Expand should be supported PropagateEmptyRelation - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/20 09:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37694) Disallow delete resources in spark sql cli - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2021/12/20 09:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37694) Disallow delete resources in spark sql cli - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 10:08:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37694) Disallow delete resources in spark sql cli - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 10:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-24417) Build and Run Spark on JDK11 - posted by "Chao Gao (Jira)" <ji...@apache.org> on 2021/12/20 12:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/20 12:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/20 12:38:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37696) Optimizer exceeds max iterations - posted by "Denis Tarima (Jira)" <ji...@apache.org> on 2021/12/20 12:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37696) Optimizer exceeds max iterations - posted by "Denis Tarima (Jira)" <ji...@apache.org> on 2021/12/20 12:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 13:07:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 13:07:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37693) Fix ChildProcAppHandleSuite failed in spark-master-test-maven-hadoop-3.2 - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/20 15:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37667) Spark throws TreeNodeException ("Couldn't find gen_alias") during wildcard column expansion - posted by "Kellan B Cummings (Jira)" <ji...@apache.org> on 2021/12/20 15:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes - posted by "Douglas Moore (Jira)" <ji...@apache.org> on 2021/12/20 16:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37698) Update orc to 1.7.2 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/20 19:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-5997) Increase partition count without performing a shuffle - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/20 19:37:00 UTC, 0 replies.
- [jira] (SPARK-5997) Increase partition count without performing a shuffle - posted by "Nicholas Chammas (Jira)" <ji...@apache.org> on 2021/12/20 19:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37698) Update orc to 1.7.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 19:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37698) Update orc to 1.7.2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 19:40:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37698) Update ORC to 1.7.2 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/20 21:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37698) Update ORC to 1.7.2 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/20 21:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37698) Update orc to 1.7.2 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/20 21:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37678) Incorrect annotations in SeriesGroupBy._cleanup_and_return - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/12/20 22:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/20 22:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 23:01:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/20 23:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37694) Disallow delete resources in spark sql cli - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/21 00:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37692) sql-migration-guide wrong description - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/21 00:34:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 02:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37700) Add LoggingSuite and some improvements - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/21 03:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37700) Add LoggingSuite and some improvements - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 03:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37700) Add LoggingSuite and some improvements - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 03:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37701) Implement `ps.to_timedelta` method - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/21 06:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37701) Implement `ps.to_timedelta` method - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 06:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37701) Implement `ps.to_timedelta` method - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 06:31:00 UTC, 0 replies.
- [jira] (SPARK-37681) Support ANSI Aggregate Function: regr_sxy - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/21 07:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37702) Support ANSI Aggregate Function: regr_syy - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/21 07:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37702) Support ANSI Aggregate Function: regr_syy - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/21 07:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36057) Support volcano/alternative schedulers - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/21 08:40:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37703) Upgrade SBT to 1.5.8 - posted by "Haonan Jiang (Jira)" <ji...@apache.org> on 2021/12/21 08:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37692) sql-migration-guide wrong description - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 09:04:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37701) Implement `ps.to_timedelta` method - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/21 10:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37692) sql-migration-guide wrong description - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/21 10:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37703) Upgrade SBT to 1.5.8 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 10:26:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37703) Upgrade SBT to 1.5.8 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 10:26:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37704) Update mypy in tests to 0.920 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/21 12:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37704) Update mypy in tests to 0.920 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/21 12:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37704) Update mypy in tests to 0.920 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 12:33:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37704) Update mypy in tests to 0.920 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 12:33:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37705) Write session time zone in the Parquet file metadata so that rebase can use it instead of JVM timezone - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/21 12:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37706) Deserializing problem in java 17 - posted by "Krzysztof Strzała (Jira)" <ji...@apache.org> on 2021/12/21 13:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37705) Write session time zone in the Parquet file metadata so that rebase can use it instead of JVM timezone - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 13:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37705) Write session time zone in the Parquet file metadata so that rebase can use it instead of JVM timezone - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 13:19:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37704) Update mypy in tests to 0.920 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/21 14:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 14:45:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-37273) Hidden File Metadata Support for Spark SQL - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/21 14:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37273) Hidden File Metadata Support for Spark SQL - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/21 14:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37273) Hidden File Metadata Support for Spark SQL - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/21 14:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37707) Allow store assignment between TimestampNTZ and Date/Timestamp - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/21 17:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37707) Allow store assignment between TimestampNTZ and Date/Timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 17:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37707) Allow store assignment between TimestampNTZ and Date/Timestamp - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 17:48:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-26404) set spark.pyspark.python or PYSPARK_PYTHON doesn't work in k8s client-cluster mode. - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/21 17:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37708) pyspark adding third-party Dependencies on k8s - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/21 17:55:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37708) pyspark adding third-party Dependencies on k8s - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/21 17:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35570) Shuffle file leak with external shuffle service enable - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2021/12/21 18:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37709) Add AVERAGE_DURATION executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/21 18:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37709) Add AVERAGE_DURATION executor roll policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 18:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37709) Add AVERAGE_DURATION executor roll policy - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 18:22:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37703) Upgrade SBT to 1.5.8 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/21 18:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37699) Fix failed K8S integration test in SparkConfPropagateSuite - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/21 19:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37709) Add AVERAGE_DURATION executor roll policy - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/21 19:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-34652) Support SchemaRegistry in from_avro method - posted by "Sayed Mohammad Hossein Torabi (Jira)" <ji...@apache.org> on 2021/12/21 19:51:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37710) Log clear message for Input/output error - posted by "Eren Avsarogullari (Jira)" <ji...@apache.org> on 2021/12/21 21:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37710) Log clear message for Input/output error - posted by "Eren Avsarogullari (Jira)" <ji...@apache.org> on 2021/12/21 21:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37710) Add clear error message for java.io.IOException: Input/output error - posted by "Eren Avsarogullari (Jira)" <ji...@apache.org> on 2021/12/21 22:23:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37710) Add clear error message for java.io.IOException: Input/output error - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 22:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37710) Add clear error message for java.io.IOException: Input/output error - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/21 22:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37145) Improvement for extending pod feature steps with KubernetesConf - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/22 01:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35437) Use expressions to filter Hive partitions at client side - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 07:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37711) Create plans for top & frequency for pandas-on-Spark optimization - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/22 07:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37711) Create plans for top & frequency for pandas-on-Spark optimization - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/22 07:28:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses int64 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/22 07:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37712) Spark request yarn cluster metrics slow and cause unnecessary delay - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/22 07:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37712) Spark request yarn cluster metrics slow and cause unnecessary delay - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 07:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37712) Spark request yarn cluster metrics slow and cause unnecessary delay - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 07:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-34791) SparkR throws node stack overflow - posted by "Tinus Chen (Jira)" <ji...@apache.org> on 2021/12/22 08:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/22 08:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/22 08:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37328) SPARK-33832 brings the bug that OptimizeSkewedJoin may not work since it was applied on whole plan innstead of new stage plan - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/22 08:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37713) No namespace assigned in Executor Pod ConfigMap - posted by "qian (Jira)" <ji...@apache.org> on 2021/12/22 09:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37713) No namespace assigned in Executor Pod ConfigMap - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 09:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37713) No namespace assigned in Executor Pod ConfigMap - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 09:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37707) Allow store assignment between TimestampNTZ and Date/Timestamp - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/22 10:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37463) Read/Write Timestamp ntz from/to Orc uses int64 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 11:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-33354) New explicit cast syntax rules in ANSI mode - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/22 12:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37714) ANSI mode: allow casting between numeric type and datetime type by default - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/22 13:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37714) ANSI mode: allow casting between numeric type and datetime type by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 13:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37714) ANSI mode: allow casting between numeric type and datetime type by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 13:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37715) Docker integration tests: Tweak docs and remove unneeded dependency - posted by "Danny Guinther (Jira)" <ji...@apache.org> on 2021/12/22 14:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37715) Docker integration tests: Tweak docs and remove unneeded dependency - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 14:57:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37715) Docker integration tests: Tweak docs and remove unneeded dependency - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 14:57:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2021/12/22 18:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2021/12/22 18:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 18:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 18:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/22 19:59:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-34544) pyspark toPandas() should return pd.DataFrame - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-34629) Python type hints improvement - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-34629) Python type hints improvement - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37711) Create a plan for top & frequency for pandas-on-Spark optimization - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37012) Disable pinned thread mode by default - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37708) pyspark adding third-party Dependencies on k8s - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:50:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37706) Deserializing problem in java 17 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 00:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37717) Improve logging in BroadcastExchangeExec - posted by "Eugene Koifman (Jira)" <ji...@apache.org> on 2021/12/23 01:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37717) Improve logging in BroadcastExchangeExec - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 01:58:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37717) Improve logging in BroadcastExchangeExec - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 01:58:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37718) Demo sql is incorrect - posted by "Peng (Jira)" <ji...@apache.org> on 2021/12/23 03:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37719) Try to remove `--add-exports` compile option for Java 17 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2021/12/23 03:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37720) /BMT1630977855165/CA1624610690382/state/0/8/1272.delta does not exist at org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider.updateFromDeltaFile - posted by "lai fangmin (Jira)" <ji...@apache.org> on 2021/12/23 03:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37719) Try to remove `--add-exports` compile option for Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 03:36:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37719) Try to remove `--add-exports` compile option for Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 03:36:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37070) Pass all UTs in `mllib-local` and `mllib` with Java 17 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 03:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37718) Demo sql is incorrect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 03:41:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37718) Demo sql is incorrect - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 03:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37695) Skip diagnosis ob merged blocks from push-based shuffle - posted by "wuyi (Jira)" <ji...@apache.org> on 2021/12/23 04:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37721) Failed to execute pyspark test in Win WSL - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/23 04:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37721) Failed to execute pyspark test in Win WSL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 04:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37721) Failed to execute pyspark test in Win WSL - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 04:21:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.72 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/23 05:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37628) Upgrade Netty from 4.1.68 to 4.1.72 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/23 05:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37722) Escape dots in partition names - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/12/23 05:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37722) Escape dots in partition names - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/12/23 05:36:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37720) /1624610690382/state/0/8/1272.delta does not exist at org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider.updateFromDeltaFile - posted by "lai fangmin (Jira)" <ji...@apache.org> on 2021/12/23 05:37:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37722) Escape dot character in partition names - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/12/23 05:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37722) Escape dots in partition names - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 05:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37722) Escape dots in partition names - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 05:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37714) ANSI mode: allow casting between numeric type and timestamp type by default - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/23 05:53:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37714) ANSI mode: allow casting between numeric type and timestamp type - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/23 05:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37723) Support tuple for non-MultiIndex column name. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/23 07:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37723) Support tuple for non-MultiIndex column name. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/23 07:06:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37659) Fix FsHistoryProvider race condition between list and delet log info - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/23 07:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37724) ANSI mode: disable ANSI reserved keyworks by default - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/23 08:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/23 08:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 08:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 08:13:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37690) Recursive view `df` detected (cycle: `df` -> `df`) - posted by "Robin (Jira)" <ji...@apache.org> on 2021/12/23 08:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37496) Migrate ReplaceTableAsSelectStatement to v2 command - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 08:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37725) Spark master UI behind reverse proxy app storage redirects to master home page - posted by "Adrian Paraschiv (Jira)" <ji...@apache.org> on 2021/12/23 09:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37725) Spark master UI behind reverse proxy app storage redirects to master home page - posted by "Adrian Paraschiv (Jira)" <ji...@apache.org> on 2021/12/23 09:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37726) Add spill size metrics for sort merge join - posted by "Cheng Su (Jira)" <ji...@apache.org> on 2021/12/23 09:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37726) Add spill size metrics for sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 10:09:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37726) Add spill size metrics for sort merge join - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 10:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37721) Failed to execute pyspark test in Win WSL - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 10:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 11:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 11:43:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException - posted by "Yimin Yang (Jira)" <ji...@apache.org> on 2021/12/23 11:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException - posted by "Yimin Yang (Jira)" <ji...@apache.org> on 2021/12/23 12:00:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 12:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 12:12:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37714) ANSI mode: allow casting between numeric type and timestamp type - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/23 12:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5 - posted by "Michał Słapek (Jira)" <ji...@apache.org> on 2021/12/23 12:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 12:27:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 12:27:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 12:41:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 12:41:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 13:10:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 13:10:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37668) 'Index' object has no attribute 'levels' in pyspark.pandas.frame.DataFrame.insert - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/23 13:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5 - posted by "Michał Słapek (Jira)" <ji...@apache.org> on 2021/12/23 13:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/23 13:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/23 13:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37462) Avoid unnecessary calculating the number of outstanding fetch requests and RPCS - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/23 13:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37718) Demo sql is incorrect - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/23 14:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37731) refactor and cleanup function lookup in Analyzer - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/23 14:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37644) Support datasource v2 complete aggregate pushdown - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/23 15:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/23 15:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37193) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should not apply to outer joins - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/23 15:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37731) refactor and cleanup function lookup in Analyzer - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 15:09:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37731) refactor and cleanup function lookup in Analyzer - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 15:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/23 20:05:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37700) Add LoggingSuite and some improvements - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/23 20:05:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice - posted by "Devesh Agrawal (Jira)" <ji...@apache.org> on 2021/12/23 20:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 20:39:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-8582) Optimize checkpointing to avoid computing an RDD twice - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/23 20:40:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions when the outer query is a single row relation - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2021/12/23 22:18:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37657) Support str and timestamp for (Series|DataFrame).describe() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 00:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/24 01:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37391) SIGNIFICANT bottleneck introduced by fix for SPARK-32001 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 01:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-34648) Reading Parquet Files in Spark Extremely Slow for Large Number of Files? - posted by "vicviz (Jira)" <ji...@apache.org> on 2021/12/24 02:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37302) Explicitly download the dependencies of guava and jetty-io in test-dependencies.sh - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 02:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37720) /1624610690382/state/0/8/1272.delta does not exist at org.apache.spark.sql.execution.streaming.state.HDFSBackedStateStoreProvider.updateFromDeltaFile - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 02:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37727) Show ignored confs & hide warnings for conf already set in SparkSession.builder.getOrCreate - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 03:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37732) Improve the implement of JDBCV2Suite - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/24 06:29:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37732) Improve the implement of JDBCV2Suite - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/24 06:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37732) Improve the implement of JDBCV2Suite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 06:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37732) Improve the implement of JDBCV2Suite - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 06:35:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37733) Change log level of tests to WARN - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/24 07:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37733) Change log level of tests to WARN - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/24 07:12:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37733) Change log level of tests to WARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 07:13:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37733) Change log level of tests to WARN - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 07:14:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 08:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37733) Change log level of tests to WARN - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 08:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202 - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/24 08:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 08:59:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37734) Upgrade h2 from 1.4.195 to 2.0.202 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 08:59:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37735) Add appId interfrace to KubernetesConf - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/24 09:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37735) Add appId interface to KubernetesConf - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/24 09:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36057) Support volcano/alternative schedulers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 10:11:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-36057) Support volcano/alternative schedulers - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 10:11:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-37733) Change log level of tests to WARN - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/24 11:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37735) Add appId interface to KubernetesConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 13:58:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37735) Add appId interface to KubernetesConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/24 13:58:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37724) ANSI mode: disable ANSI reserved keywords by default - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/24 17:11:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37708) pyspark adding third-party Dependencies on k8s - posted by "jingxiong zhong (Jira)" <ji...@apache.org> on 2021/12/24 17:25:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37729) SparkSession.setLogLevel not working in Spark Shell - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/25 00:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36853) Code failing on checkstyle - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 06:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37736) Comparation between string(great than Int.MaxValue, such as '2147483648') and int return null - posted by "jiahong.li (Jira)" <ji...@apache.org> on 2021/12/25 08:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37736) Comparation between string(great than Int.MaxValue, such as '2147483648') and int return null - posted by "jiahong.li (Jira)" <ji...@apache.org> on 2021/12/25 08:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37736) Comparation between string(great than Int.MaxValue, such as '2147483648') and int return null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 08:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37736) Comparation between string(great than Int.MaxValue, such as '2147483648') and int return null - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 08:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-34652) Support SchemaRegistry in from_avro method - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 11:40:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37429) Inline type hints for python/pyspark/mllib/linalg/__init__.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 11:52:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37429) Inline type hints for python/pyspark/mllib/linalg/__init__.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 11:52:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/25 12:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/25 12:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37737) Update Black to 21.12.b0 - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/25 12:45:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37737) Update Black to 21.12.b0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 12:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37737) Update Black to 21.12.b0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 12:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37407) Inline type hints for python/pyspark/ml/functions.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/25 19:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37738) PySpark date_add only accepts an integer as it's second parameter - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2021/12/25 22:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37659) Fix FsHistoryProvider race condition between list and delet log info - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/26 01:55:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37739) Upgrade Arrow to 6.0.1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/26 02:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37739) Upgrade Arrow to 6.0.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 03:17:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37739) Upgrade Arrow to 6.0.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 03:17:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37737) Update Black to 21.12.b0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 03:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37738) PySpark date_add only accepts an integer as it's second parameter - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 03:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37738) PySpark date_add only accepts an integer as it's second parameter - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 03:51:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37739) Upgrade Arrow to 6.0.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/26 06:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37740) Removal of obsolete codes per Jenkins' retirement - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37741) Remove Jenkins badge in README.md - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37742) Remove obsolate codes in testing scripts for Jenkins - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37743) Remove/update obsolete codes in Scala tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37744) Remove/update obsolete codes in PySpark, SparkR and other docs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37743) Remove/update obsolete codes in Scala tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:19:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37744) Remove/update obsolete codes in PySpark, SparkR and other docs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/26 07:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37741) Remove Jenkins badge in README.md - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 07:23:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37741) Remove Jenkins badge in README.md - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 07:23:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37745) Add new option to CSVOption ignoreEmptyLines - posted by "Izek Greenfield (Jira)" <ji...@apache.org> on 2021/12/26 08:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37742) Remove obsolete code in testing scripts for Jenkins - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/26 16:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37746) log4j2-defaults.properties is not working since log4j 2 is always initialized by default - posted by "Chia-Ping Tsai (Jira)" <ji...@apache.org> on 2021/12/26 16:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37746) log4j2-defaults.properties is not working since log4j 2 is always initialized by default - posted by "Chia-Ping Tsai (Jira)" <ji...@apache.org> on 2021/12/26 16:51:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37746) log4j2-defaults.properties is not working since log4j 2 is always initialized by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 17:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37746) log4j2-defaults.properties is not working since log4j 2 is always initialized by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 17:18:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2021/12/26 20:23:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37697) Make it easier to convert numpy arrays to Spark Dataframes - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2021/12/26 20:23:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37747) Upgrade zstd-jni to 1.5.1-1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/26 20:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37747) Upgrade zstd-jni to 1.5.1-1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 20:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37747) Upgrade zstd-jni to 1.5.1-1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 20:41:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37747) Upgrade zstd-jni to 1.5.1-1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/26 22:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37578) DSV2 is not updating Output Metrics - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/26 23:18:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-37740) Migrate to M1 machines in Jenkins - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37748) Add Jenkins badge back when M1 machines are ready - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37744) Revisit codes in PySpark, SparkR and other docs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37742) Revisit codes in testing scripts for Jenkins - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37743) Revisit codes in Scala tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37740) Migrate to M1 machines in Jenkins - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:24:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37741) Remove Jenkins badge in README.md - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/27 00:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37749) Built-in ORC reader cannot read data file in sub-directories created by Hive Tez - posted by "Ye Li (Jira)" <ji...@apache.org> on 2021/12/27 07:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37750) ANSI mode: Add a config to optionally return null result if element not exists in array/map - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/27 08:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2021/12/27 08:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 08:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37750) ANSI mode: optionally return null result if element not exists in array/map - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 08:28:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions when the outer query is a single row relation - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/27 09:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37716) Allow LateralJoin node to host non-deterministic expressions when the outer query is a single row relation - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/27 09:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37732) Improve the implement of JDBCV2Suite - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/27 09:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37751) Apache Commons Crypto Doesn't support Java 11 - posted by "Shipeng Feng (Jira)" <ji...@apache.org> on 2021/12/27 09:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37751) Apache Commons Crypto doesn't support Java 11 - posted by "Shipeng Feng (Jira)" <ji...@apache.org> on 2021/12/27 09:40:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37752) Python UDF fails when it should not get evaluated - posted by "Ohad Raviv (Jira)" <ji...@apache.org> on 2021/12/27 09:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-35703) Relax constraint for Spark bucket join and remove HashClusteredDistribution - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/27 11:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-35703) Relax constraint for Spark bucket join and remove HashClusteredDistribution - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/27 11:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37738) PySpark date_add only accepts an integer as it's second parameter - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 12:20:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-37676) Support ANSI Aggregation Function: percentile_cont - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/27 13:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/27 13:21:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37753) DynamicJoinSelection.shouldDemoteBroadcastHashJoin should apply to left outer with join many empty partitions on the left - posted by "Eugene Koifman (Jira)" <ji...@apache.org> on 2021/12/27 17:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37746) log4j2-defaults.properties is not working since log4j 2 is always initialized by default - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/27 19:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37754) the version of black in reformat-python is inconsistent to build_and_test.yml - posted by "Chia-Ping Tsai (Jira)" <ji...@apache.org> on 2021/12/27 19:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37754) the version of black in reformat-python is inconsistent to build_and_test.yml - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 19:48:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37754) the version of black in reformat-python is inconsistent to build_and_test.yml - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 19:48:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37754) Fix black version in dev/reformat-python - posted by "Chia-Ping Tsai (Jira)" <ji...@apache.org> on 2021/12/27 21:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37755) Optimize RocksDB configurations - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/27 21:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37755) Optimize RocksDB KVStore configurations - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/27 21:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37755) Optimize RocksDB KVStore configurations - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 21:56:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37755) Optimize RocksDB KVStore configurations - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/27 21:56:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37752) Python UDF fails when it should not get evaluated - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/27 22:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37755) Optimize RocksDB KVStore configurations - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 01:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37730) plot.hist throws AttributeError on pandas=1.3.5 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/28 01:41:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37756) Enable matplotlib test for pandas API on Spark - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/28 02:16:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37756) Enable matplotlib test for pandas API on Spark - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/28 02:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-35607) Migrate Spark Arm Job from Jenkins to GitHub Actions - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/28 02:41:00 UTC, 3 replies.
- [jira] [Created] (SPARK-37757) Enable scala test on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/28 02:47:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37757) Enable spark test scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/28 02:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37758) Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/28 02:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37757) Enable Spark test scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/28 02:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37759) Add ARM based self-hosted runner to Apache Spark - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/28 02:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37760) Upgrade SBT to 1.6.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 02:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37760) Upgrade SBT to 1.6.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 03:00:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37760) Upgrade SBT to 1.6.0 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 03:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37761) Install matplotlib in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/28 03:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37761) Install matplotlib in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2021/12/28 03:14:00 UTC, 4 replies.
- [jira] [Created] (SPARK-37762) Close SessonState when each hive request done - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 03:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37756) Enable matplotlib test for pandas API on Spark - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 03:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37763) Upgrade jackson to 2.13.1 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/28 05:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37763) Upgrade jackson to 2.13.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 05:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37763) Upgrade jackson to 2.13.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 05:34:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-37760) Upgrade SBT to 1.6.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 05:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37756) Enable matplotlib test for pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/28 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37728) reading nested columns with ORC vectorized reader can cause ArrayIndexOutOfBoundsException - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 06:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37762) Close SessonState when each hive request done - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 06:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37762) Close SessonState when each hive request done - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 06:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37715) Docker integration tests: Tweak docs and remove unneeded dependency - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 06:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37715) Remove ojdbc6 dependency and update docker-integration test docs - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 06:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37763) Upgrade jackson to 2.13.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 07:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37651) Use existing active Spark session in all places of pandas API on Spark - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 07:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37503) Improve SparkSession/PySpark SparkSession startup - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 07:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37503) Improve SparkSession/PySpark SparkSession startup - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 07:58:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37503) Improve SparkSession/PySpark SparkSession startup - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 07:58:00 UTC, 4 replies.
- [jira] [Reopened] (SPARK-37503) Improve SparkSession/PySpark SparkSession startup - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/28 08:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37507) Add the TO_BINARY() function - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/28 08:03:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 09:23:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37367) Reenable exception test in DDLParserSuite.create view -- basic - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 09:23:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37764) Reserve bucket information when relation conversion from metastore relations to data source relations - posted by "yikf (Jira)" <ji...@apache.org> on 2021/12/28 09:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37764) Reserve bucket information when relation conversion from metastore relations to data source relations - posted by "yikf (Jira)" <ji...@apache.org> on 2021/12/28 09:43:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37754) Fix black version in dev/reformat-python - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/28 09:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37754) Fix black version in dev/reformat-python - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/28 09:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37691) Support ANSI Aggregation Function: percentile_disc - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 10:32:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37764) Reserve bucket information when relation conversion from metastore relations to data source relations - posted by "yikf (Jira)" <ji...@apache.org> on 2021/12/28 10:35:00 UTC, 0 replies.
- [jira] (SPARK-2421) Spark should treat writable as serializable for keys - posted by "Guillaume Desforges (Jira)" <ji...@apache.org> on 2021/12/28 16:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-2421) Spark should treat writable as serializable for keys - posted by "Guillaume Desforges (Jira)" <ji...@apache.org> on 2021/12/28 16:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36361) Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/28 20:28:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-36361) Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 20:58:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37761) Install matplotlib in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 20:59:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37765) PySpark Dynamic DataFrame for easier inheritance - posted by "Pablo Alcain (Jira)" <ji...@apache.org> on 2021/12/28 22:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37765) PySpark Dynamic DataFrame for easier inheritance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 22:48:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37765) PySpark Dynamic DataFrame for easier inheritance - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/28 22:48:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37761) Install matplotlib in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 00:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36361) Install coverage in Python 3.9 and PyPy 3 in GitHub Actions image - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 00:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37766) Regenerate benchmark results - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 00:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37766) Regenerate benchmark results - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 00:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37766) Regenerate benchmark results - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 00:46:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37767) Follow-up Improvements of Hidden File Metadata Support for Spark SQL - posted by "Yaohua Zhao (Jira)" <ji...@apache.org> on 2021/12/29 00:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37768) Schema pruning for the metadata struct - posted by "Yaohua Zhao (Jira)" <ji...@apache.org> on 2021/12/29 00:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37705) Write session time zone in the Parquet file metadata so that rebase can use it instead of JVM timezone - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/29 00:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37769) Filter on the metadata struct - posted by "Yaohua Zhao (Jira)" <ji...@apache.org> on 2021/12/29 00:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37770) Performance improvements for ColumnVector `putByteArray` - posted by "Yaohua Zhao (Jira)" <ji...@apache.org> on 2021/12/29 00:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37771) Race condition in withHiveState and limited logic in IsolatedClientLoader result in ClassNotFoundException - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/12/29 01:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37771) Race condition in withHiveState and limited logic in IsolatedClientLoader result in ClassNotFoundException - posted by "Ivan Sadikov (Jira)" <ji...@apache.org> on 2021/12/29 01:50:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37175) Performance improvement to hash joins with many duplicate keys - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 02:24:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37175) Performance improvement to hash joins with many duplicate keys - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 02:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37757) Enable Spark test scheduled job on ARM based self-hosted runner - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 02:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37757) Enable Spark test scheduled job on ARM based self-hosted runner - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 02:57:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37758) Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 03:02:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37758) Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 03:03:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 03:07:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37758) [Scala] Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 03:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 03:08:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37757) [Scala] Enable Spark test scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 03:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37766) Regenerate benchmark results - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 03:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37773) Disable certain doctests for pandas<=1.0.5 - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/29 04:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37773) Disable certain doctests of `ps.to_timedelta` for pandas<=1.0.5 - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2021/12/29 04:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37773) Disable certain doctests of `ps.to_timedelta` for pandas<=1.0.5 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 04:44:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37773) Disable certain doctests of `ps.to_timedelta` for pandas<=1.0.5 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 04:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37774) Upgrade log4j from 2.17 to 2.17.1 - posted by "Chia-Ping Tsai (Jira)" <ji...@apache.org> on 2021/12/29 05:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37773) Disable certain doctests of `ps.to_timedelta` for pandas<=1.0.5 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/29 05:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37774) Upgrade log4j from 2.17 to 2.17.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 05:24:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37774) Upgrade log4j from 2.17 to 2.17.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 05:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37578) DSV2 is not updating Output Metrics - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/29 06:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37578) DSV2 is not updating Output Metrics - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/29 06:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37775) [PYSPARK] Fix mlflow doctest - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 07:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37775) [PYSPARK] Fix mlflow doctest - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/29 07:19:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37774) Upgrade log4j from 2.17 to 2.17.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 07:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37776) Upgrade silencer to 1.7.7 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/29 07:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37776) Upgrade silencer to 1.7.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 08:00:06 UTC, 2 replies.
- [jira] [Commented] (SPARK-37776) Upgrade silencer to 1.7.7 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 08:00:06 UTC, 0 replies.
- [jira] [Commented] (SPARK-37775) [PYSPARK] Fix mlflow doctest - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 08:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37775) [PYSPARK] Fix mlflow doctest - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 08:05:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-34755) Support the utils for transform number format - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/29 08:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-34755) Support the utils for transform number format - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2021/12/29 08:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37769) Filter on the metadata struct - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 08:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37769) Filter on the metadata struct - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 08:34:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/29 08:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 09:00:03 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36703) Remove the Sort if it is the child of RepartitionByExpression - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/29 09:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 09:01:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-36703) Remove the Sort if it is the child of RepartitionByExpression - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/29 09:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37778) Upgrade SBT to 1.6.1 - posted by "Kousuke Saruta (Jira)" <ji...@apache.org> on 2021/12/29 09:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37778) Upgrade SBT to 1.6.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 09:08:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37778) Upgrade SBT to 1.6.1 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 09:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37776) Upgrade silencer to 1.7.7 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 09:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37778) Upgrade SBT to 1.6.1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 09:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/29 10:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/29 10:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 10:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 10:26:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37780) QueryExecutionListener should also support SQLConf - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/29 10:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37780) QueryExecutionListener should also support SQLConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 11:25:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37780) QueryExecutionListener should also support SQLConf - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 11:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37775) [PYSPARK] Fix mlflow doctest - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/29 11:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-28137) Data Type Formatting Functions: `to_number` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 12:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37369) Avoid redundant ColumnarToRow transistion on InMemoryTableScan - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 14:44:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe - posted by "Thinh Nguyen (Jira)" <ji...@apache.org> on 2021/12/29 18:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe - posted by "Thinh Nguyen (Jira)" <ji...@apache.org> on 2021/12/29 18:58:00 UTC, 3 replies.
- [jira] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe - posted by "Thinh Nguyen (Jira)" <ji...@apache.org> on 2021/12/29 18:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-36059) Add the ability to specify a scheduler & queue - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/29 19:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37782) Make DataFrame.transform take the parameters for the function. - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2021/12/29 22:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37782) Make DataFrame.transform take the parameters for the function. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 22:40:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37782) Make DataFrame.transform take the parameters for the function. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/29 22:40:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37783) Add @tailrec wherever possible - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 01:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37783) Add @tailrec wherever possible - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 01:39:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37783) Add @tailrec wherever possible - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 01:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37782) Make DataFrame.transform take the parameters for the function. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 01:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37783) Add @tailrec wherever possible - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 02:27:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/12/30 02:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/12/30 02:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs - posted by "Josh Rosen (Jira)" <ji...@apache.org> on 2021/12/30 02:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37785) Add Utils.isAtExecutor - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 02:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37785) Add Utils.isAtExecutor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 02:55:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37785) Add Utils.isAtExecutor - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 02:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37784) CodeGenerator.addBufferedState() does not properly handle UDTs - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 03:28:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 03:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37781) Java Out-Of-Memory Error when retrieving value from dataframe - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 03:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37752) Python UDF fails when it should not get evaluated - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 03:36:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-37752) Python UDF fails when it should not get evaluated - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 03:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37749) Built-in ORC reader cannot read data file in sub-directories created by Hive Tez - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 03:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37779) Make ColumnarToRowExec plan canonicalizable after (de)serialization - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 03:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 03:55:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37423) Inline type hints for python/pyspark/mllib/fpm.py - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 03:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37726) Add spill size metrics for sort merge join - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/30 04:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37770) Performance improvements for ColumnVector `putByteArray` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 06:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37770) Performance improvements for ColumnVector `putByteArray` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 06:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37786) CLONE - StreamingQueryListener should also support SQLConf - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/30 07:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37786) CLONE - StreamingQueryListener should also support SQLConf - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/30 07:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37786) StreamingQueryListener should also support SQLConf - posted by "angerszhu (Jira)" <ji...@apache.org> on 2021/12/30 07:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/30 07:45:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-37772) [PYSPARK] Publish ApacheSparkGitHubActionImage arm64 docker image - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/30 07:46:00 UTC, 0 replies.
- [jira] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/30 07:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37757) [Scala] Enable Spark test scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/30 07:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37758) [PYSPARK] Enable PySpark scheduled job on ARM based self-hosted runner - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2021/12/30 07:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37783) Add @tailrec wherever possible - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 07:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35714) Bug fix for deadlock during the executor shutdown - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 08:40:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-28516) Data Type Formatting Functions: `to_char` - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2021/12/30 11:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37777) update the SQL syntax of SHOW FUNCTIONS - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/30 13:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception - posted by "huangzhir (Jira)" <ji...@apache.org> on 2021/12/30 14:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37785) Add Utils.isAtExecutor - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/30 14:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37787) Long running Spark Job(Spark ThriftServer) throw HDFS_DELEGATE_TOKEN not found in cache Exception - posted by "huangzhir (Jira)" <ji...@apache.org> on 2021/12/30 14:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37788) ColumnOrName vs Column in PySpark Functions module - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2021/12/30 14:33:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37788) ColumnOrName vs Column in PySpark Functions module - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2021/12/30 14:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37789) Add a class to represent general aggregate functions in DS V2 - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2021/12/30 15:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37738) PySpark date_add only accepts an integer as it's second parameter - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/30 15:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37789) Add a class to represent general aggregate functions in DS V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 15:12:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37789) Add a class to represent general aggregate functions in DS V2 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 15:12:00 UTC, 1 replies.
- [jira] [Comment Edited] (SPARK-6305) Add support for log4j 2.x to Spark - posted by "Steve Loughran (Jira)" <ji...@apache.org> on 2021/12/30 18:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-23599) The UUID() expression is too non-deterministic - posted by "Stu (Jira)" <ji...@apache.org> on 2021/12/30 18:51:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37782) Make DataFrame.transform take the parameters for the function. - posted by "Rafal Wojdyla (Jira)" <ji...@apache.org> on 2021/12/30 20:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37601) Could/should sql.DataFrame.transform accept function parameters? - posted by "Maciej Szymkiewicz (Jira)" <ji...@apache.org> on 2021/12/30 20:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37788) ColumnOrName vs Column in PySpark Functions module - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 20:41:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37788) ColumnOrName vs Column in PySpark Functions module - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 20:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37735) Add appId interface to KubernetesConf - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/30 21:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-6305) Add support for log4j 2.x to Spark - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/30 22:03:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37790) Upgrade SLF4J to 1.7.32 - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/30 23:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37790) Upgrade SLF4J to 1.7.32 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 23:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37790) Upgrade SLF4J to 1.7.32 - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 23:30:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37791) Use log4j2 in examples. - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/30 23:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37791) Use log4j2 in examples. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 23:37:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-37791) Use log4j2 in examples. - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/30 23:37:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37719) Try to remove `--add-exports` compile option for Java 17 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2021/12/31 01:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37790) Upgrade SLF4J to 1.7.32 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/31 01:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37792) Spark shell sets log level to INFO by default - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/31 01:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37792) Spark shell sets log level to INFO by default - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/31 01:58:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-37713) No namespace assigned in Executor Pod ConfigMap - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/31 02:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37791) Use log4j2 in examples. - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2021/12/31 02:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37793) Invalid LocalMergedBlockData cause task hang - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2021/12/31 04:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37794) Remove log4j bridge api usage - posted by "L. C. Hsieh (Jira)" <ji...@apache.org> on 2021/12/31 04:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37794) Remove log4j bridge api usage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 04:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37794) Remove log4j bridge api usage - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 04:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37793) Invalid LocalMergedBlockData cause task hang - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 04:33:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37793) Invalid LocalMergedBlockData cause task hang - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 04:33:00 UTC, 1 replies.
- [jira] [Created] (SPARK-37795) Add a checkstyle rule to ban `org.apache.log4j` - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/31 04:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37795) Add a checkstyle rule to ban `org.apache.log4j` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 04:43:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37795) Add a checkstyle rule to ban `org.apache.log4j` - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 04:43:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37795) Add a scalastyle rule to ban `org.apache.log4j` - posted by "William Hyun (Jira)" <ji...@apache.org> on 2021/12/31 04:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the checking of aligned in unaligned platform - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/12/31 06:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the check of aligning with unaligned platform - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2021/12/31 06:09:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the check of aligning with unaligned platform - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 06:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-37796) ByteArrayMethods arrayEquals should fast skip the check of aligning with unaligned platform - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 06:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37792) Spark shell sets log level to INFO by default - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2021/12/31 06:33:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-30789) Support (IGNORE | RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 09:36:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-37792) Spark shell sets log level to INFO by default - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 09:58:00 UTC, 2 replies.
- [jira] [Created] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/12/31 10:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37797) Spark Thrift Server's query timeout doesn't cancel the synchronous query - posted by "ramakrishna chilaka (Jira)" <ji...@apache.org> on 2021/12/31 10:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37099) Impl a rank-based filter to optimize top-k computation - posted by "zhengruifeng (Jira)" <ji...@apache.org> on 2021/12/31 11:37:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-37099) Impl a rank-based filter to optimize top-k computation - posted by "zhengruifeng (Jira)" <ji...@apache.org> on 2021/12/31 11:39:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-37099) Impl a rank-based filter to optimize top-k computation - posted by "zhengruifeng (Jira)" <ji...@apache.org> on 2021/12/31 11:40:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37677) spark on k8s, when the user want to push python3.6.6.zip to the pod , but no permission to execute - posted by "Apache Spark (Jira)" <ji...@apache.org> on 2021/12/31 12:31:00 UTC, 1 replies.