You are viewing a plain text version of this content. The canonical link for it is here.

---

- [jira] [Created] (SPARK-42999) Impl Dataset#foreach, foreachPartitions - posted by "Zhen Li (Jira)" <ji...@apache.org> on 2023/04/01 00:03:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-42860) Add analysed logical mode in org.apache.spark.sql.execution.ExplainMode - posted by "xiaochen zhou (Jira)" <ji...@apache.org> on 2023/04/01 01:17:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-42998) Fix DataFrame.collect with null struct. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/01 01:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42998) Fix DataFrame.collect with null struct. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/01 01:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42993) Make Torch Distributor compatible with Spark Connect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/01 03:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42993) Make Torch Distributor compatible with Spark Connect - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/01 03:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41628) Support async query execution - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/01 04:59:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values - posted by "Clément de Groc (Jira)" <ji...@apache.org> on 2023/04/01 05:28:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43000) Do not cast to double type if one side is AnsiIntervalType in BinaryArithmetic - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/01 07:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43001) Spark last window dont flush in append mode - posted by "padavan (Jira)" <ji...@apache.org> on 2023/04/01 07:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43001) Spark last window dont flush in append mode - posted by "padavan (Jira)" <ji...@apache.org> on 2023/04/01 07:54:00 UTC, 12 replies.
- [jira] [Commented] (SPARK-38478) Use error classes in org.apache.spark.ui - posted by "Wencong Liu (Jira)" <ji...@apache.org> on 2023/04/01 08:38:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/01 09:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42840) Assign a name to the error class _LEGACY_ERROR_TEMP_2004 - posted by "Leibniz Hu (Jira)" <ji...@apache.org> on 2023/04/01 23:25:00 UTC, 0 replies.
- [jira] (SPARK-42840) Assign a name to the error class _LEGACY_ERROR_TEMP_2004 - posted by "Leibniz Hu (Jira)" <ji...@apache.org> on 2023/04/01 23:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42774) Expose VectorTypes API for DataSourceV2 Batch Scans - posted by "xiaochen zhou (Jira)" <ji...@apache.org> on 2023/04/02 05:33:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-43001) Spark last window dont flush in append mode - posted by "Vindhya G (Jira)" <ji...@apache.org> on 2023/04/02 05:49:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-38078) Aggregation with Watermark in AppendMode is holding data beyong water mark boundary. - posted by "Vindhya G (Jira)" <ji...@apache.org> on 2023/04/02 05:50:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/02 06:46:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/02 06:50:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/02 06:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42627) Spark: Getting SQLException: Unsupported type -102 reading from Oracle - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/02 06:52:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-42811) Make proto message `CacheTable` support `StorageLevel` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/02 23:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42806) Add Catalog - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/02 23:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42806) Add Catalog - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/02 23:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42811) Make proto message `CacheTable` support `StorageLevel` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/02 23:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42926) Upgrade Parquet to 1.13.0 - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/03 00:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43002) Modify Yarn Client's application report to reduce noise - posted by "Shreyesh Shaju Arangath (Jira)" <ji...@apache.org> on 2023/04/03 01:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43002) Modify Yarn Client's application report to reduce noise - posted by "Shreyesh Shaju Arangath (Jira)" <ji...@apache.org> on 2023/04/03 01:27:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43003) Enable doctest - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/03 02:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals() - posted by "Tian Haoyu (Jira)" <ji...@apache.org> on 2023/04/03 03:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals() - posted by "Tian Haoyu (Jira)" <ji...@apache.org> on 2023/04/03 03:07:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py - posted by "Tian Haoyu (Jira)" <ji...@apache.org> on 2023/04/03 03:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__() - posted by "Tian Haoyu (Jira)" <ji...@apache.org> on 2023/04/03 03:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__() - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/03 03:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-42859) Basic support for pandas API on Spark - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/03 03:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/03 03:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals() - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/03 03:38:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-43004) vendor==vendor typo in ResourceRequest.equals() - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 03:39:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/03 05:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/03 05:32:00 UTC, 3 replies.
- [jira] [Resolved] (SPARK-42519) Add more WriteTo tests after Scala Client session config is supported - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/03 05:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43007) Upgrade rocksdbjni to 8.0.0 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/03 05:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42914) Reuse transformUnregisteredFunction for DistributedSequenceID. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/03 05:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42955) Skip classifyException and wrap AnalysisException for SparkThrowable - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/03 07:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42955) Skip classifyException and wrap AnalysisException for SparkThrowable - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/03 07:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43008) Upgrade jodatime to 2.12.5 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/03 08:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43009) Parameterized sql() with constants - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/03 08:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43010) Migrate Column errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/03 10:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43011) array_insert should fail with 0 index - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/03 10:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43012) Name based access of accumulators from tasks - posted by "Mayur Bhosale (Jira)" <ji...@apache.org> on 2023/04/03 11:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43011) array_insert should fail with 0 index - posted by "ci-cassandra.apache.org (Jira)" <ji...@apache.org> on 2023/04/03 11:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43013) Migrate ValueError from DataFrame into PySparkValueError. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/03 11:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43014) spark.app.submitTime is not right in k8s cluster mode - posted by "Zhou Yifan (Jira)" <ji...@apache.org> on 2023/04/03 11:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43014) spark.app.submitTime is not right in k8s cluster mode - posted by "Zhou Yifan (Jira)" <ji...@apache.org> on 2023/04/03 13:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 13:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43005) `v is v >= 0` typo in pyspark/pandas/config.py - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 13:26:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__() - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 13:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43006) self.deserialized == self.deserialized typo in StorageLevel __eq__() - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 13:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42974) Restore `Utils#createTempDir` use `ShutdownHookManager.registerShutdownDeleteDir` to cleanup tempDir - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 13:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42974) Restore `Utils#createTempDir` use `ShutdownHookManager.registerShutdownDeleteDir` to cleanup tempDir - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/03 13:29:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43015) Python: await_termination & exception() for Streaming Connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/03 19:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43016) Python: Streaming Query Manager API for Connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/03 19:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42997) TableOutputResolver must use correct column paths in error messages for arrays and maps - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/03 22:22:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42997) TableOutputResolver must use correct column paths in error messages for arrays and maps - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/03 22:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43017) Connect to multiple hive metastore using single sparkcontext (i.e without stopping it") - posted by "Pravin Rathore (Jira)" <ji...@apache.org> on 2023/04/03 23:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43018) Fix bug with timestamp literals - posted by "Daniel (Jira)" <ji...@apache.org> on 2023/04/04 00:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43019) Move Ordering to PhysicalDataType - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/04 00:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43020) Add main error class for type errors - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/04 01:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur - posted by "Nikita Eshkeev (Jira)" <ji...@apache.org> on 2023/04/04 02:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43022) protobuf functions - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/04 03:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43023) Enhanced CatalogMetadata API test - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/04 03:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42810) Add a test catalog like InMemoryTableCatalog for SimpleSparkConnectService - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/04 03:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43023) Add switch catalog testing scenario for CatalogSuite - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/04 03:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42999) Impl Dataset#foreach, foreachPartitions - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/04 03:55:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43012) Name based access of accumulators from tasks - posted by "Mayur Bhosale (Jira)" <ji...@apache.org> on 2023/04/04 04:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43024) Upgrade pandas to 2.0.0 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/04 05:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43025) Eliminate Union if filters on the same child plan - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/04 05:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43025) Eliminate Union if filters on the same child plan - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/04 05:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43025) Eliminate Union if filters on the same child plan - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/04 06:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43026) Apply AQE with non-exchange table cache - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/04 06:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43027) Introduce dropDuplicatesWithinWatermark in PySpark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/04 06:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42963) Extend SparkSessionExtensions to inject rules into AQE query stage optimizer - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/04 07:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42963) Extend SparkSessionExtensions to inject rules into AQE query stage optimizer - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/04 07:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42974) Restore `Utils#createTempDir` use `ShutdownHookManager.registerShutdownDeleteDir` to cleanup tempDir - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/04 07:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43011) array_insert should fail with 0 index - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/04 07:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43011) array_insert should fail with 0 index - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/04 07:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43028) Add error class SQL_CONF_NOT_FOUND - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2023/04/04 08:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42964) PosgresDialect SqlState 42P07 also means table already exists - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/04 08:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42964) PosgresDialect SqlState 42P07 also means table already exists - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/04 08:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43026) Apply AQE with non-exchange table cache - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/04 09:14:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43025) Eliminate Union if filters have the same child plan - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/04 09:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration - posted by "Emil Ejbyfeldt (Jira)" <ji...@apache.org> on 2023/04/04 12:02:00 UTC, 4 replies.
- [jira] [Created] (SPARK-43029) Support pandas 2.0 - posted by "Phillip Cloud (Jira)" <ji...@apache.org> on 2023/04/04 12:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43029) PySpark Breaks with Pandas 2.0 - posted by "Phillip Cloud (Jira)" <ji...@apache.org> on 2023/04/04 12:39:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43026) Apply AQE with non-exchange table cache - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/04 13:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43026) Apply AQE with non-exchange table cache - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/04 13:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42655) Incorrect ambiguous column reference error - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/04 13:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42655) Incorrect ambiguous column reference error - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/04 13:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43030) deduplicate relations with metadata columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/04 14:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration - posted by "Emil Ejbyfeldt (Jira)" <ji...@apache.org> on 2023/04/04 14:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43009) Parameterized sql() with constants - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/04 15:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43011) array_insert should fail with 0 index - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/04 15:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42362) Upgrade kubernetes-client from 6.4.0 to 6.4.1 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/04 17:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43031) Enable tests for Python streaming spark-connect - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/04 17:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43031) Enable tests for Python streaming spark-connect - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/04 17:45:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43032) Add StreamingQueryManager API - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/04 17:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43033) Avoid task retries due to AssertNotNull checks - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/04 20:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43034) Improve error message in AssertNotNull by including combined column path - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/04 20:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43009) Parameterized sql() with constants - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/05 00:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43035) Add error class in Spark Connect server's ErrorInfo - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2023/04/05 00:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43035) Add error classes in Spark Connect server's ErrorInfo - posted by "Allison Wang (Jira)" <ji...@apache.org> on 2023/04/05 00:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42983) Fix the error message of createDataFrame from np.array(0) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/05 03:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42983) Fix the error message of createDataFrame from np.array(0) - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/05 03:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43030) deduplicate relations with metadata columns - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/05 03:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42983) Fix the error message of createDataFrame from np.array(0) - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/05 03:24:00 UTC, 0 replies.
- [jira] (SPARK-42411) Better support for Istio service mesh while running Spark on Kubernetes - posted by "Puneet (Jira)" <ji...@apache.org> on 2023/04/05 03:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41537) Protobuf backwards compatibility testing - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/05 06:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42316) Assign name to _LEGACY_ERROR_TEMP_2044 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/05 07:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42316) Assign name to _LEGACY_ERROR_TEMP_2044 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/05 07:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/05 08:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42855) Migrate nullability write checks to runtime for V2 tables - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/05 08:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42992) Introduce PySparkRuntimeError - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/05 09:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43013) Migrate ValueError from DataFrame into PySparkValueError. - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/05 09:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43027) Introduce dropDuplicatesWithinWatermark in PySpark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/05 09:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42995) Migrate Spark Connect DataFrame errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/05 10:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42995) Migrate Spark Connect DataFrame errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/05 10:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43036) Spark structuring streaming with kinesis and rocksdb integration - posted by "Rajesh (Jira)" <ji...@apache.org> on 2023/04/05 13:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43036) Spark structuring streaming with kinesis and rocksdb integration - posted by "Rajesh (Jira)" <ji...@apache.org> on 2023/04/05 13:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43037) Support fetch migrated shuffle with multiple reducers - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/05 14:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43038) Support the CBC mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/05 15:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43038) Support the CBC mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/05 15:25:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-43038) Support the CBC mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/05 15:25:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43039) Support custom fields in the file source _metadata column - posted by "Ryan Johnson (Jira)" <ji...@apache.org> on 2023/04/05 15:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-30292) Throw Exception when invalid string is cast to decimal in ANSI mode - posted by "Yeachan Park (Jira)" <ji...@apache.org> on 2023/04/05 16:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42218) Upgrade netty to version 4.1.87.Final - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42117) Upgrade kubernetes-client from 6.3.1 to 6.4.0 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39540) Upgrade mysql-connector-java to 8.0.29 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39725) Upgrade jetty-http from 9.4.46.v20220331 to 9.4.48.v20220622 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38340) Upgrade protobuf-java from 2.5.0 to 3.16.1 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38420) Upgrade bcprov-jdk15on from 1.60 to 1.67 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38287) Upgrade h2 from 2.0.204 to 2.1.210 in /sql/core - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38262) Upgrade Google guava to version 30.0-jre - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38291) Upgrade postgresql from 42.3.0 to 42.3.3 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:53:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38303) Upgrade ansi-regex from 5.0.0 to 5.0.1 in /dev - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/05 16:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43040) Improve TimestampNTZ support in JDBC data source - posted by "Tianhan Hu (Jira)" <ji...@apache.org> on 2023/04/05 18:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43040) Improve TimestampNTZ support in JDBC data source - posted by "Tianhan Hu (Jira)" <ji...@apache.org> on 2023/04/05 18:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43041) Restore constructors of exceptions for compatibility in connector API - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/05 19:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43016) Python: Streaming Query Manager API for Connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/05 19:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43015) Python: await_termination & exception() for Streaming Connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/05 19:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42960) Add remaining Streaming Query commands like await_termination() - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/05 19:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42951) Spark Connect: Streaming DataStreamReader API except table() - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/05 19:16:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43042) Spark Connect: Streaming DataStreamReader table() API - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/05 19:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43042) Spark Connect: Streaming readerwriter table() API - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/05 19:18:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43041) Restore constructors of exceptions for compatibility in connector API - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/05 20:18:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43043) Improve the performance of MapOutputTracker.updateMapOutput - posted by "Xingbo Jiang (Jira)" <ji...@apache.org> on 2023/04/05 23:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43043) Improve the performance of MapOutputTracker.updateMapOutput - posted by "Xingbo Jiang (Jira)" <ji...@apache.org> on 2023/04/05 23:10:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42101) Wrap InMemoryTableScanExec with QueryStage - posted by "Eugene Koifman (Jira)" <ji...@apache.org> on 2023/04/06 01:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43044) Upgrade buf to v1.17.0 - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2023/04/06 01:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43045) Clean-up remaining mypy failure - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/06 01:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43036) Spark structuring streaming with kinesis and rocksdb integration - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/06 01:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43046) Implement dropDuplicatesWithinWatermark in Spark Connect - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/06 02:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42672) Document error class list - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 03:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42672) Document error class list - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 03:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43010) Migrate Column errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 03:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43010) Migrate Column errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 03:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43047) Automate error class documentation - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/06 03:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42939) Streaming connect core API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 03:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42939) Streaming connect core API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 03:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43048) Testing JVM-captured exceptions from Python side. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/06 04:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43018) Fix bug with timestamp literals - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/06 04:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43018) Fix bug with timestamp literals - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/06 04:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43041) Restore constructors of exceptions for compatibility in connector API - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/06 05:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43041) Restore constructors of exceptions for compatibility in connector API - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/06 05:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43019) Move Ordering to PhysicalDataType - posted by "ci-cassandra.apache.org (Jira)" <ji...@apache.org> on 2023/04/06 05:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43049) Use CLOB instead of VARCHAR(255) for StringType for Oracle jdbc - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/06 05:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43012) Name based access of accumulators from tasks - posted by "Mayur Bhosale (Jira)" <ji...@apache.org> on 2023/04/06 06:37:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-42844) Assign a name to the error class _LEGACY_ERROR_TEMP_2008 - posted by "Liang Yan (Jira)" <ji...@apache.org> on 2023/04/06 07:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42844) Assign a name to the error class _LEGACY_ERROR_TEMP_2008 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/06 07:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42844) Assign a name to the error class _LEGACY_ERROR_TEMP_2008 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/06 07:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43013) Migrate ValueError from DataFrame into PySparkValueError. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 09:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43013) Migrate ValueError from DataFrame into PySparkValueError. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/06 09:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-35324) Spark SQL configs not respected in RDDs - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2023/04/06 12:01:00 UTC, 0 replies.
- [jira] (SPARK-42999) Impl Dataset#foreach, foreachPartitions - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/06 12:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42840) Assign a name to the error class _LEGACY_ERROR_TEMP_2004 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/06 12:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42840) Assign a name to the error class _LEGACY_ERROR_TEMP_2004 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/06 12:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/06 14:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43051) Allow materializing zero values when deserializing protobuf messages - posted by "Parth Upadhyay (Jira)" <ji...@apache.org> on 2023/04/06 14:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43051) Allow materializing zero values when deserializing protobuf messages - posted by "Parth Upadhyay (Jira)" <ji...@apache.org> on 2023/04/06 15:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43052) Handle stacktrace with null file name in event log - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/06 15:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43033) Avoid task retries due to AssertNotNull checks - posted by "xiaochen zhou (Jira)" <ji...@apache.org> on 2023/04/06 15:39:00 UTC, 4 replies.
- [jira] [Created] (SPARK-43053) Possible logic issue - posted by "Rob Harrison (Jira)" <ji...@apache.org> on 2023/04/06 15:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42977) spark sql Disable vectorized faild - posted by "Sun Chao (Jira)" <ji...@apache.org> on 2023/04/06 16:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/06 16:13:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-42953) Impl typed map, flatMap, mapPartitions in Dataset - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/06 19:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43054) Support foreach() in streaming spark connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/06 21:55:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-43015) Python: await_termination & exception() for Streaming Connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/06 22:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43055) createDataFrame should support duplicated nested field names - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/06 23:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42993) Make Torch Distributor compatible with Spark Connect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/07 00:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42993) Make Torch Distributor compatible with Spark Connect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/07 00:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43053) Possible logic issue - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/07 01:20:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43044) Upgrade buf to v1.17.0 - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/07 01:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43044) Upgrade buf to v1.17.0 - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/07 01:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/07 01:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43056) RocksDB state store commit should continue background work in finally only if its paused - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/07 01:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43056) RocksDB state store commit should continue background work in finally only if its paused - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/07 01:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43019) Move Ordering to PhysicalDataType - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/07 01:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43023) Add switch catalog testing scenario for CatalogSuite - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/07 01:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43057) Migrate Spark Connect Column errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/07 02:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43058) Move Numeric to PhysicalDataType - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/07 02:46:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43049) Use CLOB instead of VARCHAR(255) for StringType for Oracle jdbc - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/07 03:03:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-43049) Use CLOB instead of VARCHAR(255) for StringType for Oracle jdbc - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/07 03:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43059) Migrate TypeError from DataFrame(Reader|Writer) into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/07 03:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43025) Eliminate Union if filters have the same child plan - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/07 03:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41532) DF operations that involve multiple data frames should fail if sessions don't match - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/07 03:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43058) Move Numeric to PhysicalDataType - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/07 03:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42994) Support sc.resources in Connect - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/07 03:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43030) deduplicate relations with metadata columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/07 03:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43030) deduplicate relations with metadata columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/07 03:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42926) Upgrade Parquet to 1.13.0 - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/07 03:50:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 04:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-39696) Uncaught exception in thread executor-heartbeater java.util.ConcurrentModificationException: mutation occurred during iteration - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 04:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43060) [SQL] Spark JDBC rate limitation - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/07 05:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-38200) [SQL] Spark JDBC Savemode Supports Upsert - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/07 05:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43007) Upgrade rocksdbjni to 8.0.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 05:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43007) Upgrade rocksdbjni to 8.0.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 05:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/07 05:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43062) Add options to lint-python to run each test separately - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/07 06:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43062) Add options to lint-python to run each test separately - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/07 06:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43063) `df.show` handle null should print NULL instead of null - posted by "yikaifei (Jira)" <ji...@apache.org> on 2023/04/07 07:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43063) `df.show` handle null should print NULL instead of null - posted by "yikaifei (Jira)" <ji...@apache.org> on 2023/04/07 07:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once - posted by "angerszhu (Jira)" <ji...@apache.org> on 2023/04/07 08:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once - posted by "angerszhu (Jira)" <ji...@apache.org> on 2023/04/07 08:32:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43065) Set job description for tpcds queries - posted by "caican (Jira)" <ji...@apache.org> on 2023/04/07 08:52:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43065) Set job description for tpcds queries - posted by "caican (Jira)" <ji...@apache.org> on 2023/04/07 08:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43066) Add Java test for dropDuplicates in batch DataFrame - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/07 09:55:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43067) Error class resource file in Kafka connector is misplaced - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/07 10:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43067) Error class resource file in Kafka connector is misplaced - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/07 10:22:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-43067) Error class resource file in Kafka connector is misplaced - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/07 10:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43068) Create an allGather function with a byte array - posted by "Derek M Miller (Jira)" <ji...@apache.org> on 2023/04/07 14:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43069) Use `sbt-eclipse` instead of `sbteclipse-plugin` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 18:58:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43069) Use `sbt-eclipse` instead of `sbteclipse-plugin` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 19:50:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43069) Use `sbt-eclipse` instead of `sbteclipse-plugin` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 19:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43069) Use `sbt-eclipse` instead of `sbteclipse-plugin` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 19:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43070) Upgrade sbt-unidoc to 0.5.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 20:12:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43070) Upgrade sbt-unidoc to 0.5.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 20:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43071) Support SELECT DEFAULT with ORDER BY, LIMIT, OFFSET for INSERT source relation - posted by "Daniel (Jira)" <ji...@apache.org> on 2023/04/07 22:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43070) Upgrade sbt-unidoc to 0.5.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 23:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43070) Upgrade sbt-unidoc to 0.5.0 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/07 23:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43072) Include TIMESTAMP_NTZ in ANSI Compliance doc - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/07 23:36:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-43017) Connect to multiple hive metastore using single sparkcontext (i.e without stopping it") - posted by "Leibniz Hu (Jira)" <ji...@apache.org> on 2023/04/08 06:41:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-43017) Connect to multiple hive metastore using single sparkcontext (i.e without stopping it") - posted by "Leibniz Hu (Jira)" <ji...@apache.org> on 2023/04/08 06:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42859) Basic support for pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/08 07:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42859) Basic support for pandas API on Spark - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/08 07:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43062) Add options to lint-python to run each test separately - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/08 07:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43062) Add options to lint-python to run each test separately - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/08 07:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43066) Add Java test for dropDuplicates in batch DataFrame - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/08 07:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43066) Add Java test for dropDuplicates in batch DataFrame - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/08 07:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43073) Add proto types constant - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/08 07:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43073) Add proto types constants - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/08 07:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42280) add spark.yarn.archive/jars similar option for spark on K8S - posted by "Leibniz Hu (Jira)" <ji...@apache.org> on 2023/04/08 08:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43074) Add the function without constant parameters of `SessionState#executePlan` - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/08 13:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43074) Add the function without constant parameters of `SessionState#executePlan` - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/08 13:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42931) dropDuplicates within watermark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 13:46:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42931) dropDuplicates within watermark - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 13:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43075) Change gRPC to grpcio when it is not installed. - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/08 20:10:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43029) PySpark Breaks with Pandas 2.0 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/08 20:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43067) Error class resource file in Kafka connector is misplaced - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 21:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43067) Error class resource file in Kafka connector is misplaced - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 21:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42860) Add analysed logical mode in org.apache.spark.sql.execution.ExplainMode - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 21:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42976) spark sql Disable vectorized faild - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 21:42:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-42976) spark sql Disable vectorized faild - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 21:43:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43017) Connect to multiple hive metastore using single sparkcontext (i.e without stopping it") - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 21:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-38078) Aggregation with Watermark in AppendMode is holding data beyong water mark boundary. - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 22:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-36121) Write data loss caused by stage retry when enable v2 FileOutputCommitter - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/08 22:04:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43074) Add the function without constant parameters of `SessionState#executePlan` - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/09 03:36:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-43001) Spark last window dont flush in append mode - posted by "Vindhya G (Jira)" <ji...@apache.org> on 2023/04/09 05:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43075) Change gRPC to grpcio when it is not installed. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/09 05:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43075) Change gRPC to grpcio when it is not installed. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/09 05:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43076) Removing the dependency on `grpcio` when remote session is not used. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/10 01:13:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43076) Removing the dependency on `grpcio` when remote session is not used. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/10 01:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43073) Add proto types constants - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/10 01:37:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43073) Add proto types constants - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/10 01:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43072) Include TIMESTAMP_NTZ in ANSI Compliance doc - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 02:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43072) Include TIMESTAMP_NTZ in ANSI Compliance doc - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 02:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43077) Improve the error message of UNRECOGNIZED_SQL_TYPE - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/10 02:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43074) Add the function without constant parameters of `SessionState#executePlan` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43065) Set job description for tpcds queries - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43060) Spark JDBC rate limitation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:14:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-43060) [SQL] Spark JDBC rate limitation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43063) `df.show` handle null should print NULL instead of null - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:14:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-43053) Possible logic issue - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43052) Handle stacktrace with null file name in event log - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:15:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43046) Implement dropDuplicatesWithinWatermark in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:16:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43039) Support custom fields in the file source _metadata column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43038) Support the CBC mode by aes_encrypt()/aes_decrypt() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43039) Support custom fields in the file source _metadata column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:17:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-43029) PySpark Breaks with Pandas 2.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43000) Do not cast to double type if one side is AnsiIntervalType in BinaryArithmetic - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42987) Correct code highlights in SQL protobuf documentation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:22:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-42989) When Spark is going to end support of Hadoop2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42988) Spark Sql insert into hive table dynamic partitions slow - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42987) Correct code highlights in SQL protobuf documentation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42987) Correct code highlights in SQL protobuf documentation - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42975) Cast result type to timestamp type for string +/- interval - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42950) Add exit code in SparkListenerApplicationEnd - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:27:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42948) Execution plan error, unable to obtain desired results - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-42932) Spark 3.3.2, with hadoop3, Error with java.io.IOException: Mkdirs failed to create file - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42923) Delayed scheduling doesn’t work in some situations in local mode if different localities present in loaded files leading to tasks getting stuck - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:29:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-42916) JDBCCatalog Keep Char/Varchar meta information on the read-side - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:30:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-42910) Generic annotation of class attribute in abstract class is NOT initalized in inherited classes - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42860) Add analysed logical mode in org.apache.spark.sql.execution.ExplainMode - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 03:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42948) Execution plan error, unable to obtain desired results - posted by "miaowang (Jira)" <ji...@apache.org> on 2023/04/10 03:40:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-43056) RocksDB state store commit should continue background work in finally only if its paused - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/10 05:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43056) RocksDB state store commit should continue background work in finally only if its paused - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/10 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43059) Migrate TypeError from DataFrame(Reader|Writer) into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 06:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43059) Migrate TypeError from DataFrame(Reader|Writer) into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 06:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43057) Migrate Spark Connect Column errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 06:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43065) Set job description for tpcds queries - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 06:20:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43065) Set job description for tpcds queries - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 06:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43078) Separate test into `pyspark-conenct-pandas` and `pyspark-connect-pandas-slow` - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/10 06:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43079) Add bloom filter details in spark history server plans/SVGs - posted by "Rajesh Balamohan (Jira)" <ji...@apache.org> on 2023/04/10 07:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-40609) Casts types according to bucket info for Equality expression - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/10 08:00:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43080) Upgrade zstd-jni to 1.5.5-1 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/10 09:03:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43080) Upgrade zstd-jni to 1.5.5-1 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/10 09:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43077) Improve the error message of UNRECOGNIZED_SQL_TYPE - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/10 09:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43081) Add torch distributor data loader that loads data from spark partition data - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/10 09:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43081) Add torch distributor data loader that loads data from spark partition data - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/10 12:06:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43081) Add torch distributor data loader that loads data from spark partition data - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/10 12:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43081) Add torch distributor data loader that loads data from spark partition data - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/10 12:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/10 16:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43061) Introduce TaskEvaluator for SQL operator execution - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/10 16:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43061) Introduce PartitionEvaluator for SQL operator execution - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/10 16:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43082) Arrow-optimized Python UDFs in Spark Connect - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/10 17:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.5 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 19:16:00 UTC, 1 replies.
- [jira] [Reopened] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.5 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 19:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.6 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 19:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43083) Mark `*StateStoreSuite` as `ExtendedSQLTest` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 21:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43084) Add Python state API (applyInPandasWithState) and verify UDFs - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/10 21:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43085) Fix bug in column DEFAULT assignment for target tables with three-part names - posted by "Daniel (Jira)" <ji...@apache.org> on 2023/04/10 22:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43085) Fix bug in column DEFAULT assignment for target tables with three-part names - posted by "Daniel (Jira)" <ji...@apache.org> on 2023/04/10 22:22:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43086) Support bin pack task scheduling on executors - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/10 22:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43071) Support SELECT DEFAULT with ORDER BY, LIMIT, OFFSET for INSERT source relation - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/10 23:10:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43071) Support SELECT DEFAULT with ORDER BY, LIMIT, OFFSET for INSERT source relation - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/10 23:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43087) Support coalesce buckets in join in AQE - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/10 23:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43083) Mark `*StateStoreSuite` as `ExtendedSQLTest` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 23:25:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43083) Mark `*StateStoreSuite` as `ExtendedSQLTest` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 23:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43083) Mark `*StateStoreSuite` as `ExtendedSQLTest` - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/10 23:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.6 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 23:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42951) Spark Connect: Streaming DataStreamReader API except table() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 23:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42951) Spark Connect: Streaming DataStreamReader API except table() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/10 23:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42382) Upgrade `cyclonedx-maven-plugin` to 2.7.6 - posted by "Mike K (Jira)" <ji...@apache.org> on 2023/04/11 00:11:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43085) Fix bug in column DEFAULT assignment for target tables with multi-part names - posted by "Daniel (Jira)" <ji...@apache.org> on 2023/04/11 00:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/11 00:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43089) Redact debug string in UI - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/11 01:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43089) Redact debug string in UI - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/11 01:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43090) Move withTable from RemoteSparkSession to SQLHelper - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/11 02:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43090) Move withTable from RemoteSparkSession to SQLHelper - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/11 02:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43090) Move withTable from RemoteSparkSession to SQLHelper - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/11 02:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43091) Support overloading UDF - posted by "Hang Wu (Jira)" <ji...@apache.org> on 2023/04/11 02:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43077) Improve the error message of UNRECOGNIZED_SQL_TYPE - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/11 02:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43077) Improve the error message of UNRECOGNIZED_SQL_TYPE - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/11 02:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43089) Redact debug string in UI - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/11 03:23:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43089) Redact debug string in UI - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/11 03:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43089) Redact debug string in UI - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/11 03:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/11 03:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43092) Cleanup unsuppoerted function `dropDuplicatesWithinWatermark` from `Dataset` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/11 05:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43093) Test case "Add a directory when spark.sql.legacy.addSingleFileInAddFile set to false" should use random directories for testing - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/11 05:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42380) Upgrade maven to 3.9.1 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/11 08:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43028) Add error class SQL_CONF_NOT_FOUND - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/11 10:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43028) Add error class SQL_CONF_NOT_FOUND - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/11 10:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43094) Array Insert Should Throw On 'Pos' Value 0 - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2023/04/11 11:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43094) Array Insert Should Throw On 'Pos' Value 0 - posted by "Daniel Davies (Jira)" <ji...@apache.org> on 2023/04/11 11:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43058) Move Numeric to PhysicalDataType - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/11 12:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43087) Support coalesce buckets in join in AQE - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/11 13:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/11 13:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43096) Comment of DAGScheduler.submitMissingTasks is wrong - posted by "Jie Han (Jira)" <ji...@apache.org> on 2023/04/11 13:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43096) Comment of DAGScheduler.submitMissingTasks is wrong - posted by "Jie Han (Jira)" <ji...@apache.org> on 2023/04/11 13:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43096) Comment of DAGScheduler.submitMissingTasks is wrong - posted by "Jie Han (Jira)" <ji...@apache.org> on 2023/04/11 14:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43097) Implement pyspark ML logistic regression estimator on top of torch distributor - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/11 15:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43097) Implement pyspark ML logistic regression estimator on top of torch distributor - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/11 15:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43080) Upgrade zstd-jni to 1.5.5-1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/11 16:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43080) Upgrade zstd-jni to 1.5.5-1 - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/11 16:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43002) Modify Yarn Client's application report to reduce noise - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/11 17:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43002) Modify Yarn Client's application report to reduce noise - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/11 17:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty - posted by "Jack Chen (Jira)" <ji...@apache.org> on 2023/04/11 19:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry - posted by "Alex Jing (Jira)" <ji...@apache.org> on 2023/04/11 22:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43100) Mismatch of field name in log event writer and parser for push shuffle metrics - posted by "Ye Zhou (Jira)" <ji...@apache.org> on 2023/04/11 23:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43100) Mismatch of field name in log event writer and parser for push shuffle metrics - posted by "Ye Zhou (Jira)" <ji...@apache.org> on 2023/04/12 00:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43087) Support coalesce buckets in join in AQE - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/12 00:25:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42962) Allow access to stopped streaming queries - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/12 00:56:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42994) Torch Distributor support Local Mode - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/12 01:23:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-43096) Comment of DAGScheduler.submitMissingTasks is wrong - posted by "Jie Han (Jira)" <ji...@apache.org> on 2023/04/12 02:18:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43093) Test case "Add a directory when spark.sql.legacy.addSingleFileInAddFile set to false" should use random directories for testing - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/12 02:24:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43093) Test case "Add a directory when spark.sql.legacy.addSingleFileInAddFile set to false" should use random directories for testing - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/12 02:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39625) add Dataset.to(StructType) - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/12 02:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43039) Support custom fields in the file source _metadata column - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/12 03:04:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43039) Support custom fields in the file source _metadata column - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/12 03:04:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43101) Add CREATE/DROP catalog - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/12 04:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43102) Upgrade commons-compress to 1.23.0 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/12 04:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43103) Move Integral to PhysicalDataType - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/12 06:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43055) createDataFrame should support duplicated nested field names - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/12 06:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42985) Fix createDataFrame from pandas to respect session timezone. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/12 06:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43104) Set `shadeTestJar` of protobuf module to false - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/12 07:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42994) Torch Distributor support Local Mode - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/12 07:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42994) Torch Distributor support Local Mode - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/12 07:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43105) Abbreviate Bytes in proto message's debug string - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/12 07:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails - posted by "vaibhav beriwala (Jira)" <ji...@apache.org> on 2023/04/12 10:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails - posted by "vaibhav beriwala (Jira)" <ji...@apache.org> on 2023/04/12 10:10:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-43105) Abbreviate Bytes in proto message's debug string - posted by "GridGain Integration (Jira)" <ji...@apache.org> on 2023/04/12 11:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43103) Move Integral to PhysicalDataType - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/12 12:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43107) Coalesce applied on broadcast join stream side - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/12 13:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43038) Support the CBC mode by aes_encrypt()/aes_decrypt() - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/12 13:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43108) org.apache.spark.storage.StorageStatus NotSerializableException when try to access StorageStatus in a MapPartitionsFunction - posted by "surender godara (Jira)" <ji...@apache.org> on 2023/04/12 14:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43108) org.apache.spark.storage.StorageStatus NotSerializableException when try to access StorageStatus in a MapPartitionsFunction - posted by "surender godara (Jira)" <ji...@apache.org> on 2023/04/12 15:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43109) JavaRDD.saveAsTextFile Directory Creation issue using Spark 3.3.2, with hadoop3 - posted by "shamim (Jira)" <ji...@apache.org> on 2023/04/12 16:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-16484) Incremental Cardinality estimation operations with Hyperloglog - posted by "Hudson (Jira)" <ji...@apache.org> on 2023/04/12 16:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43110) Move asIntegral to PhysicalDataType - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/12 16:51:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43084) Add Python state API (applyInPandasWithState) and verify UDFs - posted by "Peng Zhong (Jira)" <ji...@apache.org> on 2023/04/12 18:08:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-42437) Pyspark catalog.cacheTable allow to specify storage level Connect add support Storagelevel - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/12 20:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43111) Merge nested if statements into single if statements - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/12 20:30:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43111) Merge nested if statements into single if statements - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/12 20:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43112) Spark may use a column other than the actual specified partitioning column for partitioning, for Hive format tables - posted by "Asif (Jira)" <ji...@apache.org> on 2023/04/12 22:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43112) Spark may use a column other than the actual specified partitioning column for partitioning, for Hive format tables - posted by "Asif (Jira)" <ji...@apache.org> on 2023/04/12 22:13:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2023/04/12 22:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43114) Add interval types to TypeCoercionSuite - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/12 23:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43115) Split pyspark-pandas-connect from pyspark-connect module. - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/12 23:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43107) Coalesce applied on broadcast join stream side - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/12 23:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43114) Add interval types to TypeCoercionSuite - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/12 23:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/12 23:44:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43112) Spark may use a column other than the actual specified partitioning column for partitioning, for Hive format tables - posted by "Asif (Jira)" <ji...@apache.org> on 2023/04/12 23:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43031) Enable tests for Python streaming spark-connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/13 00:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43031) Enable tests for Python streaming spark-connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/13 00:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2023/04/13 00:33:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43101) Add CREATE/DROP catalog - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/13 01:13:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43101) Dynamic Catalogs - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/13 01:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43110) Move asIntegral to PhysicalDataType - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 01:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43063) `df.show` handle null should print NULL instead of null - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 02:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43063) `df.show` handle null should print NULL instead of null - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 02:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43116) Fix Cast.forceNullable - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/13 02:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43116) Fix Cast.forceNullable - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/13 02:49:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43115) Split pyspark-pandas-connect from pyspark-connect module. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/13 03:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43115) Split pyspark-pandas-connect from pyspark-connect module. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/13 03:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43117) proto message abbreviation should support repeated and map fields - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/13 03:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43118) Remove unnecessary assert for UninterruptibleThread in KafkaMicroBatchStream - posted by "Boyang Jerry Peng (Jira)" <ji...@apache.org> on 2023/04/13 03:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43118) Remove unnecessary assert for UninterruptibleThread in KafkaMicroBatchStream - posted by "Boyang Jerry Peng (Jira)" <ji...@apache.org> on 2023/04/13 03:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-37099) Introduce a rank-based filter to optimize top-k computation - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/13 03:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43118) Remove unnecessary assert for UninterruptibleThread in KafkaMicroBatchStream - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/13 03:49:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43119) Support Get SQL Keywords Dynamically - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/13 03:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43119) Support Get SQL Keywords Dynamically - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/13 04:18:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-42916) JDBCCatalog Keep Char/Varchar meta information on the read-side - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/13 05:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42916) JDBCCatalog Keep Char/Varchar meta information on the read-side - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/13 05:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42975) Cast result type to timestamp type for string +/- interval - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/13 06:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43120) Add tracking for block cache pinned usage for RocksDB state store - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/13 06:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43120) Add tracking for block cache pinned usage for RocksDB state store - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/13 06:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43118) Remove unnecessary assert for UninterruptibleThread in KafkaMicroBatchStream - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/13 08:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43118) Remove unnecessary assert for UninterruptibleThread in KafkaMicroBatchStream - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/13 08:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43121) Use `BytesWritable.copyBytes` instead of manual copy in `HiveInspectors` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/13 08:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43122) Reenable TorchDistributorLocalUnitTestsIIOnConnect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/13 08:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/13 09:04:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-43114) Add interval types to TypeCoercionSuite - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/13 09:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43114) Add interval types to TypeCoercionSuite - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/13 09:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42982) Fix createDataFrame from pandas with map type - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/13 09:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42982) Fix createDataFrame from pandas with map type - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/13 09:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 09:58:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43088) Respect RequiresDistributionAndOrdering in CTAS/RTAS - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 09:58:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42407) `with as` executed again - posted by "yiku123 (Jira)" <ji...@apache.org> on 2023/04/13 11:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42407) `with as` executed again - posted by "yiku123 (Jira)" <ji...@apache.org> on 2023/04/13 11:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43123) special internal field metadata should not be leaked to catalogs - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 11:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43124) Dataset.show should not trigger job execution on CommandResults - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2023/04/13 12:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43125) Connect Server Can't Handle Exception With Null Message Normally - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/13 13:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43125) Connect Server Can't Handle Exception With Null Message Normally - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/13 13:06:00 UTC, 4 replies.
- [jira] [Resolved] (SPARK-43120) Add tracking for block cache pinned usage for RocksDB state store - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/13 13:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43120) Add tracking for block cache pinned usage for RocksDB state store - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/13 13:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43127) pandas udf/udaf not support partial merge - posted by "jibiyr (Jira)" <ji...@apache.org> on 2023/04/13 13:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43126) mark two Hive UDF expressions as stateful - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 13:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 13:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41674) Runtime filter should supports multi level shuffle join side as filter creation side - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/13 13:55:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42781) provide one format for writing to kafka - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/13 14:01:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43128) Streaming progress struct (especially in Scala) - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/13 17:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43129) Scala MVP for Streaming Spark Connect - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/13 18:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43129) Scala Core API for Streaming Spark Connect - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/13 18:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43130) Move InternalType to PhysicalDataType - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/13 19:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43131) Add labels to identify UDF - posted by "Ahmed Hussein (Jira)" <ji...@apache.org> on 2023/04/13 19:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43132) Add foreach streaming API in Python - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/13 20:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43133) Add foreach streaming API in Scala - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/13 20:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43134) Add streaming query exception API in Scala - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/13 20:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43085) Fix bug in column DEFAULT assignment for target tables with multi-part names - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/13 21:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43085) Fix bug in column DEFAULT assignment for target tables with multi-part names - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/13 21:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43135) Remove `branch-3.2` from `publish_snapshot` GitHub Action job - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/13 22:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43135) Remove `branch-3.2` from `publish_snapshot` GitHub Action job - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/14 00:39:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43135) Remove `branch-3.2` from `publish_snapshot` GitHub Action job - posted by "Dongjoon Hyun (Jira)" <ji...@apache.org> on 2023/04/14 00:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43121) Use `BytesWritable.copyBytes` instead of manual copy in `HiveInspectors` - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 00:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43121) Use `BytesWritable.copyBytes` instead of manual copy in `HiveInspectors` - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 00:50:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43126) mark two Hive UDF expressions as stateful - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 00:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43126) mark two Hive UDF expressions as stateful - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 00:51:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43105) Abbreviate Bytes in proto message's debug string - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/14 01:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43105) Abbreviate Bytes in proto message's debug string - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/14 01:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43122) Reenable TorchDistributorLocalUnitTestsOnConnect and TorchDistributorLocalUnitTestsIIOnConnect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/14 01:22:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43136) Scala mapGroup, coGroup - posted by "Zhen Li (Jira)" <ji...@apache.org> on 2023/04/14 01:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43122) Reenable TorchDistributorLocalUnitTestsOnConnect and TorchDistributorLocalUnitTestsIIOnConnect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/14 01:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/14 03:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43021) Shuffle happens when Coalesce Buckets should occur - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/14 03:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-41210) Window based executor failure tracking mechanism - posted by "Mike K (Jira)" <ji...@apache.org> on 2023/04/14 03:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero. - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/14 03:38:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43125) Connect Server Can't Handle Exception With Null Message Normally - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/14 03:47:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43125) Connect Server Can't Handle Exception With Null Message Normally - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/14 03:47:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2023/04/14 06:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43138) ClassNotFound during RDD block replication/migration - posted by "Emil Ejbyfeldt (Jira)" <ji...@apache.org> on 2023/04/14 06:07:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43138) ClassNotFound during RDD block replication/migration - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/14 06:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43138) ClassNotFoundException during RDD block replication/migration - posted by "Emil Ejbyfeldt (Jira)" <ji...@apache.org> on 2023/04/14 08:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43139) Bug in INSERT INTO documentation - posted by "Bjorn Olsen (Jira)" <ji...@apache.org> on 2023/04/14 09:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43123) special internal field metadata should not be leaked to catalogs - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/14 09:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43123) special internal field metadata should not be leaked to catalogs - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/14 09:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43140) Override computeStats in DummyLeafNode - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/14 09:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43140) Override computeStats in DummyLeafNode - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/14 10:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-30552) Chained spark column expressions with distinct windows specs produce inefficient DAG - posted by "Dovi Joel (Jira)" <ji...@apache.org> on 2023/04/14 11:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43141) Ignore generated Java files in checkstyle - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/14 11:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2023/04/14 13:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2023/04/14 13:18:00 UTC, 4 replies.
- [jira] [Comment Edited] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Willi Raschkowski (Jira)" <ji...@apache.org> on 2023/04/14 13:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43104) Set `shadeTestJar` of protobuf module to false - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 15:42:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43104) Set `shadeTestJar` of protobuf module to false - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 15:42:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 15:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43064) Spark SQL CLI SQL tab should only show once statement once - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/14 15:45:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39892) Use ArrowType.Decimal(precision, scale, bitWidth) instead of ArrowType.Decimal(precision, scale) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42169) Implement code generation for `to_csv` function (StructsToCsv) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39814) Use AmazonKinesisClientBuilder.withCredentials instead of new AmazonKinesisClient(credentials) - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-38945) simply KEYTAB and PRINCIPAL in KerberosConfDriverFeatureStep - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-37935) Migrate onto error classes - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-41259) Spark-sql cli query results should correspond to schema - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39136) JDBCTable support properties - posted by "Xinrong Meng (Jira)" <ji...@apache.org> on 2023/04/14 16:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43022) protobuf functions - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/14 16:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43143) Scala: Add StreamingQuery awaitTermination() API - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/14 19:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43144) Scala: DataStreamReader table() API - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/14 19:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43145) Reduce ClassNotFound of hive storage handler table - posted by "Yi Zhang (Jira)" <ji...@apache.org> on 2023/04/14 19:42:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43145) Reduce ClassNotFound of hive storage handler table - posted by "Yi Zhang (Jira)" <ji...@apache.org> on 2023/04/14 22:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43146) Implement eager evaluation. - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/14 23:07:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43147) Python lint local config - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/15 00:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43148) Add official image dockerfile for Spark v3.4.0 - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2023/04/15 01:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 01:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43107) Coalesce buckets in join applied on broadcast join stream side - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 01:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42926) Upgrade Parquet to 1.13.0 - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 01:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42926) Upgrade Parquet to 1.13.0 - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 01:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 01:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43095) Avoid Once strategy's idempotence is broken for batch: Infer Filters - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 01:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43149) When CREATE USING fails to store metadata in metastore, data gets left around - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2023/04/15 01:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43149) When CTAS with USING fails to store metadata in metastore, data gets left around - posted by "Bruce Robbins (Jira)" <ji...@apache.org> on 2023/04/15 01:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43150) Remove workaround for PARQUET-2160 - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/15 02:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43050) Fix construct aggregate expressions by replacing grouping functions - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/15 02:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43150) Remove workaround for PARQUET-2160 - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/15 04:51:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43150) Remove workaround for PARQUET-2160 - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/15 04:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43151) Update the instruction for generating Python API docs - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/15 07:09:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43151) Update the prerequisites for generating Python API docs - posted by "Gengliang Wang (Jira)" <ji...@apache.org> on 2023/04/15 07:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42317) Assign name to _LEGACY_ERROR_TEMP_2247 - posted by "Koray Beyaz (Jira)" <ji...@apache.org> on 2023/04/15 15:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43152) Parametrisable output metadata path (_spark_metadata) - posted by "Wojciech Indyk (Jira)" <ji...@apache.org> on 2023/04/15 17:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43152) Parametrisable output metadata path (_spark_metadata) - posted by "Wojciech Indyk (Jira)" <ji...@apache.org> on 2023/04/15 18:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43153) Skip Spark execution when the dataframe is local. - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/15 21:31:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43139) Bug in INSERT INTO documentation - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/16 00:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-38471) Use error classes in org.apache.spark.rdd - posted by "xin chen (Jira)" <ji...@apache.org> on 2023/04/16 03:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42388) Avoid unnecessary parquet footer reads when no filters in vectorized reader - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/16 04:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42388) Avoid unnecessary parquet footer reads when no filters in vectorized reader - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/16 04:11:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43139) Bug in INSERT INTO documentation - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/16 07:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43139) Bug in INSERT INTO documentation - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/16 07:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43154) Pyspark 3.4 fails when running "pivot" function on a dataframe using the values arguement - posted by "Ofri Kleinfeld (Jira)" <ji...@apache.org> on 2023/04/16 10:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43141) Ignore generated Java files in checkstyle - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/16 10:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43141) Ignore generated Java files in checkstyle - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/16 10:48:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43154) Pyspark 3.4 fails when running "pivot" function on a dataframe using the values arguement - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/16 12:34:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43138) ClassNotFoundException during RDD block replication/migration - posted by "Emil Ejbyfeldt (Jira)" <ji...@apache.org> on 2023/04/16 13:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43155) DataSourceV2 is hard to be implemented without following V1 - posted by "PEIYUAN SUN (Jira)" <ji...@apache.org> on 2023/04/16 13:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43155) DataSourceV2 is hard to be implemented without following V1 - posted by "PEIYUAN SUN (Jira)" <ji...@apache.org> on 2023/04/16 13:55:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null` - posted by "Jack Chen (Jira)" <ji...@apache.org> on 2023/04/16 20:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null` - posted by "Jack Chen (Jira)" <ji...@apache.org> on 2023/04/16 20:30:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43157) TreeNode tags can become corrupted and hang driver when the dataset is cached - posted by "Rob Reeves (Jira)" <ji...@apache.org> on 2023/04/16 22:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43157) TreeNode tags can become corrupted and hang driver when the dataset is cached - posted by "Rob Reeves (Jira)" <ji...@apache.org> on 2023/04/16 22:28:00 UTC, 3 replies.
- [jira] [Created] (SPARK-43158) Set lowerbound of pandas version in 3.4.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 00:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43158) Set upperbound of pandas version in binder integrations - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 00:57:00 UTC, 3 replies.
- [jira] [Assigned] (SPARK-43158) Set upperbound of pandas version in binder integartions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 00:57:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43158) Set upperbound of pandas version in binder integartions - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 00:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43158) Set upperbound of pandas version in binder integrations - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 01:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry - posted by "GridGain Integration (Jira)" <ji...@apache.org> on 2023/04/17 01:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43141) Ignore generated Java files in checkstyle - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 02:58:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43147) Python lint local config - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 03:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43147) Python lint local config - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 03:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43140) Override computeStats in DummyLeafNode - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 03:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43140) Override computeStats in DummyLeafNode - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 03:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/17 03:16:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43099) `Class.getCanonicalName` return null for anonymous class on JDK15+, impacting function registry - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/17 03:23:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43122) Reenable TorchDistributorLocalUnitTestsOnConnect and TorchDistributorLocalUnitTestsIIOnConnect - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/17 03:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43158) Set upperbound of pandas version in binder integrations - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/17 04:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43130) Move InternalType to PhysicalDataType - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/17 04:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43151) Update the prerequisites for generating Python API docs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 06:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43042) Spark Connect: Streaming readerwriter table() API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 06:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43042) Spark Connect: Streaming readerwriter table() API - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/17 06:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43159) Refine `column_op` to use lambda function instead of Column API. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/17 06:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43160) Remove typing.io references as it is being deprecated from python 3.12 - posted by "Aimilios Tsouvelekakis (Jira)" <ji...@apache.org> on 2023/04/17 07:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43161) Throw error in planning phase when the query redefines watermark for a stream - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/17 07:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43160) Remove typing.io references as it is being deprecated from python 3.12 - posted by "Aimilios Tsouvelekakis (Jira)" <ji...@apache.org> on 2023/04/17 07:45:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43160) Remove typing.io namespace references as it is being removed - posted by "Aimilios Tsouvelekakis (Jira)" <ji...@apache.org> on 2023/04/17 08:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43162) Runtime filter should extracts multiple filter creation side plans - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/17 09:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43162) Runtime filter should extracts multiple filter creation side plans - posted by "jiaan.geng (Jira)" <ji...@apache.org> on 2023/04/17 09:25:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-42869) can not analyze window exp on sub query - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/17 11:07:00 UTC, 3 replies.
- [jira] [Commented] (SPARK-42869) can not analyze window exp on sub query - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/17 11:10:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43163) An exception occurred while hive table join tidb table - posted by "Zhang Qi (Jira)" <ji...@apache.org> on 2023/04/17 11:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43152) Parametrisable output metadata path (_spark_metadata) - posted by "Wojciech Indyk (Jira)" <ji...@apache.org> on 2023/04/17 11:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43163) An exception occurred while hive table join tidb table - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/17 12:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43164) Spark overwrites existing FILES/ARCHIVES/... settings instead of merging them - posted by "YE (Jira)" <ji...@apache.org> on 2023/04/17 13:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43164) Spark overwrites existing FILES/ARCHIVES/... settings instead of merging them - posted by "YE (Jira)" <ji...@apache.org> on 2023/04/17 13:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42657) Support to find and transfer client-side REPL classfiles to server as artifacts - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/17 13:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43165) Move canWrite to DataTypeUtils - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/17 17:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43166) Docker images are missing passwd entry for UID 185 - posted by "Derek Brown (Jira)" <ji...@apache.org> on 2023/04/17 17:47:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43166) Docker images are missing passwd entry for UID 185 - posted by "Derek Brown (Jira)" <ji...@apache.org> on 2023/04/17 17:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43167) Streaming Connect console output format support - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/17 18:20:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43168) Remove get PhysicalDataType method from Datatype class - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/17 18:42:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43165) Move canWrite to DataTypeUtils - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/17 18:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43146) Implement eager evaluation. - posted by "GridGain Integration (Jira)" <ji...@apache.org> on 2023/04/17 19:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43084) Add Python state API (applyInPandasWithState) and verify UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 00:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43084) Add Python state API (applyInPandasWithState) and verify UDFs - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 00:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-41210) Window based executor failure tracking mechanism - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/18 01:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-41210) Window based executor failure tracking mechanism - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/18 01:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42984) Fix test_createDataFrame_with_single_data_type. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/18 02:15:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42984) Fix test_createDataFrame_with_single_data_type. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/18 02:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43168) Remove get PhysicalDataType method from Datatype class - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/18 02:18:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43169) Update mima's previousSparkVersion to 3.4.0 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/18 02:19:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried - posted by "todd (Jira)" <ji...@apache.org> on 2023/04/18 02:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried - posted by "todd (Jira)" <ji...@apache.org> on 2023/04/18 03:00:00 UTC, 5 replies.
- [jira] [Resolved] (SPARK-43148) Add official image dockerfile for Spark v3.4.0 - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2023/04/18 03:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43148) Add official image dockerfile for Spark v3.4.0 - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2023/04/18 03:01:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43122) Reenable TorchDistributorLocalUnitTestsOnConnect and TorchDistributorLocalUnitTestsIIOnConnect - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/18 03:24:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 03:58:00 UTC, 9 replies.
- [jira] [Resolved] (SPARK-43163) An exception occurred while hive table join tidb table - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 04:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 04:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43111) Merge nested if statements into single if statements - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 04:14:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43111) Merge nested if statements into single if statements - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 04:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43171) Support dynamic changing unix user in Pod - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/18 04:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43078) Separate test into `pyspark-conenct-pandas` and `pyspark-connect-pandas-slow` - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/18 04:45:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42663) Fix `default_session` to work properly - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/18 05:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42663) Fix `default_session` to work properly - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/18 05:21:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-42663) Fix `default_session` to work properly - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/18 05:21:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43153) Skip Spark execution when the dataframe is local. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/18 07:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43153) Skip Spark execution when the dataframe is local. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/18 07:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42151) Align UPDATE assignments with table attributes - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/18 08:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42151) Align UPDATE assignments with table attributes - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/18 08:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42552) Get ParseException when run sql: "SELECT 1 UNION SELECT 1;" - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/18 09:05:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero. - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/18 09:08:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-42585) Streaming createDataFrame implementation - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/18 09:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42669) Short circuit local relation rpcs - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/18 09:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43172) Expose host and bearer tokens from the spark connect client - posted by "Niranjan Jayakar (Jira)" <ji...@apache.org> on 2023/04/18 09:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43173) `write jdbc` in `ClientE2ETestSuite` will test fail with out `-Phive` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/18 09:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43173) `write jdbc` in `ClientE2ETestSuite` will test fail with out `-Phive` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/18 09:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43174) Fix SparkSQLCLIDriver completer - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/18 09:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43172) Expose host and bearer tokens from the spark connect client - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 12:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43172) Expose host and bearer tokens from the spark connect client - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/18 12:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42657) Support to find and transfer client-side REPL classfiles to server as artifacts - posted by "GridGain Integration (Jira)" <ji...@apache.org> on 2023/04/18 13:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43175) decom.sh can cause an UnsupportedOperationException - posted by "Iain Cardnell (Jira)" <ji...@apache.org> on 2023/04/18 13:13:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43175) decom.sh can cause an UnsupportedOperationException - posted by "Iain Cardnell (Jira)" <ji...@apache.org> on 2023/04/18 13:16:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43176) Deduplicate imports in Connect Tests - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/18 13:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-30542) Two Spark structured streaming jobs cannot write to same base path - posted by "Wojciech Indyk (Jira)" <ji...@apache.org> on 2023/04/18 15:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42452) Remove hadoop-2 profile from Apache Spark - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/18 16:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43177) Add deprecation warning for input_file_name() - posted by "Yaohua Zhao (Jira)" <ji...@apache.org> on 2023/04/18 20:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43167) Streaming Connect console output format support - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/18 22:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin" - posted by "Erik Krogen (Jira)" <ji...@apache.org> on 2023/04/18 23:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin" - posted by "Erik Krogen (Jira)" <ji...@apache.org> on 2023/04/19 00:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin" - posted by "Sun Chao (Jira)" <ji...@apache.org> on 2023/04/19 00:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42539) User-provided JARs can override Spark's Hive metadata client JARs when using "builtin" - posted by "Sun Chao (Jira)" <ji...@apache.org> on 2023/04/19 00:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43169) Update mima's previousSparkVersion to 3.4.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 00:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43169) Update mima's previousSparkVersion to 3.4.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 00:30:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43173) `write jdbc` in `ClientE2ETestSuite` will test fail with out `-Phive` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 00:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43173) `write jdbc` in `ClientE2ETestSuite` will test fail with out `-Phive` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 00:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43178) Migrate UDF errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/19 00:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations) - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/19 01:11:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42592) Document SS guide doc for supporting multiple stateful operators (especially chained aggregations) - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/19 01:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43146) Implement eager evaluation. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 01:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43146) Implement eager evaluation. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 01:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 01:43:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 01:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43170) The spark sql like statement is pushed down to parquet for execution, but the data cannot be queried - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/19 03:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42845) Assign a name to the error class _LEGACY_ERROR_TEMP_2010 - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/19 04:20:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-35877) Spark Protobuf jar has CVE issue CVE-2015-5237 - posted by "Abhay Dandekar (Jira)" <ji...@apache.org> on 2023/04/19 04:45:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43179) Allow applications to control whether their metadata gets saved by the shuffle server in the db - posted by "Chandni Singh (Jira)" <ji...@apache.org> on 2023/04/19 05:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43179) Add option for applications to control saving of metadata in the External Shuffle Service LevelDB - posted by "Chandni Singh (Jira)" <ji...@apache.org> on 2023/04/19 05:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43179) Add option for applications to control saving of metadata in External Shuffle Service LevelDB - posted by "Chandni Singh (Jira)" <ji...@apache.org> on 2023/04/19 05:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43165) Move canWrite to DataTypeUtils - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 05:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43180) Upgrade mypy package in python pyspark dependencies - posted by "Aimilios Tsouvelekakis (Jira)" <ji...@apache.org> on 2023/04/19 08:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43181) spark-sql console should display the Spark WEB UI address - posted by "BingKun Pan (Jira)" <ji...@apache.org> on 2023/04/19 08:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42552) Get ParseException when run sql: "SELECT 1 UNION SELECT 1;" - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 08:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42552) Get ParseException when run sql: "SELECT 1 UNION SELECT 1;" - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 08:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43182) 3 tables join with limit when AE is enabled and one table is skewed - posted by "Liu Shuo (Jira)" <ji...@apache.org> on 2023/04/19 08:49:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43182) Mutilple tables join with limit when AE is enabled and one table is skewed - posted by "Liu Shuo (Jira)" <ji...@apache.org> on 2023/04/19 08:52:00 UTC, 10 replies.
- [jira] [Updated] (SPARK-43182) Mutiple tables join with limit when AE is enabled and one table is skewed - posted by "Liu Shuo (Jira)" <ji...@apache.org> on 2023/04/19 08:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43181) spark-sql console should display the Spark WEB UI address - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/19 09:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43183) Move update event on idleness in streaming query listener to separate callback method - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/19 09:46:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43184) Resume using enumeration to compare `NodeState.DECOMMISSIONING` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 09:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43176) Deduplicate imports in Connect Tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 10:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43176) Deduplicate imports in Connect Tests - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 10:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43185) Inline `hadoop-client` related properties in `pom.xml` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 11:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43186) Remove workaround for FileSinkDesc - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 11:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43187) Remove workaround for MiniKdc's BindException - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 11:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43187) Remove workaround for MiniKdc's BindException - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/19 12:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43188) Cannot write to Azure Datalake Gen2 (abfs/abfss) after Spark 3.1.2 - posted by "Nicolas PHUNG (Jira)" <ji...@apache.org> on 2023/04/19 12:21:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43188) Cannot write to Azure Datalake Gen2 (abfs/abfss) after Spark 3.1.2 - posted by "Nicolas PHUNG (Jira)" <ji...@apache.org> on 2023/04/19 12:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43189) No overload variant of "pandas_udf" matches argument type "str" - posted by "Andrew Grigorev (Jira)" <ji...@apache.org> on 2023/04/19 12:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43189) No overload variant of "pandas_udf" matches argument type "str" - posted by "Andrew Grigorev (Jira)" <ji...@apache.org> on 2023/04/19 12:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43190) ListQuery.childOutput should be consistent with child output - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 12:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43191) Replace reflection w/ direct calling for Hadoop CallerContext - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 12:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43192) Spark connect's user agent validations are too restrictive - posted by "Niranjan Jayakar (Jira)" <ji...@apache.org> on 2023/04/19 12:44:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43193) Remove workaround for HADOOP-12074 - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 13:01:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0 - posted by "Phillip Cloud (Jira)" <ji...@apache.org> on 2023/04/19 13:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43195) Remove unnecessary serializable wrapper in HadoopFSUtils - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 13:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43196) Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 13:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-24497) ANSI SQL: Recursive query - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2023/04/19 14:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43197) Clean up the code written for compatibility with Hadoop 2 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:01:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-24497) ANSI SQL: Recursive query - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2023/04/19 14:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43196) Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43195) Remove unnecessary serializable wrapper in HadoopFSUtils - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:03:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43193) Remove workaround for HADOOP-12074 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43191) Replace reflection w/ direct calling for Hadoop CallerContext - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43186) Remove workaround for FileSinkDesc - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43187) Remove workaround for MiniKdc's BindException - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:05:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43184) Resume using enumeration to compare `NodeState.DECOMMISSIONING` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:06:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43185) Inline `hadoop-client` related properties in `pom.xml` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/19 14:06:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 14:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-37829) An outer-join using joinWith on DataFrames returns Rows with null fields instead of null values - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 14:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero. - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 14:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43137) Improve ArrayInsert if the position is foldable and equals to zero. - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/19 14:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43179) Add option for applications to control saving of metadata in the External Shuffle Service LevelDB - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/19 15:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43198) Fix "Could not initialise class ammonite..." error when using filter - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2023/04/19 16:08:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43198) Fix "Could not initialise class ammonite..." error when using filter - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2023/04/19 16:08:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43199) Make InlineCTE idempotent - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2023/04/19 16:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43160) Remove typing.io namespace references as it is being removed - posted by "Hudson (Jira)" <ji...@apache.org> on 2023/04/19 17:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43124) Dataset.show should not trigger job execution on CommandResults - posted by "Hudson (Jira)" <ji...@apache.org> on 2023/04/19 17:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43186) Remove workaround for FileSinkDesc - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/19 17:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43186) Remove workaround for FileSinkDesc - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/19 17:26:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43187) Remove workaround for MiniKdc's BindException - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/19 17:27:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43187) Remove workaround for MiniKdc's BindException - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/19 17:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43200) Remove Hadoop 2 reference in docs - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 18:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43201) Inconsistency between from_avro and from_json function - posted by "Philip Adetiloye (Jira)" <ji...@apache.org> on 2023/04/19 18:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43201) Inconsistency between from_avro and from_json function - posted by "Philip Adetiloye (Jira)" <ji...@apache.org> on 2023/04/19 18:59:00 UTC, 4 replies.
- [jira] [Updated] (SPARK-43203) Fix DROP table behavior in session catalog - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/19 19:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43203) Fix DROP table behavior in session catalog - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/19 19:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/19 19:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43204) Align MERGE assignments with table attributes - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/19 20:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43205) Add an IDENTIFIER(stringLiteral) clause that maps a string to an identifier - posted by "Serge Rielau (Jira)" <ji...@apache.org> on 2023/04/19 22:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42945) Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 23:33:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-42945) Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 23:33:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43129) Scala Core API for Streaming Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 23:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43129) Scala Core API for Streaming Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/19 23:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43206) Streaming query exception() also include stack trace - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/19 23:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43207) Add helper functions for extract value from literal expression - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 00:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43197) Clean up the code written for compatibility with Hadoop 2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 00:40:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-43194) PySpark 3.4.0 cannot convert timestamp-typed objects to pandas with pandas 2.0 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 00:43:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43189) No overload variant of "pandas_udf" matches argument type "str" - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 00:43:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43206) Streaming query exception() also include stack trace - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/20 00:56:00 UTC, 2 replies.
- [jira] [Resolved] (SPARK-43167) Streaming Connect console output format support - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/20 00:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43112) Spark may use a column other than the actual specified partitioning column for partitioning, for Hive format tables - posted by "Asif (Jira)" <ji...@apache.org> on 2023/04/20 01:17:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43195) Remove unnecessary serializable wrapper in HadoopFSUtils - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:03:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43195) Remove unnecessary serializable wrapper in HadoopFSUtils - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:03:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43200) Remove Hadoop 2 reference in docs - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43200) Remove Hadoop 2 reference in docs - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43191) Replace reflection w/ direct calling for Hadoop CallerContext - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43191) Replace reflection w/ direct calling for Hadoop CallerContext - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:09:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43196) Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf` - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:10:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43196) Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf` - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 04:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43208) IsolatedClassLoader should close barrier class InputStream after reading - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/20 05:31:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-42945) Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 05:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42945) Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 05:34:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42945) Support PYSPARK_JVM_STACKTRACE_ENABLED in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 05:35:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43209) Migrate Expression errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/20 06:05:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43210) Introduce PySparkAssersionError - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/20 06:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43211) Remove Hadoop2 support in IsolatedClientLoader - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/20 06:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43190) ListQuery.childOutput should be consistent with child output - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/20 07:14:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43190) ListQuery.childOutput should be consistent with child output - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/20 07:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43212) Migrate Structured Streaming errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/20 07:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43207) Add helper functions for extract value from literal expression - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 08:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43207) Add helper functions for extract value from literal expression - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 08:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43183) Move update event on idleness in streaming query listener to separate callback method - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/20 08:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43183) Move update event on idleness in streaming query listener to separate callback method - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/20 08:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39203) Fix remote table location based on database location - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/20 09:12:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43213) Add `DataFrame.offset` to PySpark - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 09:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43169) Update mima's previousSparkVersion to 3.4.0 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/20 09:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43213) Add `DataFrame.offset` to PySpark - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 09:12:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43213) Add `DataFrame.offset` to PySpark - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/20 09:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43184) Resume using enumeration to compare `NodeState.DECOMMISSIONING` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 09:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43184) Resume using enumeration to compare `NodeState.DECOMMISSIONING` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/20 09:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43214) Post driver-side metrics for LocalTableScanExec/CommandResultExec - posted by "Fu Chen (Jira)" <ji...@apache.org> on 2023/04/20 10:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43215) Remove `ResourceRequestHelper#isYarnResourceTypesAvailable` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/20 10:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43216) Refactor `ResourceRequestHelper ` to no longer use reflection - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/20 10:33:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36058) Support replicasets/job API - posted by "Hu Ziqian (Jira)" <ji...@apache.org> on 2023/04/20 11:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField - posted by "Johan Lasperas (Jira)" <ji...@apache.org> on 2023/04/20 12:20:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField - posted by "Johan Lasperas (Jira)" <ji...@apache.org> on 2023/04/20 12:20:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43152) User-defined output metadata path (_spark_metadata) - posted by "Jacek Laskowski (Jira)" <ji...@apache.org> on 2023/04/20 13:03:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43218) Support "ESCAPE BY" in SparkScriptTransformationExec - posted by "jiang13021 (Jira)" <ji...@apache.org> on 2023/04/20 13:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/20 14:54:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/20 15:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/20 15:41:00 UTC, 2 replies.
- [jira] [Commented] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/20 15:49:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-43216) Refactor `ResourceRequestHelper ` to no longer use reflection - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/20 15:49:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43215) Remove `ResourceRequestHelper#isYarnResourceTypesAvailable` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/20 15:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43215) Remove `ResourceRequestHelper#isYarnResourceTypesAvailable` - posted by "GridGain Integration (Jira)" <ji...@apache.org> on 2023/04/20 15:51:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43221) Executor obtained error information - posted by "Qiang Yang (Jira)" <ji...@apache.org> on 2023/04/20 15:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43222) Remove check of `VersionUtils.isHadoop3` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/20 16:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43221) Executor obtained error information - posted by "Qiang Yang (Jira)" <ji...@apache.org> on 2023/04/20 16:13:00 UTC, 13 replies.
- [jira] [Updated] (SPARK-43222) Remove check of `isHadoop3` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/20 16:21:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-35959) Add a new Maven profile "no-shaded-client" for older Hadoop 3.x versions - posted by "Sun Chao (Jira)" <ji...@apache.org> on 2023/04/20 16:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43223) KeyValueGroupedDataset#agg - posted by "Zhen Li (Jira)" <ji...@apache.org> on 2023/04/20 16:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43208) IsolatedClassLoader should close barrier class InputStream after reading - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 16:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43208) IsolatedClassLoader should close barrier class InputStream after reading - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 16:54:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API - posted by "Mike K (Jira)" <ji...@apache.org> on 2023/04/20 18:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 20:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43202) Replace reflection w/ direct calling for YARN Resource API - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 20:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43211) Remove Hadoop2 support in IsolatedClientLoader - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 20:11:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43211) Remove Hadoop2 support in IsolatedClientLoader - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/20 20:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43224) Executor should not be removed when decommissioned in standalone - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/20 22:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42960) Add remaining Streaming Query commands like await_termination() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 23:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42960) Add remaining Streaming Query commands like await_termination() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/20 23:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43124) Dataset.show should not trigger job execution on CommandResults - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 00:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43124) Dataset.show should not trigger job execution on CommandResults - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 00:34:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-39203) Fix remote table location based on database location - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 01:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-39203) Fix remote table location based on database location - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 01:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/21 01:48:00 UTC, 0 replies.
- [jira] [Closed] (SPARK-43220) INSERT INTO REPLACE statement can't support WHERE with bool_expression - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/21 01:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43119) Support Get SQL Keywords Dynamically - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/21 02:25:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43119) Support Get SQL Keywords Dynamically - posted by "Kent Yao (Jira)" <ji...@apache.org> on 2023/04/21 02:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43225) Change the scope of jackson-mapper-asl from compile to test - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/21 02:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43136) Scala mapGroup, coGroup - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/21 03:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43128) Streaming progress struct (especially in Scala) - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/21 03:37:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43226) Define extractors for file-constant metadata columns - posted by "Ryan Johnson (Jira)" <ji...@apache.org> on 2023/04/21 03:44:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43193) Remove workaround for HADOOP-12074 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 04:02:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43193) Remove workaround for HADOOP-12074 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 04:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-31733) Make YarnClient.`specify a more specific type for the application` pass in Hadoop-3.2 - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/21 04:13:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43193) Remove workaround for HADOOP-12074 - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/21 04:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43225) Change the scope of jackson-mapper-asl from compile to test - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/21 04:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43222) Remove check of `isHadoop3` - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/21 04:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43226) Define extractors for file-constant metadata columns - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 04:20:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43224) Executor should not be removed when decommissioned in standalone - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 04:21:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43213) Add `DataFrame.offset` to PySpark - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 04:56:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43213) Add `DataFrame.offset` to PySpark - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 04:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43227) Fix deserialisation issue when UDFs contain a lambda expression - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2023/04/21 05:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43102) Upgrade commons-compress to 1.23.0 - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 05:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43102) Upgrade commons-compress to 1.23.0 - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 05:23:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/21 05:59:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-43222) Remove check of `isHadoop3` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 06:00:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43222) Remove check of `isHadoop3` - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 06:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43192) Spark connect's user agent validations are too restrictive - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 06:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43192) Spark connect's user agent validations are too restrictive - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/21 06:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42288) Expose file path if reading failed - posted by "yikaifei (Jira)" <ji...@apache.org> on 2023/04/21 08:00:06 UTC, 0 replies.
- [jira] [Created] (SPARK-43228) Join keys also match PartitioningCollection - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/21 08:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43229) Support Barrier Python UDF - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 09:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43229) Support Barrier Python UDF - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/21 09:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null` - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/21 09:14:00 UTC, 3 replies.
- [jira] [Created] (SPARK-43230) Simplify `DataFrameNaFunctions.fillna` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 09:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43230) Simplify `DataFrameNaFunctions.fillna` - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/21 09:18:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43228) Join keys also match PartitioningCollection - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/21 09:19:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43199) Make InlineCTE idempotent - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/21 09:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43231) Reduce the memory requirement in torch-related tests - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/21 09:24:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43232) Improve ObjectHashAggregateExec performance - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/21 09:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43232) Improve ObjectHashAggregateExec performance - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/21 09:59:00 UTC, 2 replies.
- [jira] [Updated] (SPARK-42780) Upgrade google Tink to 1.9.0 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/21 12:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42780) Upgrade google Tink to 1.9.0 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/21 12:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/21 12:56:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/21 12:57:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42330) Assign name to _LEGACY_ERROR_TEMP_2175 - posted by "Koray Beyaz (Jira)" <ji...@apache.org> on 2023/04/21 13:00:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43196) Replace reflection w/ direct calling for `ContainerLaunchContext#setTokensConf` - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/21 14:16:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/21 15:01:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-43142) DSL expressions fail on attribute with special characters - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/21 15:01:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43179) Add option for applications to control saving of metadata in the External Shuffle Service LevelDB - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2023/04/21 17:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43179) Add option for applications to control saving of metadata in the External Shuffle Service LevelDB - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2023/04/21 17:22:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43134) Add streaming query exception API in Scala - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/21 19:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43032) Add StreamingQueryManager API - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/21 19:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43143) Scala: Add StreamingQuery awaitTermination() API - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/21 19:35:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43206) Streaming query exception() also include stack trace - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/21 21:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43233) Before batch reading from Kafka, log topic partition, offset range, etc, for debuggin - posted by "Siying Dong (Jira)" <ji...@apache.org> on 2023/04/21 21:29:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43233) Before batch reading from Kafka, log topic partition, offset range, etc, for debuggin - posted by "Siying Dong (Jira)" <ji...@apache.org> on 2023/04/21 21:34:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43206) Connect Better StreamingQueryException - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/21 21:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43206) Connect Better StreamingQueryException - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/21 21:50:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-38114) Spark build fails in Windows - posted by "Felipe (Jira)" <ji...@apache.org> on 2023/04/21 21:53:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43174) Fix SparkSQLCLIDriver completer - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/22 00:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43174) Fix SparkSQLCLIDriver completer - posted by "Yuming Wang (Jira)" <ji...@apache.org> on 2023/04/22 00:17:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43046) Implement dropDuplicatesWithinWatermark in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/22 00:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43082) Arrow-optimized Python UDFs in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/22 00:32:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43082) Arrow-optimized Python UDFs in Spark Connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/22 00:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43234) Migrate ValueError from Connect DataFrame into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/22 05:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43235) ClientDistributedCacheManager doesn't set the LocalResourceVisibility.PRIVATE if isPublic throws exception - posted by "Pralabh Kumar (Jira)" <ji...@apache.org> on 2023/04/22 09:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43236) Sort entries in the pyspark API reference docs alphabetically - posted by "Lukasz Mentel (Jira)" <ji...@apache.org> on 2023/04/22 11:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43237) Handle null exception message in event log - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/22 17:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43238) Support only decommission idle workers in standalone - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/22 18:22:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43224) Executor should not be removed when decommissioned in standalone - posted by "Zhongwei Zhu (Jira)" <ji...@apache.org> on 2023/04/22 18:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43239) Remove null_counts from info() - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/22 20:14:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43239) Remove null_counts from info() - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/22 20:32:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43239) Remove null_counts from info() - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/22 20:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow] - posted by "Ke Jia (Jira)" <ji...@apache.org> on 2023/04/23 02:51:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow] - posted by "Ke Jia (Jira)" <ji...@apache.org> on 2023/04/23 02:54:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43185) Inline `hadoop-client` related properties in `pom.xml` - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/23 03:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43241) MultiIndex.append not checking names for equality - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/23 06:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43232) Improve ObjectHashAggregateExec performance with high cardinality - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/23 07:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43232) Improve ObjectHashAggregateExec performance for high cardinality - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/23 08:31:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43232) Improve ObjectHashAggregateExec performance for high cardinality - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/23 09:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43242) shuffle diagnoseCorruption should not throw Unexpected type of BlockId for ShuffleBlockBatchId - posted by "Zhang Liang (Jira)" <ji...@apache.org> on 2023/04/23 13:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43242) shuffle diagnoseCorruption should not throw Unexpected type of BlockId for ShuffleBlockBatchId - posted by "Zhang Liang (Jira)" <ji...@apache.org> on 2023/04/23 13:38:00 UTC, 1 replies.
- [jira] [Updated] (SPARK-43242) diagnoseCorruption should not throw Unexpected type of BlockId for ShuffleBlockBatchId - posted by "Zhang Liang (Jira)" <ji...@apache.org> on 2023/04/23 13:45:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43008) Upgrade jodatime to 2.12.5 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/23 14:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43008) Upgrade jodatime to 2.12.5 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/23 14:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43243) Add Level param to df.printSchema for Python API - posted by "Khalid Mammadov (Jira)" <ji...@apache.org> on 2023/04/23 16:10:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2023/04/23 18:40:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2023/04/23 18:51:00 UTC, 5 replies.
- [jira] [Updated] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2023/04/23 18:52:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-43239) Remove null_counts from info() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/24 00:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43239) Remove null_counts from info() - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/24 00:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43212) Migrate Structured Streaming errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/24 00:18:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43212) Migrate Structured Streaming errors into error class - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/24 00:18:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43113) Codegen error when full outer join's bound condition has multiple references to the same stream-side column - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/24 01:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43210) Introduce PySparkAssersionError - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 01:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43210) Introduce PySparkAssersionError - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 01:15:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43245) Fix DatetimeIndex.microsecond to return 'int32' instead of 'int64' type of Index. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/24 04:00:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43209) Migrate Expression errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 05:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43209) Migrate Expression errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 05:28:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43246) Make `CheckConnectJvmClientCompatibility` filter the check on `private[packageName]` scope member as default - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/24 06:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43246) Make `CheckConnectJvmClientCompatibility` filter the check on `private[packageName]` scope member as default - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/24 06:06:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43246) Make `CheckConnectJvmClientCompatibility` filter the check on `private[packageName]` scope member as default - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/24 06:09:00 UTC, 2 replies.
- [jira] [Comment Edited] (SPARK-43246) Make `CheckConnectJvmClientCompatibility` filter the check on `private[packageName]` scope member as default - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/24 06:13:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43230) Simplify `DataFrameNaFunctions.fillna` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 06:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43230) Simplify `DataFrameNaFunctions.fillna` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 06:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43234) Migrate ValueError from Connect DataFrame into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 06:47:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43234) Migrate ValueError from Connect DataFrame into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 06:47:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43247) Add apache/spark docker image overview - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2023/04/24 06:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43248) Unnecessary serialize/deserialize of Path on parallel gather partition stats - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/24 07:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43229) Introduce Barrier Python UDF - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 07:09:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42317) Assign name to _LEGACY_ERROR_TEMP_2247 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 08:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43249) df.sql() should send metrics back() - posted by "Martin Grund (Jira)" <ji...@apache.org> on 2023/04/24 08:31:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42317) Assign name to _LEGACY_ERROR_TEMP_2247 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 08:31:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43249) df.sql() should send metrics back() - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 08:35:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43249) df.sql() should send metrics back() - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 08:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43250) Assign a name to the error class _LEGACY_ERROR_TEMP_2014 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43250) Assign a name to the error class _LEGACY_ERROR_TEMP_2014 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:35:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43251) Assign a name to the error class _LEGACY_ERROR_TEMP_2015 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43252) Assign a name to the error class _LEGACY_ERROR_TEMP_2016 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43251) Assign a name to the error class _LEGACY_ERROR_TEMP_2015 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:36:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43252) Assign a name to the error class _LEGACY_ERROR_TEMP_2016 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43254) Assign a name to the error class _LEGACY_ERROR_TEMP_2018 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43254) Assign a name to the error class _LEGACY_ERROR_TEMP_2018 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:37:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43256) Assign a name to the error class _LEGACY_ERROR_TEMP_2021 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43256) Assign a name to the error class _LEGACY_ERROR_TEMP_2021 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43255) Assign a name to the error class _LEGACY_ERROR_TEMP_2020 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:38:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43258) Assign a name to the error class _LEGACY_ERROR_TEMP_2023 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43257) Assign a name to the error class _LEGACY_ERROR_TEMP_2022 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43257) Assign a name to the error class _LEGACY_ERROR_TEMP_2022 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43258) Assign a name to the error class _LEGACY_ERROR_TEMP_2023 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:39:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43259) Assign a name to the error class _LEGACY_ERROR_TEMP_2024 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/24 09:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43178) Migrate UDF errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 10:19:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43178) Migrate UDF errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/24 10:19:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43214) Post driver-side metrics for LocalTableScanExec/CommandResultExec - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/24 10:49:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43214) Post driver-side metrics for LocalTableScanExec/CommandResultExec - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/24 10:49:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43260) Migrate the Spark SQL pandas arrow type errors into error class. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/24 11:27:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43261) Migrate `TypeError` from Spark SQL types into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/24 12:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43262) Migrate Spark Connect Structured Streaming errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/24 12:14:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43201) Inconsistency between from_avro and from_json function - posted by "karthik kadiyam (Jira)" <ji...@apache.org> on 2023/04/24 13:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43263) Upgrade FasterXML / jackson-dataformats-text to 2.15.0 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/24 13:35:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43264) Avoid allocation of unwritten ColumnVector in VectorizedReader - posted by "Zamil Majdy (Jira)" <ji...@apache.org> on 2023/04/24 14:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43265) Move Error framework to a common utils module - posted by "Rui Wang (Jira)" <ji...@apache.org> on 2023/04/24 15:33:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/24 15:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43266) Move MergeScalarSubqueries to spark-sql - posted by "Peter Toth (Jira)" <ji...@apache.org> on 2023/04/24 15:41:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43217) Correctly recurse into maps of maps and arrays of arrays in StructType.findNestedField - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/24 15:42:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43267) Support creating data frame from a Postgres table that contains user-defined array column - posted by "Sifan Huang (Jira)" <ji...@apache.org> on 2023/04/24 16:37:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43268) Use proper error classes when exceptions are constructed with a message - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/24 16:58:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43269) Adding support for MissingFiles when spark.sql.parquet.mergeSchema=true - posted by "Neil Jonkers (Jira)" <ji...@apache.org> on 2023/04/24 17:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43269) Adding support for MissingFiles when spark.sql.parquet.mergeSchema=true - posted by "Neil Jonkers (Jira)" <ji...@apache.org> on 2023/04/24 17:18:00 UTC, 10 replies.
- [jira] [Updated] (SPARK-43263) Upgrade FasterXML jackson to 2.15.0 - posted by "Bjørn Jørgensen (Jira)" <ji...@apache.org> on 2023/04/24 18:53:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43263) Upgrade FasterXML jackson to 2.15.0 - posted by "PJ Fanning (Jira)" <ji...@apache.org> on 2023/04/24 19:09:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns - posted by "Beishao Cao (Jira)" <ji...@apache.org> on 2023/04/24 20:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns - posted by "Beishao Cao (Jira)" <ji...@apache.org> on 2023/04/24 20:47:00 UTC, 10 replies.
- [jira] [Commented] (SPARK-43250) Assign a name to the error class _LEGACY_ERROR_TEMP_2014 - posted by "Atour Mousavi Gourabi (Jira)" <ji...@apache.org> on 2023/04/24 22:14:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43268) Use proper error classes when exceptions are constructed with a message - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/25 00:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43268) Use proper error classes when exceptions are constructed with a message - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/25 00:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43233) Before batch reading from Kafka, log topic partition, offset range, etc, for debuggin - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/25 00:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43262) Migrate Spark Connect Structured Streaming errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 01:38:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43262) Migrate Spark Connect Structured Streaming errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 01:38:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43271) Fix test DataFrameTests.test_reindex with specifying `index`. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/25 03:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43271) Match behavior with DataFrame.reindex with specifying `index`. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/25 03:29:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42419) Migrate `TypeError` into error framework for Spark Connect column API. - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/25 03:36:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/25 03:40:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43144) Scala: DataStreamReader table() API - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 06:22:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43260) Migrate the Spark SQL pandas arrow type errors into error class. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 06:23:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43260) Migrate the Spark SQL pandas arrow type errors into error class. - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 06:23:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43272) Replace reflection w/ direct calling for `SparkHadoopUtil#createFile` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/25 06:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression - posted by "Andrew Grigorev (Jira)" <ji...@apache.org> on 2023/04/25 07:00:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression - posted by "Andrew Grigorev (Jira)" <ji...@apache.org> on 2023/04/25 07:17:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression - posted by "Andrew Grigorev (Jira)" <ji...@apache.org> on 2023/04/25 07:28:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43231) Reduce the memory requirement in torch-related tests - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 07:29:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43231) Reduce the memory requirement in torch-related tests - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 07:29:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43274) Introduce `PySparkNotImplementError` - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/25 07:30:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43275) Migrate Spark Connect GroupedData error into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/25 07:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43276) Migrate Spark Connect Window errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/25 07:44:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43243) Add Level param to df.printSchema for Python API - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 08:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43243) Add Level param to df.printSchema for Python API - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 08:05:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43226) Define extractors for file-constant metadata columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/25 08:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43226) Define extractors for file-constant metadata columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/25 08:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43277) Clean up deprecation hadoop api usage in Yarn module - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/25 08:27:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43204) Align MERGE assignments with table attributes - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/25 08:37:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43204) Align MERGE assignments with table attributes - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/25 08:37:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42940) Session management support streaming connect - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/25 09:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43278) Exception in thread "main" java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer; - posted by "jiangjiguang0719 (Jira)" <ji...@apache.org> on 2023/04/25 09:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43278) Exception in thread "main" java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer; - posted by "jiangjiguang0719 (Jira)" <ji...@apache.org> on 2023/04/25 09:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43279) Cleanup unused members from `SparkHadoopUtil` - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/25 09:22:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43280) Improve the protobuf breaking change script - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 09:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43280) Improve the protobuf breaking change script - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 09:27:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43280) Improve the protobuf breaking change checker script - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/25 09:28:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43272) Replace reflection w/ direct calling for `SparkHadoopUtil#createFile` - posted by "Nikita Awasthi (Jira)" <ji...@apache.org> on 2023/04/25 11:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43281) Fix concurrent writer does not update file metrics - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/25 12:32:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-43273) Spark can't read parquet files with a newer LZ4_RAW compression - posted by "Andrew Grigorev (Jira)" <ji...@apache.org> on 2023/04/25 12:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43282) Investigate DataFrame.sort_values with pandas behavior. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/25 13:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation - posted by "Jean-Christophe Lefebvre (Jira)" <ji...@apache.org> on 2023/04/25 13:41:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-39753) Broadcast joins should pushdown join constraints as Filter to the larger relation - posted by "Jean-Christophe Lefebvre (Jira)" <ji...@apache.org> on 2023/04/25 13:41:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/25 13:52:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42798) Upgrade protobuf-java to 3.22.2 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/25 13:54:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-42798) Upgrade protobuf-java to 3.22.2 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/25 13:54:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43225) Remove jackson-core-asl and jackson-mapper-asl from pre-built distribution - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/25 13:55:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-36112) Enable DecorrelateInnerQuery for IN/EXISTS subqueries - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/25 14:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43098) Should not handle the COUNT bug when the GROUP BY clause of a correlated scalar subquery is non-empty - posted by "Ignite TC Bot (Jira)" <ji...@apache.org> on 2023/04/25 14:50:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43283) _metadata.file_path returns unescaled URLs - posted by "David Lewis (Jira)" <ji...@apache.org> on 2023/04/25 15:53:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43284) _metadata.file_path - posted by "David Lewis (Jira)" <ji...@apache.org> on 2023/04/25 16:11:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17 - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2023/04/25 16:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17 - posted by "Venkata Sai Akhil Gudesa (Jira)" <ji...@apache.org> on 2023/04/25 16:17:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43284) _metadata.file_path regression - posted by "David Lewis (Jira)" <ji...@apache.org> on 2023/04/25 16:17:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43286) Update CBC mode in aes_encrypt()/aes_decrypt() to not use KDF - posted by "Steve Weis (Jira)" <ji...@apache.org> on 2023/04/25 18:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17 - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/25 19:12:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43285) ReplE2ESuite consistently fails with JDK 17 - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/25 19:12:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/25 20:46:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/25 20:47:00 UTC, 2 replies.
- [jira] [Assigned] (SPARK-43136) Scala mapGroup, coGroup - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/25 20:59:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43136) Scala mapGroup, coGroup - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/25 20:59:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43280) Reimplement the protobuf breaking change checker script - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 00:48:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43020) Refactoring similar error classes such as `NOT_XXX`. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/26 01:29:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43288) DataSourceV2: CREATE TABLE LIKE - posted by "John Zhuge (Jira)" <ji...@apache.org> on 2023/04/26 02:29:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43277) Clean up deprecation hadoop api usage in Yarn module - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/26 03:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43289) PySpark UDF supports python package dependencies - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/26 03:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43289) PySpark UDF supports python package dependencies - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/26 03:35:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43276) Migrate Spark Connect Window errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 03:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43276) Migrate Spark Connect Window errors into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 03:54:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null` - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 04:16:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null` - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 04:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43290) Support IV and AAD optional parameters for aes_encrypt - posted by "Steve Weis (Jira)" <ji...@apache.org> on 2023/04/26 04:31:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43291) Match behavior for DataFrame.cov on string DataFrame - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/26 05:13:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43291) Re-enable test for DataFrame.cov on string DataFrame. - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/26 05:13:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43275) Migrate Spark Connect GroupedData error into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43275) Migrate Spark Connect GroupedData error into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 05:48:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43274) Introduce `PySparkNotImplementError` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 05:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43274) Introduce `PySparkNotImplementError` - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 05:48:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42992) Introduce PySparkRuntimeError - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 05:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42992) Introduce PySparkRuntimeError - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/26 05:53:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43076) Removing the dependency on `grpcio` when remote session is not used. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 06:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43076) Removing the dependency on `grpcio` when remote session is not used. - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 06:25:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43199) Make InlineCTE idempotent - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 07:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43199) Make InlineCTE idempotent - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 07:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43292) ArtifactManagerSuite can't run using maven - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/26 08:01:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43292) ArtifactManagerSuite can't run using maven - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/26 08:35:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43257) Assign a name to the error class _LEGACY_ERROR_TEMP_2022 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/26 09:04:00 UTC, 1 replies.
- [jira] [Assigned] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow] - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 09:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43240) df.describe() method may- return wrong result if the last RDD is RDD[UnsafeRow] - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 09:26:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43134) Add streaming query exception API in Scala - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/26 12:59:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43134) Add streaming query exception API in Scala - posted by "Jungtaek Lim (Jira)" <ji...@apache.org> on 2023/04/26 12:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43293) __qualified_access_only should be ignored in normal columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/26 14:26:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43294) Upgrade zstd-jni to 1.5.5-2 - posted by "Yang Jie (Jira)" <ji...@apache.org> on 2023/04/26 15:00:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43295) Make DataFrameGroupBy.sum support for string type columns - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/26 16:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43198) Fix "Could not initialise class ammonite..." error when using filter - posted by "Herman van Hövell (Jira)" <ji...@apache.org> on 2023/04/26 16:14:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43296) Migrate Spark Connect session errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/26 16:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43297) Make improvement to LocalKMeans - posted by "wenweijian (Jira)" <ji...@apache.org> on 2023/04/26 17:01:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43278) Exception in thread "main" java.lang.NoSuchMethodError: java.nio.ByteBuffer.flip()Ljava/nio/ByteBuffer; - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 17:08:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43280) Reimplement the protobuf breaking change checker script - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 17:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-31733) Make YarnClient.`specify a more specific type for the application` pass in Hadoop-3.2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 17:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-31733) Make YarnClient.`specify a more specific type for the application` pass in Hadoop-3.2 - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 17:36:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43280) Reimplement the protobuf breaking change checker script - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/26 17:36:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43131) Add labels to identify UDF - posted by "Ahmed Hussein (Jira)" <ji...@apache.org> on 2023/04/26 17:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43298) predict_batch_udf with scalar input fails when batch size consists of a single value - posted by "Lee Yang (Jira)" <ji...@apache.org> on 2023/04/26 20:32:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43298) predict_batch_udf with scalar input fails when batch size consists of a single value - posted by "Lee Yang (Jira)" <ji...@apache.org> on 2023/04/26 20:33:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43299) JVM Client throw StreamingQueryException when error handling is implemented - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/26 20:50:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43288) DataSourceV2: CREATE TABLE LIKE - posted by "John Zhuge (Jira)" <ji...@apache.org> on 2023/04/27 00:27:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43287) Connect JVM client REPL not correctly shut down if killed - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/27 00:56:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43300) Cascade failure in Guava cache due to fate-sharing - posted by "Ziqi Liu (Jira)" <ji...@apache.org> on 2023/04/27 01:06:00 UTC, 0 replies.
- [jira] [Reopened] (SPARK-43156) Correctness COUNT bug in correlated scalar subselect with `COUNT(*) is null` - posted by "Jack Chen (Jira)" <ji...@apache.org> on 2023/04/27 02:36:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43293) __qualified_access_only should be ignored in normal columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/27 02:56:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43293) __qualified_access_only should be ignored in normal columns - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/27 02:56:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43298) predict_batch_udf with scalar input fails when batch size consists of a single value - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/27 03:32:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43248) Unnecessary serialize/deserialize of Path on parallel gather partition stats - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/27 03:41:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43248) Unnecessary serialize/deserialize of Path on parallel gather partition stats - posted by "Chao Sun (Jira)" <ji...@apache.org> on 2023/04/27 03:41:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43301) BlockStoreClient getHostLocalDirs RPC supports IOexception retry - posted by "dzcxzl (Jira)" <ji...@apache.org> on 2023/04/27 03:43:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43302) Make Python UDAF an AggregateFunction - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/27 03:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43301) BlockStoreClient getHostLocalDirs RPC supports IOexception retry - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/27 03:49:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43302) Make Python UDAF an AggregateFunction - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/27 03:55:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43052) Handle stacktrace with null file name in event log - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2023/04/27 04:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43052) Handle stacktrace with null file name in event log - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2023/04/27 04:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43303) Migrate NotImplementedError into PySparkNotImplementedError - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/27 08:28:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/27 08:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43219) Website can't find INSERT INTO REPLACE Statement - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/27 08:34:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43261) Migrate `TypeError` from Spark SQL types into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/27 08:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43261) Migrate `TypeError` from Spark SQL types into error class - posted by "Ruifeng Zheng (Jira)" <ji...@apache.org> on 2023/04/27 08:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0 - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/27 09:48:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43305) Add Java17 dockerfiles for 3.4.0 - posted by "Yikun Jiang (Jira)" <ji...@apache.org> on 2023/04/27 10:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43306) Migrate `ValueError` from Spark SQL types into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/27 10:52:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43307) Migrate PandasUDF value errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/27 11:17:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43051) Allow materializing zero values when deserializing protobuf messages - posted by "Nikita Awasthi (Jira)" <ji...@apache.org> on 2023/04/27 11:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43257) Assign a name to the error class _LEGACY_ERROR_TEMP_2022 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/27 12:02:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43257) Assign a name to the error class _LEGACY_ERROR_TEMP_2022 - posted by "Max Gekk (Jira)" <ji...@apache.org> on 2023/04/27 12:02:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43308) Improve scalar subquery logic plan when result are literal - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/27 12:44:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43308) Improve scalar subquery logic plan when result are literal - posted by "Jia Fan (Jira)" <ji...@apache.org> on 2023/04/27 12:45:00 UTC, 2 replies.
- [jira] [Created] (SPARK-43309) Extend INTERNAL_ERROR with category - posted by "Bo Zhang (Jira)" <ji...@apache.org> on 2023/04/27 13:57:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43310) Dataset.observe is ignored when writing to Kafka with batch query - posted by "David Deuber (Jira)" <ji...@apache.org> on 2023/04/27 15:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43311) RocksDB state store provider memory management enhancements - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/27 18:25:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43311) RocksDB state store provider memory management enhancements - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/27 18:26:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43311) RocksDB state store provider memory management enhancements - posted by "Anish Shrigondekar (Jira)" <ji...@apache.org> on 2023/04/27 18:26:00 UTC, 1 replies.
- [jira] [Resolved] (SPARK-43298) predict_batch_udf with scalar input fails when batch size consists of a single value - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/27 18:52:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43298) predict_batch_udf with scalar input fails when batch size consists of a single value - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/27 18:52:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43132) Add foreach streaming API in Python - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/27 19:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43054) Support foreach() in streaming spark connect - posted by "Wei Liu (Jira)" <ji...@apache.org> on 2023/04/27 19:04:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43310) Dataset.observe is ignored when writing to Kafka with batch query - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/27 19:06:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43312) Protobfu: Allow converting Any fields to JSON - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/27 21:30:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43312) Protobuf: Allow converting Any fields to JSON - posted by "Raghu Angadi (Jira)" <ji...@apache.org> on 2023/04/27 21:31:00 UTC, 0 replies.
- [jira] [Comment Edited] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2023/04/27 23:09:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43313) Adding missing default values for MERGE INSERT actions - posted by "Daniel (Jira)" <ji...@apache.org> on 2023/04/28 00:09:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017 - posted by "LUIZ FERNANDO NEVES DE ARAUJO (Jira)" <ji...@apache.org> on 2023/04/28 00:34:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43314) Migrate Spark Connect client errors into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/28 01:39:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43315) Migrate errors from DataFrame(Reader|Writer) into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/28 02:19:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43315) Migrate remaining errors from DataFrame(Reader|Writer) into error class - posted by "Haejoon Lee (Jira)" <ji...@apache.org> on 2023/04/28 02:20:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43309) Extend INTERNAL_ERROR with category - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/28 03:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-38461) Use error classes in org.apache.spark.broadcast - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/28 03:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-38461) Use error classes in org.apache.spark.broadcast - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/28 03:07:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43309) Extend INTERNAL_ERROR with category - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/28 03:07:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43302) Make Python UDAF an AggregateFunction - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/28 03:08:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43302) Make Python UDAF an AggregateFunction - posted by "Wenchen Fan (Jira)" <ji...@apache.org> on 2023/04/28 03:08:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails - posted by "kalyan s (Jira)" <ji...@apache.org> on 2023/04/28 05:03:00 UTC, 3 replies.
- [jira] [Comment Edited] (SPARK-43106) Data lost from the table if the INSERT OVERWRITE query fails - posted by "kalyan s (Jira)" <ji...@apache.org> on 2023/04/28 05:04:00 UTC, 1 replies.
- [jira] [Created] (SPARK-43316) Add more CTE SQL tests - posted by "Runyao.Chen (Jira)" <ji...@apache.org> on 2023/04/28 06:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43317) Support combine adjacent aggregation - posted by "XiDuo You (Jira)" <ji...@apache.org> on 2023/04/28 06:21:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-42843) Assign a name to the error class _LEGACY_ERROR_TEMP_2007 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/28 09:02:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43304) Enable test_to_latex by supporting jinja2>=3.0.0 - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/28 09:14:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43306) Migrate `ValueError` from Spark SQL types into error class - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/28 09:19:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43235) ClientDistributedCacheManager doesn't set the LocalResourceVisibility.PRIVATE if isPublic throws exception - posted by "Pralabh Kumar (Jira)" <ji...@apache.org> on 2023/04/28 09:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43318) spark reader csv and json support wholetext parameters - posted by "melin (Jira)" <ji...@apache.org> on 2023/04/28 12:24:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43263) Upgrade FasterXML jackson to 2.15.0 - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/28 13:31:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43319) Remove usage of deprecated DefaultKubernetesClient - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/28 16:59:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43320) Directly call Hive 2.3.9 API - posted by "Cheng Pan (Jira)" <ji...@apache.org> on 2023/04/28 17:32:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43321) Impl Dataset#JoinWith - posted by "Zhen Li (Jira)" <ji...@apache.org> on 2023/04/28 23:17:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43322) Spark SQL docs for explode_outer and posexplode_outer omit behavior for null/empty - posted by "Robert Juchnicki (Jira)" <ji...@apache.org> on 2023/04/28 23:24:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43322) Spark SQL docs for explode_outer and posexplode_outer omit behavior for null/empty - posted by "Robert Juchnicki (Jira)" <ji...@apache.org> on 2023/04/28 23:25:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43323) DataFrame.toPandas with Arrow enabled should handle exceptions properly - posted by "Takuya Ueshin (Jira)" <ji...@apache.org> on 2023/04/29 01:33:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43324) DataSource V2: Handle UPDATE commands for delta-based sources - posted by "Anton Okolnychyi (Jira)" <ji...@apache.org> on 2023/04/29 02:55:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-42940) Session management support streaming connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/29 02:57:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-42940) Session management support streaming connect - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/29 02:57:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/29 03:05:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43270) Implement __dir__() in pyspark.sql.dataframe.DataFrame to include columns - posted by "Hyukjin Kwon (Jira)" <ji...@apache.org> on 2023/04/29 03:06:00 UTC, 0 replies.
- [jira] [Assigned] (SPARK-43237) Handle null exception message in event log - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2023/04/29 04:15:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43237) Handle null exception message in event log - posted by "Mridul Muralidharan (Jira)" <ji...@apache.org> on 2023/04/29 04:15:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43237) Handle null exception message in event log - posted by "Snoot.io (Jira)" <ji...@apache.org> on 2023/04/29 04:16:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43325) regexp_extract_all DataFrame API - posted by "Sayed Mohammad Hossein Torabi (Jira)" <ji...@apache.org> on 2023/04/29 10:21:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43326) CoalesceBucketsInJoin not working with SHUFFLE_HASH hint - posted by "Nikita Eshkeev (Jira)" <ji...@apache.org> on 2023/04/29 13:04:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory - posted by "Adam Binford (Jira)" <ji...@apache.org> on 2023/04/29 13:30:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43320) Directly call Hive 2.3.9 API - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/29 14:40:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43320) Directly call Hive 2.3.9 API - posted by "Sean R. Owen (Jira)" <ji...@apache.org> on 2023/04/29 14:40:00 UTC, 0 replies.
- [jira] [Created] (SPARK-43327) Trigger `committer.setupJob` before plan execute in `FileFormatWriter` - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/30 07:12:00 UTC, 0 replies.
- [jira] [Updated] (SPARK-43327) Trigger `committer.setupJob` before plan execute in `FileFormatWriter` - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/30 07:16:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43325) regexp_extract_all DataFrame API - posted by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/30 09:05:00 UTC, 1 replies.
- [jira] [Commented] (SPARK-43326) CoalesceBucketsInJoin not working with SHUFFLE_HASH hint - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/30 09:34:00 UTC, 0 replies.
- [jira] [Resolved] (SPARK-43081) Add torch distributor data loader that loads data from spark partition data - posted by "Weichen Xu (Jira)" <ji...@apache.org> on 2023/04/30 11:59:00 UTC, 0 replies.
- [jira] [Commented] (SPARK-43327) Trigger `committer.setupJob` before plan execute in `FileFormatWriter` - posted by "zzzzming95 (Jira)" <ji...@apache.org> on 2023/04/30 14:23:00 UTC, 0 replies.