reviews@spark.apache.org, 2026-03

You are viewing a plain text version of this content. The canonical link for it is here.

- Re: [PR] [SPARK-54353][SQL] Make CollectMetricsExec.collectedMetrics thread-safe [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/01 00:43:16 UTC, 1 replies.
- Re: [PR] [SPARK-55699][SS][FOLLOWUP] Inconsistent reading of LowLatencyClock when used together with ManualClock [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/01 04:27:50 UTC, 3 replies.
- Re: [PR] [SPARK-55753][UI] Upgrade Bootstrap from 4.6.2 to 5.3.8 [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/01 06:55:50 UTC, 1 replies.
- [PR] [SPARK-55764][UI] Use delegated event listener for Bootstrap 5 Tooltip lazy initialization [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/01 08:18:41 UTC, 6 replies.
- [PR] [SPARK-55776][UI] Fix data-title to data-bs-title for timeline tooltips after Bootstrap 5 upgrade [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/01 08:29:08 UTC, 2 replies.
- [PR] [SPARK-55780][UI] Replace PNG logo with SVG in Spark Web UI [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/01 08:44:13 UTC, 2 replies.
- [I] Any plan to update Derby from 10.16.1.1 to 10.17.1.0? [spark] - posted by "stayform (via GitHub)" <gi...@apache.org> on 2026/03/01 10:54:43 UTC, 0 replies.
- [PR] [SPARK-55771][UI] Modernize progress bars using Bootstrap 5 Progress component [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/01 13:22:28 UTC, 7 replies.
- Re: [PR] [SPARK-55631][SQL] ALTER TABLE must invalidate cache for DSv2 tables [spark] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/03/01 14:06:39 UTC, 0 replies.
- Re: [PR] [SPARK-55716][SQL] Support NOT NULL constraint enforcement for V1 file source table inserts [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/01 15:03:47 UTC, 11 replies.
- Re: [PR] [SPARK-55719][SQL] Remove deprecation warning for spark.sql.hive.convertCTAS [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/01 15:05:07 UTC, 8 replies.
- Re: [PR] [SPARK-55747][SQL] Fix NPE when accessing elements from an array that is null [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/01 15:05:37 UTC, 1 replies.
- Re: [PR] [SPARK-52780] Add StreamRows and Arrow Record Streaming [spark-connect-go] - posted by "caldempsey (via GitHub)" <gi...@apache.org> on 2026/03/01 16:15:52 UTC, 9 replies.
- [PR] [SPARK-55786][UI] Compact SQL plan visualization with detail side panel [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/01 19:02:07 UTC, 7 replies.
- [PR] [SPARK-51559][SQL] Make max broadcast table size configurable [spark] - posted by "pratham76 (via GitHub)" <gi...@apache.org> on 2026/03/01 19:38:20 UTC, 5 replies.
- Re: [PR] [SPARK-55714][SQL] JDK might throw ArithmeticException without message [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/02 00:31:57 UTC, 1 replies.
- Re: [PR] [SPARK-54026][BUILD] Use BOM for AWS Java SDK V2 dependency management [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/02 00:38:23 UTC, 1 replies.
- Re: [PR] [SPARK-54006][TESTS][DSTREAM][3.5] Fix for NoClassDefFoundError in WithAggregationKinesisBackedBlockRDDSuite and KinesisTestUitls [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/02 00:38:28 UTC, 1 replies.
- [PR] [SPARK-55751)][SS] Add metrics on state store loads from cloud storage [spark] - posted by "gnanda (via GitHub)" <gi...@apache.org> on 2026/03/02 01:53:53 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-55657][BUILD] Bump Hadoop 3.5.0 RC0 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/02 02:10:08 UTC, 2 replies.
- Re: [PR] [SPARK-53226][SPARK-52088][CORE] Make ClosureCleaner work with Java22+ [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/02 02:59:09 UTC, 5 replies.
- Re: [PR] [SPARK-54807][SQL] Allow qualified names for built-in and session functions [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/02 04:30:34 UTC, 18 replies.
- Re: [PR] [SPARK-55326][PYTHON][CONNECT] Release remote session when SPARK_CONNECT_RELEASE_SESSION_ON_EXIT is set [spark] - posted by "wbo4958 (via GitHub)" <gi...@apache.org> on 2026/03/02 06:21:50 UTC, 5 replies.
- Re: [PR] [SPARK-55464][PYTHON] Support GeographyType in convert_numpy [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/02 06:22:14 UTC, 1 replies.
- Re: [PR] [SPARK-37711][PS] Reduce pandas describe job count from O(N) to O(1) [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/02 06:25:34 UTC, 1 replies.
- Re: [PR] [SPARK-55663][PYTHON] Unify __module__ for data source functions [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/02 06:30:40 UTC, 1 replies.
- Re: [PR] [SPARK-55583][PYTHON] Validate Arrow schema types in Python data source [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/02 06:32:37 UTC, 1 replies.
- [PR] [SPARK-55788][PYTHON] Always use ExtensionDType for integers in Pandas UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/02 07:55:01 UTC, 7 replies.
- [PR] [DOCS] Add welcome section for new contributors in CONTRIBUTING.md [spark] - posted by "Pavan-249 (via GitHub)" <gi...@apache.org> on 2026/03/02 08:14:43 UTC, 1 replies.
- Re: [PR] [SPARK-54418][SQL][PYSPARK] Support path-like targets in DataFrame.mergeInto [spark] - posted by "academy-codex (via GitHub)" <gi...@apache.org> on 2026/03/02 09:19:26 UTC, 0 replies.
- Re: [PR] [SPARK-55440][SQL] Types Framework - Phase 1a - Core Type System Foundation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/02 09:27:54 UTC, 15 replies.
- [PR] [SPARK-55789][CORE][TESTS] Add a microbenchmark for `Platform` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/02 09:34:58 UTC, 12 replies.
- [PR] [SPARK-55790][Geo][SQL] Build a complete SRS registry using PROJ 9.7.1 data [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/03/02 09:52:42 UTC, 20 replies.
- [PR] [SPARK-55686][CORE] SizeEstimator takes care of Compact Object Headers [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/02 12:06:09 UTC, 14 replies.
- Re: [PR] [SPARK-54665][PS] Fix boolean vs string comparison to match pandas behavior [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/02 14:13:53 UTC, 2 replies.
- Re: [PR] [SPARK-46161][PS] Add axis=1 support for DataFrame.diff [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/02 14:21:08 UTC, 0 replies.
- Re: [PR] [SPARK-46167][PS] Add axis implementation to DataFrame.rank [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/02 14:30:47 UTC, 4 replies.
- [PR] [SPARK-55770][UI] Replace custom .btn-spark with Bootstrap 5 button variant [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/02 14:57:18 UTC, 7 replies.
- [PR] [SPARK-55773][UI] Replace custom collapse/toggle system with Bootstrap 5 Collapse API [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/02 16:10:58 UTC, 4 replies.
- [PR] [SPARK-55793][WEBUI] Add multiple log directories support to SHS [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/02 16:32:41 UTC, 1 replies.
- [PR] [SPARK-55794][SQL] Always alias `OuterReference`s [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/02 16:55:51 UTC, 2 replies.
- Re: [PR] [SPARK-55742][SQL] Support TransformingEncoder inside RowEncoder [spark] - posted by "chris-twiner (via GitHub)" <gi...@apache.org> on 2026/03/02 17:04:35 UTC, 1 replies.
- Re: [PR] [SPARK-55728][SS] Introduce RocksDB conf for file checksum threadpool size [spark] - posted by "gnanda (via GitHub)" <gi...@apache.org> on 2026/03/02 17:52:06 UTC, 14 replies.
- Re: [PR] [SPARK-55617] Add VariantGet to V2ExpressionBuilder for DSv2 filter pushdown [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/03/02 17:53:00 UTC, 0 replies.
- [PR] Streaming offset v1 to v2 migration [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/03/02 18:00:51 UTC, 0 replies.
- Re: [PR] [SPARK-54687][SQL] Add more edge cases with generators [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/02 18:56:51 UTC, 1 replies.
- Re: [PR] [SPARK-55267][INFRA] Make sbt less verbose in github actions [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/02 19:19:25 UTC, 1 replies.
- Re: [PR] [SPARK-55695][SQL] Avoid double planning in row-level operations [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/03/02 19:59:10 UTC, 12 replies.
- [PR] [WIP] Sequential Union Implementation [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/03/02 20:43:19 UTC, 0 replies.
- Re: [PR] [SPARK-55535][SPARK-55092][SQL] Refactor `KeyGroupedPartitioning` and Storage Partition Join [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/02 21:36:36 UTC, 62 replies.
- Re: [PR] [SPARK-46162][PS] Implement nunique with axis=1 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/02 21:40:07 UTC, 0 replies.
- [PR] [SPARK-55797] Upgrade `gRPC Swift NIO Transport` to 2.4.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/02 21:43:44 UTC, 3 replies.
- [PR] commit [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/03/02 21:52:26 UTC, 0 replies.
- Re: [PR] [SPARK-55798][SQL] Propagate config data type into config builders [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/03/02 21:56:49 UTC, 0 replies.
- [PR] [SPARK-55799][PYTHON][TESTS] Add datasource tests with simple worker [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/02 22:57:49 UTC, 4 replies.
- Re: [PR] [SPARK-55793][CORE] Add multiple log directories support to SHS [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/02 23:27:58 UTC, 25 replies.
- Re: [PR] [SPARK-55750] Retry creating secondary resources on transient 5xx and network timeouts [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/03/02 23:40:26 UTC, 6 replies.
- [PR] [SPARK-55800][PYTHON] Remove the unused type check for datetime.date [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/02 23:51:09 UTC, 4 replies.
- Re: [PR] [SPARK-55667][PYTHON][CONNECT] Move check_dependencies to __init__ [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/02 23:53:42 UTC, 8 replies.
- Re: [PR] [SPARK-55720][SS] Deprecate MapPartitions in Streaming Real-Time Mode [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/02 23:57:42 UTC, 11 replies.
- [PR] [SPARK-55801][PYTHON] Fix type hint of _SimpleStreamReaderWrapper.getCache [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/02 23:58:01 UTC, 2 replies.
- Re: [PR] [SPARK-55721][INFRA] Group sbt build messages in github actions [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/02 23:58:19 UTC, 2 replies.
- Re: [PR] [SPARK-55726][PYTHON][TEST] Add ASV microbenchmark for grouped map pandas UDF [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/03 00:03:27 UTC, 4 replies.
- [PR] [MINOR] [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2026/03/03 00:20:32 UTC, 0 replies.
- Re: [PR] [MINOR][DOCS] add section for running `pyspark` with `uv` inline dependencies [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/03 00:26:10 UTC, 0 replies.
- Re: [PR] [SPARK-55621][PYTHON] Fix ambiguous and unnecessary unicode usage [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/03 00:27:59 UTC, 1 replies.
- [PR] [SPARK-55802][SQL] Fix integer overflow when computing Arrow batch bytes [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/03 00:28:55 UTC, 4 replies.
- Re: [PR] [SPARK-53803][ML][Feature] Added ArimaRegression for time series forecasting in MLlib [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/03 00:38:42 UTC, 1 replies.
- [PR] [SPARK-55803] Bump lz4-java 1.10.4 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/03 00:48:36 UTC, 0 replies.
- [PR] [SPARK-55804] Expose informer cache sync timeout as operator config [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/03/03 00:54:12 UTC, 3 replies.
- Re: [PR] [MINOR] Clarify error message; do not use non-local return [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/03 01:34:36 UTC, 0 replies.
- Re: [PR] [SPARK-55803] Bump lz4-java 1.10.4 to bring back performance [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/03 02:01:52 UTC, 0 replies.
- [PR] [SPARK-54693][CORE][TESTS][FOLLOWUP] Minor fix TPCDSDataBenchmark [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/03 02:23:15 UTC, 3 replies.
- Re: [PR] [SPARK-55806][DOCS] add section for running `pyspark` with `uv` inline dependencies [spark] - posted by "markjm (via GitHub)" <gi...@apache.org> on 2026/03/03 02:24:30 UTC, 4 replies.
- Re: [PR] [SPARK-55685][BUILD] Upgrade ORC to 2.3.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/03 02:53:16 UTC, 1 replies.
- Re: [PR] [SPARK-55803][BUILD] Bump lz4-java 1.10.4 to bring back performance [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/03 03:14:43 UTC, 2 replies.
- [PR] [SPARK-55807] Use Java 25 Compact Object Headers [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/03 03:20:53 UTC, 3 replies.
- [PR] [SPARK-55808] Add `UseCompactObjectHeaders` to `gradle.properties` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/03 03:33:33 UTC, 1 replies.
- [PR] [SPARK-55771][UI][FOLLOWUP] Fix progress bar height alignment in BS5 stacked progress [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/03 04:07:49 UTC, 3 replies.
- Re: [PR] [SPARK-55808] Use `-XX:+UseCompactObjectHeaders` for Java 25+ GitHub Actions `build-test` jobs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/03 04:08:22 UTC, 2 replies.
- Re: [PR] [SPARK-55788][PYTHON] Support ExtensionDType for integers in Pandas UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/03 04:11:45 UTC, 9 replies.
- Re: [PR] [SPARK-55492][SQL][SS][FOLLOWUP] Clarify error message; do not use non-local return [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/03 04:38:38 UTC, 1 replies.
- [PR] [SPARK-55779][UI] Add tooltip helper utilities for Spark Web UI [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/03 04:41:37 UTC, 2 replies.
- Re: [PR] [SPARK-55727][PYTHON] Remove nested exception throwing in streaming data source error handling [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/03 04:53:22 UTC, 2 replies.
- [PR] [SPARK-55767][UI] Use Bootstrap 5 Offcanvas for executor detail panels [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/03 05:36:14 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-53327] Test datasketches-memory GH 272 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/03 06:07:19 UTC, 4 replies.
- Re: [PR] [SPARK-55690] Schema evolution in DSv2 AppendData, OverwriteByExpression, OverwritePartitionsDynamic [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/03/03 07:55:36 UTC, 36 replies.
- [I] Unable to get the query execution plan for a `create or replace table` without executing the statement. [spark] - posted by "malduarte (via GitHub)" <gi...@apache.org> on 2026/03/03 12:14:04 UTC, 2 replies.
- Re: [PR] [SPARK-55275] SQL State Coverage: IllegalStateException [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/03/03 13:31:05 UTC, 0 replies.
- Re: [PR] [SPARK-55338][CONNECT] Centralize Spark Connect request decompression logic in gRPC interceptor [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/03/03 13:44:37 UTC, 6 replies.
- [PR] [SPARK-55812][SQL] Consolidate dataSchemaNotSpecifiedError to use UNABLE_TO_INFER_SCHEMA [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/03/03 13:59:34 UTC, 1 replies.
- Re: [PR] [SPARK-55528][SQL] Add default collation support for SQL UDFs [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/03 14:02:34 UTC, 4 replies.
- [PR] [SPARK-55813][SQL] Rename _LEGACY_ERROR_TEMP_2078 to JDBC_TABLE_AND_QUERY_BOTH_SPECIFIED with SQL state 42000 [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/03/03 14:12:00 UTC, 0 replies.
- [PR] [SPARK-55440][SQL][FOLLOW UP] Types Framework - Phase 1a - Remove not needed Serializable interface [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/03/03 14:30:16 UTC, 4 replies.
- [PR] [SPARK-55814][SQL] Add proper error class and SQL state for defineTempViewWithIfNotExistsError [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/03/03 14:48:17 UTC, 0 replies.
- Re: [PR] [SPARK-55785][UI] Compact SQL plan visualization with detail side panel [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/03 15:27:41 UTC, 12 replies.
- Re: [PR] [SPARK-55647][SQL] Improve `ConstantPropagation` for collated `AttributeReference`s [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/03 15:28:14 UTC, 1 replies.
- [PR] [SPARK-55815][SQL] Add proper error class and SQL state for cannotFindCatalogToHandleIdentifierError [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/03/03 15:31:35 UTC, 0 replies.
- [PR] [SPARK-55816][SQL] Rename _LEGACY_ERROR_TEMP_3058 to DUPLICATE_PARTITION_TRANSFORM with SQL state 42000 [spark] - posted by "miland-db (via GitHub)" <gi...@apache.org> on 2026/03/03 15:43:30 UTC, 0 replies.
- [PR] [SPARK-55716][SQL][FOLLOWUP] Simplify NOT NULL preservation by skipping asNullable in resolveRelation [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/03 16:00:23 UTC, 2 replies.
- [PR] [SPARK-55817][SQL] Enable Parquet row-group skipping for shredded variant [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/03/03 16:10:34 UTC, 1 replies.
- [PR] [SPARK-55818][PS] Decimal-float mixed arithmetic should always raise TypeError [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/03 17:23:49 UTC, 1 replies.
- [PR] [SPARK-55811] [SQL] Catch `NonFatal` instead of `UnresolvedException` when calling `nodeWithOutputColumnsString` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/03/03 17:38:44 UTC, 3 replies.
- Re: [PR] [SPARK-55271][SS] The error originates in KafkaMicroBatchStream.metrics() at line 520, where the code attempts to call .get() on a Scala Option that contains null, then immediately invokes .map() on the null result [spark] - posted by "cpbotha (via GitHub)" <gi...@apache.org> on 2026/03/03 18:47:31 UTC, 1 replies.
- [PR] [SPARK-55819] Refactor ExpandExec to be more succinct [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/03/03 19:49:22 UTC, 0 replies.
- Re: [PR] [SPARK-55751][SS] Add metrics on state store loads from cloud storage [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/03/03 19:57:30 UTC, 2 replies.
- [PR] [SPARK-55820] [SS] Fix race condition in no-overwrite FS when RocksDB version files cach… [spark] - posted by "liviazhu (via GitHub)" <gi...@apache.org> on 2026/03/03 20:21:11 UTC, 0 replies.
- [I] [FEATURE REQUEST] Add ADBC (Arrow Database Connectivity) Data Source [spark] - posted by "tokoko (via GitHub)" <gi...@apache.org> on 2026/03/03 20:43:29 UTC, 6 replies.
- [PR] [SPARK-53501][PYTHON][CORE] Extract PythonWorkerFactory cache from SparkEnv [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/03/03 21:41:26 UTC, 2 replies.
- [PR] [SPARK-55821][PYTHON] Enforce keyword-only arguments in serializer __init__ methods [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/03 22:38:41 UTC, 3 replies.
- [PR] [SPARK-55822][SQL] Rename `_LEGACY_ERROR_TEMP_0052` to `CREATE_VIEW_WITH_IF_NOT_EXISTS_AND_REPLACE` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/03 23:16:16 UTC, 4 replies.
- [PR] [SPARK-55823][SQL] Rename _LEGACY_ERROR_TEMP_1134 to UNABLE_TO_INFER_SCHEMA_FOR_DATA_SOURCE [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/03 23:49:47 UTC, 0 replies.
- [PR] [SPARK-55824][SQL] Rename _LEGACY_ERROR_TEMP_1034 to WINDOW_FUNCTION_NOT_ALLOWED_IN_CLAUSE [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/04 00:12:00 UTC, 0 replies.
- [PR] [SPARK-55825][SQL] Rename _LEGACY_ERROR_TEMP_1309 to PARTITION_BY_NOT_ALLOWED_WITH_INSERT_INTO [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/04 00:21:33 UTC, 0 replies.
- Re: [PR] [SPARK-53848] Add ability to support Alpha family in Theta Aggregates [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/04 00:37:02 UTC, 1 replies.
- [PR] [SPARK-55826][SQL] Rename _LEGACY_ERROR_TEMP_0006 to MERGE_INSERT_VALUE_COUNT_MISMATCH [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/04 00:40:06 UTC, 0 replies.
- [PR] [SPARK-55827][PYTHON] Fix type hint for datasource workers [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/04 01:21:07 UTC, 2 replies.
- [PR] [SPARK-55465][PYTHON] Support GeometryType in convert_numpy [spark] - posted by "fangchenli (via GitHub)" <gi...@apache.org> on 2026/03/04 01:52:17 UTC, 4 replies.
- Re: [PR] [SPARK-55728][SS] Introduce RocksDB conf for file checksum threadpool size and support disabling the threadpool [spark] - posted by "gnanda (via GitHub)" <gi...@apache.org> on 2026/03/04 01:54:18 UTC, 12 replies.
- Re: [PR] [SPARK-55596][SQL] DSV2 Enhanced Partition Stats Filtering [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/04 01:59:45 UTC, 185 replies.
- [PR] [SPARK-55772][UI] Replace jQuery show/hide with Bootstrap 5 d-none utility class [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 02:05:55 UTC, 1 replies.
- Re: [PR] [SPARK-55819][SQL] Refactor ExpandExec to be more succinct [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/04 02:32:36 UTC, 7 replies.
- [PR] [SPARK-55775][UI] Replace inline styles with Bootstrap 5 utility classes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 03:13:01 UTC, 2 replies.
- Re: [PR] [SPARK-55658][PYTHON] SparkSessionBuilder.create in PySpark classic should mirror getOrCreate path as much as possible [spark] - posted by "jonmio (via GitHub)" <gi...@apache.org> on 2026/03/04 03:29:50 UTC, 0 replies.
- [PR] [SPARK-55782][UI] Replace CSS float right with Bootstrap 5 float-end utility [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 04:22:55 UTC, 2 replies.
- [PR] [SPARK-55829][INFRA] Skip PySpark/SparkR/TPC-DS CI for static-resource-only changes [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 04:50:21 UTC, 2 replies.
- Re: [PR] [WIP] Java25 compatible test [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/04 06:29:55 UTC, 0 replies.
- Re: [PR] [SPARK-55825][SQL] Rename `_LEGACY_ERROR_TEMP_1309` to `PARTITION_BY_NOT_ALLOWED_WITH_INSERT_INTO` [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/03/04 11:51:00 UTC, 3 replies.
- [PR] Solved Support path-based table reference in DataFrame.mergeInto by Me [spark] - posted by "SUCHNA24 (via GitHub)" <gi...@apache.org> on 2026/03/04 11:59:53 UTC, 1 replies.
- [PR] [SPARK-55831][YARN] Support `spark.yarn.am.defaultJavaOptions` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/04 12:33:39 UTC, 8 replies.
- Re: [PR] [SPARK-55693][SQL] Avoid deadlock by making SparkSession.observationManager a non-lazy val [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/04 12:51:49 UTC, 1 replies.
- Re: [PR] [SPARK-55461][SQL] Improve AQE Coalesce Grouping warning messages when numOfPartitions of ShuffleStages in the same coalesce group are not equal [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/04 13:02:56 UTC, 1 replies.
- [PR] [SPARK-55832][SQL][TESTS] Reduce periodic GC interval in ThriftServerQueryTestSuite to mitigate OOM [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 13:24:45 UTC, 2 replies.
- [PR] [SPARK-55784][UI] Add Bootstrap 5 table-hover class for row highlight on mouseover [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 13:58:27 UTC, 2 replies.
- [PR] [SPARK-55774][UI] Replace border-triangle CSS with CSS transform chevron indicators [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 14:03:06 UTC, 1 replies.
- [PR] [SPARK-55778][UI] Remove redundant data-bs-placement="top" from tooltip markup [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 14:25:12 UTC, 5 replies.
- [PR] [SPARK-55834][UI] Use Bootstrap 5 nav-tabs for Environment page sections [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 15:38:07 UTC, 3 replies.
- Re: [PR] [SPARK-55823][SQL] Rename `_LEGACY_ERROR_TEMP_1134` to `UNABLE_TO_INFER_SCHEMA_FOR_DATA_SOURCE` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/04 16:11:27 UTC, 1 replies.
- Re: [PR] [SPARK-55824][SQL] Rename `_LEGACY_ERROR_TEMP_1034` to `WINDOW_FUNCTION_NOT_ALLOWED_IN_CLAUSE` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/04 16:13:45 UTC, 1 replies.
- [I] Helm chart missing RBAC for leader election leases [spark-kubernetes-operator] - posted by "yogeek (via GitHub)" <gi...@apache.org> on 2026/03/04 16:14:37 UTC, 2 replies.
- [PR] [SPARK-55802][SQL][4.0] Fix integer overflow when computing Arrow batch bytes [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/04 16:30:25 UTC, 2 replies.
- [PR] [SPARK-55840] Upgrade `Gradle` to 9.4.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/04 16:35:35 UTC, 5 replies.
- [PR] [SPARK-55829][INFRA][FOLLOWUP] Fix static-only CI check skipping all jobs on empty diff [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/04 17:20:17 UTC, 3 replies.
- Re: [PR] [SPARK-54796][CORE] Fix NPE caused by race condition between Executor initialization and shuffle migration [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/04 17:28:42 UTC, 6 replies.
- [PR] [SPARK-55841] Upgrade jackson to 2.21.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/04 19:05:41 UTC, 0 replies.
- [PR] [SPARK-55828][SQL] Add DSV2 TableChange toString and fix missing error class for Merge Into Schema Evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/04 19:13:17 UTC, 3 replies.
- [PR] [SPARK-54665][PS] Fix comparison between boolean Series and string literals [spark] - posted by "singhpraveen2010 (via GitHub)" <gi...@apache.org> on 2026/03/04 21:13:18 UTC, 0 replies.
- Re: [I] Supports write logs to S3 upon Driver/Executor termination [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/04 21:46:07 UTC, 2 replies.
- Re: [PR] [SPARK-55841][BUILD] Upgrade jackson to 2.21.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/04 22:00:53 UTC, 1 replies.
- [PR] [SPARK-55843][PS] Handle the unit of datetime64 and timedelta64 dtypes [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/04 22:06:40 UTC, 5 replies.
- [PR] [SPARK-55844] Upgrade `Vapor` to 4.121.3 in `web` example [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/04 22:14:03 UTC, 4 replies.
- [PR] [SPARK-55156][PS][FOLLOW-UP] Fix fallback functions [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/04 22:53:57 UTC, 3 replies.
- Re: [PR] [SPARK-54335][SQL] Reducing skew in the number of file splits per partition [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/05 00:38:05 UTC, 1 replies.
- Re: [PR] [SPARK-52508][CORE] Fallback storage retries FileNotFoundExceptions [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/05 00:38:12 UTC, 1 replies.
- [PR] [SPARK-55559][SQL] Fix BitCount to respect input integer type bit width [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/05 01:40:59 UTC, 4 replies.
- Re: [PR] [SPARK-55754][PYTHON][TEST] Add ASV microbenchmarks for scalar Arrow UDF eval types [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/05 01:50:59 UTC, 5 replies.
- Re: [PR] [SPARK-55826][SQL] Rename `_LEGACY_ERROR_TEMP_0006` to `MERGE_INSERT_VALUE_COUNT_MISMATCH` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/05 04:05:35 UTC, 1 replies.
- [PR] [SPARK-55845] Add `.claude` to `.gitignore` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/05 04:32:27 UTC, 4 replies.
- [PR] [SPARK-55837][UI] Render Environment page tables client-side via REST API [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/05 05:00:24 UTC, 3 replies.
- Re: [I] [SQL] dropDuplicates and Window dedup produce incorrect results with SPJ partiallyClusteredDistribution [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/05 05:13:39 UTC, 6 replies.
- [PR] [SPARK-55847] Upgrade `kubernetes-client` to 7.6.0 and update CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/05 05:29:02 UTC, 4 replies.
- [PR] [SPARK-55841][BUILD][FOLLOWUP] Update `SparkBuild.scala` consistently [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/05 05:39:01 UTC, 6 replies.
- [PR] [SPARK-55849] Add `.claude` to `.gitignore` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/05 05:53:01 UTC, 4 replies.
- [PR] [SPARK-55850][BUILD] Upgrade `kubernetes-client` to 7.6.0 for K8s 1.35 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/05 06:54:41 UTC, 3 replies.
- [PR] [SPARK-55851][PYTHON] Clarify types of datasource partition and read [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/05 07:24:23 UTC, 4 replies.
- [PR] [SPARK-55620][PYTHON][CONNECT] Fix deadlock in test_connect_session d… [spark] - posted by "godeomt (via GitHub)" <gi...@apache.org> on 2026/03/05 08:28:02 UTC, 8 replies.
- [I] Spark Docker Image Release Discrepancy Between apache/spark and Docker Library [spark] - posted by "AnmolVirdi (via GitHub)" <gi...@apache.org> on 2026/03/05 10:04:28 UTC, 0 replies.
- [PR] [SPARK-55835][UI] Highlight non-default Spark configuration values on Environment page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/05 10:36:58 UTC, 3 replies.
- [PR] [SPARK-55769][UI] Replace browser alert() with Bootstrap 5 Toast notifications [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/05 11:44:10 UTC, 1 replies.
- [PR] [SPARK-55853][UI] Migrate hardcoded CSS colors to Bootstrap 5 CSS custom properties [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/05 12:24:39 UTC, 2 replies.
- [I] Spark-operator is not reconciling modified settings for cluster [spark-kubernetes-operator] - posted by "DSurfer (via GitHub)" <gi...@apache.org> on 2026/03/05 13:40:20 UTC, 6 replies.
- [PR] fix [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/05 14:09:31 UTC, 1 replies.
- Re: [PR] [SPARK-55623] Add granular restart control with consecutive failure tracking [spark-kubernetes-operator] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/05 15:29:18 UTC, 8 replies.
- [PR] [SPARK-55855] DSv2 Transaction API foundations [spark] - posted by "andreaschat-db (via GitHub)" <gi...@apache.org> on 2026/03/05 15:56:34 UTC, 0 replies.
- Re: [PR] [SPARK-35564][SQL] Support subexpression elimination for conditionally evaluated expressions [spark] - posted by "Kimahriman (via GitHub)" <gi...@apache.org> on 2026/03/05 16:42:55 UTC, 0 replies.
- [PR] [SPARK-55856][INFRA] Add `.claude` to `.gitignore` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/05 17:04:52 UTC, 3 replies.
- [PR] [SPARK-49634] Remove the ANSI config suggestion in NUMERIC_VALUE_OUT_OF_RANGE.WITH_SUGGESTION [spark] - posted by "rpnkv (via GitHub)" <gi...@apache.org> on 2026/03/05 18:09:00 UTC, 0 replies.
- Re: [PR] [SPARK-55750] Retry creating secondary resources on transient error, response 500, and network timeouts [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/03/05 20:36:08 UTC, 1 replies.
- [PR] [MINOR] Fix inconsistent name in Java doc [spark-kubernetes-operator] - posted by "jiangzho (via GitHub)" <gi...@apache.org> on 2026/03/05 22:18:01 UTC, 3 replies.
- [PR] Bump org.eclipse.jetty:jetty-server from 12.1.5 to 12.1.6 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/03/05 22:26:30 UTC, 2 replies.
- [I] Spark map lookup is O(n) [spark] - posted by "DanSkells (via GitHub)" <gi...@apache.org> on 2026/03/06 00:02:21 UTC, 5 replies.
- [PR] [SPARK-55857][SQL] Support ignoreMissingFiles during schema inference… [spark] - posted by "yashtc (via GitHub)" <gi...@apache.org> on 2026/03/06 01:41:28 UTC, 4 replies.
- Re: [PR] [SPARK-55478][BUILD] Upgrade Jetty to 12.1.6 [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/06 02:51:18 UTC, 1 replies.
- Re: [PR] [SPARK-55502][PYTHON] Unify UDF and UDTF Arrow conversion error handling [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/06 03:05:52 UTC, 3 replies.
- [PR] [SPARK-55766][UI] Support dark mode with Bootstrap 5 theme toggle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/06 04:21:47 UTC, 4 replies.
- [PR] [SPARK-55858][PYTHON][INFRA] Fix UDF logging tests under coverage [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/06 04:26:20 UTC, 3 replies.
- [PR] [SPARK-55859][PYTHON][TESTS] Fix udf tests with double [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/06 08:23:14 UTC, 0 replies.
- [PR] [SPARK-55831][FOLLOWUP] Fix Maven CI by retaining assembly for yarn module [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/06 08:53:39 UTC, 1 replies.
- Re: [PR] [SPARK-55831][FOLLOWUP] Fix Maven CI by replacing with dummy SPARK_HOME in test [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/06 09:51:48 UTC, 3 replies.
- [PR] Add InvalidPlanInput sql states for sql/connect [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/03/06 09:52:07 UTC, 2 replies.
- Re: [PR] [DO-NOT-MERGE] Rewrite spark.catalog in SQL DDL formatted text [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/06 09:56:31 UTC, 3 replies.
- [PR] Config binding policy [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/06 10:55:52 UTC, 0 replies.
- [PR] [SPARK-55860][SQL] Use `UNABLE_TO_INFER_SCHEMA` instead of `UNABLE_TO_INFER_SCHEMA_FOR_DATA_SOURCE` [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/06 10:57:43 UTC, 2 replies.
- [PR] [SPARK-55861][SQL] Rename _LEGACY_ERROR_TEMP_2045 to UNSUPPORTED_TABLE_CHANGE [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2026/03/06 12:05:07 UTC, 1 replies.
- [PR] [SQL] Rename _LEGACY_ERROR_TEMP_2027 to UNEXPECTED_OPERATOR_IN_CORRELATED_SUBQUERY [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2026/03/06 12:33:32 UTC, 0 replies.
- [PR] [SPARK-55863][UI] Add footer to Spark Web UI with user, version, and uptime [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/06 13:22:38 UTC, 1 replies.
- [PR] [WIP] Type evolution in DSv2 [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/03/06 14:22:19 UTC, 2 replies.
- [PR] [SPARK-47997][PS] Add errors parameter to DataFrame.drop and Series.drop [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/06 16:12:40 UTC, 2 replies.
- Re: [PR] [SPARK-55611] Add `RunningWithPartialCapacity` state for `SparkApplication` CRD [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/06 16:51:25 UTC, 0 replies.
- [PR] [SPARK-55864][CORE][TESTS] Add more tests for SHS multiple log directories feature [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/06 17:06:24 UTC, 2 replies.
- [PR] [SPARK-55865][SQL] Rename _LEGACY_ERROR_TEMP_1266 to CANNOT_TRUNCATE_EXTERNAL_TABLE [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2026/03/06 17:13:14 UTC, 2 replies.
- [PR] [SPARK-55866][SQL] Rename _LEGACY_ERROR_TEMP_2145 to OPTION_VALUE_EXCEEDS_ONE_CHARACTER [spark] - posted by "mikhailnik-db (via GitHub)" <gi...@apache.org> on 2026/03/06 17:16:45 UTC, 1 replies.
- Re: [PR] [SPARK-55855][SQL] DSv2 Transaction API foundations [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/03/06 17:17:19 UTC, 1 replies.
- Re: [PR] [SPARK-55568][SQL] Separate schema construction from field stats collection [spark] - posted by "qlong (via GitHub)" <gi...@apache.org> on 2026/03/06 18:30:19 UTC, 9 replies.
- [PR] [SPARK-55289][SQL][FOLLOWUP] Fix flaky test in-order-by.sql by disabling broadcast join [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/06 18:32:18 UTC, 2 replies.
- Re: [PR] [SPARK-55859][PYTHON][TESTS][4.0] Fix udf tests with double [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/06 20:23:09 UTC, 2 replies.
- [PR] [SPARK-55867][PS] Fix StringMethods with pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/06 21:15:36 UTC, 3 replies.
- [PR] [SPARK-55453][SQL] Fix LIKE pattern matching for supplementary Unicode characters [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/06 23:13:29 UTC, 5 replies.
- [PR] [SPARK-55868][SQL][Tests] Fix Predicate Pushdown for InMemoryTable for V2Filters [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/07 00:00:08 UTC, 2 replies.
- [PR] [SQL] Add toV2Stats/toV2ColStat to CatalogStatistics for DSv2 connectors [spark] - posted by "huan233usc (via GitHub)" <gi...@apache.org> on 2026/03/07 01:44:49 UTC, 6 replies.
- [PR] [SPARK-55870][SQL] Add docs for Geo types [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/07 01:53:02 UTC, 4 replies.
- [PR] [WIP] [SPARK-55869][SQL] Extended Predicate Pushdown for DataSource V2 [spark] - posted by "schenksj (via GitHub)" <gi...@apache.org> on 2026/03/07 03:52:06 UTC, 0 replies.
- Re: [PR] [SPARK-55863][UI] Move Application-level information from Job Tab to footer [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/07 04:00:42 UTC, 1 replies.
- [PR] [SPARK-55768][UI] Improve responsive layout with table-responsive wrappers and viz overflow [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/07 04:58:22 UTC, 1 replies.
- [PR] [SPARK-55875][UI] Switch SQL tab query listing to client-side DataTables [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/07 06:13:32 UTC, 16 replies.
- [PR] [SPARK-48942][SQL][TESTS] Add regression tests for Array of Structs with UDT fields in Parquet [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/03/07 09:01:56 UTC, 0 replies.
- Re: [PR] [DNM][SPARK-54934][CORE] Make UnsafeInMemorySorter free memory thread-safety [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/03/07 11:13:02 UTC, 0 replies.
- [PR] [SPARK-55881][SQL][UI] Add queryId, errorMessage, and rootExecutionId to SQL execution REST API [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/07 12:00:31 UTC, 1 replies.
- Re: [PR] [SPARK-55869][SQL] Extended Predicate Pushdown for DataSource V2 [spark] - posted by "schenksj (via GitHub)" <gi...@apache.org> on 2026/03/07 14:30:05 UTC, 4 replies.
- [I] Fix various typo errors in code comments across multiple modules [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/03/07 14:44:08 UTC, 0 replies.
- [PR] [SPARK-54674][CORE][SQL][YARN] Fix various typo errors in comments [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/03/07 14:44:44 UTC, 1 replies.
- [PR] Spark 55557 [spark] - posted by "mgaido91 (via GitHub)" <gi...@apache.org> on 2026/03/07 16:31:21 UTC, 0 replies.
- Re: [PR] [SPARK-55478][BUILD] Upgrade Jetty to 12.1.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/07 18:25:04 UTC, 2 replies.
- Re: [PR] [SPARK-55626][SQL][4.1] Don't load metadata columns on Table unless needed in V2TableUtil [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/07 18:28:07 UTC, 11 replies.
- [PR] [SPARK-55557][SQL] Fix numerical instability in asinh/acosh for large values [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/07 21:10:36 UTC, 4 replies.
- [PR] [SPARK-55882][SQL] Rename `_LEGACY_ERROR_TEMP_1048` to `INVALID_COALESCE_HINT_PARAMETER` [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/03/07 22:26:30 UTC, 5 replies.
- Re: [PR] [SPARK-54024][BUILD] Add sbt-dependency-tree to SBT plugin [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/08 00:38:53 UTC, 1 replies.
- Re: [PR] [SPARK-47836][SQL] Use doubles sketch replace the GK algorithm for ap… [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/08 00:38:56 UTC, 2 replies.
- Re: [PR] [SPARK-52336][CORE] Prepend Spark identifier to GCS user agent [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/08 00:39:03 UTC, 1 replies.
- [PR] Fix/spj partial clustering dedup [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/08 06:41:46 UTC, 0 replies.
- Re: [PR] [SPARK-55848][SQL] Fix incorrect dedup results with SPJ partial clustering [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/08 06:44:17 UTC, 8 replies.
- Re: [PR] [SPARK-49644][SQL] Support drop multi-level partition V2 table with partial partition spec [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/09 00:38:35 UTC, 1 replies.
- [I] Rename TABLESAMPLE-related legacy error conditions to descriptive names [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/03/09 03:36:23 UTC, 0 replies.
- [PR] [SPARK-54680][SQL] Rename TABLESAMPLE-related legacy error conditions to descriptive names [spark] - posted by "ycli12 (via GitHub)" <gi...@apache.org> on 2026/03/09 03:37:06 UTC, 0 replies.
- Re: [PR] [SPARK-55557][SQL] Hyperbolic functions should not overflow with large inputs [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/09 05:00:17 UTC, 21 replies.
- [PR] [WIP][PYTHON] Revert cached timezone [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/09 06:06:16 UTC, 0 replies.
- [PR] [SPARK-55164][TESTS][FOLLOW-UP] Correct the error message for mismatched output [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/09 06:21:31 UTC, 2 replies.
- Re: [PR] Revert "[SPARK-54285][PYTHON] Cache timezone info to avoid expensive timestamp conversion" [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/09 07:53:26 UTC, 1 replies.
- [PR] [SPARK-55523][SQL] Fix inputMetrics.recordsRead to report rows instead of CachedBatches [spark] - posted by "moomindani (via GitHub)" <gi...@apache.org> on 2026/03/09 08:29:03 UTC, 0 replies.
- [PR] Special handling of `CollectLimitExec/CollectTailExec` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/09 08:50:22 UTC, 1 replies.
- [PR] [MINOR] Add .claude/ to .gitignore [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/09 08:57:47 UTC, 5 replies.
- Re: [PR] [SPARK-55887][CONNECT] Special handling for `CollectLimitExec/CollectTailExec` to avoid full table scans [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/09 09:54:20 UTC, 8 replies.
- [I] Allow injecting logical plan stats [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2026/03/09 10:33:41 UTC, 0 replies.
- Re: [PR] [SPARK-55854][SQL] Tag pass-through duplicate attributes in Expand output to prevent AMBIGUOUS_REFERENCE [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/09 11:24:53 UTC, 1 replies.
- [PR] [SPARK-55888] [K8S] Parallel pod creation for Kubernetes executor allocation [spark] - posted by "DenineLu (via GitHub)" <gi...@apache.org> on 2026/03/09 12:44:50 UTC, 1 replies.
- [PR] Check arrow memory at end of tests [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/03/09 14:34:36 UTC, 1 replies.
- [PR] [SPARK-55889][BUILD] Upgrade Maven to 3.9.13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 16:34:59 UTC, 7 replies.
- Re: [PR] [SPARK-55750] Retry creating secondary resources on `408/500/502/503/504` error codes and network timeouts [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 16:54:33 UTC, 1 replies.
- Re: [PR] [SPARK-55890] Check arrow memory at end of tests [spark] - posted by "garlandz-db (via GitHub)" <gi...@apache.org> on 2026/03/09 16:59:52 UTC, 11 replies.
- [PR] [SPARK-55891][SQL] Preserve the SQL scripting context inside EXECUTE IMMEDIATE [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/09 17:17:21 UTC, 9 replies.
- [PR] [SPARK-38743][SQL] Test the error class: MISSING_STATIC_PARTITION_COLUMN [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/03/09 18:05:29 UTC, 1 replies.
- [PR] Bump org.apache.zookeeper:zookeeper from 3.9.4 to 3.9.5 [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/03/09 18:22:21 UTC, 2 replies.
- [PR] [SPARK-38719][SQL] Test the error class: CANNOT_CAST_DATATYPE [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/03/09 18:34:56 UTC, 1 replies.
- [PR] [SPARK-49642][SQL] Remove the ANSI config suggestion in DATETIME_FIEL… [spark] - posted by "deepujain (via GitHub)" <gi...@apache.org> on 2026/03/09 19:34:25 UTC, 2 replies.
- [PR] [SPARK-55893][EXAMPLE] Fix `SparkDataFramePi` to match with `SparkPi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 20:03:45 UTC, 2 replies.
- [PR] [SPARK-55892][SS] Fix unable to load state store because reused SST file was deleted by maintenance [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/03/09 20:12:19 UTC, 5 replies.
- [PR] [SPARK-55894] Upgrade Zookeeper to 3.9.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 20:20:03 UTC, 0 replies.
- [PR] [SPARK-55895] Fix `pi` example to use n instead of n-1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 20:33:36 UTC, 0 replies.
- Re: [PR] [SPARK-55893][EXAMPLES] Fix `SparkDataFramePi` to match with `SparkPi` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 21:36:10 UTC, 4 replies.
- Re: [PR] [SPARK-55895] Fix `pi` example to use `n` instead of `n-1` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 21:36:21 UTC, 2 replies.
- [PR] [SPARK-55896][PS] Use numpy functions instead of builtins and fix groupby-apply [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/09 21:54:55 UTC, 1 replies.
- Re: [PR] [SPARK-55390][PYTHON] Consolidate SQL_SCALAR_ARROW_UDF wrapper, mapper, and serializer logic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/09 21:57:08 UTC, 2 replies.
- [PR] wip pr for looking at udt/ columnar row issues [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/03/09 22:44:17 UTC, 1 replies.
- Re: [PR] [SPARK-55894][BUILD] Upgrade Zookeeper to 3.9.5 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 23:00:23 UTC, 1 replies.
- [PR] [SPARK-55897][SQL] Handle UserDefinedType in ColumnarRow, ColumnarBatchRow, and ColumnarArray get() [spark] - posted by "james-willis (via GitHub)" <gi...@apache.org> on 2026/03/09 23:08:55 UTC, 2 replies.
- [PR] [SPARK-55724][PYTHON][TEST] Add ASV microbenchmark for SQL_ARROW_BATCHED_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/09 23:16:03 UTC, 0 replies.
- [PR] [SPARK-55900] Simplify SparkAppStatusUtils by adjusting import statements [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 23:22:16 UTC, 0 replies.
- [PR] [SPARK-55901][PS] Raise an error from Series.replace() with no arguments [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/09 23:31:56 UTC, 3 replies.
- Re: [PR] [SPARK-55900] Simplify `SparkAppStatusUtils` by adjusting `import` statements [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/09 23:38:34 UTC, 2 replies.
- [PR] [SPARk-55903][SQL] Simplify Merge Into Schema Evolution and Check Write Privileges [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/09 23:41:49 UTC, 2 replies.
- [PR] [SPARK-55902][PYTHON] Refactor SQL_ARROW_BATCHED_UDF to use ArrowStreamSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/09 23:42:26 UTC, 0 replies.
- [PR] Add subplots support for pie charts in Plotly backend [spark] - posted by "RishbhaJain (via GitHub)" <gi...@apache.org> on 2026/03/09 23:48:56 UTC, 0 replies.
- [PR] [SPARK-55904][PYTHON][CONNECT] Utilize _check_same_session to narrow down types [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/09 23:50:13 UTC, 2 replies.
- [PR] SPARK-53675: Add str support in withColumn and withColumn in PySpark [spark] - posted by "ZoeyeoZ (via GitHub)" <gi...@apache.org> on 2026/03/09 23:51:20 UTC, 0 replies.
- Re: [PR] [SPARK-50111][Python] Add subplots support for pie charts in Plotly backend [spark] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/03/09 23:52:39 UTC, 13 replies.
- [PR] Spark 55905 [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/03/09 23:59:34 UTC, 0 replies.
- [PR] [SPARK-55906] Remove unused `SparkAppStatusUtils.hasReachedState` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 00:00:26 UTC, 5 replies.
- [PR] Fix potential NPE/IllegalArgumentException by wrapping toBoolean call with Try and defaulting to false for LEGACY_PARQUET_NANOS_AS_LONG config [spark] - posted by "wanghui111 (via GitHub)" <gi...@apache.org> on 2026/03/10 01:53:25 UTC, 1 replies.
- [PR] [SPARK-55907][SQL] Fix incorrect error positions for invalid data types in CREATE FUNCTION [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/10 02:24:53 UTC, 4 replies.
- Re: [PR] [SPARK-55899][PYTHON][TEST] Add ASV microbenchmark for SQL_ARROW_BATCHED_UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/10 02:43:41 UTC, 1 replies.
- [PR] [SPARK-55908] Rename `SPARK_(SWIFT_APP -> APP)` and `SPARK_(SWIFT -> APP)_HOME` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 03:15:33 UTC, 4 replies.
- [PR] [SPARK-55911] Improve `ModelUtils` to support `isClientMode` method [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 03:41:02 UTC, 4 replies.
- [PR] [SPARK-55909][SQL][TESTS] Introduce trait SparkSessionProvider [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/10 03:49:53 UTC, 0 replies.
- Re: [PR] [SPARK-55905] Exponential backoff for getOrCreateSecondaryResource attempt [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 03:57:32 UTC, 14 replies.
- [PR] [SPARK-55912] Add `since` Javadoc tag for all public `spark-operator-api` classes [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 04:03:09 UTC, 3 replies.
- [PR] [SPARK-55913][INFRA] Add `.kiro` to `.gitignore` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/10 04:11:27 UTC, 5 replies.
- [PR] [SPARK-55914][TESTS] add `sbt_test_goals` to `sparktestsupport/modules.py` for `sql-api` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/10 04:41:44 UTC, 2 replies.
- [PR] [SPARK-55848][SQL] Add regression tests for SPJ partial clustering de… [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/10 05:07:01 UTC, 18 replies.
- [PR] [SPARK-55724][PYTHON][TEST] Add ASV microbenchmark for SQL_MAP_ARROW_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/10 05:23:13 UTC, 2 replies.
- [PR] [SPARK-55726][PYTHON][TEST][FOLLOW-UP] Restore SQL_GROUPED_MAP_PANDAS_UDF benchmark [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/10 05:39:38 UTC, 0 replies.
- Re: [I] [PYTHON] Support path-based table reference in `DataFrame.mergeInto` [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/10 05:46:11 UTC, 0 replies.
- [PR] [SPARK-54878][SQL] Add sortKeys option to to_json function [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/10 05:55:55 UTC, 12 replies.
- [PR] [SPARK-55918][SQL] Rewrite spark.catalog getDatabase / databaseExists in SQL DDL [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/10 07:23:48 UTC, 3 replies.
- [PR] [SPARK-55927][WEBUI] Remove `jquery.mustache.js` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/10 07:24:16 UTC, 5 replies.
- [PR] [SPARK-53807][CORE] Fix deadlock between unlock and releaseAllLocksForTask for write lock in BlockInfoManager [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2026/03/10 08:27:49 UTC, 4 replies.
- Re: [PR] [SPARK-55918][SQL][CONNECT] Rewrite spark.catalog getDatabase / databaseExists in SQL DDL [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/10 08:56:37 UTC, 6 replies.
- [PR] [SPARK-55929][SQL] Add missing toString() to TableChange.UpdateColumnDefaultValue [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/03/10 09:08:14 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Add INSERT INTO ... REPLACE ON/USING syntax [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/03/10 09:23:26 UTC, 0 replies.
- [I] [SPARK-38101] execuors fail fetching map statuses with INTERNAL_ERROR_BROADCAST [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/03/10 10:26:55 UTC, 1 replies.
- [I] dropDuplicates(columns) followed by ExceptAll results in INTERNAL_ERROR_ATTRIBUTE_NOT_FOUND [spark] - posted by "BaseKan (via GitHub)" <gi...@apache.org> on 2026/03/10 10:53:10 UTC, 2 replies.
- [PR] New single-pass analyzer functionality [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/10 12:26:51 UTC, 1 replies.
- [PR] [SPARK-55932] Fix XML to variant parser hang on negative scale [spark] - posted by "stevomitric (via GitHub)" <gi...@apache.org> on 2026/03/10 13:11:07 UTC, 4 replies.
- [PR] [SPARK-55535][SQL][FOLLOW-UP] Fix `OrderedDistribution` handling and other improvements to `EnsureRequirements` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/10 13:58:12 UTC, 8 replies.
- [PR] [SPARK-55930][SPARK-55931][CONNECT] Byte-aware gRPC metadata size checks and errorClassFallback [spark] - posted by "othon2000 (via GitHub)" <gi...@apache.org> on 2026/03/10 14:10:14 UTC, 4 replies.
- [PR] [SPARK-XXXXX][SQL] single-pass resolver - core infrastruc… [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/10 14:26:59 UTC, 0 replies.
- [PR] Resolver pr2 operators [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/10 14:27:05 UTC, 1 replies.
- [PR] Resolver pr3 tests [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/10 14:27:15 UTC, 1 replies.
- Re: [PR] [SPARK-55092][SQL] Disable partition grouping in `KeyGroupedPartitioning` when not needed [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/10 15:04:14 UTC, 1 replies.
- Re: [PR] [SPARK-55535][SQL][FOLLOW-UP] Fix `OrderedDistribution` handling and minor improvements to `EnsureRequirements` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/10 15:56:56 UTC, 7 replies.
- [PR] [SPARK-55935][BUILD] Exclude unused Netty dependencies [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/10 16:07:28 UTC, 11 replies.
- Re: [PR] [SPARK-53713] Remove `org.jetbrains.annotations` test code dependency from `spark-operator` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 16:11:10 UTC, 0 replies.
- Re: [PR] [SPARK-55896][PS] Use numpy functions instead of builtins [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 16:48:58 UTC, 1 replies.
- [PR] [SPARK-55936] Upgrade `kubernetes-client` to 7.6.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 16:55:36 UTC, 0 replies.
- [PR] [SPARK-55937] Upgrade `kubernetes-client` to 7.6.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 16:59:18 UTC, 3 replies.
- [PR] [SPARK-55938][LICENSE] Update Netty libs in LICENSE-binary [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/10 17:02:05 UTC, 0 replies.
- Re: [PR] [SPARK-55936][BUILD] Upgrade `kubernetes-client` to 7.6.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 17:04:38 UTC, 2 replies.
- Re: [PR] [SPARK-55903][SQL] Simplify MERGE Schema Evolution and Check Write Privileges [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/10 17:52:32 UTC, 10 replies.
- [PR] [SPARK-55940] Upgrade Kafka to 3.9.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 18:33:50 UTC, 0 replies.
- Re: [PR] [SPARK-55940][BUILD] Upgrade Kafka to 3.9.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 18:40:26 UTC, 2 replies.
- [PR] [SPARK-55941] [spark-connect-rust] - posted by "sjrusso8 (via GitHub)" <gi...@apache.org> on 2026/03/10 18:47:22 UTC, 0 replies.
- [I] Take over `spark-connect-rs` and Update Crate [spark-connect-rust] - posted by "sjrusso8 (via GitHub)" <gi...@apache.org> on 2026/03/10 19:04:06 UTC, 0 replies.
- [PR] [SPARK-55723][PYTHON] Generalize enforce_schema error to PySparkTypeError [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/10 19:06:41 UTC, 5 replies.
- [PR] [SPARK-55942] Update GitHub Actions YAML file in `branch-0.8` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 19:14:37 UTC, 3 replies.
- [PR] [SPARK-55944] Bump version to 0.9.0-SNAPSHOT in `main` branch [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 19:27:31 UTC, 3 replies.
- [PR] [SPARK-XXXXX][SQL] Add DSv2 CDC connector API and analyzer resolution [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/10 20:00:13 UTC, 2 replies.
- [PR] [SPARK-XXXXX][SQL] Add SQL CHANGES clause for CDC queries [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/10 20:00:30 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Add DataFrame API and Spark Connect support for CDC queries [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/10 20:00:49 UTC, 0 replies.
- [PR] [SPARK-55945] Simplify Protobuf API for SDP Eager Analysis [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2026/03/10 20:02:41 UTC, 2 replies.
- [PR] [SPARK-55946][PS] Set up __pandas_priority__ so mixed binary ops dispatch correctly to pandas-on-Spark [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/10 20:11:31 UTC, 8 replies.
- [PR] [SPARK-55954][PYTHON] Remove the incorrect overload type hint for fillna [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/10 20:32:09 UTC, 2 replies.
- [PR] [SPARK-55947][PYTHON] Add ASV micro-benchmarks for grouped Arrow UDF eval types [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/10 20:55:20 UTC, 0 replies.
- [PR] [SPARK-55955][PYTHON] Remove overload type hint for drop [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/10 20:57:17 UTC, 2 replies.
- [PR] [SPARK-55939][SQL] Add built-in DataSketches ItemsSketch (Frequent Items) functions [spark] - posted by "xiongbo-sjtu (via GitHub)" <gi...@apache.org> on 2026/03/10 21:52:32 UTC, 5 replies.
- [PR] [SPARK-55950][PYTHON] Add PySpark support for CDC changes() API [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/10 22:38:44 UTC, 7 replies.
- Re: [PR] [SPARK-53807][CORE][FOLLOW-UP] Fix deadlock between unlock and releaseAllLocksForTask for write lock in BlockInfoManager [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/10 23:20:27 UTC, 1 replies.
- Re: [PR] [SPARK-55884][SQL] Add toV2Stats/toV2ColStat to CatalogStatistics for DSv2 connectors [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/10 23:48:00 UTC, 0 replies.
- [PR] [SPARK-55956] Use `4.2.0-preview3` RC1 for Spark 4.2 integration tests [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/10 23:48:15 UTC, 4 replies.
- Re: [PR] [SPARK-55884][SQL] Add transformV1Stats to DataSourceV2Relation [spark] - posted by "huan233usc (via GitHub)" <gi...@apache.org> on 2026/03/10 23:50:23 UTC, 0 replies.
- Re: [PR] [SPARK-55884][SQL] Add toV2Stats to DataSourceV2Relation [spark] - posted by "huan233usc (via GitHub)" <gi...@apache.org> on 2026/03/10 23:57:08 UTC, 1 replies.
- Re: [PR] [SPARK-55945][SDP] Simplify Protobuf API for SDP Eager Analysis [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2026/03/11 00:11:11 UTC, 10 replies.
- Re: [PR] [SPARK-55948][SQL] Add DSv2 CDC connector API, analyzer resolution, and SQL CHANGES clause [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/11 00:21:45 UTC, 19 replies.
- Re: [PR] [SPARK-55820] [SS] Fix race condition in no-overwrite FS when RocksDB version files cache is out of sync [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/03/11 00:27:35 UTC, 0 replies.
- Re: [PR] [SPARK-55949][SQL] Add DataFrame API and Spark Connect support for CDC queries [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/03/11 01:43:07 UTC, 8 replies.
- Re: [PR] [SPARK-55938][BUILD] Update Netty libs in LICENSE-binary [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/11 02:20:15 UTC, 1 replies.
- [PR] [SPARK-55958][BUILD][CONNECT] Remove unused `add-scala-test-sources` setting from `pom.xml` in `connect-common` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/11 02:24:36 UTC, 2 replies.
- [PR] [SPARK-55959][SQL] Optimize Map Key Lookup for `GetMapValue` and `ElementAt` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/11 03:06:03 UTC, 11 replies.
- [PR] [SPARK-55848][SQL][4.1] Fix incorrect dedup results with SPJ partial clustering [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/11 03:21:36 UTC, 23 replies.
- [PR] [SPARK-55957][SQL] Add 'DATA_SOURCE_NOT_FOUND' in Catalog.ERROR_HANDLING_RULES [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/11 03:30:08 UTC, 2 replies.
- [PR] [SPARK-55889][DOCS][FOLLOWUP] Update `building-spark.md` with Maven 3.9.13 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/11 03:38:12 UTC, 4 replies.
- [PR] [WIP][BEFORE-SUBMISSION] Support state data source reader for stream-stream join v4 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/11 04:03:12 UTC, 1 replies.
- Re: [PR] [SPARK-55884][SQL] Add v1StatsToV2Stats to DataSourceV2Relation [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/11 05:04:19 UTC, 1 replies.
- [PR] [SPARK-55357][PYTHON] Fix incorrect documentation for timestamp_add [spark] - posted by "RonakkGovani (via GitHub)" <gi...@apache.org> on 2026/03/11 06:49:22 UTC, 2 replies.
- [PR] [SPARK-55960][INFRA][CONNECT][PYTHON] Add a docker image for spark connect codegen [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/11 08:19:52 UTC, 5 replies.
- Re: [PR] [SPARK-55909][SQL][TESTS] Introduce trait `SparkSessionProvider` [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/11 08:43:25 UTC, 0 replies.
- Re: [PR] [SPARK-55928][SQL] New linter for config effectiveness in views, UDFs and procedures [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/11 08:49:08 UTC, 0 replies.
- [PR] [SPARK-55960][INFRA][CONNECT][PYTHON][FOLLOW-UP] Fix build on linux [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/11 10:03:15 UTC, 2 replies.
- Re: [PR] [SPARK-54088][CORE] When TaskSchedulerImpl searches for an executor to schedule an unschedulable task, it should exclude executors that are pending to remove [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/03/11 10:34:00 UTC, 1 replies.
- [PR] [SPARK-55961][UI] Make SQL plan viz side panel collapsible with resize handle [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/11 11:13:03 UTC, 0 replies.
- Re: [PR] [SPARK-55928][SQL] New linter for config effectiveness in views and UDFs [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/11 12:09:52 UTC, 3 replies.
- Re: [PR] [SPARK-55275] Add InvalidPlanInput sql states for sql/connect [spark] - posted by "khakhlyuk (via GitHub)" <gi...@apache.org> on 2026/03/11 12:43:02 UTC, 6 replies.
- [PR] [SPARK-55722][SQL] Use `getShort` instead of `getInt` casting in `putShortsFromIntsLittleEndian` on Little Endian platforms [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/11 12:44:54 UTC, 1 replies.
- [PR] [SPARK-55963][K8S] Optimize snapshot traversal in ExecutorPodsAllocator [spark] - posted by "DenineLu (via GitHub)" <gi...@apache.org> on 2026/03/11 12:47:07 UTC, 3 replies.
- Re: [PR] [SPARK-55961][UI] Make SQL plan viz side panel collapsible [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/11 16:09:24 UTC, 2 replies.
- Re: [PR] [SPARK-55945][SDP] Support structured identifiers for flows in SDP eager analysis protos [spark] - posted by "SCHJonathan (via GitHub)" <gi...@apache.org> on 2026/03/11 16:44:58 UTC, 3 replies.
- Re: [PR] [SPARK-55962][SQL] Use `getShort` instead of `getInt` casting in `putShortsFromIntsLittleEndian` on Little Endian platforms [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/11 17:16:52 UTC, 4 replies.
- Re: [PR] [SPARK-53675][PYTHON] Add str support in withColumn and withColumns in PySpark [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/11 17:59:43 UTC, 11 replies.
- Re: [PR] [SPARK-55493] [SS] Do not mkdirs in streaming checkpoint offset/commit log directory in StateDataSource [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/03/11 20:09:46 UTC, 7 replies.
- [PR] [SPARK-55965][PYTHON] Add warning when pandas >= 3.0.0 is used with PySpark [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/11 20:30:08 UTC, 3 replies.
- [PR] [SQL][TESTS] Add test for CREATE OR REPLACE TABLE AS SELECT with constraints [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/03/11 21:24:54 UTC, 0 replies.
- [PR] [SPARK-55839] Add export config button to Environment page [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/11 21:43:14 UTC, 14 replies.
- [PR] [SPARK-55966][PYTHON] Fix type hint of groupby [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/11 21:48:06 UTC, 12 replies.
- [PR] [SPARK-55967][PYTHON] Unify column conversion for connect dataframe [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/11 23:33:43 UTC, 2 replies.
- Re: [PR] [SPARK-53733][SQL] Delay `resolveColsLastResort` until all previous `UnresolvedAlias`es are resolved [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/12 00:32:09 UTC, 1 replies.
- Re: [PR] [SPARK-55888][K8S] Parallel pod creation for Kubernetes executor allocation [spark] - posted by "yikf (via GitHub)" <gi...@apache.org> on 2026/03/12 03:51:05 UTC, 5 replies.
- Re: [PR] [SPARK-54698][SQL] Support hashing for all data types for array set like operations [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/12 04:11:43 UTC, 5 replies.
- Re: [PR] [SPARK-52218][SS] RabbitMQ stream source [spark] - posted by "keksmd (via GitHub)" <gi...@apache.org> on 2026/03/12 05:26:56 UTC, 0 replies.
- [PR] [SPARK-55964] system catalog wins over user catalog for BUILTIN, SESSION, AI schemas. [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/03/12 05:46:49 UTC, 1 replies.
- [PR] [SPARK-55970][CORE] Cap spark.executor.cores to max worker cores when set too large [spark] - posted by "Ngone51 (via GitHub)" <gi...@apache.org> on 2026/03/12 06:14:18 UTC, 6 replies.
- [PR] [SPARK-55960][INFRA][DOCS][FOLLOW-UP] Document how to re-generate the protobuf files for python client [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/12 06:37:26 UTC, 5 replies.
- Re: [PR] [SPARK-55947][PYTHON][TEST] Add ASV micro-benchmarks for SQL_GROUPED_MAP_ARROW_UDF and SQL_GROUPED_MAP_ARROW_ITER_UDF [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/12 07:15:06 UTC, 1 replies.
- [PR] [SPARK-55971][UI] Add Jobs table section to SQL execution detail page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/12 07:30:59 UTC, 0 replies.
- [PR] [SPARK-55973][SS] LeftSemi optimization for stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/12 07:56:55 UTC, 9 replies.
- Re: [PR] [SPARK-55324][PYTHON]: Make convert_numpy support ArrayType [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/12 07:57:30 UTC, 8 replies.
- Re: [PR] [SPARK-54808] Qualified session view [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/12 07:58:20 UTC, 18 replies.
- Re: [PR] [SPARK-55726][PYTHON][TEST][FOLLOW-UP] Make SQL_GROUPED_MAP_PANDAS_UDF benchmark to two bench classes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/12 09:05:20 UTC, 1 replies.
- [PR] Feature/directory write support [spark] - posted by "uselesscoder-forever (via GitHub)" <gi...@apache.org> on 2026/03/12 09:28:04 UTC, 2 replies.
- [PR] [SPARK-55974][CORE][YARN] Relaunch new executors if the executor launching take too long time [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/03/12 09:35:30 UTC, 1 replies.
- [PR] [SPARK-55975][TESTS] NaN comparison can cause false UT failures due to different NaNs [spark] - posted by "mgaido91 (via GitHub)" <gi...@apache.org> on 2026/03/12 10:41:49 UTC, 1 replies.
- [PR] [SPARK-55976][SQL] Use Set instead of Seq for write privileges [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/03/12 11:41:59 UTC, 4 replies.
- [PR] [SPARK-53339][CONNECT] Fix interrupt on pending operations by moving `postStarted()` and allowing Pending to Canceled/Failed transition [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/12 12:12:52 UTC, 2 replies.
- Re: [PR] handle command return code in launch_gateway function [spark] - posted by "peterxcli (via GitHub)" <gi...@apache.org> on 2026/03/12 13:38:00 UTC, 0 replies.
- [PR] Remove redundant backtick [spark] - posted by "joonro (via GitHub)" <gi...@apache.org> on 2026/03/12 15:54:55 UTC, 0 replies.
- Re: [PR] [SPARK-55971][UI] Add Jobs table to SQL execution detail page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/12 16:58:24 UTC, 2 replies.
- [PR] [SPARK-55977][PS] Fix isin() to use strict type matching like pandas [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/12 17:55:08 UTC, 4 replies.
- [PR] [SPARK-55628][SS] Integrate stream-stream join state format V4 [spark] - posted by "nicholaschew11 (via GitHub)" <gi...@apache.org> on 2026/03/12 19:03:42 UTC, 8 replies.
- Re: [PR] [MINOR] Fix typos in MD files [spark] - posted by "ostronaut (via GitHub)" <gi...@apache.org> on 2026/03/12 19:55:51 UTC, 0 replies.
- [PR] [SPARK-55979][SQL] Required input attributes are missing from PartialMerge / Final BaseAggregateExec.references [spark] - posted by "zhztheplayer (via GitHub)" <gi...@apache.org> on 2026/03/12 21:27:40 UTC, 5 replies.
- [PR] [SPARK-55980][PS] Always apply _cast_back_float in numeric arithmetic [spark] - posted by "devin-petersohn (via GitHub)" <gi...@apache.org> on 2026/03/12 22:38:15 UTC, 2 replies.
- Re: [PR] [SPARK-55975][SQL][TESTS] NaN comparison can cause false UT failures due to different NaNs [spark] - posted by "mgaido91 (via GitHub)" <gi...@apache.org> on 2026/03/12 23:11:15 UTC, 4 replies.
- Re: [PR] [SPARK-54560][SQL] Safe type casting in `QueryPlan._subqueries` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/13 00:37:46 UTC, 1 replies.
- Re: [PR] [SQL][MINOR] Defensive code for number of Partitions in rCTEs [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/13 00:37:48 UTC, 1 replies.
- Re: [PR] [MINOR][DOCS] Remove redundant backtick in docstrings [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/13 00:40:33 UTC, 1 replies.
- [PR] [SPARK-55981][SQL] Allow Geo Types with SRID's fro the pre-built registry [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/13 00:57:31 UTC, 2 replies.
- [PR] [SPARK-55964] Cache coherence: clear function registry on DROP DATABASE [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/03/13 01:55:25 UTC, 9 replies.
- Re: [PR] [SPARK-54651][CORE] Driver should delete temporary files when exiting during commit process [spark] - posted by "AngersZhuuuu (via GitHub)" <gi...@apache.org> on 2026/03/13 02:53:50 UTC, 2 replies.
- [PR] Upgrade black to 26.3.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/13 05:49:16 UTC, 0 replies.
- Re: [PR] [SPARK-XXXXX][PYTHON] Upgrade black to 26.3.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/13 05:49:42 UTC, 0 replies.
- [PR] [SPARK-44065][SQL] Optimize BroadcastHashJoin skew in OptimizeSkewedJoin [spark] - posted by "wForget (via GitHub)" <gi...@apache.org> on 2026/03/13 07:48:51 UTC, 3 replies.
- [PR] [SPARK-55984] [SQL] [TEST-ONLY] Add metadata_column_resolution.sql golden file [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/03/13 12:15:55 UTC, 1 replies.
- [PR] [SPARK-55985][WEBUI] Remove `jquery.blockUI.min.js` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/13 12:58:33 UTC, 3 replies.
- [PR] [SPARK-55880][UI] Link SQL plan metric stage IDs to stage detail page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/13 13:18:01 UTC, 3 replies.
- Re: [PR] [SPARK-55986][PYTHON] Upgrade black to 26.3.1 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/13 15:37:01 UTC, 6 replies.
- Re: [PR] [SQL] New functionality and bugfixes for single-pass analyzer [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/13 17:10:09 UTC, 0 replies.
- [PR] [SPARK-55987][SS] Fix time window join in stream-stream join state format V4 [spark] - posted by "nicholaschew11 (via GitHub)" <gi...@apache.org> on 2026/03/13 18:17:08 UTC, 3 replies.
- [PR] [SPARK-54923][SQL] Add configuration for directory traversal depth before parallel partition discovery [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/13 20:42:08 UTC, 0 replies.
- [PR] [SPARK-55988][PS][TESTS] Compare categorical index codes by values in tests [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/13 21:48:42 UTC, 3 replies.
- [PR] [SPARK-55989][PS] Preserve non-int64 index dtypes in `restore_index` [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/13 21:52:48 UTC, 5 replies.
- [PR] SPARK-52785: removing super(Class, cls) syntax from python/pyspark [spark] - posted by "simolanayak (via GitHub)" <gi...@apache.org> on 2026/03/13 22:47:16 UTC, 1 replies.
- [PR] [WIP][SPARK-55805] fixed ignore type override for linter in _SimpleStreamReaderWrapper [spark] - posted by "sreeraj234 (via GitHub)" <gi...@apache.org> on 2026/03/13 22:52:48 UTC, 0 replies.
- [PR] [SPARK-55357][PYTHON] Fix docstring for timestamp_add [spark] - posted by "judycheung-piaopiao (via GitHub)" <gi...@apache.org> on 2026/03/13 23:45:22 UTC, 4 replies.
- Re: [PR] SPARK-52785: simplifying super() syntax in PySpark [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/13 23:46:35 UTC, 1 replies.
- [PR] [SPARK-55990][PS] Improve iterator UDF single-UDF assertion mess… [spark] - posted by "MrHappyEnding (via GitHub)" <gi...@apache.org> on 2026/03/13 23:47:02 UTC, 4 replies.
- [PR] [SPARK-49825] Fix the default warehouse dir for case with white spaces. [spark] - posted by "fm100 (via GitHub)" <gi...@apache.org> on 2026/03/13 23:58:33 UTC, 1 replies.
- [PR] [SPARK-50284][pyspark] create-pyspark-variants-api [spark] - posted by "judycheung-piaopiao (via GitHub)" <gi...@apache.org> on 2026/03/14 00:13:58 UTC, 0 replies.
- Re: [PR] [SPARK-55855][SQL][DML] DSv2 Transaction API foundations [spark] - posted by "Xuefeng-Zhu (via GitHub)" <gi...@apache.org> on 2026/03/14 00:38:11 UTC, 3 replies.
- [PR] [SPARK-52687] Fix SPARK_CONNECT_MODE parsing in bin/pyspark [spark] - posted by "mukimasta (via GitHub)" <gi...@apache.org> on 2026/03/14 01:01:49 UTC, 1 replies.
- [PR] [SPARK-53970][PYTHON] Remove incorrect 'optional' tag for messageName… [spark] - posted by "volcano-mite (via GitHub)" <gi...@apache.org> on 2026/03/14 01:16:24 UTC, 2 replies.
- [PR] [SPARK-55991] Fix unicode related SQL text corruption with parameters [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/03/14 01:16:41 UTC, 1 replies.
- [PR] Spark 54878 support sort keys option inside to json [spark] - posted by "judycheung-piaopiao (via GitHub)" <gi...@apache.org> on 2026/03/14 01:20:01 UTC, 1 replies.
- [PR] fix SPARK_CONNECT_MODE parsing [spark] - posted by "mukimasta (via GitHub)" <gi...@apache.org> on 2026/03/14 01:20:58 UTC, 1 replies.
- Re: [PR] [SPARK-55610][PYTHON] Add getExecutorInfos to StatusTracker in Python [spark] - posted by "WweiL (via GitHub)" <gi...@apache.org> on 2026/03/14 05:02:04 UTC, 5 replies.
- [PR] [SPARK-55992][SQL] Fix GroupPartitions textual representation [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/14 10:04:33 UTC, 4 replies.
- [PR] [SPARK-55877][UI] Side-by-side Initial vs Final plan comparison for AQE queries [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/14 13:20:38 UTC, 6 replies.
- [PR] [SPARK-55557][SQL][3.5] Hyperbolic functions should not overflow withlarge inputs [spark] - posted by "mgaido91 (via GitHub)" <gi...@apache.org> on 2026/03/14 15:09:54 UTC, 2 replies.
- [PR] [SPARK-55557][SQL][4.0] Hyperbolic functions should not overflow with large inputs [spark] - posted by "mgaido91 (via GitHub)" <gi...@apache.org> on 2026/03/14 15:14:22 UTC, 2 replies.
- Re: [PR] [SPARK-55559][SQL] [SPARK-55559][SQL][PYTHON] Add optional bits parameter to bit_count for Trino compatibility [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/14 15:54:24 UTC, 1 replies.
- [PR] [SPARK-55968][SQL] Do not treat vectorized reader capacity overflow a… [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/14 17:26:31 UTC, 1 replies.
- [PR] [SPARK-55450][SS][PYTHON][DOCS] Document admission control and Trigger.AvailableNow in PySpark streaming data sources [spark] - posted by "jiteshsoni (via GitHub)" <gi...@apache.org> on 2026/03/14 17:42:01 UTC, 4 replies.
- [PR] [SPARK-55993][SS][TEST] Fix flaky RocksDBStateStoreIntegrationSuite bounded memory test [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/14 18:09:12 UTC, 2 replies.
- [PR] [][SQL] Support CREATE TABLE LIKE for V2 [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/14 23:23:25 UTC, 0 replies.
- Re: [PR] Update supported_api_gen.py: remove an invalid escape sequence "\_" using a raw string [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/15 00:44:40 UTC, 1 replies.
- [PR] [SPARK-54878][SQL] Support sort_keys option inside to_json [spark] - posted by "judycheung-piaopiao (via GitHub)" <gi...@apache.org> on 2026/03/15 01:34:30 UTC, 2 replies.
- Re: [PR] [SPARK-52785][PYTHON] Simplifying super() syntax in PySpark [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/15 05:10:05 UTC, 2 replies.
- [PR] Spark 46959 [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/15 07:36:28 UTC, 0 replies.
- [PR] [SPARK-55995][SQL] Support TIMESTAMP WITH LOCAL TIME ZONE in SQL syntax [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/15 09:29:12 UTC, 10 replies.
- Re: [I] BEWARE, DATA LOSS: CreateDataFrameFromArrow reads every batch from Parquet but only the first batch from ND‑JSON unless JSON is loaded with WithChunk(-1) [spark-connect-go] - posted by "slachiewicz (via GitHub)" <gi...@apache.org> on 2026/03/15 11:35:03 UTC, 2 replies.
- [PR] [SPARK-54724][SQL] Fix dropDuplicates(columns) followed by exceptAll causing INTERNAL_ERROR_ATTRIBUTE_NOT_FOUND [spark] - posted by "nookcreed (via GitHub)" <gi...@apache.org> on 2026/03/15 17:07:01 UTC, 1 replies.
- [PR] [SPARK-55996][CORE] Remove default `jdk.reflect.useDirectMethodHandle=false` [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/15 19:53:54 UTC, 5 replies.
- [PR] [SPARK-55997][SS] Set upper bound to prefixScan in RocksDB state store provider [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/15 22:38:22 UTC, 2 replies.
- Re: [PR] [SPARK-54593][SQL] Expand DPP for LogicalRelation and LogicalRDD [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/16 00:43:32 UTC, 1 replies.
- Re: [PR] [SPARK-54554][SQL] Enable Dynamic Partition Pruning with CommandResult [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/16 00:43:36 UTC, 1 replies.
- Re: [PR] [SPARK-49825][SQL] Fix the default warehouse dir for case with white spaces. [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/16 01:25:24 UTC, 2 replies.
- [PR] [SPARK-55998][SHS] Synchronize more places on accessing SHS listing.db [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/16 02:26:45 UTC, 7 replies.
- [PR] [SPARK-39382][WEBUI] UI show the duration of the failed task when the executor lost [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/03/16 06:06:16 UTC, 3 replies.
- [PR] [SPARK-55885][SQL] Optimize vectorized Parquet boolean reading with lookup-table expansion and batch buffer reads [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/16 06:13:24 UTC, 5 replies.
- [PR] [SPARK-55559][SQL] Fix BIT_COUNT for negative tinyint/smallint/int [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/16 06:49:11 UTC, 0 replies.
- Re: [PR] [SPARK-55984] [SQL] [TESTS] Add metadata_column_resolution.sql golden file [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/16 07:38:15 UTC, 1 replies.
- Re: [PR] [SPARK-53339][CONNECT] Fix an issue which occurs when an operation in pending state is interrupted [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/16 07:56:45 UTC, 1 replies.
- [PR] [SPARK-56000][BUILD] Upgrade `arrow-java` to 19.0.0 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/16 08:08:37 UTC, 12 replies.
- [PR] Revert "[SPARK-53339][CONNECT] Fix interrupt on pending operations by moving `postStarted()` and allowing Pending to Canceled/Failed transition" [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/16 08:38:51 UTC, 5 replies.
- [PR] [SPARK-56002][UI] Make SQL plan visualization metrics table sortable [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/16 10:08:47 UTC, 5 replies.
- Re: [PR] [SPARK-55964] system catalog wins over user catalog for BUILTIN, and SESSION schemas. [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/16 11:00:08 UTC, 8 replies.
- [PR] [SPARK-53840][SQL] Add AS JSON output support for SHOW TABLES and SHOW TABLE EXTENDED [spark] - posted by "ayushbilala (via GitHub)" <gi...@apache.org> on 2026/03/16 11:46:35 UTC, 2 replies.
- Re: [PR] [SPARK-33902][SQL] Support CREATE TABLE LIKE for V2 [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/03/16 11:57:25 UTC, 64 replies.
- [PR] [SPARK-56003][BUILD] Use Nisse as plugin and bump it to 0.7.0 [spark] - posted by "waterlx (via GitHub)" <gi...@apache.org> on 2026/03/16 17:02:39 UTC, 6 replies.
- [PR] Change order [spark-kubernetes-operator] - posted by "TQJADE (via GitHub)" <gi...@apache.org> on 2026/03/16 17:49:53 UTC, 0 replies.
- [PR] Fix ignoreCorruptFiles to only skip Parquet CRC corruption errors [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/03/16 17:50:50 UTC, 1 replies.
- Re: [PR] [SPARK-55983][SQL] New single-pass analyzer functionality and bugfixes [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/03/16 17:55:13 UTC, 4 replies.
- [PR] [SPARK-56006] Upgrade Maven to 3.9.14 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 19:08:48 UTC, 0 replies.
- [PR] [SPARK-56005] Propagate MDC context in SparkClusterReconciler [spark-kubernetes-operator] - posted by "aaruna (via GitHub)" <gi...@apache.org> on 2026/03/16 19:33:03 UTC, 5 replies.
- [PR] [SPARK-56008] Upgrade `tink` to 1.20.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 19:35:23 UTC, 0 replies.
- [PR] [SPARK-56004] Upgrade java-operator-sdk to 5.3.0 [spark-kubernetes-operator] - posted by "aaruna (via GitHub)" <gi...@apache.org> on 2026/03/16 19:37:41 UTC, 2 replies.
- [PR] [SPARK-56009] Upgrade `netty-tcnative` to 2.0.75.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 19:54:25 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-55056][SQL][PYTHON] Fix toPandas() SIGSEGV on nested empty arrays [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/16 20:00:02 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-55059][PYTHON] Remove empty table workaround in toPandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/16 20:00:39 UTC, 0 replies.
- [PR] [SPARK-56010] Upgrade `snowflake-jdbc` to 4.0.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 20:05:13 UTC, 0 replies.
- [PR] [SPARK-56007][CONNECT] Fix ArrowDeserializer to use positional binding for rows [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/03/16 20:09:26 UTC, 0 replies.
- Re: [PR] [SPARK-56010][BUILD] Upgrade `snowflake-jdbc` to 4.0.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 20:14:21 UTC, 3 replies.
- [PR] [SPARK-56012] Upgrade `xz` to 1.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 20:23:13 UTC, 0 replies.
- [PR] [SPARK-56011][PYTHON] Add dev/asv wrapper script for running benchmarks from repo root [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/16 20:26:45 UTC, 0 replies.
- [PR] [SPARK-56013] Upgrade `JAXB` to 4.0.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 20:34:34 UTC, 0 replies.
- [PR] [SPARK-56014][PS][TESTS] Fix to_numeric ignore test for pandas 3.0 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/16 20:52:50 UTC, 6 replies.
- Re: [PR] [SPARK-55728][SS] Introduce conf for file checksum threadpool size and support disabling the threadpool [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/03/16 21:06:15 UTC, 4 replies.
- Re: [PR] [SPARK-52251] Use `crd-generator-cli` to generate CRDs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 21:10:50 UTC, 6 replies.
- [PR] [SPARK-56016][PS] Preserve named Series columns in concat with ignore_index on pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/16 22:03:41 UTC, 3 replies.
- Re: [PR] [SPARK-51988][SS] Do file checksum verification on read for RocksDB zip file [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/03/16 22:04:44 UTC, 9 replies.
- Re: [PR] [SPARK-56006][BUILD] Upgrade Maven to 3.9.14 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 22:50:06 UTC, 4 replies.
- [PR] [WIP][SPARK-56015][DOCS] Bump package versions in Docs Docker file [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/16 23:09:31 UTC, 0 replies.
- [PR] REOPEN [SPARK-52218][SS] RabbitMQ stream source #52218 [spark] - posted by "keksmd (via GitHub)" <gi...@apache.org> on 2026/03/16 23:24:25 UTC, 0 replies.
- Re: [PR] [SPARK-56008][BUILD] Upgrade `tink` to 1.20.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 23:27:59 UTC, 2 replies.
- Re: [PR] [SPARK-56009][BUILD] Upgrade `netty-tcnative` to 2.0.75.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 23:28:14 UTC, 1 replies.
- Re: [PR] [SPARK-56011][PYTHON][INFRA] Add dev/asv wrapper script for running benchmarks from repo root [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/16 23:28:17 UTC, 3 replies.
- Re: [PR] [SPARK-56012][BUILD] Upgrade `xz` to 1.12 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 23:28:31 UTC, 2 replies.
- Re: [PR] [SPARK-56013][BUILD] Upgrade `JAXB` to 4.0.6 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 23:28:48 UTC, 10 replies.
- [PR] [SPARK-56018][PYTHON] Use ruff as formatter [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/16 23:35:51 UTC, 4 replies.
- [PR] [SPARK-54833][SQL] Fix Mode sql() to display correct sort direction for WITHIN GROUP [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/16 23:46:43 UTC, 0 replies.
- Re: [PR] [SPARK-56004] Upgrade `java-operator-sdk` to 5.3.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/16 23:50:41 UTC, 1 replies.
- [PR] [SPARK-56020][SQL] Improve GroupPartitions Explain Extended [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/17 00:33:21 UTC, 0 replies.
- [PR] [SPARK-56021][SS] Increase AutoSnapshotRepair default maxChangeFileReplay threshold from 50 to 500 [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/03/17 00:34:51 UTC, 0 replies.
- Re: [PR] [SPARK-44976] Utils.getCurrentUserName should return the full principal name [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/17 00:37:01 UTC, 1 replies.
- Re: [PR] [SPARK-38117][CORE] Expose stage level metrics in prometheus endpoint [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/17 00:37:03 UTC, 1 replies.
- Re: [PR] [SPARK-53791][CORE][SQL] Make the rename operations multi-threaded. [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/17 00:37:05 UTC, 1 replies.
- Re: [PR] [SPARK-56020][SQL] Improve GroupPartitions Spark UI [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/17 00:42:07 UTC, 3 replies.
- [PR] [SPARK-55145][SS] Support avro for timestamp based RocksDB state key encoders [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/17 02:05:15 UTC, 0 replies.
- [PR] [SPARK-55729][SS] Support state data source reader for new state format v4 on stream-stream join [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/17 02:12:13 UTC, 16 replies.
- Re: [PR] [SPARK-55453][SQL][3.5] Fix LIKE pattern matching for supplementary Unicode characters [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/17 02:16:05 UTC, 0 replies.
- [PR] [SPARK-XXXXX][SQL] Preserve SparkThrowable error classes in parmap/awaitResult [spark] - posted by "linhongliu-db (via GitHub)" <gi...@apache.org> on 2026/03/17 02:43:32 UTC, 0 replies.
- Re: [PR] [SPARK-55557][SQL] Port fdlibm asinh/acosh algorithm for improved precision [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/17 03:10:20 UTC, 0 replies.
- [PR] [SPARK-55999][SS] Enable forceSnapshotUploadOnLag by default [spark] - posted by "zifeif2 (via GitHub)" <gi...@apache.org> on 2026/03/17 03:48:22 UTC, 1 replies.
- [PR] [SPARK-56023][SS] Better load balance in LowLatencyMemoryStream [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/03/17 03:52:18 UTC, 8 replies.
- [PR] [SPARK-56024][BUILD] Upgrade `jakarta.xml.bind-api` to 4.0.5 [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/03/17 05:01:21 UTC, 1 replies.
- [PR] [SPARK-55714][SQL][FOLLOWUP] Narrow overflow message canonicalization to only match JDK patterns [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/17 05:11:26 UTC, 2 replies.
- [PR] [SPARK-55848][SQL][4.0] Fix incorrect dedup results with SPJ partial … [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/17 05:42:48 UTC, 0 replies.
- Re: [PR] [SPARK-55848][SQL][4.0] Fix incorrect dedup results with SPJ partial clustering [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/17 05:44:24 UTC, 13 replies.
- [PR] [SPARK-55848][SQL][3.5] Fix incorrect dedup results with SPJ partial clustering [spark] - posted by "naveenp2708 (via GitHub)" <gi...@apache.org> on 2026/03/17 06:16:44 UTC, 4 replies.
- [PR] [SPARK-56025][INFRA] Install `remotes` R package for spark-test-image/lint/Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/17 06:34:28 UTC, 0 replies.
- Re: [PR] [SPARK-56025][INFRA] Install `remotes` R package for `spark-test-image/lint/Dockerfile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/17 06:47:56 UTC, 2 replies.
- Re: [PR] [SPARK-55559][SQL] Add optional bits parameter to bit_count for Trino compatibility [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/17 06:50:10 UTC, 0 replies.
- [PR] [SPARK-55630][SS] Skip updating matched flag for non-outer side in stream-stream join v4 [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/17 06:52:12 UTC, 7 replies.
- Re: [PR] [SPARK-56025][INFRA] Install `remotes` R package for `spark-test-image/(lint|docs)/Dockerfile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/17 06:58:41 UTC, 5 replies.
- [PR] [SPARK-XXXXX][INFRA] Upgrade `roxygen2` to `7.3.3` to recover CI [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/17 07:15:25 UTC, 4 replies.
- [PR] [SPARK-56027] Fix `NoEmptyContinuation` warning of spark-test-image/lint/Dockerfile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/17 07:29:44 UTC, 0 replies.
- Re: [PR] [SPARK-56027][INFRA] Fix `NoEmptyContinuation` warning of `spark-test-image/lint/Dockerfile` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/17 08:04:45 UTC, 0 replies.
- Re: [PR] [SPARK-56025][INFRA] Install `remotes` R package for `spark-test-image/(lint|docs|sparkr)/Dockerfile` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/17 08:11:46 UTC, 4 replies.
- [PR] [SPARK-56028][Core] fix shuffle block GC not cleanup checksum file [spark] - posted by "CavemanIV (via GitHub)" <gi...@apache.org> on 2026/03/17 08:22:12 UTC, 0 replies.
- [PR] [SPARK-56031][SQL] Make Natural Join column matching respect case sensitivity conf [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/03/17 10:03:47 UTC, 3 replies.
- [PR] [SPARK-56030] [SQL] Normalize inner Project when below Project -> Filter [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/03/17 10:21:28 UTC, 4 replies.
- Re: [PR] [SPARK-55557][SQL][FOLLOWUP] Port fdlibm asinh/acosh algorithm for improved precision [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/17 10:57:35 UTC, 6 replies.
- [PR] [SPARK-55645][SQL][FOLLOWUP] Move serdeName to last parameter and filter empty strings [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/17 11:02:15 UTC, 6 replies.
- [PR] [SPARK-56029] Optional sub error conditions [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/03/17 11:02:53 UTC, 5 replies.
- [PR] [SPARK-56032][SQL] Support subexpression elimination in FilterExec whole-stage codegen [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/17 12:09:19 UTC, 0 replies.
- [PR] [SPARK-48139][TESTS] Re-enable `SparkSessionE2ESuite.interrupt tag` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/17 12:26:50 UTC, 0 replies.
- [PR] [SPARK-56033][SQL] Support whole-stage codegen for `ArrayTransform` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/17 12:32:31 UTC, 0 replies.
- [PR] [SPARK-56034][SQL] Push down Join through Union when the right side is broadcastable [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/17 12:42:08 UTC, 32 replies.
- [PR] added missing failureThreshold and timeoutSeconds to the values.schem… [spark-kubernetes-operator] - posted by "danbaron63 (via GitHub)" <gi...@apache.org> on 2026/03/18 15:32:41 UTC, 0 replies.
- Re: [PR] Expose failureThreshold and timeoutSeconds in operator livenessProbe schema [spark-kubernetes-operator] - posted by "danbaron63 (via GitHub)" <gi...@apache.org> on 2026/03/18 15:35:57 UTC, 2 replies.
- Re: [PR] [SPARK-56045][SQL] Add flag for ignoring Parquet UNKNOWN type annotation and revert to old behavior [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 16:34:46 UTC, 5 replies.
- Re: [PR] [SPARK-55983][SQL][FOLLOWUP] New single-pass analyzer functionality and bugfixes [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/03/18 16:41:46 UTC, 2 replies.
- [PR] [4.1][SPARK-56045][SQL] Add flag for ignoring Parquet UNKNOWN type annotation and revert to old behavior [spark] - posted by "ZiyaZa (via GitHub)" <gi...@apache.org> on 2026/03/18 16:45:29 UTC, 0 replies.
- Re: [PR] [SPARK-56046][SQL] Typed SPJ partition key `Reducer`s [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/18 17:12:16 UTC, 60 replies.
- Re: [PR] [SPARK-55848][SQL][TESTS] Add regression tests for SPJ partial clustering dedup [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/18 17:30:02 UTC, 4 replies.
- [PR] [SPARK-56048][UI] Add copy plan text and share link buttons to SQL execution page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/18 17:43:42 UTC, 3 replies.
- [PR] [SPARK-56049][UI] Add search/filter for metrics in SQL plan viz side panel [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/18 17:45:36 UTC, 6 replies.
- Re: [PR] [SPARK-55848][SQL][4.1][FOLLOW-UP] Restore deleted comments [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/18 17:57:10 UTC, 2 replies.
- Re: [PR] [SPARK-56045][SQL][4.1] Add flag for ignoring Parquet UNKNOWN type annotation and revert to old behavior [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 18:21:08 UTC, 1 replies.
- [PR] [SPARK-XXX][SQL] Eagerly resolve IDENTIFIER() with string literals at parse time [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/18 18:51:19 UTC, 0 replies.
- Re: [PR] [SPARK-55056][SQL][PYTHON][TEST] Add tests using Arrow to deserialize nested array with empty outer array [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/18 19:04:44 UTC, 2 replies.
- [PR] [SPARK-56013][BUILD] Upgrade `JAXB` to 4.0.7 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 19:10:41 UTC, 2 replies.
- [PR] [SPARK-56051] Upgrade `grpc-swift-2` to 2.3.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 19:43:12 UTC, 3 replies.
- [PR] [SPARK-56052] Update `Spark Connect`-generated `Swift` source code with `4.2.0-preview3` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 20:09:13 UTC, 3 replies.
- [PR] [SPARK-56053] Upgrade `gRPC Swift Protobuf` to 2.2.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 20:27:57 UTC, 3 replies.
- [PR] [SPARK-56055] Use `ubuntu-slim` for GitHub Actions `linter` job [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 20:34:30 UTC, 2 replies.
- [PR] [SPARK-56054] Fix aliased nested fields ignored for schema evolution in MERGE [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/03/18 20:36:21 UTC, 0 replies.
- [PR] [SPARK-56056][PYTHON] Support simpler worker profiling with viztracer [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/18 20:45:48 UTC, 2 replies.
- [PR] [SPARK-56058] Import `FoundationEssentials` if available [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 21:18:17 UTC, 0 replies.
- [PR] [SPARK-56059] Use `ContinuousClock` instead of `DispatchTime` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 21:33:38 UTC, 3 replies.
- Re: [PR] [SPARK-36600][SQL] Avoid unnecessary list conversion in createDataFrame [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/18 21:52:21 UTC, 6 replies.
- [PR] [SPARK-56060][PS] Handle pandas 3 null string conversion in describe() for empty timestamp frames [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/18 21:55:22 UTC, 3 replies.
- [PR] [SPARK-56057] Fix TLS Memory Leak [spark] - posted by "akpatnam25 (via GitHub)" <gi...@apache.org> on 2026/03/18 22:02:18 UTC, 4 replies.
- [PR] [SPARK-56061] Use integer arithmetic instead of `ceil` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 22:19:06 UTC, 3 replies.
- Re: [PR] [SPARK-56043][SQL] Wrap NullPointerException from Avro 1.12.x ParseContext.resolve() in SchemaParseException [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/18 22:23:53 UTC, 3 replies.
- [PR] [SPARK-56064] Use `FileDescriptor` instead of `FileHandle` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 22:42:03 UTC, 0 replies.
- [PR] [SPARK-56062][PYTHON] Isolate memory_profiler to improve import time [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/18 22:58:00 UTC, 2 replies.
- Re: [PR] [SPARK-50111][PYTHON] Add subplots support for pie charts in Plotly backend [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/18 23:22:33 UTC, 2 replies.
- Re: [PR] [SPARK-55839][UI] Add export config button to Environment page [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/18 23:29:04 UTC, 5 replies.
- Re: [PR] [SPARK-50284][PYTHON] Change docs for parseJson function [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/18 23:32:40 UTC, 1 replies.
- Re: [PR] [SPARK-56064] Use `SystemPackage.FileDescriptor` instead of `FileHandle` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 23:41:11 UTC, 4 replies.
- [PR] [SPARK-56066][PYTHON] Lazy import numpy to improve import speed [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/18 23:41:28 UTC, 6 replies.
- Re: [PR] [SPARK-52687][PYTHON] Fix SPARK_CONNECT_MODE parsing [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/18 23:41:51 UTC, 3 replies.
- Re: [PR] [SPARK-54810] Path [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/18 23:47:13 UTC, 0 replies.
- [PR] [SPARK-56067][PYTHON] Lazy import psutil to improve import speed [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/18 23:50:24 UTC, 4 replies.
- [PR] [SPARK-56068] Use `Date.FormatStyle` instead of `DateFormatter` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/18 23:57:03 UTC, 3 replies.
- [PR] [SPARK-56069] Use `FileManager.default.temporaryDirectory` instead of `NSTemporaryDirectory` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 00:12:26 UTC, 3 replies.
- Re: [PR] [SPARK-56011][PYTHON][INFRA] Add python/asv wrapper script for running benchmarks from repo root [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/19 00:15:52 UTC, 1 replies.
- [PR] [SPARK-56070] Avoid `NSString.expandingTildeInPath` usage [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 00:23:14 UTC, 2 replies.
- Re: [PR] [SPARK-56044][CORE] HistoryServerDiskManager does not delete app store on release when app is not in active map [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/19 02:59:21 UTC, 4 replies.
- [PR] [SPARK-56071] Avoid `ObjCBool` usage [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 02:59:59 UTC, 4 replies.
- Re: [PR] [SPARK-55577][PYTHON] Refactor SQL_SCALAR_ARROW_ITER_UDF wrapper, mapper, and serializer logic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/19 03:37:55 UTC, 1 replies.
- Re: [PR] [SPARK-56047][SQL] Propagate distinctCount through Union in CBO statistics estimation [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/19 03:43:20 UTC, 0 replies.
- Re: [PR] [SPARK-56058] Import `FoundationEssentials` instead of `Foundation` if available [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 04:35:54 UTC, 5 replies.
- [PR] [SPARK-56072] Use Decimal constructor instead of `pow` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 04:55:25 UTC, 2 replies.
- [PR] [SPARK-56073][PYTHON][SQL] Simplify the build of `PythonRunnerConfMap` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/19 04:57:15 UTC, 2 replies.
- Re: [PR] [SPARK-56072] Use `Decimal` constructor instead of `pow` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 05:17:16 UTC, 2 replies.
- [PR] [MINOR] Improve AGENTS.md with inline build/test commands, PR workflow, and dev notes [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/19 05:26:38 UTC, 21 replies.
- Re: [PR] [SPARK-56074][INFRA] Improve AGENTS.md with inline build/test commands, PR workflow, and dev notes [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/19 05:58:08 UTC, 70 replies.
- Re: [I] Update Derby and Hive version [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/19 06:01:52 UTC, 0 replies.
- Re: [PR] [SPARK-55147][SS] Scope timestamp range for time-interval join retrieval in V4 state format [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/19 06:10:19 UTC, 2 replies.
- Re: [PR] [SPARK-55059][PYTHON] Remove empty table workaround in toPandas [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/19 06:25:16 UTC, 2 replies.
- Re: [PR] [SPARK-56020][SQL] Improve `GroupPartitions` Spark UI [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/19 07:15:03 UTC, 1 replies.
- Re: [PR] [SPARK-56054][SQL] Fix aliased nested fields ignored for schema evolution in MERGE [spark] - posted by "johanl-db (via GitHub)" <gi...@apache.org> on 2026/03/19 07:48:04 UTC, 4 replies.
- [PR] [SPARK-43253][SQL] Assign a name to the error class _LEGACY_ERROR_TEMP_2017 [spark] - posted by "adityaksolves (via GitHub)" <gi...@apache.org> on 2026/03/19 08:39:36 UTC, 1 replies.
- [PR] [SPARK-55969][SQL] regr_r2 should treat first param as dependent variable [spark] - posted by "mgaido91 (via GitHub)" <gi...@apache.org> on 2026/03/19 09:10:13 UTC, 3 replies.
- [PR] [SPARK-55887][CONNECT][TESTS][FOLLOW-UP] Make new tests more stable [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/19 11:38:36 UTC, 4 replies.
- [PR] [SPARK-56075][PYTHON] Remove a batch of dead python error classes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/19 12:01:04 UTC, 2 replies.
- Re: [PR] [SPARK-56035] [SQL] Introduce `AggregateValidator` for single-pass resolver `Aggregate` validation [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/19 14:04:39 UTC, 0 replies.
- [PR] [SPARK-55887][CONNECT][FOLLOWUP] Fix flaky SparkConnectServiceSuite limit/tail tests [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/19 14:05:20 UTC, 4 replies.
- [PR] supporting various clients thorugh types framework [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/03/19 14:06:36 UTC, 0 replies.
- Re: [PR] [SPARK-55689] Skip unsupported column changes during schema evolution [spark] - posted by "aokolnychyi (via GitHub)" <gi...@apache.org> on 2026/03/19 14:28:52 UTC, 10 replies.
- Re: [PR] [SPARK-56050][SQL] Eagerly resolve IDENTIFIER() with string literals at parse time [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 16:16:57 UTC, 3 replies.
- Re: [PR] [SPARK-55983][SQL][FOLLOW-UP] New single-pass analyzer functionality and bugfixes [spark] - posted by "dtenedor (via GitHub)" <gi...@apache.org> on 2026/03/19 16:23:59 UTC, 1 replies.
- [PR] [SPARK-56077] Upgrade `gRPC Swift NIO Transport` to 2.4.5 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 17:25:50 UTC, 3 replies.
- Re: [PR] SPARK-56078 - Expose failureThreshold and timeoutSeconds in operator livenessProbe schema [spark-kubernetes-operator] - posted by "danbaron63 (via GitHub)" <gi...@apache.org> on 2026/03/19 17:31:16 UTC, 0 replies.
- Re: [PR] [SPARK-56078] Expose failureThreshold and timeoutSeconds in operator livenessProbe schema [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 17:32:51 UTC, 0 replies.
- Re: [PR] [SPARK-56078] Expose `failureThreshold` and `timeoutSeconds` in operator livenessProbe schema [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 17:38:41 UTC, 3 replies.
- [PR] [SPARK-56079] Optimize `pi` example Docker image size [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 18:23:33 UTC, 5 replies.
- Re: [PR] Add tests for supported compression types in RocksDB. [spark] - posted by "fedimser (via GitHub)" <gi...@apache.org> on 2026/03/19 18:42:15 UTC, 0 replies.
- [PR] [SPARK-56080][PS] Align Series.argmax/argmin with pandas 3.0 NA handling [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/19 18:51:35 UTC, 3 replies.
- [PR] [SPARK-56081][PS] Align idxmax and idxmin NA handling with pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/19 18:58:14 UTC, 5 replies.
- [PR] [SPARK-56082] Optimize `spark-sql` example Docker image size [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 19:38:31 UTC, 3 replies.
- Re: [PR] [SPARK-56035] [SQL] Introduce `AggregationValidator ` for single-pass resolver `Aggregate` validation [spark] - posted by "mihailoale-db (via GitHub)" <gi...@apache.org> on 2026/03/19 19:52:30 UTC, 2 replies.
- [PR] [SPARK-56083] Add `pyspark-connect` example [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 20:08:01 UTC, 6 replies.
- [PR] [SPARK-56086] Use `URL.homeDirectory` for iOS [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 21:44:10 UTC, 3 replies.
- [PR] [SPARK-56087] Use Java 26 toolchain while supporting Java 17+ [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 22:05:22 UTC, 3 replies.
- Re: [PR] [SPARK-55145][SS] Support Avro for timestamp based RocksDB state key encoders [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/19 22:12:47 UTC, 1 replies.
- [PR] Bump flatted from 3.1.1 to 3.4.2 in /dev [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/03/19 22:23:12 UTC, 2 replies.
- [PR] [SPARK-56088] Support Java 26 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 22:24:45 UTC, 6 replies.
- Re: [PR] [SPARK-55751][SS] Add metrics on state store loads from DFS [spark] - posted by "micheal-o (via GitHub)" <gi...@apache.org> on 2026/03/19 22:47:44 UTC, 8 replies.
- [PR] [SPARK-55667][PYTHON][CONNECT][FOLLOWUP] Detect REPL for doctest check [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/19 23:15:15 UTC, 2 replies.
- [PR] [SPARK-56090] Fix 64-byte alignment calculation in ArrowBuffer [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/19 23:27:18 UTC, 3 replies.
- [PR] [SPARK-56089][SQL] Align asinh/acosh with fdlibm algorithm for cross-engine compatibility [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/19 23:41:12 UTC, 11 replies.
- [PR] [SPARK-56091] Upgrade `Apache DataFusion Comet` to 0.14.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 00:17:57 UTC, 2 replies.
- [PR] [SPARK-55799][PYTHON][TESTS][FOLLOWUP] Disable some expensive tests for data source simple worker [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/20 00:21:24 UTC, 0 replies.
- Re: [PR] [DOCS] Fix Missing Documentation for SparkSession in Declarative Pipelines (Python) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/20 00:38:35 UTC, 1 replies.
- [PR] [SPARK-XXXXX][SS][CONNECT] Fix NPE in StreamingQueryException.toString() when cause is null [spark] - posted by "eason-yuchen-liu (via GitHub)" <gi...@apache.org> on 2026/03/20 02:18:14 UTC, 0 replies.
- Re: [PR] [SPARK-56047][SQL] Propagate `distinctCount` through Union in CBO statistics estimation [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 03:38:57 UTC, 4 replies.
- Re: [PR] [SPARK-55949][SQL][CONNECT] Add DataFrame API and Spark Connect support for CDC queries [spark] - posted by "gengliangwang (via GitHub)" <gi...@apache.org> on 2026/03/20 03:58:08 UTC, 1 replies.
- Re: [PR] [SPARK-56032][SQL] Support subexpression elimination in `FilterExec` whole-stage codegen [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/20 04:14:07 UTC, 15 replies.
- Re: [PR] [SPARK-56093][CORE][HISTORY] Allow AppStatus to be cached and reused by the history server. [spark] - posted by "ForVic (via GitHub)" <gi...@apache.org> on 2026/03/20 05:04:20 UTC, 3 replies.
- [PR] [SPARK-56094] Support `getOperationStatuses` API [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 05:05:32 UTC, 4 replies.
- [PR] [SPARK-56095] Optimize `app` example Docker image size [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 06:13:23 UTC, 3 replies.
- [PR] [SPARK-56096] Upgrade `mockito` to 5.23.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 06:32:49 UTC, 3 replies.
- [PR] [SPARK-56097] Optimize `web` example Docker image size [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 06:38:31 UTC, 3 replies.
- [PR] [SPARK-56098] Upgrade `mockito-core` to 5.23.0 and use `mockito-5-18` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 06:48:58 UTC, 0 replies.
- [PR] [SPARK-56099] Upgrade `spotless-plugin` to 8.4.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 07:06:56 UTC, 3 replies.
- Re: [PR] [SPARK-55799][PYTHON][TESTS][FOLLOW-UP] Disable some expensive tests for data source simple worker [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/20 07:21:24 UTC, 1 replies.
- [I] DecisionTreeClassifierSuite fails in Spark 4.2 (Scala 2.13) with corrupted Parquet file error [spark] - posted by "afsantamaria-stratio (via GitHub)" <gi...@apache.org> on 2026/03/20 08:20:49 UTC, 0 replies.
- [PR] [SPARK-56101] Upgrade `flatted` to 3.4.2 to fix CVE-2026-33228 [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/20 09:52:24 UTC, 0 replies.
- [PR] [SPARK-56102][SQL] `UnionEstimation` code cleanup [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/20 10:48:19 UTC, 15 replies.
- Re: [PR] [SPARK-55441][SQL] Types Framework - Phase 1c - Client Integration [spark] - posted by "davidm-db (via GitHub)" <gi...@apache.org> on 2026/03/20 10:54:34 UTC, 13 replies.
- [PR] [SPARK-55809][CORE] HeapHistogram uses DiagnosticCommandMBean instead of jmap subprocess [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/20 11:39:16 UTC, 8 replies.
- Re: [PR] [SPARK-56098][BUILD] Upgrade `mockito-core` to 5.23.0 and use `mockito-5-18` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 12:20:17 UTC, 1 replies.
- Re: [PR] [SPARK-56101][INFRA] Upgrade `flatted` to 3.4.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 12:33:40 UTC, 1 replies.
- [PR] [SPARK-56103] Upgrade `junit` to 6.0.3 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 13:09:29 UTC, 3 replies.
- [PR] [SPARK-56104][BUILD] Upgrade `junit` to 6.0.3 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 13:14:22 UTC, 5 replies.
- [PR] [SPARK-56105] Upgrade `shadow-jar-plugin` to 8.3.10 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 13:24:25 UTC, 3 replies.
- [PR] [MINOR] Use SparkContext.isDriver() in GlobalSingletonManualClock [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/20 14:20:45 UTC, 0 replies.
- [PR] [SPARK-56106] Optimize `stream` example Docker image size [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 14:50:47 UTC, 5 replies.
- [PR] [SPARK-56107] Remove `docker-entrypoint.sh` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 15:59:10 UTC, 4 replies.
- [PR] [SPARK-56020][SQL][FOLLOW-UP] Use `Reducer.displayName()` in `GroupPartitions` textual representation [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/20 16:00:49 UTC, 4 replies.
- [PR] [SPARK-56108] Remove `Super-Linter` from GitHub Actions jobs [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 16:34:36 UTC, 3 replies.
- [PR] [SPARK-56109] Remove `Super-Linter` from GitHub Actions jobs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 16:36:13 UTC, 3 replies.
- [PR] [SPARK-56110] Use `Distroless` images for `Examples` [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 17:35:02 UTC, 4 replies.
- Re: [PR] [SPARK-56111][CORE] Add SparkContext.isDriver() and use it across the codebase [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/20 17:37:23 UTC, 2 replies.
- Re: [PR] [SPARK-55306] Add ability to run Kafka tests in Python [spark] - posted by "jerrypeng (via GitHub)" <gi...@apache.org> on 2026/03/20 17:39:36 UTC, 22 replies.
- [PR] Remove redundant closeOperation for abandoned executions [spark] - posted by "terana (via GitHub)" <gi...@apache.org> on 2026/03/20 17:59:37 UTC, 1 replies.
- [PR] [SPARK-56065][SQL] Add AQE fallback from failed broadcast joins to shuffle joins [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/03/20 18:11:15 UTC, 11 replies.
- [PR] [SPARK-56112] Update `publish_image` to cover all example images [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 18:26:59 UTC, 4 replies.
- [PR] [SPARK-56113][PS] Improve pandas 3 string restoration in pandas-on-Spark [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/20 19:15:54 UTC, 3 replies.
- [PR] [SPARK-56100][SQL] Fail the query when IN list has no left-hand column or expression in the where clause [spark] - posted by "mani2296 (via GitHub)" <gi...@apache.org> on 2026/03/20 19:36:45 UTC, 0 replies.
- [PR] [SPARK-56107][FOLLOWUP] Remove `docker run` step from `build-image` GitHub Actions job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 19:47:59 UTC, 3 replies.
- [PR] [SPARK-56114] Use Java 26 always except `build-test` matrix job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 20:14:57 UTC, 0 replies.
- Re: [PR] [SPARK-55510] Update structured-streaming-state-data-source.md doc to reflect deleteRange [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/03/20 21:14:17 UTC, 1 replies.
- [PR] [SPARK-56018][PYTHON][FOLLOW-UP] Disable black check by default [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/20 21:46:27 UTC, 3 replies.
- Re: [PR] [SPARK-56114] Use Java 26 instead of 25 except `build-test` matrix job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 21:50:27 UTC, 2 replies.
- [PR] [SPARK-56116] Upgrade `Gradle` to 9.4.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 21:58:30 UTC, 3 replies.
- [PR] [SPARK-56117] Make `spotless` ignore `.claude` directory [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 22:03:24 UTC, 3 replies.
- [PR] [SPARK-56118][PS] Match pandas 3.0 bool handling in GroupBy.quantile [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/20 22:13:45 UTC, 3 replies.
- [PR] [SPARK-55690][SQL][Follow-up] Fix dead references [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/20 22:42:14 UTC, 3 replies.
- [PR] [SPARK-56119] Sync `docker`-related GitHub Actions versions to the ASF approved patterns [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/20 22:48:54 UTC, 3 replies.
- [I] github actions are not working due to a new security policy [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/20 23:07:54 UTC, 2 replies.
- [PR] [SPARK-56085][PYTHON] Add ASV micro-benchmarks for SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/20 23:32:47 UTC, 0 replies.
- [PR] [SPARK-56122][PS] Use pandas-aware numeric dtype check in Series.cov [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/20 23:33:17 UTC, 3 replies.
- [PR] [SPARK-56124] Sync `docker`-related GitHub Actions versions to the ASF approved patterns [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 00:30:30 UTC, 4 replies.
- Re: [PR] [DRAFT][DO-NOT-REVIEW][SPARK-51XXX][SQL] Enable implicit cast from STRING to TIME type [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/21 00:36:26 UTC, 1 replies.
- [PR] [SPARK-56125][SQL] Simplify schema calculation code for Merge Into Schema Evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/21 00:54:23 UTC, 0 replies.
- Re: [PR] [SPARK-56125][SQL] Simplify schema calculation for Merge Into Schema Evolution [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/21 01:46:16 UTC, 4 replies.
- [PR] [SPARK-56126][INFRA] Sync `docker`-related GitHub Actions versions to the ASF approved patterns [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 03:32:36 UTC, 3 replies.
- [PR] [SPARK-56126][INFRA][4.1] Sync `docker`-related GitHub Actions versions to the ASF approved patterns [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 03:44:12 UTC, 3 replies.
- [PR] [SPARK-56126][INFRA][4.0] Sync `docker`-related GitHub Actions versions to the ASF approved patterns [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 03:55:46 UTC, 3 replies.
- [PR] [SPARK-53565][SQL] Fix aggregate function evaluation for empty grouping sets in PropagateEmptyRelation [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/21 06:12:06 UTC, 0 replies.
- [PR] [SPARK-55163][PYTHON][CONNECT] Reuse metadata plans for DataFrames [spark] - posted by "davidgvad (via GitHub)" <gi...@apache.org> on 2026/03/21 06:52:38 UTC, 2 replies.
- [PR] [SPARK-56127] Use `zulu-openjdk-alpine` to minimize the Docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 19:26:40 UTC, 3 replies.
- [PR] [SPARK-56128] Use Java `21-jre` instead of `21` image in K8s Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 19:45:01 UTC, 1 replies.
- [PR] [SPARK-56129] Exclude `Netty QUIC` native libraries [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 19:56:03 UTC, 0 replies.
- Re: [PR] [SPARK-56129] Exclude `Netty QUIC` native libraries to minimize Docker image [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 20:00:52 UTC, 3 replies.
- Re: [PR] [SPARK-56128][K8S] Use Java `21-jre` instead of `21` image in K8s Dockerfile [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 20:14:22 UTC, 5 replies.
- [PR] [SPARK-56130] Make `values.schema.json` up-to-date [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 20:30:55 UTC, 6 replies.
- [PR] [SPARK-56131] Use `jlink` custom JRE runtime to minimize Docker image size [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 21:28:31 UTC, 3 replies.
- [PR] [SPARK-56132] Increase `emptyDir` sizeLimit to 200Mi for `pi-with-comet` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/21 21:57:58 UTC, 3 replies.
- Re: [PR] [SPARK-54684][SS] Introduce stream-stream join operations microbenchmark [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/22 00:41:25 UTC, 1 replies.
- Re: [PR] [WIP][PYTHON] Zero Copy Pandas UDF [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/22 00:41:30 UTC, 1 replies.
- [PR] [SPARK-54916][ML] Fix Parquet footer error in DecisionTree test suites by caching RDDs [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/22 13:12:58 UTC, 0 replies.
- Re: [I] DecisionTreeClassifierSuite fails in Spark 4.2.0-preview3 (Scala 2.13) with corrupted Parquet file error [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/22 13:14:34 UTC, 0 replies.
- Re: [PR] [SPARK-54670][CONNECT] Rework Connect Literal handling [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/23 00:42:21 UTC, 1 replies.
- Re: [PR] backport libthrift update to fix CVE-2019-0205 & CVE-2020-13949 [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/23 00:42:23 UTC, 1 replies.
- Re: [PR] [SPARK-54605][K8S] Override default spark env in driver pod [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/23 00:42:26 UTC, 1 replies.
- Re: [PR] [SPARK-53622][CORE][TEST] Improve `UninterruptibleThreadSuite` [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/23 00:42:28 UTC, 1 replies.
- [PR] [SPARK-56134] Make BufferedRowIterator.unsafeRow public to avoid IllegalAccessError. [spark] - posted by "chenhao-db (via GitHub)" <gi...@apache.org> on 2026/03/23 02:24:25 UTC, 1 replies.
- [PR] [SPARK-56135][DOCS] Add option to use venv in PySpark docs [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/23 03:01:07 UTC, 3 replies.
- [PR] [SPARK-56136] Add PySpark 4.1.1 integration test coverage [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 03:15:07 UTC, 0 replies.
- [PR] [SPARK-56138] Replace `ubuntu-latest` with `ubuntu-slim` in `build-test` GitHub Actions job [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 03:23:25 UTC, 6 replies.
- [PR] [SPARK-56139] Add E2E test for `ApplicationTimeoutConfig` with `driverStartTimeoutMillis` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 03:40:18 UTC, 3 replies.
- [PR] [SPARK-56141] Cache Gradle Java Toolchain in CI [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 03:58:03 UTC, 6 replies.
- [PR] [SPARK-56142] Add worker StatefulSet replica validation to `SparkCluster` e2e test [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 04:18:03 UTC, 3 replies.
- [PR] [SPARK-56143][WEBIUI] Remove `jquery.cookies` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/23 04:20:28 UTC, 2 replies.
- [PR] [SPARK-55927][WEBUI][FOLLOWUP] Remove `"jquery.mustache.js"` from `ignorePatterns` in `eslint.js` [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/23 04:28:07 UTC, 2 replies.
- [PR] [SPARK-56144] Remove no-op `spark.master.rest.enabled` because it is enabled by default since Apache Spark 4.1 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 04:28:28 UTC, 4 replies.
- [PR] [SPARK-56146] Add e2e test for `resourceRetainPolicy: OnFailure` with a failed SparkApp [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 05:05:54 UTC, 3 replies.
- [PR] [SPARK-48338][SQL] `spark-sql` cli correctly handles SQL Scripting compound blocks [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/23 05:47:04 UTC, 1 replies.
- [PR] [SPARK-56149] Upgrade `gRPC Swift NIO Transport` to 2.5.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 05:57:57 UTC, 4 replies.
- [PR] [SPARK-56150] Update `README.md` with the docker image sizes [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 06:39:21 UTC, 5 replies.
- Re: [PR] [SPARK-56136] Add `PySpark 4.1.1` integration test coverage [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 06:41:19 UTC, 3 replies.
- [PR] History server disk store lease should remove temp path delete hook after commit and rollback to avoid memory leak [spark] - posted by "LennonChin (via GitHub)" <gi...@apache.org> on 2026/03/23 07:02:50 UTC, 0 replies.
- Re: [PR] [SPARK-53209][YARN] Add ActiveProcessorCount JVM option to YARN executor and AM [spark] - posted by "jzhuge (via GitHub)" <gi...@apache.org> on 2026/03/23 08:03:11 UTC, 20 replies.
- [PR] [SPARK-56075][PYTHON][FOLLOW-UP] Remove remaining dead python error classes [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/23 08:30:39 UTC, 2 replies.
- [PR] [SPARK-56151][SQL] Improve CreateVariable display string [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/23 08:31:43 UTC, 3 replies.
- [PR] [SPARK-56152][SQL] Enable implicit cast from STRING to TIME type [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/03/23 09:43:07 UTC, 1 replies.
- [PR] [SPARK-55809][CORE][FOLLOWUP] HeapHistogram uses DiagnosticCommandMBean instead of jmap subprocess [spark] - posted by "cxzl25 (via GitHub)" <gi...@apache.org> on 2026/03/23 10:56:42 UTC, 4 replies.
- Re: [PR] [SPARK-49671][SQL] Remove the RTRIM collation config [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/03/23 11:43:53 UTC, 0 replies.
- Re: [PR] [DRAFT][Geo][SQL] Enhance SRID/CRS support based on PROJ data [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/03/23 11:56:12 UTC, 1 replies.
- [PR] [MINOR] Fix typo errors in code comments across multiple modules [spark] - posted by "r266-tech (via GitHub)" <gi...@apache.org> on 2026/03/23 14:55:57 UTC, 1 replies.
- [I] Dataset.localCheckpoint() should accept a StorageLevel parameter [spark] - posted by "iasonS (via GitHub)" <gi...@apache.org> on 2026/03/23 15:37:30 UTC, 2 replies.
- [PR] [MINOR] Add quotes to fix erroneous pip install command in SDP Prog Guide [spark] - posted by "suhuruli (via GitHub)" <gi...@apache.org> on 2026/03/23 16:18:45 UTC, 2 replies.
- [PR] [SPARK-56156][BUILD] Upgrade jackson to 2.21.2 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 16:41:12 UTC, 4 replies.
- [PR] [SPARK-56155][SQL] Collect_list/collect_set sql() function includes "RESPECT NULLS" [spark] - posted by "helioshe4 (via GitHub)" <gi...@apache.org> on 2026/03/23 17:20:30 UTC, 3 replies.
- [PR] [SPARK-56161] Ban `org.apache.hadoop.util.StringUtils.stringifyException` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 18:27:55 UTC, 0 replies.
- [PR] [SPARK-55999][SS][FOLLOWUP] Explicitly set forceSnapshotUploadOnLag=false in remaining lag-reporting tests [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/23 18:46:14 UTC, 2 replies.
- [PR] [SPARK-56162] Prevent Jackson from using reflection on final fields during deserialization for `JEP-500` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 19:03:25 UTC, 4 replies.
- Re: [PR] [SPARK-56161][K8S] Ban `org.apache.hadoop.util.StringUtils.stringifyException` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 19:15:53 UTC, 3 replies.
- [PR] [SPARK-56163][CORE][K8S] Move `uploadFileToHadoopCompatibleFS` to `Utils` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/23 19:44:01 UTC, 3 replies.
- [PR] [SPARK-56164][SQL] Fix SPJ merged key ordering [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/23 20:10:07 UTC, 11 replies.
- Re: [PR] [SPARK-56085][PYTHON][TEST] Add ASV micro-benchmarks for SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/23 20:51:23 UTC, 2 replies.
- [PR] [SPARK-55600][PYTHON][TEST][FOLLOW-UP] Fix test to verify row count preservation with 0-column schema [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/23 21:10:37 UTC, 2 replies.
- [PR] [SPARK-55330][K8S] Make spark.kubernetes.legacy.useReadWriteOnceAccessMode a public config [spark] - posted by "nitrajen (via GitHub)" <gi...@apache.org> on 2026/03/23 21:22:20 UTC, 0 replies.
- [PR] [SPARK-56165][PYTHON][TESTS] Use temporary directory instead of saveAsTable in test_data_source_segfault [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/23 21:35:31 UTC, 3 replies.
- [PR] [SPARK-53440][PYTHON] Allow Column.transform() to accept SQL lambda expression strings [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/23 22:08:34 UTC, 1 replies.
- Re: [PR] [SPARK-55999][SS][FOLLOW-UP] Explicitly set forceSnapshotUploadOnLag=false in remaining lag-reporting tests [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/23 22:15:05 UTC, 1 replies.
- [PR] [SPARK-56160][SQL] Add DataType classes for nanosecond timestamp types [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/23 22:16:10 UTC, 1 replies.
- [PR] [SPARK-56166][PYTHON] Use ArrowBatchTransformer.enforce_schema to replace manual type coercion logic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/23 22:32:53 UTC, 0 replies.
- [PR] [SPARK-56167][PS] Align astype with pandas 3 default string behavior [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/23 22:37:12 UTC, 3 replies.
- [PR] [SPARK-56168][PS][TESTS] Relax groupby diff-length assertions for pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/23 23:27:48 UTC, 3 replies.
- [PR] [SPARK-56169][SQL] Fix `ClassCastException` in error reporting when `GetStructField` child type is changed by plan transformation [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/24 00:16:23 UTC, 2 replies.
- [PR] [WIP][SPARK-XXXXX][SQL] Replace legacy error codes with named errors in DSv2 connector API [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/03/24 00:22:49 UTC, 0 replies.
- [PR] [SPARK-55978][SQL] Add TABLESAMPLE SYSTEM block sampling with DSv2 pu… [spark] - posted by "stanyao (via GitHub)" <gi...@apache.org> on 2026/03/24 00:29:19 UTC, 0 replies.
- Re: [PR] [SPARK-56166][PYTHON] Use ArrowBatchTransformer.enforce_schema to replace column-wise type coercion logic [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/24 01:27:39 UTC, 5 replies.
- [PR] [SPARK-56153][SQL][TEST] Add trait `QueryTestBase` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/24 01:44:39 UTC, 1 replies.
- [PR] [SPARK-56015][INFRA][DOCS] Switch to non-deprecated package installation where possible for R in Docs Docker file [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/24 01:44:44 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-56015][INFRA][DOCS] Cleanup docs container, remove unused R deps, and fix x86 build. [spark] - posted by "holdenk (via GitHub)" <gi...@apache.org> on 2026/03/24 01:45:21 UTC, 1 replies.
- [PR] [SPARK-56032][SQL][FOLLOW-UP] Fix comments in FilterExec CSE [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/24 02:51:38 UTC, 5 replies.
- [PR] [DO-NOT-REVIEW][SPARK-55886][SQL] Add `DataFrame.zip` for merging column-projected DataFrames [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/24 02:59:29 UTC, 0 replies.
- [PR] [SPARK-56171][SQL] Enable file source V2 write path with partition and dynamic overwrite support [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/24 04:59:13 UTC, 1 replies.
- [PR] [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 1 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/24 05:04:50 UTC, 2 replies.
- Re: [PR] [SPARK-56134][SQL] Make BufferedRowIterator.unsafeRow public to avoid IllegalAccessError. [spark] - posted by "rednaxelafx (via GitHub)" <gi...@apache.org> on 2026/03/24 05:35:16 UTC, 0 replies.
- [PR] [SPARK-56180][INFRA] `build/mvn` prefer to download tgz from maven central [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/24 08:18:56 UTC, 0 replies.
- [PR] [WIP][SPARK-56182][SQL] Allow SPJ reducing identity to other transforms [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/24 09:11:12 UTC, 1 replies.
- Re: [PR] [SPARK-44571][SQL] Merge subplans with one row result [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/24 09:18:43 UTC, 1 replies.
- Re: [PR] [SPARK-56171][SQL] Enable file source V2 write path with partition, dynamic overwrite, and catalog table support [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/24 09:33:49 UTC, 2 replies.
- Re: [PR] [WIP][SPARK-56171][SQL] Enable file source V2 write path with partition, dynamic overwrite, and catalog table support [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/24 10:39:42 UTC, 0 replies.
- Re: [PR] [SPARK-51712][SQL] Swallow non-fatal Throwables when resolving tables/views in spark.catalog.listTables() [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/24 10:43:28 UTC, 8 replies.
- [PR] [SPARK-56184][SQL] Replace AssertionError with proper SparkRuntimeException in partition column parsing [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/24 11:30:22 UTC, 0 replies.
- [PR] [SPARK-56183][BUILD] Upgrade Oracle JDBC to version 23.26.1.0.0 [spark] - posted by "LucaCanali (via GitHub)" <gi...@apache.org> on 2026/03/24 13:27:33 UTC, 0 replies.
- [PR] [SPARK-56089][SQL][FOLLOWUP] Use ctx.freshName for codegen variables in Asinh/Acosh [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/24 13:40:23 UTC, 3 replies.
- [I] [DOCS] Document return types for aggregate functions (stddev, variance, etc.) [spark] - posted by "sanketitnal (via GitHub)" <gi...@apache.org> on 2026/03/24 13:42:48 UTC, 5 replies.
- Re: [PR] [WIP][SPARK-54372][SQL] ANSI mode should reject avg/sum on timestamp types [spark] - posted by "sharkqwy (via GitHub)" <gi...@apache.org> on 2026/03/24 14:14:55 UTC, 0 replies.
- Re: [PR] [SPARK-56182][SQL] Allow SPJ reducing identity to other transforms [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/24 14:38:57 UTC, 2 replies.
- [PR] [SPARK-38101][CORE] Fix executors failing fetching map statuses with INTERNAL_ERROR_BROADCAST [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/24 14:40:20 UTC, 0 replies.
- Re: [I] [SPARK-38101] execuors fail fetching map statuses with `INTERNAL_ERROR_BROADCAST` [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/24 15:00:57 UTC, 0 replies.
- [PR] [SPARK-56186][PYTHON] Retire pypy [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/24 20:19:17 UTC, 6 replies.
- [PR] [SPARK-56187][PS] Fix Series.argsort null ordering for pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/24 20:41:13 UTC, 3 replies.
- [PR] [SPARK-56188][PS] Align Series.map({}) with pandas 3 empty-dict behavior [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/24 22:41:39 UTC, 2 replies.
- [PR] [SPARK-56123][PYTHON] Refactor SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF to use ArrowStreamSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/24 23:19:24 UTC, 0 replies.
- [PR] [SPARK-55700][PS][FOLLOW-UP] Use positional access when squeezing a single-element Series [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/24 23:21:37 UTC, 3 replies.
- [PR] [SPARK-55170][PYTHON][FOLLOWUP] Extract _read_arrow_stream to fix latent recursion in _load_group_dataframes [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/24 23:49:13 UTC, 3 replies.
- Re: [PR] [SPARK-55502][PYTHON][4.0] Unify UDF and UDTF Arrow conversion error handling [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/24 23:56:02 UTC, 4 replies.
- Re: [PR] [DOCS] Fix comma placement in array_append doc [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/25 00:39:53 UTC, 1 replies.
- Re: [PR] [SPARK-56089][SQL][FOLLOW-UP] Use ctx.freshName for codegen variables in Asinh/Acosh [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 00:52:28 UTC, 2 replies.
- Re: [PR] [SPARK-56184][SQL] Replace `assert` with proper `SparkRuntimeException` in partition column parsing [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/25 01:12:26 UTC, 2 replies.
- [PR] [SPARK-56190][SQL] Support nested partition columns for DSV2 PartitionPredicate [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/25 01:14:55 UTC, 30 replies.
- [PR] [SPARK-55579][PYTHON] Rename PySpark error classes to be eval-type-agnostic [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/25 01:22:18 UTC, 5 replies.
- [PR] [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 2 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/25 01:54:20 UTC, 2 replies.
- Re: [PR] [SPARK-56180][INFRA] `build/mvn` prefer to download tgz from Google mirror of Maven Central [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/25 02:32:34 UTC, 2 replies.
- [PR] [SPARK-56171][SQL] Enable V2 file write path for non-partitioned DataFrame API writes and delete `FallBackFileSourceV2` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/25 04:05:14 UTC, 2 replies.
- Re: [PR] [SPARK-56183][BUILD][TESTS] Upgrade Oracle JDBC to 23.26.1.0.0 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 04:26:39 UTC, 0 replies.
- [PR] [SPARK-56191] Upgrade `gRPC Swift NIO Transport` to 2.6.0 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 04:56:42 UTC, 3 replies.
- Re: [PR] [SPARK-56015][INFRA][DOCS] Cleanup docs container, remove unused R deps, and fix x86 build. [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 05:03:42 UTC, 5 replies.
- Re: [PR] [SPARK-56181][SQL] Guard against unresolved attributes in constraint inference [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 05:04:37 UTC, 0 replies.
- [PR] [SPARK-56192] Exclude `spotbugs-annotations` from the uber jar [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 05:23:40 UTC, 3 replies.
- [PR] [SPARK-56193] Fix `spark-operator-api` to use `compileOnly` for `Lombok` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 05:31:40 UTC, 3 replies.
- [PR] [SPARK-56194] Upgrade `Lombok` to 1.18.44 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 05:40:08 UTC, 3 replies.
- [I] AES-GCM for RPC encryption does not work on YARN [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/03/25 05:51:23 UTC, 0 replies.
- [PR] [SPARK-56195] Fix `BaseStatus` to handle when K8s API returns null for `stateTransitionHistory` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 06:24:28 UTC, 0 replies.
- Re: [PR] [SPARK-56195] Fix `BaseStatus` to handle when K8s API returns `null` for `stateTransitionHistory` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 06:40:41 UTC, 3 replies.
- [PR] [SPARK-49829][SS][FOLLOWUP] Run SPARK-49829 tests with VCF joins now that StateDataSource supports it [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 06:41:31 UTC, 2 replies.
- [PR] [SPARK-56196] Use official `Swift 6.3` Docker image instead of nightly [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 06:48:34 UTC, 3 replies.
- [PR] [SPARK-56197] Use `musl` Static Linux SDK for `Examples` Docker images [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 07:00:14 UTC, 4 replies.
- [PR] [SPARK-56050][SQL][FOLLOWUP] Add comment to withIdentClause about withOrigin pitfall [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 07:09:57 UTC, 2 replies.
- Re: [PR] [SPARK-56001][SQL] Add INSERT INTO ... REPLACE ON/USING syntax [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 07:20:38 UTC, 21 replies.
- [PR] [SPARK-56198] Update Operator to Java Operator SDK 5.3.1 [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/03/25 07:24:26 UTC, 1 replies.
- Re: [PR] [SPARK-55862][SQL] Rename _LEGACY_ERROR_TEMP_2027 to UNEXPECTED_OPERATOR_IN_CORRELATED_SUBQUERY [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 07:30:30 UTC, 0 replies.
- Re: [PR] [SPARK-55469][CORE] Fallback storage reads block data lazily [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/03/25 08:45:28 UTC, 0 replies.
- Re: [PR] [SPARK-52505][K8S] Allow to create executor kubernetes service [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/03/25 08:47:33 UTC, 1 replies.
- [PR] [SPARK-56179][PYTHON] Consolidate error classes for type mismatch - part 3 [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/25 08:57:03 UTC, 2 replies.
- Re: [PR] [SPARK-56147][SQL] `spark-sql` cli correctly handles SQL Scripting compound blocks [spark] - posted by "pan3793 (via GitHub)" <gi...@apache.org> on 2026/03/25 09:10:44 UTC, 0 replies.
- [PR] [SPARK-56199][CORE] Read fallback storage blocks asynchronously and multithread [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/03/25 09:37:14 UTC, 1 replies.
- [PR] [SPARK-56200][CORE] Remove jackson JSON nesting depth limitation [spark] - posted by "lsm1 (via GitHub)" <gi...@apache.org> on 2026/03/25 10:08:49 UTC, 0 replies.
- Re: [PR] [SPARK-56201][SS] Run SPARK-49829 tests with VCF joins now that StateDataSource supports it [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 11:31:56 UTC, 1 replies.
- [PR] [SPARK-XXX][SS] Refactor streaming join tests: split Base/Suite hierarchy and simplify mode dispatch [spark] - posted by "cloud-fan (via GitHub)" <gi...@apache.org> on 2026/03/25 14:39:47 UTC, 0 replies.
- Re: [PR] [SPARK-56202][SS] Refactor streaming join tests: split Base/Suite hierarchy and simplify mode dispatch [spark] - posted by "Copilot (via GitHub)" <gi...@apache.org> on 2026/03/25 14:49:54 UTC, 2 replies.
- [PR] [SPARK-56203][SQL] Fix race condition in `SortExec.rowSorter` [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/25 15:41:35 UTC, 5 replies.
- [PR] [SPARK-56204][SQL] Strip `Alias` wrappers from inline table row expressions in parser [spark] - posted by "mihailotim-db (via GitHub)" <gi...@apache.org> on 2026/03/25 15:45:43 UTC, 5 replies.
- [PR] [SS] Validate base state store checkpoint ID before committing microbatch [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/03/25 16:33:14 UTC, 0 replies.
- [PR] [SPARKSPARK-56206][SQL] Fix case-insensitive duplicate CTE name detection [spark] - posted by "ilicmarkodb (via GitHub)" <gi...@apache.org> on 2026/03/25 17:08:25 UTC, 0 replies.
- Re: [PR] [SPARK-56206][SQL] Fix case-insensitive duplicate CTE name detection [spark] - posted by "srielau (via GitHub)" <gi...@apache.org> on 2026/03/25 17:17:24 UTC, 4 replies.
- Re: [PR] [SPARK-56123][PYTHON] Refactor SQL_GROUPED_AGG_ARROW_UDF and SQL_GROUPED_AGG_ARROW_ITER_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/25 17:34:38 UTC, 2 replies.
- Re: [PR] [SPARK-56207][SQL] Replace legacy error codes with named errors in DSv2 connector API [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/25 18:17:38 UTC, 12 replies.
- Re: [PR] [SPARK-56205][SS] Validate base state store checkpoint ID before committing microbatch [spark] - posted by "anishshri-db (via GitHub)" <gi...@apache.org> on 2026/03/25 18:25:12 UTC, 3 replies.
- [PR] [SPARK-56208][K8S][BUILD][4.1] Upgrade `kubernetes-client` to 7.4.1 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 18:43:53 UTC, 4 replies.
- [PR] [SPARK-55502][PYTHON][4.1] Unify UDF and UDTF Arrow conversion error handling [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/25 18:59:31 UTC, 3 replies.
- [I] Security vulnerabilities on Spark version 4.0.2 [spark] - posted by "cmrohila (via GitHub)" <gi...@apache.org> on 2026/03/25 19:12:41 UTC, 3 replies.
- [PR] [SPARK-56209] Upgrade `vertx` to 4.5.26 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 19:24:53 UTC, 0 replies.
- Re: [PR] [SPARK-56209][BUILD] Upgrade `vertx` to 4.5.26 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 19:37:41 UTC, 2 replies.
- Re: [PR] [SPARK-55448][CONNECT] Fix query events loss when session closes during query execution [spark] - posted by "hvanhovell (via GitHub)" <gi...@apache.org> on 2026/03/25 19:41:55 UTC, 1 replies.
- [PR] [SPARK-56121][SQL] Use dedicated EmptyRelation node for static PropagateEmptyRelation [spark] - posted by "liuzqt (via GitHub)" <gi...@apache.org> on 2026/03/25 19:52:04 UTC, 0 replies.
- [PR] [SPARK-56210] Remove `lombok.SneakyThrows` from `StatusRecorder` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 19:59:16 UTC, 3 replies.
- [PR] [SPARK-56211] Ban `lombok.(SneakyThrows|val|var)` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 20:21:58 UTC, 3 replies.
- [PR] [SPARK-56212] Fix `spark-versions` and `python` e2e test flakiness by explicit clean-up [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 20:46:39 UTC, 3 replies.
- [PR] [SS] Integrate checkpoint V2 with auto-repair snapshot [spark] - posted by "ericm-db (via GitHub)" <gi...@apache.org> on 2026/03/25 21:00:15 UTC, 1 replies.
- [PR] [SPARK-56213] Upgrade `Netty` to 4.2.12.Final [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 21:19:37 UTC, 3 replies.
- [PR] [SPARK-56214] Upgrade `Netty` to 4.2.12.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 21:20:44 UTC, 0 replies.
- [PR] [WIP][SPARK-XXXXX][SQL] df.cache() with DSv2 interfaces to enable V2ScanRelationPushDown optimizer rules [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/03/25 21:23:38 UTC, 1 replies.
- [PR] [SPARK-56215] Exclude `netty-codec-*-quic` classes [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 21:55:01 UTC, 0 replies.
- [PR] Bump picomatch in /ui-test [spark] - posted by "dependabot[bot] (via GitHub)" <gi...@apache.org> on 2026/03/25 22:03:42 UTC, 2 replies.
- Re: [PR] [SPARK-56215] Exclude `netty-codec-*-quic` dependencies [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 22:19:58 UTC, 2 replies.
- [PR] [SPARK-31561][SQL] Add QUALIFY Clause [spark] - posted by "sunchao (via GitHub)" <gi...@apache.org> on 2026/03/25 22:28:59 UTC, 0 replies.
- [PR] [SPARK-56218] Exclude Netty `io_uring`-related dependencies [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/25 22:32:28 UTC, 3 replies.
- [PR] [SPARK-56217][PYTHON] Fix bucketBy exceptions in connect [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/25 22:32:30 UTC, 2 replies.
- [PR] [SPARK-56219][PS] Align groupby idxmax and idxmin skipna=False behavior with pandas 2/3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/25 22:47:59 UTC, 3 replies.
- [PR] [SPARK-56220][PYTHON] Add utility to check wrongly used errorClass in Python [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/25 23:28:07 UTC, 1 replies.
- [PR] [SPARK-56224][PYTHON] Polish type annotations for accumulators.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/26 00:25:15 UTC, 2 replies.
- [PR] [SPARK-56225][SQL] Improve View WITH SCHEMA EVOLUTION error message [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/26 00:36:23 UTC, 2 replies.
- Re: [PR] [SPARK-44988][SQL] Support reading Parquet TIMESTAMP(NANOS,false) [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/26 00:42:18 UTC, 1 replies.
- [PR] [SPARK-56221][SQL][PYTHON] Feature parity between spark.catalog.* vs DDL commands [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/26 00:44:13 UTC, 10 replies.
- [PR] [SPARK-56222][PYTHON] Extract ArrowStreamGroupSerializer and ArrowStreamCoGroupSerializer from ArrowStreamSerializer [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/26 00:47:06 UTC, 0 replies.
- [PR] [SPARK-56226][PS][CONNECT] Catch analysis errors before `InternalFrame.__init__` in `.loc` [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/26 01:14:06 UTC, 3 replies.
- [PR] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/03/26 01:44:02 UTC, 0 replies.
- [PR] [SPARK-56228] Fix `StatusRecorder` to refresh `resourceVersion` on 409 Error before retrying [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/26 02:20:35 UTC, 3 replies.
- [PR] [SPARK-56229] Remove `io.netty.noUnsafe` from default JVM args according to Netty change [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/26 03:42:00 UTC, 5 replies.
- Re: [PR] [SPARK-56214][BUILD] Upgrade `Netty` to 4.2.12.Final [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/26 03:42:46 UTC, 4 replies.
- Re: [PR] [SPARK-56227][CORE] Fix GcmTransportCipher to correctly handle multiple messages per channel [spark] - posted by "aajisaka (via GitHub)" <gi...@apache.org> on 2026/03/26 04:35:39 UTC, 3 replies.
- [PR] [SPARK-56234][CORE] Support disabling initial/periodic scan for specific URI schemes in SHS [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/26 05:28:35 UTC, 3 replies.
- Re: [PR] [SPARK-55950][PYTHON][CONNECT] Add PySpark support for CDC changes() API [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/26 06:13:15 UTC, 1 replies.
- [PR] [SPARK-56235][CORE] Add reverse index in TaskSetManager to avoid O(N) scans in executorLost [spark] - posted by "DenineLu (via GitHub)" <gi...@apache.org> on 2026/03/26 07:30:34 UTC, 4 replies.
- Re: [PR] [SPARK-56234][CORE] Support disabling log directory scanning by path pattern in SHS [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/26 07:30:52 UTC, 11 replies.
- [PR] [SPARK-54944][PYTHON][TEST] Add tests for pa.Array.to_pandas with default arguments [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/26 08:40:26 UTC, 1 replies.
- [PR] [SPARK-56236][TESTS] Fix npm vulnerabilities related to picomatch [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/26 09:39:14 UTC, 0 replies.
- [PR] Fix link to pyspark-notebook repository [spark-docker] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/03/26 10:16:42 UTC, 0 replies.
- Re: [PR] [SPARK-44635][CORE] Handle shuffle fetch failures in decommissions [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/03/26 10:19:39 UTC, 0 replies.
- Re: [PR] [SPARK-56237] Fix links in `awesome-spark-docker.md` [spark-docker] - posted by "manuzhang (via GitHub)" <gi...@apache.org> on 2026/03/26 10:24:47 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-52090] retry fetch on ExecutorDeadException if block is found on another executor [spark] - posted by "EnricoMi (via GitHub)" <gi...@apache.org> on 2026/03/26 10:30:08 UTC, 0 replies.
- Re: [PR] [SPARK-56198] Update Operator to Java Operator SDK 5.3.2 [spark-kubernetes-operator] - posted by "csviri (via GitHub)" <gi...@apache.org> on 2026/03/26 12:26:50 UTC, 2 replies.
- [PR] Add test coverage for DSv2 table refresh and pinning design doc [spark] - posted by "longvu-db (via GitHub)" <gi...@apache.org> on 2026/03/26 12:34:19 UTC, 0 replies.
- [PR] [SPARK-56175][SQL] FileTable implements SupportsPartitionManagement and V2 catalog table loading [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/26 13:42:15 UTC, 1 replies.
- [PR] [SPARK-56239][UI] Fix SQL tab DataTables: API default limit, date format, and appId resolution [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/26 13:51:31 UTC, 3 replies.
- Re: [PR] [SPARK-56236][TESTS] Fix npm vulnerabilities related to `picomatch` [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/26 14:42:27 UTC, 1 replies.
- [PR] [SPARK-56241][SQL] Derive `outputOrdering` from `KeyedPartitioning` key expressions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/26 16:41:40 UTC, 27 replies.
- [PR] [SPARK-56242][PYTHON][TESTS] Add a test to ensure no 3rd party libraries are imported for "import pyspark" [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/26 18:11:25 UTC, 2 replies.
- Re: [PR] [SPARK-56222][PYTHON] Create ArrowStreamGroupSerializer and ArrowStreamCoGroupSerializer [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/26 18:31:36 UTC, 1 replies.
- [PR] [SPARK-56243][SS] Throw detailed error on malformed Kafka record timestamps [spark] - posted by "kavpreetgrewal (via GitHub)" <gi...@apache.org> on 2026/03/26 18:41:55 UTC, 0 replies.
- Re: [PR] [SPARK-55978][SQL] Add TABLESAMPLE SYSTEM block sampling with DSv2 pushdown [spark] - posted by "dbtsai (via GitHub)" <gi...@apache.org> on 2026/03/26 19:01:17 UTC, 2 replies.
- Re: [PR] [SPARK-55981][SQL] Allow Geo Types with SRID's from the pre-built registry [spark] - posted by "uros-db (via GitHub)" <gi...@apache.org> on 2026/03/26 19:56:49 UTC, 26 replies.
- [PR] [WIP] Optimize python TWS stateful processor serialization calls [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2026/03/26 20:56:37 UTC, 1 replies.
- [PR] [SPARK-56244][PYTHON] Refine benchmark class layout in bench_eval_type.py [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/26 21:15:02 UTC, 2 replies.
- [PR] [SPARK-56245][PS] Fix DataFrame.eval inplace assignment on pandas 3 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/26 21:20:00 UTC, 3 replies.
- [PR] [SPARK-33903][SQL] Add CREATE VIEW AS SELECT support for V2 ViewCatalog [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/26 22:32:44 UTC, 0 replies.
- [PR] [SPARK-56247][PYTHON] Fix the fall back behavior and type hint of inheritable_thread_target [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/26 23:26:15 UTC, 2 replies.
- [PR] [SPARK-56092][SS] Fix NPE in StreamingQueryException.toString() when cause is null [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/26 23:30:45 UTC, 0 replies.
- [PR] [SPARK-53996][SQL] Improve InferFiltersFromConstraints to infer filters from complex join expressions [spark] - posted by "vanekjar (via GitHub)" <gi...@apache.org> on 2026/03/26 23:45:47 UTC, 0 replies.
- Re: [PR] [SPARK-54804][CONNECT] Reduce conf RPCs SparkSession.createDataset(..) [spark] - posted by "asf-gitbox-commits (via GitHub)" <gi...@apache.org> on 2026/03/27 00:37:03 UTC, 0 replies.
- [PR] [SPARK-54509][DOCS] Add Documentation for Spark Data Source V2 [spark] - posted by "szehon-ho (via GitHub)" <gi...@apache.org> on 2026/03/27 01:10:38 UTC, 6 replies.
- [PR] [SPARK-56154][SQL] Preserve ENUM logical annotation through Parquet read-write [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/27 02:15:38 UTC, 0 replies.
- [PR] [SPARK-56250] Add warning comment to SortExec.rowSorter [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/27 02:21:06 UTC, 0 replies.
- Re: [PR] [SPARK-54449][CORE] Storage Memory off heap size should be considered only when off heap is enabled [spark] - posted by "VindhyaG (via GitHub)" <gi...@apache.org> on 2026/03/27 04:02:26 UTC, 0 replies.
- [PR] [SPARK-52351][SQL] Fix T prefix detection after whitespace trimming in stringToTimestamp [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/27 04:08:50 UTC, 2 replies.
- [PR] [SPARK-55878][UI] Add Job Timeline to SQL execution detail page [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/27 04:48:06 UTC, 6 replies.
- [PR] [SPARK-54731][SQL] Fix Reverse expression to handle BinaryType by performing raw byte-level reversal [spark] - posted by "xiaoxuandev (via GitHub)" <gi...@apache.org> on 2026/03/27 05:17:31 UTC, 2 replies.
- [I] Feature Request: Add support for qualify clause in SQL [spark] - posted by "travis-leith (via GitHub)" <gi...@apache.org> on 2026/03/27 05:19:46 UTC, 2 replies.
- [PR] [WIP] Add default fetchSize for postgres to avoid loading all data in memory [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/03/27 05:53:46 UTC, 0 replies.
- [PR] [SPARK-56246][INFRA][DOCS] Pin pandas version in docs Docker image [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/27 06:15:05 UTC, 0 replies.
- Re: [PR] [HISTORY] History server disk store lease should remove temp path delete hook after commit and rollback to avoid memory leak [spark] - posted by "LennonChin (via GitHub)" <gi...@apache.org> on 2026/03/27 07:04:17 UTC, 3 replies.
- Re: [PR] [SPARK-56250][SQL] Add warning comment to SortExec.rowSorter [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/27 07:05:29 UTC, 2 replies.
- Re: [PR] [SPARK-56246][INFRA][4.0] Pin pandas to version 2.2.3 in docs Docker image [spark] - posted by "HyukjinKwon (via GitHub)" <gi...@apache.org> on 2026/03/27 09:12:10 UTC, 1 replies.
- [PR] [SPARK-56256][PYTHON] Add emptyDataFrame API to SparkSession [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/27 09:15:27 UTC, 3 replies.
- [PR] [SPARK-56120][PYTHON][TEST] Add ASV micro-benchmarks for SQL_WINDOW_AGG_ARROW_UDF [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/27 09:49:51 UTC, 3 replies.
- [PR] [SPARK-56257][PYTHON][CONNECT] Support DataFrame input for spark.read.json/csv/xml [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/27 10:12:23 UTC, 3 replies.
- [I] Spark CBO considers columnar operator by generic interface [spark] - posted by "jinchengchenghh (via GitHub)" <gi...@apache.org> on 2026/03/27 10:24:07 UTC, 1 replies.
- [PR] [SPARK-56244][PYTHON][TEST][FOLLOWUP] Lazy scenario building for accurate peakmem benchmarks [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/27 10:50:38 UTC, 2 replies.
- [PR] [SPARK-56258][SQL] Make MetricUtils.stringValue lenient for unknown metric types [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/27 11:05:55 UTC, 7 replies.
- [PR] [SPARK-56240][CORE][TESTS] Add `NettyTransportBenchmark` for Netty transport layer performance evaluation [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/27 12:27:43 UTC, 10 replies.
- [PR] [SPARK-56259][UI] Fix SHS application list table header/data column mismatch [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/27 12:40:01 UTC, 5 replies.
- Re: [PR] [SPARK-56250][SQL] Remove confusing defensive code in SortExec.rowSorter and add warning comment [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/27 17:47:55 UTC, 15 replies.
- [PR] [SPARK-56260][INFRA] Pin official GitHub Actions to commit SHA [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/27 18:18:53 UTC, 7 replies.
- [PR] [SPARK-39660][SQL] Support v2 DESCRIBE TABLE .. PARTITION [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/27 18:22:15 UTC, 1 replies.
- [PR] [SPARK-56261] Use `Xcode 26.4` in CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 18:23:52 UTC, 4 replies.
- [PR] [SPARK-56262][PYTHON] Remove the unnecessary mypy check disable for types [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/27 18:26:00 UTC, 2 replies.
- [PR] [SPARK-56260][INFRA] Pin third-party GitHub Actions to commit SHA [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/27 18:44:29 UTC, 1 replies.
- [PR] [SPARK-56263] Upgrade `gRPC Swift NIO Transport` to 2.6.1 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 18:45:50 UTC, 4 replies.
- [PR] [SPARK-56264] Use Swift 6.3 always in CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 18:56:16 UTC, 0 replies.
- Re: [PR] [SPARK-56264] Use `Swift 6.3` always in CIs [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 19:02:30 UTC, 2 replies.
- [PR] [SPARK-56265] Update `Examples` Docker image sizes [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 19:33:44 UTC, 0 replies.
- Re: [PR] [WIP][SPARK-56248][PYTHON][SS] Optimize python TWS stateful processor serialization calls [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2026/03/27 19:36:51 UTC, 6 replies.
- Re: [PR] [SPARK-56265] Make `Examples` Docker image sizes up-to-date with the published images [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 19:37:25 UTC, 4 replies.
- [PR] [SPARK-56266] Migrate `Examples` to Swift 6.3 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 19:48:19 UTC, 3 replies.
- [PR] [SPARK-56267] Use `testCompileOnly` for `spotbugs-annotations` in `spark-operator` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 21:23:02 UTC, 3 replies.
- [PR] [SPARK-56268] Remove unnecessary log4j dependencies from `spark-operator-api` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 21:31:44 UTC, 3 replies.
- [PR] [SPARK-56269] Fix `Gradle 10` deprecation warnings [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/27 22:05:03 UTC, 3 replies.
- [PR] [SPARK-56270][PYTHON] Fix type hints and import issue for find_spark_home [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/27 22:47:05 UTC, 2 replies.
- [PR] [SPARK-56271][PYTHON] Fix type hint and remove unused method for _globals.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/27 23:10:21 UTC, 1 replies.
- [PR] [SPARK-56272][PYTHON] Add type hint for install.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/27 23:59:37 UTC, 2 replies.
- Re: [PR] [WIP][CONNECT] Read ChunkedLocalRelation from BlockManager [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/28 00:39:29 UTC, 1 replies.
- [PR] [SPARK-56273][SQL] Simplify extracting fields from DataSourceV2ScanRelation [spark] - posted by "yyanyy (via GitHub)" <gi...@apache.org> on 2026/03/28 00:40:01 UTC, 4 replies.
- [PR] [SPARK-55729][SPARK-55630][SS][FOLLOWUP] Fix failing test due to dependencies of two changes [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/28 00:51:21 UTC, 3 replies.
- [PR] Fix expansion of "KLL" initialism. [spark] - posted by "donaldchai (via GitHub)" <gi...@apache.org> on 2026/03/28 04:20:31 UTC, 0 replies.
- [PR] [SPARK-56140][UI] Add server-side pagination for SQL tab query listing [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/28 07:29:47 UTC, 4 replies.
- [PR] [SPARK-43413][SQL] Support QUALIFY clause [spark] - posted by "azmatsiddique (via GitHub)" <gi...@apache.org> on 2026/03/28 09:17:05 UTC, 1 replies.
- [PR] [SPARK-54986][PYSPARK][DOCS] Document return type (DoubleType) for aggregate functions [spark] - posted by "hudda-ravina (via GitHub)" <gi...@apache.org> on 2026/03/28 09:57:25 UTC, 0 replies.
- [I] Support mapUnsignedTinyIntToShort [spark] - posted by "melin (via GitHub)" <gi...@apache.org> on 2026/03/28 13:53:25 UTC, 2 replies.
- [PR] [SPARK-53316] Add Null literal type and improve from_str_name [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:25:08 UTC, 0 replies.
- [PR] [SPARK-53316] Add Byte literal type [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:25:11 UTC, 0 replies.
- [PR] [SPARK-53316] Add Decimal literal type [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:25:13 UTC, 0 replies.
- [PR] [SPARK-53316] Add CalendarInterval literal type [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:25:15 UTC, 0 replies.
- [PR] [SPARK-53316] Add YearMonthInterval literal type [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:25:19 UTC, 0 replies.
- [PR] [SPARK-53316] Add DayTimeInterval literal type [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:25:22 UTC, 0 replies.
- [PR] [SPARK-53314] Add DataStreamReader and DataStreamWriter convenience methods [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:32:21 UTC, 0 replies.
- [PR] [SPARK-53313] Add JDBC Reader and Writer support [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:32:24 UTC, 0 replies.
- [PR] [SPARK-53316] Add Map and Struct literal types [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/28 18:32:26 UTC, 0 replies.
- [PR] [SPARK-56276] Fix file descriptor leak in SparkAppResourceSpecFactory [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/03/28 23:16:44 UTC, 2 replies.
- [PR] [SPARK-56274] Fix redundant SparkConf set() call in SparkClusterSubmissionWorker [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/03/28 23:16:59 UTC, 2 replies.
- [PR] [SPARK-56275] Set appProtocol on Kubernetes service ports [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/03/28 23:17:05 UTC, 5 replies.
- Re: [PR] [SPARK-48750][SQL] AQEPropagateEmptyRelation convert broadcast query stage plan to empty relation causing error [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/29 00:46:07 UTC, 1 replies.
- Re: [PR] [SPARK-49921][CORE] Add task write data time to SQL tab's graph node [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/29 00:46:09 UTC, 1 replies.
- Re: [PR] [SPARK-51019][SQL][TESTS] Fix flaky test: SPARK-47148 AQE should avoid to submit shuffle job on cancellation [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/29 00:46:11 UTC, 1 replies.
- Re: [PR] [SPARK-54700][SQL][WIP] Quote constraint name and columns for dsv2 constraints [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/29 00:46:13 UTC, 1 replies.
- Re: [PR] [SPARK-54694][K8S] Fail app on ConfigMap size over limit [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/29 00:46:16 UTC, 1 replies.
- Re: [PR] [SPARK-54305][SQL][PYTHON] Add admission control support to Python DataSource streaming API [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/29 00:46:17 UTC, 1 replies.
- [PR] Fix path traversal in NettyStreamManager.openStream [spark] - posted by "Tagar (via GitHub)" <gi...@apache.org> on 2026/03/29 05:56:01 UTC, 3 replies.
- [PR] [SPARK-52428] Harden client module error handling [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:21:03 UTC, 0 replies.
- [PR] [SPARK-52428] Harden DataFrame error handling [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:21:05 UTC, 0 replies.
- [PR] [SPARK-52428] Harden streaming and session error handling [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:21:07 UTC, 0 replies.
- [PR] [SPARK-52428] Harden miscellaneous module error handling [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:21:10 UTC, 0 replies.
- [PR] [SPARK-52428] Add configurable gRPC connection and request timeouts [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:32:08 UTC, 0 replies.
- [PR] [SPARK-52428] Add SparkSession::stop() for resource cleanup [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:42:33 UTC, 0 replies.
- [PR] [SPARK-52428] Add parameterized SQL support (named and positional args) [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:42:36 UTC, 0 replies.
- [PR] [SPARK-53315] Add Column::get_item() and Column::get_field() [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:57:08 UTC, 0 replies.
- [PR] [SPARK-52428] Add DataFrame::to_local_iterator() for batch-by-batch results [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:57:10 UTC, 0 replies.
- [PR] [SPARK-52428] Add DataFrame::checkpoint() and local_checkpoint() [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 07:57:12 UTC, 0 replies.
- [PR] [SPARK-52428] Add DataFrame::observe() for metric collection [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 08:05:00 UTC, 0 replies.
- [PR] [SPARK-52428] Extract structured error info from gRPC status metadata [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 08:05:02 UTC, 0 replies.
- [PR] [SPARK-52428] Add SparkSession::add_artifact() for uploading files to the cluster [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 08:05:05 UTC, 0 replies.
- [PR] [SPARK-52428] Add DataFrame::merge_into() builder for MERGE INTO operations [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 08:24:32 UTC, 0 replies.
- [PR] [SPARK-53317] Add SparkSession::create_dataframe_from_polars() [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 08:24:34 UTC, 0 replies.
- [PR] [SPARK-52428] Add UDF registration and invocation support [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 08:50:01 UTC, 0 replies.
- [PR] [SPARK-52428] Add comprehensive CI workflow with unit and integration tests [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 09:03:02 UTC, 0 replies.
- [PR] [SPARK-52428] Add higher-order functions with lambda expression support [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 09:20:42 UTC, 0 replies.
- [PR] [SPARK-55076][SQL] Add legacy config for MySQL unsigned TINYINT type … [spark] - posted by "piyushka-ally (via GitHub)" <gi...@apache.org> on 2026/03/29 09:27:38 UTC, 4 replies.
- [PR] [SPARK-56032][SQL][TESTS][FOLLOWUP] Use `DayTimeIntervalType` in FilterExec CSE codegen test to fix non-ansi mode failure [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/29 09:36:08 UTC, 2 replies.
- [I] [SPARK-52428] Column missing comparison methods (gt, lt, ge, le) [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 09:49:42 UTC, 0 replies.
- [PR] [SPARK-52428] Add Column comparison methods (gt, lt, ge, le) [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 09:53:13 UTC, 0 replies.
- [PR] [SPARK-52428] Add ergonomic convenience methods for catalog and config APIs [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 09:53:15 UTC, 0 replies.
- [PR] [SPARK-52428] Fix show() to print table directly instead of double-wrapping [spark-connect-rust] - posted by "rafafrdz (via GitHub)" <gi...@apache.org> on 2026/03/29 10:02:28 UTC, 0 replies.
- [PR] [SPARK-52965][BUILD] Upgrade gRPC to 1.76.0 and Netty to 4.1.124 to fix end-of-stream mid-frame in Spark Connect [spark] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/03/29 13:04:07 UTC, 1 replies.
- [I] 4.1.1 spark-connect-common module compile error [spark] - posted by "luanmaxiansheng (via GitHub)" <gi...@apache.org> on 2026/03/29 14:10:16 UTC, 6 replies.
- [PR] [SPARK-54986][DOCS] Document return types for aggregate functions [spark] - posted by "piyushka-ally (via GitHub)" <gi...@apache.org> on 2026/03/29 16:54:27 UTC, 0 replies.
- [PR] [SPARK-55278][CONNECT][SQL] Add language-agnostic UDF IPC protocol (Phase 1: protocol definition + Arrow serde) [spark] - posted by "nookcreed (via GitHub)" <gi...@apache.org> on 2026/03/29 20:48:54 UTC, 1 replies.
- [PR] [SPARK-56277][SQL] Add missing toString() to NamespaceChange property classes [spark] - posted by "anshulbaliga7 (via GitHub)" <gi...@apache.org> on 2026/03/29 21:36:51 UTC, 3 replies.
- Re: [PR] [SPARK-54772][Shuffle] Introduce failedChunks metrics in ChunkFetchHandler [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/30 00:45:09 UTC, 1 replies.
- Re: [PR] [SPARK-54539][SQL] TaskMetrics add spillTime metrics [spark] - posted by "github-actions[bot] (via GitHub)" <gi...@apache.org> on 2026/03/30 00:45:11 UTC, 1 replies.
- [PR] [SPARK-56278][CORE] Populate accurate metadata immediately during on-demand loading in SHS [spark] - posted by "sarutak (via GitHub)" <gi...@apache.org> on 2026/03/30 01:35:43 UTC, 9 replies.
- [PR] [SPARK-56279][CORE] Enable native zero-copy sendfile for file-backed shuffle transfer [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/30 03:10:32 UTC, 0 replies.
- [I] Is this work still progressing? [spark-connect-rust] - posted by "xunxunmimi5577 (via GitHub)" <gi...@apache.org> on 2026/03/30 03:19:58 UTC, 1 replies.
- Re: [PR] [SPARK-56279][CORE] Enable zero-copy sendfile for FileRegion in native Netty transports [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 03:45:20 UTC, 11 replies.
- [PR] [SPARK-56280][STREAMING] normalize NaN and +/-0.0 in streaming dedupe node [spark] - posted by "richardc-db (via GitHub)" <gi...@apache.org> on 2026/03/30 05:10:55 UTC, 0 replies.
- [PR] [SPARK-56281] Upgrade PMD to 7.23.0 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 05:58:41 UTC, 3 replies.
- [PR] [SPARK-56282] Exclude unnecessary `avro` dependency [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 06:41:33 UTC, 3 replies.
- Re: [PR] [SPARK-56251][SQL] Add default fetchSize for postgres to avoid loading all data in memory [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/03/30 06:41:39 UTC, 9 replies.
- [PR] [SPARK-56283] Exclude HDFS/YARN UI resources [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 07:06:42 UTC, 4 replies.
- [PR] [SPARK-56285] Add `minimize` to `shadowJar` task [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 07:30:15 UTC, 4 replies.
- [PR] [SPARK-55278] Introduce core abstraction for UDF worker. [spark] - posted by "haiyangsun-db (via GitHub)" <gi...@apache.org> on 2026/03/30 07:46:35 UTC, 0 replies.
- [PR] [SPARK-56240][CORE][TESTS][4.1] Add `NettyTransportBenchmark` for Netty tr… [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/30 08:49:24 UTC, 0 replies.
- Re: [PR] [SPARK-56240][CORE][TESTS][4.1] Add `NettyTransportBenchmark` for Netty transport layer performance evaluation [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/30 08:50:30 UTC, 4 replies.
- [PR] [SPARK-56174][SQL] Complete V2 file write path for DataFrame API [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/30 09:11:01 UTC, 2 replies.
- [I] Why didn't the Executor fail after the Shuffle connection timeout? [spark] - posted by "qiqi0818 (via GitHub)" <gi...@apache.org> on 2026/03/30 10:49:15 UTC, 0 replies.
- [I] UT fails with UnsatisfiedLinkError on Apple Silicon [spark] - posted by "txyself (via GitHub)" <gi...@apache.org> on 2026/03/30 12:41:02 UTC, 3 replies.
- [I] AQE does not apply optimizations for queries involving TableCacheQueryStageExec [spark] - posted by "boobpoop (via GitHub)" <gi...@apache.org> on 2026/03/30 13:55:26 UTC, 4 replies.
- [PR] [SPARK-56286][PYTHON] Add DataFrame.dataQuality API for column profiling [spark] - posted by "sougata99 (via GitHub)" <gi...@apache.org> on 2026/03/30 14:04:08 UTC, 1 replies.
- [I] Ubuntu 25.10 - access denied to /tmp even in 777 mode without protected mode [spark] - posted by "Tusenka (via GitHub)" <gi...@apache.org> on 2026/03/30 16:23:52 UTC, 1 replies.
- [PR] [SPARK-56253][PYTHON][CONNECT] Make spark.read.json accept DataFrame input [spark] - posted by "Yicong-Huang (via GitHub)" <gi...@apache.org> on 2026/03/30 16:51:42 UTC, 2 replies.
- [PR] [SPARK-56250][SQL][FOLLOW][4.1] Remove confusing defensive code in SortExec.rowSorter and add warning comment [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/30 16:57:48 UTC, 0 replies.
- Re: [PR] [SPARK-56250][SQL][FOLLOWUP][4.1] Remove confusing defensive code in SortExec.rowSorter and add warning comment [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 17:17:54 UTC, 2 replies.
- [PR] [SPARK-56288] Upgrade `gRPC Swift NIO Transport` to 2.6.2 [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 18:20:16 UTC, 3 replies.
- [PR] [SPARK-56289] Upgrade minimum Java runtime version to 21 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 18:28:30 UTC, 4 replies.
- [PR] [SPARK-56290] Rename `build-macos-26-swift(62 -> 63)` in CI [spark-connect-swift] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 18:55:48 UTC, 3 replies.
- [PR] [SPARK-56291] Make `BaseStateSummary` a `sealed` interface [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 19:09:19 UTC, 3 replies.
- [PR] [SPARK-56292] Make `(App|Cluster)ReconcileStep` abstract classes `sealed` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 19:38:18 UTC, 3 replies.
- [PR] [SPARK-56293] Make `BaseAppDriverObserver` abstract class `sealed` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 19:40:28 UTC, 3 replies.
- [PR] [SPARK-56294] Apply exhaustive `switch` for `ResourceRetainPolicy` and `ClusterStateSummary` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 20:03:19 UTC, 3 replies.
- [PR] [SPARK-49543][SQL] Add SHOW COLLATIONS command [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/30 21:38:31 UTC, 16 replies.
- Re: [PR] [WIP][SPARK-56248][PYTHON][SS] Optimize python stateful processor serialization to skip unnecessary list/dict/row construction. [spark] - posted by "jiateoh (via GitHub)" <gi...@apache.org> on 2026/03/30 22:27:07 UTC, 0 replies.
- [PR] [SPARK-56295][PYTHON] Add Java error classes to Python side [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/30 22:48:36 UTC, 0 replies.
- [PR] [SPARK-56296][SQL] Pivot createTableLike to pass full TableInfo including schema, partitioning, constraints, and owner [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/30 23:08:00 UTC, 0 replies.
- [PR] [SPARK-56297] Use Virtual Threads (JEP 444) for unbounded reconciliation thread pool [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 23:38:29 UTC, 0 replies.
- [PR] [SPARK-56298] Enable `spark.master.rest.virtualThread.enabled` by default [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/30 23:45:46 UTC, 5 replies.
- [PR] claude learnings [spark] - posted by "Rockstar5645 (via GitHub)" <gi...@apache.org> on 2026/03/31 00:01:35 UTC, 2 replies.
- [PR] [SPARK-49793][PYTHON][TESTS] Reenable test_cachine for predict_batch_udf [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/31 00:21:04 UTC, 0 replies.
- Re: [PR] [SPARK-56297] Use `Virtual Threads (JEP 444)` for unbounded reconciliation thread pool [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 00:29:47 UTC, 4 replies.
- [PR] [MINOR][PYTHON] Fix typos in `error-conditions.json` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/31 01:59:16 UTC, 3 replies.
- [PR] [SPARK-56299] Fix `Dockerfile` for `jdeps` to use 21 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 02:30:04 UTC, 5 replies.
- [PR] [SPARK-56300] Add Java-friendly factory method to `KubernetesDriverSpec` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 02:57:26 UTC, 0 replies.
- [PR] [SPARK-56279][CORE][4.1] Enable zero-copy sendfile for FileRegion in native Netty transports [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/31 03:19:29 UTC, 5 replies.
- Re: [PR] [SPARK-56301][PYTHON] Fix typos in `error-conditions.json` [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/31 03:46:16 UTC, 1 replies.
- Re: [PR] [SPARK-49793][PYTHON][TESTS] Reenable test_caching for predict_batch_udf [spark] - posted by "zhengruifeng (via GitHub)" <gi...@apache.org> on 2026/03/31 03:57:04 UTC, 1 replies.
- [PR] [SPARK-56176][SPARK-56232][SQL] V2-native ANALYZE TABLE/COLUMN with stats propagation to FileScan [spark] - posted by "LuciferYang (via GitHub)" <gi...@apache.org> on 2026/03/31 04:03:04 UTC, 1 replies.
- [PR] Collation-aware PIVOT [spark] - posted by "aknayar (via GitHub)" <gi...@apache.org> on 2026/03/31 04:26:22 UTC, 0 replies.
- Re: [PR] [SPARK-56274] Remove redundant SparkConf set() call [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/03/31 05:40:28 UTC, 1 replies.
- Re: [PR] [SPARK-56280][SS] normalize NaN and +/-0.0 in streaming dedupe node [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/31 06:15:09 UTC, 4 replies.
- [PR] [WIP][SPARK-56302] Free task result memory eagerly during serialization/deserialization [spark] - posted by "ivoson (via GitHub)" <gi...@apache.org> on 2026/03/31 06:23:30 UTC, 0 replies.
- Re: [PR] [SPARK-56275] Set appProtocol on spark-connect service port [spark-kubernetes-operator] - posted by "j1wonpark (via GitHub)" <gi...@apache.org> on 2026/03/31 06:43:46 UTC, 0 replies.
- Re: [PR] [SPARK-55450][SS][PYTHON][DOCS] Document admission control in PySpark streaming data sources [spark] - posted by "HeartSaVioR (via GitHub)" <gi...@apache.org> on 2026/03/31 06:59:03 UTC, 2 replies.
- Re: [PR] [SPARK-56300][K8S] Add Java-friendly factory method to `KubernetesDriverSpec` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 07:09:39 UTC, 5 replies.
- [PR] [SPARK-56303] Use `SparkLauncher.NO_RESOURCE` instead of `Option.empty()` in `SparkAppSubmissionWorker` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 07:17:19 UTC, 1 replies.
- [PR] [SPARK-56137][UI] Add regression tests for SQL tab DataTables migration [spark] - posted by "yaooqinn (via GitHub)" <gi...@apache.org> on 2026/03/31 07:22:21 UTC, 0 replies.
- [PR] [SPARK-56303][K8S] Add Java-friendly factory methods to `JavaMainAppResource` [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 07:25:37 UTC, 4 replies.
- [I] Cannot use deploy mode: cluster from python code. [spark-kubernetes-operator] - posted by "DSurfer (via GitHub)" <gi...@apache.org> on 2026/03/31 12:14:09 UTC, 0 replies.
- Re: [PR] [SPARK-56137][UI][TESTS] Add regression tests for SQL tab DataTables migration [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 13:05:11 UTC, 2 replies.
- Re: [PR] Change volumeMounts and volumes types to array [spark-kubernetes-operator] - posted by "Sbaia (via GitHub)" <gi...@apache.org> on 2026/03/31 16:08:08 UTC, 0 replies.
- [I] Spark Declarative Pipelines and Unity Catalog [spark] - posted by "graemecash-spec (via GitHub)" <gi...@apache.org> on 2026/03/31 16:09:51 UTC, 0 replies.
- [PR] [SPARK-56307] Upgrade `log4j` to 2.25.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 17:00:41 UTC, 0 replies.
- [PR] [SPARK-56308] Remove invalid `log4j2.contextSelector` from test `log4j2.properties` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 17:10:46 UTC, 3 replies.
- [PR] [SPARK-55109][SQL] Enhance RaiseError to support valid SQL [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/03/31 17:15:39 UTC, 1 replies.
- Re: [PR] [SPARK-46036][SQL] Removing error-class from raise_error function [spark] - posted by "felipepessoto (via GitHub)" <gi...@apache.org> on 2026/03/31 17:16:55 UTC, 0 replies.
- Re: [PR] [SPARK-56306][SQL] Fix collation-aware PIVOT [spark] - posted by "stefankandic (via GitHub)" <gi...@apache.org> on 2026/03/31 17:30:09 UTC, 1 replies.
- Re: [PR] [SPARK-56274] Simplify `SparkClusterSubmissionWorker.getResourceSpec` [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 17:47:32 UTC, 1 replies.
- [PR] [SPARK-56309] Upgrade `log4j` to 2.25.4 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 17:50:46 UTC, 4 replies.
- [PR] [WIP][SPARK-55715][SQL] Keep `outputOrdering` when `GroupPartitionsExec` coalesces partitions [spark] - posted by "peter-toth (via GitHub)" <gi...@apache.org> on 2026/03/31 17:51:48 UTC, 0 replies.
- Re: [PR] [SPARK-56307][BUILD] Upgrade `log4j` to 2.25.4 [spark] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 17:54:48 UTC, 3 replies.
- [PR] [SPARK-56123][PYTHON][FOLLOWUP] Avoid using concat_batches for old version of pyarrow [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/31 18:21:39 UTC, 1 replies.
- [PR] [SPARK-56310][PYTHON] Handle pandas 3 dtype in DataFrame.toPandas [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/31 19:02:54 UTC, 1 replies.
- [PR] [SPARK-56311][PYTHON] Add type hints for daemon.py [spark] - posted by "gaogaotiantian (via GitHub)" <gi...@apache.org> on 2026/03/31 21:46:18 UTC, 0 replies.
- [PR] [SPARK-xxxxx][SQL] Skip ColumnarToRow for Arrow-backed input to Python UDFs [spark] - posted by "viirya (via GitHub)" <gi...@apache.org> on 2026/03/31 21:48:05 UTC, 3 replies.
- [PR] [SPARK-56219][PS][FOLLOW-UP] Fix groupby idxmax and idxmin skipna=False for pandas 2.2 [spark] - posted by "ueshin (via GitHub)" <gi...@apache.org> on 2026/03/31 22:15:53 UTC, 1 replies.
- [PR] [MINOR] Update Java badge to 21 [spark-kubernetes-operator] - posted by "dongjoon-hyun (via GitHub)" <gi...@apache.org> on 2026/03/31 22:46:35 UTC, 2 replies.